> Markdown version of [/jobs/ext/2706075-software-engineer-model-performance](https://www.wearedevelopers.com/jobs/ext/2706075-software-engineer-model-performance). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer - Model Performance

- **Company:** Baseten, Inc
- **Location:** San Francisco, CA, United States
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, C++ (Programming Language), Nvidia CUDA, Software Debugging, Python (Programming Language), Machine Learning, Open Source Technology, Software Engineering, Software Systems, Graphics Processing Unit (GPU), Pytorch, Large Language Models, Backend, Scikit Learn, Information Technology, Optimization Algorithms, TensorRT, Decoding, Docker, Programming Languages
- **Published:** September 4, 2026
- **Apply:** https://startup.jobs/software-engineer-model-performance-baseten-6237878

## About the Role

* Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field.
 * Experience with one or more general-purpose programming languages, such as Python or C++.
 * Familiarity with LLM optimization techniques (e.g., quantization, speculative decoding, continuous batching).
 * Strong familiarity with ML libraries, especially PyTorch, TensorRT, or TensorRT-LLM.
 * Demonstrated interest and experience in LLM's.
 * Deep understanding of GPU architecture.
 * Bonus:
 + Proficiency in enhancing the performance of software systems, particularly in the context of large language models (LLMs).
 + Experience with CUDA or similar technologies.
 + Deep understanding of software engineering principles and a proven track record of developing and deploying AI/ML inference solutions.
 + Experience with Docker and Kubernetes.

## Description

Are you passionate about advancing the application of artificial intelligence? We are looking for a Software Engineer focused on ML performance to join our dynamic team. This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to the exciting field of LLM Inference. If you are a backend engineer who thrives on making things faster and is excited about open-source ML models, we look forward to your application., * Implement, refine, and productionize cutting-edge techniques (quantization, speculative decoding, kv cache reuse, chunked prefill and LoRA) for ML model inference and infrastructure.

 * Deep dive into underlying codebases of TensorRT, PyTorch, TensorRT-LLM, vllm, sglang, CUDA, and other libraries to debug ML performance issues.
 * Apply and scale optimization techniques across a wide range of ML models, particularly large language models.
 * Collaborate with a diverse team to design and implement innovative solutions.
 * Own projects from idea to production.


## Related Videos

- [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding)
- [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models)
- [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [A 5-Step Open-Source Setup for Agentic Engineering](https://www.wearedevelopers.com/magazine/738-a-5-step-open-source-setup-for-agentic-engineering)