> Markdown version of [/jobs/ext/2722850-ml-infrastructure-engineer](https://www.wearedevelopers.com/jobs/ext/2722850-ml-infrastructure-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# ML Infrastructure Engineer

- **Company:** AI AGENTS LLC
- **Location:** San Mateo, CA, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Data Analysis, Distributed Systems, Large Language Models, AI Platforms, Machine Learning Operations, Hardware Infrastructure
- **Published:** September 4, 2026
- **Apply:** https://startup.jobs/ml-infrastructure-engineer-zaimler-8121930

## About the Role

* Proven ability to build scalable ML/AI platforms from scratch, end-to-end, for production use cases. You've owned a zero-to-one build before, or can show you're capable of it
 * Deep understanding of the inference stack: vLLM, KV cache, and the optimization layers underneath model serving
 * Experience building distributed systems for AI/ML workloads at scale, connecting them to real product or vertical integrations
 * 3+ years of relevant experience. We care about capability, not tenure

## Description

You'll own our inference and model-serving infrastructure end to end. This isn't a research role. It's a build role: you're setting up and scaling the systems that let our agents actually run in production, fast and reliably, at increasing concurrency.

You report to Sofus and work closely with our ML and infra teams.

What You'll Own

 * Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data analysis and agent workflows
 * Scale agent GPU infrastructure for concurrency and efficiency across multiple agent workloads
 * Optimize and improve the engine builder and model server that power scalable agent orchestration, * Familiarity with AIBrix
Why Join

 * A rare chance to shape both company and product direction as an early team engineer
 * Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch
 * Onsite culture in San Mateo, built for deep collaboration and high-velocity building
 * Full benefits (medical, dental, vision, 401k)
 * We sponsor H-1B visas and assist with immigration We value builders over résumés. If this role excites you but you don't check every box, we still want to hear from you. zaimler is an equal opportunity employer.


## Related Videos

- [This App Reached 10,000 Users in One Week. Here's How.](https://www.wearedevelopers.com/videos/100329-this-app-reached-10-000-users-in-one-week-here-s-how)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Best Practices for AI-Assisted Development of Distributed Systems](https://www.wearedevelopers.com/videos/100200-best-practices-for-ai-assisted-development-of-distributed-systems)
- [DevOps for AI: running LLMs in production with Kubernetes and KubeFlow](https://www.wearedevelopers.com/videos/1222-devops-for-ai-running-llms-in-production-with-kubernetes-and-kubeflow)
- [From AI Assistance to Agentic Systems: Scaling Sovereign AI in Banking](https://www.wearedevelopers.com/videos/100070-from-ai-assistance-to-agentic-systems-scaling-sovereign-ai-in-banking)
- [Your Infrastructure Is Not a Playground: AI Agents for Infra Done Right](https://www.wearedevelopers.com/videos/2084-your-infrastructure-is-not-a-playground-ai-agents-for-infra-done-right)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)