> Markdown version of [/jobs/ext/2070888-staff-software-engineer-ml-inference-platform](https://www.wearedevelopers.com/jobs/ext/2070888-staff-software-engineer-ml-inference-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Staff Software Engineer, ML Inference Platform

- **Company:** Nuro Inc.
- **Location:** United States
- **Experience:** Expert
- **Salary:** $193,930.0
- **Contract:** Permanent contract
- **Skills:** Automation of Tests, C++ (Programming Language), Software Quality, Distributed Systems, Monitoring of Systems, Python (Programming Language), Machine Learning, Large Language Models, Build Management, Kubernetes, Machine Learning Operations, Data Pipelines, Data Generation
- **Published:** August 15, 2026
- **Apply:** https://www.dice.com/job-detail/23ba6335-95e1-494b-ad5c-c62c04907fe4

## About the Role

* You have a degree in BS, MS.c or Ph.D and 3+ years of relevant experience
 * Strong proficiency in Python or similar languages. Familiarity with c++.
 * Technical excellence: Develop with a high standard for performance, scalability, and code quality.
Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systems

 * Independence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems.

Bonus Points:

 * Strong proficiency in C++ or other high-performance low-level languages
 * Experience working with large-scale distributed systems
 * Experience with system & framework design
 * Experience with data workflow orchestration platforms
 * Experience with ML compilers

## Description

The ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro's fleet of self-driving robots!

About the Work

 * Design and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models.
 * Develop and maintain continuous testing and monitoring systems for core ML infrastructure components.
 * Develop observability to track ML model lifecycles from data generation to on-road validation.
 * Maintain an in-house ML inference platform to serve large language models efficiently.
 * Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms.


## Related Videos

- [LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices](https://www.wearedevelopers.com/videos/1582-llmops-driven-fine-tuning-evaluation-and-inference-with-nvidia-nim-nemo-microservices)
- [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [Enhancing AI-based Robotics with Simulation Workflows](https://www.wearedevelopers.com/videos/472-enhancing-ai-based-robotics-with-simulation-workflows)
- [Developer Experience, Platform Engineering and AI powered Apps](https://www.wearedevelopers.com/videos/990-developer-experience-platform-engineering-and-ai-powered-apps)
- [AI That Fits Your Business, Not the Other Way Around](https://www.wearedevelopers.com/videos/100148-ai-that-fits-your-business-not-the-other-way-around)

## Related Articles

- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)