> Markdown version of [/jobs/ext/2718813-technical-ml-infrastructure-engineer](https://www.wearedevelopers.com/jobs/ext/2718813-technical-ml-infrastructure-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # technical ML infrastructure engineer - **Company:** Quince Therapeutics, Inc. - **Location:** Palo Alto, United States - **Experience:** Experienced - **Salary:** $218,000.0 - $285,000.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Big Data, Cloud Computing, Code Review, Continuous Integration, Tensorflow, Pulumi, Cloud Platform System, Data Ingestion, Pytorch, Apache Spark, Kubernetes, Infrastructure Automation Frameworks, Apache Flink, Deployment Automation, Performance Monitor, Apache Kafka, Machine Learning Operations, Terraform, Software Version Control, Data Pipelines, Docker - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/staff-engineer-ml-infra-mlops-quince-company-8794968 ## About the Role The ideal candidate is a deeply technical ML infrastructure engineer who combines hands-on mastery with system-level thinking. You have built and operated production-grade ML systems at scale - from distributed training pipelines and feature stores to high-throughput inference serving - and you take pride in engineering platforms that other engineers love to use. You don't just build for today's requirements; you design for extensibility, observability, and resilience. You are the kind of engineer who gravitates toward the hardest problems - whether that's optimizing GPU utilization at the tail of the cost curve, designing a zero-downtime model deployment system, or defining the architectural patterns that will define how Quince industrializes AI at scale. You operate with high autonomy, hold yourself to exceptional standards, and elevate the engineers around you through code reviews, technical mentorship, and by setting a bar for what great looks like., * 8+ years of industry experience, with at least 4+ years of focused, hands-on work in ML Infrastructure, MLOps, or large-scale Data Platform engineering. * Proven track record of designing and building MLOps platforms that support the full model lifecycle - from data ingestion and distributed training to real-time inference and model governance. * Deep expertise in cloud-native infrastructure (preferably AWS), Kubernetes (EKS), Docker, and Infrastructure as Code tools (Terraform/Pulumi). * Hands-on mastery of ML frameworks such as PyTorch, TensorFlow, Kubeflow, or SageMaker, with strong opinions on building a cohesive, high-leverage developer experience. * Expertise in building Feature Stores and high-throughput data pipelines (Spark, Flink, Kafka), with a strong understanding of training/serving skew and data consistency. * Expert-level knowledge of CI/CD for ML, including model versioning, experiment tracking, and deployment strategies such as blue-green and canary rollouts. * Demonstrated ability to optimize GPU utilization, implement model batching, and systematically reduce cloud infrastructure costs. * Strong operational instincts, with a history of improving reliability through rigorous on-call practices, proactive monitoring, and root-cause analysis. * You understand the hustle of a startup and are good at handling ambiguity. You are a curious, quick learner who loves to experiment and thrives at a rapid pace. ## Description * Architect the ML Infrastructure Foundation: Own the end-to-end technical design of Quince's ML platform - including model training, serving, feature pipelines, and monitoring - ensuring it is modular, scalable, and built for long-term extensibility. * Build the "Paved Road" for Production: Design and implement the core developer experience for Quince's Data Scientists and AI Researchers, enabling them to move from "idea to production" with minimal friction and maximum reliability. * Drive Technical Excellence Across the Stack: Set and uphold engineering standards in CI/CD for ML, Infrastructure as Code (IaC), model versioning, experiment tracking, and deployment strategies (blue-green, canary) - and build the tooling that makes those standards the path of least resistance. * Own High-Impact System Design Decisions: Lead the technical evaluation and selection of core platform components - from inference runtimes and feature stores to orchestration frameworks - with a clear-eyed view of build vs. buy tradeoffs. * Optimize Compute Performance & Cost: Design and implement GPU utilization optimizations, model batching strategies, and cloud cost controls to maximize performance per dollar across training and inference workloads. * Ensure Production Scalability & Reliability: Architect ML serving infrastructure that gracefully handles traffic surges, seasonal spikes, and model version transitions, with robust monitoring, alerting, and automated recovery. * Mentor and Elevate the Engineering Team: Provide deep technical mentorship to junior and mid-level engineers through design reviews, code reviews, and pairing sessions - raising the collective technical bar without adding process overhead. * Champion Operational Excellence: Lead root-cause analyses (RCAs) for production failures and drive systemic, permanent fixes over reactive patches. Model a culture of rigorous on-call discipline and accountability., Quince is committed to providing reasonable accommodations to qualified individuals with disabilities. If you need a reasonable accommodation to complete your application or to perform the essential functions of a role at Quince, please let us know by completing this accommodation form. We review all requests individually and will work with you to determine appropriate accommodations on a case-by-case basis. Employment is contingent upon successful completion of a background check. Quince will conduct background checks in compliance with applicable federal, state, and local laws. ## Related Videos - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Why segmenting your infrastructure into tiers makes your infrastructure design better](https://www.wearedevelopers.com/videos/1960-why-segmenting-your-infrastructure-into-tiers-makes-your-infrastructure-design-better) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Geometric deep learning for drug discovery](https://www.wearedevelopers.com/videos/264-geometric-deep-learning-for-drug-discovery) - [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models) ## Related Articles - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)