> Markdown version of [/jobs/ext/2716146-machine-learning-engineer](https://www.wearedevelopers.com/jobs/ext/2716146-machine-learning-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Machine Learning Engineer - **Company:** Ambience Healthcare - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Salary:** $225,000.0 - $300,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Continuous Integration, Software Debugging, Python (Programming Language), Routing, Regression Testing, Tensorflow, Chatbots, Pytorch, Large Language Models, Multi-Agent Systems, Free and Open-Source Software, Virtual Agents, Automation Anywhere - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/senior-machine-learning-engineer-ambience-healthcare-8980157 ## About the Role * Strong Production AI Experience 5+ years in production ML, research engineering, or applied AI. Have built a consequential production AI system or materially improved model behavior in production. Strong understanding of modern LLMs, transformers, and production AI systems. * Deep Evaluation Experience Experienced designing evaluations for LLMs, agents, or other complex AI systems. Can turn ambiguous quality problems into measurable dimensions, datasets, and experiments. Familiar with challenges such as grader bias, leakage, misleading aggregate metrics, regression detection, and offline-online mismatch. * Agentic Systems Experience Experience building production systems involving multiple models, tools, retrieval, context, state, routing, or orchestration. Understands reliability and failure modes in complex AI workflows, not just individual model calls. * Production-Grade Software Engineer Proficient in Python and modern ML frameworks; PyTorch preferred. Comfortable with deployment, observability, CI/CD, and containerized systems. Still highly hands-on: writes code, inspects traces, analyzes failures, and debugs production systems. * Data-Centric AI Developer Skilled at building high-quality datasets and feedback loops. Experienced using production failures, user feedback, and active learning to improve model and system quality. * Effective Interdisciplinary Collaborator Able to work closely with clinicians, product managers, and fellow engineers. Strong communicator who can simplify complex AI concepts for diverse audiences. Comfortable owning ambiguous technical problems and driving them to measurable outcomes. Nice-to-Haves * Experience with realtime voice, conversational AI, or multimodal systems. * Experience with fine-tuning, post-training, or model adaptation. * Prior work in healthcare, clinical AI, or other regulated, high-stakes industries. * Experience interviewing or mentoring ML engineers. * Open-source contributions to ML, agent, or evaluation tooling. ## Description As a Senior Machine Learning Engineer at Ambience, you will build and improve the AI systems that power our clinical products. You'll own complex projects end-to-end, from diagnosing production failures and designing evaluations to building, deploying, and iterating on model and agentic systems. This is a highly hands-on role with significant technical ownership. You'll work closely with clinicians, product managers, and fellow engineers to translate cutting-edge research into reliable, production-grade AI systems. Our engineering roles are hybrid - working onsite at our San Francisco office three days per week., * Build Trustworthy AI Evaluation Systems: Design and own evaluation pipelines for LLM and agentic systems, combining automated graders, regression testing, production feedback, and human evaluation to measure real product quality. * Improve Production Model Behavior: Diagnose high-impact failure modes and test improvements across prompting, retrieval, context, routing, data, fine-tuning, or other model and system interventions. * Build Agentic AI Systems: Develop production systems involving tool use, retrieval, context and state management, routing, orchestration, tracing, and failure recovery. * Build Data and Improvement Flywheels: Turn production failures and user feedback into better datasets, evaluations, and model behavior through active learning and systematic iteration. * Stay at the Cutting Edge: Distill insights from recent research in LLMs, agents, NLP, speech, and multimodal AI and translate promising ideas into practical experiments. * Own AI Systems End-to-End: Work across models, data, evaluation, orchestration, serving, and observability, while remaining deeply hands-on in code and production debugging. ## Related Videos - [Creating a routing app with Google Maps API from scratch](https://www.wearedevelopers.com/videos/831-creating-a-routing-app-with-google-maps-api-from-scratch) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Chatbots are going to destroy infrastructures and your cloud bills](https://www.wearedevelopers.com/videos/1130-chatbots-are-going-to-destroy-infrastructures-and-your-cloud-bills) - [Navigating the AI Revolution in Software Development](https://www.wearedevelopers.com/videos/1266-navigating-the-ai-revolution-in-software-development) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)