> Markdown version of [/jobs/ext/738418-senior-ai-engineer](https://www.wearedevelopers.com/jobs/ext/738418-senior-ai-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior AI Engineer - **Company:** ATRIA HEALTH COLLABORATIVE, INC. - **Location:** United States - **Experience:** Expert - **Salary:** $190,000.0 - $250,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Health Informatics, Clinical Data Repository, Code Review, Information Engineering, Software Debugging, Software Design Documents, Information Extraction, Python (Programming Language), Regression Testing, Software Deployment, Management of Software Versions, Data Logging, Fast Healthcare Interoperability Resources, Flask (Web Framework), Large Language Models, Snowflake, Backend, Fastapi, Health Level Seven International, Machine Learning Operations - **Published:** June 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=db821a8c1c9b7904 ## About the Role Do you have experience in Tooling?, A bias to ship. You would rather have a rough thing in production tomorrow that you can measure and improve than a beautiful thing in a design doc next quarter. * A scrappy streak. You can pick up an unfamiliar tool, framework, or clinical concept on a Wednesday and have something working with it by Friday. * A serious drive to keep getting better. You read other people's code, papers, and post-mortems. You treat being wrong as cheap information rather than an event. * Hands-on experience building and operating LLM-powered or production ML systems: 4+ years. * Strong Python skills and deep familiarity with at least one production backend framework (FastAPI, Flask, etc.). * Hands-on experience with LLM orchestration, function/tool calling, and retrieval system design: chunking, hybrid search, reranking, and the rest of the unfashionable middle bit that makes RAG actually work. * Working knowledge of a cloud data warehouse (Snowflake strongly preferred) and modern data tooling such as dbt, Dagster, or Airflow. * A track record of designing evaluation systems for LLM applications - including the ones that caught regressions before users did, and the ones that didn't. * Familiarity with safety considerations for LLM applications: guardrails, adversarial testing, and the failure modes that tend to introduce themselves at 4pm on a Friday. * Practical understanding of HIPAA, BAAs, PHI handling, and the everyday realities of working in a regulated environment without losing the will to live. * Strong written communication: design docs, technical RFCs, and documentation that someone else can actually follow six months later. Nice to have * Experience in healthcare, clinical informatics, or other regulated domains (finance, biotech, anywhere people will sue you for being sloppy). * Familiarity with medical ontologies (LOINC, SNOMED CT, ICD-10, RxNorm) and clinical data standards (FHIR, HL7). * Experience with self-hosted model serving (vLLM, Triton, TGI, SGLang) and inference optimization. * Multimodal experience: vision, structured data, or time-series data alongside text. ## Description As a Senior AI Engineer at Atria, you will own the design, development, and production deployment of the LLM-powered systems that put AI directly in front of clinicians and members: agentic medical companions, clinical decision support, and the document understanding pipelines that turn unstructured clinical data into usable signal. You'll work end-to-end across orchestration, retrieval, evaluation, and deployment, building on a data estate that very few organizations in the world can match (whole-genome sequencing, advanced imaging, longitudinal labs and wearables, multi-generational family records) and translating clinical and operational requirements into AI products that are reliable, safe, observable, and (crucially) actually used. This is a hands-on, high-ownership role for an engineer who wants to do work with direct patient impact, and for whom "we'll add evals later" is the sort of phrase that ruins a perfectly good Tuesday. What you'll do * Architect and ship production AI systems end-to-end (orchestration, retrieval, inference, evaluation, and monitoring) for clinical decision support, document understanding, and agentic medical companions. * Design agentic workflows with custom skills and harnesses, using frontier LLMs and self-hosted models where appropriate, and resisting the urge to reach for an agent when a function call would do. * Lead development of structured information extraction pipelines from clinical documents, including automated verification systems and human-in-the-loop gates, where necessary. * Build robust evaluation infrastructure (golden datasets, LLM-as-judge, regression tests, online A/B evaluation) that gates every model and prompt change. Accuracy, safety, cost, and latency are first-class metrics. * Engineer for latency and cost: streaming, caching, prompt compression, model routing, and inference-cost budgets. * Own production health: trace- and span-level observability, prompt versioning, drift detection, cost monitoring, replay-from-production for debugging, PHI-safe logging throughout, and the general art of finding out something is broken before a clinician does. * Operationalize models trained by the AI Scientist team: serving, evaluation in production, rollback paths, and the feedback loops that turn real usage into training and eval data, rather than into a Slack thread nobody reads. * Partner with clinicians, the data engineering team, and our research collaborators to translate clinical requirements into specifications and deliverable systems. * Educate and mentor PMs and engineers across Atria on applied AI best practices, from prompt and evaluation design to choosing the right model for the job (which, surprisingly often, is not the largest one). Leadership and Influence * Set technical direction for AI engineering at Atria: architecture decisions, build-vs-buy calls, and the evaluation and observability standards the team actually works to. * Raise the bar on engineering practices, code review, observability, and incident response. Quietly, persistently, and with grace. * Drive vendor and partner technical due diligence for AI/ML vendors: BAA scope, PHI handling, sub-processor obligations, and IP terms. * Mentor other AI engineers through code review, design docs, and architecture decisions, with the patient conviction that good systems are made twice: once badly, then properly. ## Related Videos - [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [AI in High-Stakes Industries: Lessons Learned](https://www.wearedevelopers.com/videos/100253-ai-in-high-stakes-industries-lessons-learned) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try)