AI Engineer

NeueHealth, Inc.
United States
1 day ago
Apply on www.builtincolorado.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$191,000.0 - $334,000.0
Working hours
Regular working hours

Tech stack

Java (Programming Language) Artificial Intelligence Amazon Web Services Audit Trail Microsoft Azure Bioinformatics C Sharp (Programming Language) Cloud Computing Information Systems Computer Engineering Continuous Integration Software Debugging
+20 more
Python (Programming Language) OpenAI Cloud Services Azure Machine Learning Scala (Programming Language) Software Engineering Software Technical Review TypeScript Google Cloud Retrieval-Augmented Generation Large Language Models AI Platforms Kubernetes Information Technology Data Management Machine Learning Operations Data Pipelines Automation Anywhere Servicenow Databricks

Job description

The Senior AI Engineer leads the design, delivery, and production operation of complex healthcare AI products spanning traditional software enhanced by AI to AI-native, agentic workflows. This hands-on role owns prompts, agent behavior, retrieval, model optimization, evaluations, and human-review controls that make high-stakes workflows safe, reliable, observable, and governable.

Working independently and in close partnership with Product, business, clinical, operational, Data Engineering, Platform, and Security teams, the Senior AI Engineer translates real-world workflows into configuration-driven decision logic and scalable systems for operating AI at enterprise scale. They curate domain datasets, drive evaluation-based iteration, optimize models and retrieval, and help advance what is possible with AI in a highly regulated healthcare environment.

This is a work-from-home position; candidates located in TX, MN, or FL are preferred, subject to business need., * Lead the end-to-end delivery of complex AI products including agentic workflows, RAG systems, and services.

  • Collaborate with Product, Engineering, Data, and clinical and operational teams.
  • Translate stakeholder needs into validated, access-aware AI workflows with clear system behavior, acceptance criteria, risk controls, and delivery trade-offs.
  • Design AI workflow and RAG product lines, including ingestion, retrieval quality, attribution, confidence handling, agent tools, and human-review paths.
  • Implement workflows with reliable AI control layers and optimize healthcare AI models across prompting, retrieval, reranking, fine-tuning, and model-selection approaches.
  • Own healthcare AI evaluation and release frameworks, including adversarial testing, regression thresholds, release gates, and production telemetry.
  • Provide senior technical leadership through design and code reviews, incident response, mentoring, and reusable engineering improvements.
  • Deliver healthcare AI services using approved cloud capabilities and HITRUST-aligned controls for PHI/PII, security, privacy, auditability, responsible AI, and compliance.

Requirements

  • Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, Data Science, Linguistics, or a related field; equivalent practical experience may be considered.
  • Typically, 5+ years of relevant engineering experience, including ownership of complex production components or technical leadership of feature delivery.
  • Hands-on experience delivering and operating production or near-production AI/ML/LLM-enabled applications.
  • Strong software engineering expertise in service and data-contract design, testing, CI/CD, observability, debugging, reliability, and operational support.
  • Strong proficiency in Python, Java, Scala, C#, TypeScript or a comparable modern language.
  • Deep working knowledge of structured outputs, RAG, tool use, evaluations, guardrails, monitoring, and human-in-the-loop design.
  • Experience with cloud services and data-intensive systems; ability to collaborate across structured-data products and unstructured-data pipelines.
  • Demonstrated self-directed exploration of emerging AI capabilities through independently built prototypes, tools, experiments, or applications.
  • Experience translating AI experimentation into production solutions for enterprise or regulated environments, with attention to safety, reliability, security, governance, and measurable outcomes.

PREFERRED EXPERIENCE

  • Healthcare experience involving PHI/PII, clinical or operational workflows, payer/provider operations, auditability, safety review, compliance controls, or value-based care.
  • Experience with cloud AI and data platforms such as Azure, AWS, GCP, Databricks, Agent Bricks, Genie, Azure AI Foundry/Azure OpenAI, Azure ML, AKS/Kubernetes, OpenTelemetry, or AI observability and evaluation tooling.
  • Model benchmarking, selection, adaptation, fine-tuning, reranking, or other domain-model optimization techniques.
  • Experience leading technical initiatives across teams or mentoring several engineers.

Benefits & conditions

Yesterday Remote or Hybrid 191K-334K Annually Senior level 191K-334K Annually Senior level Artificial Intelligence * Cloud * HR Tech * Information Technology * Productivity * Software * Automation Design and architect AI agent systems for enterprise observability, incident investigation, alert remediation, and reduced MTTR. Drive technical strategy, architecture, and high-impact initiatives while integrating LLMs and multi-agent frameworks into production systems. Collaborate across engineering, product, UX, and security teams; build reusable tools and frameworks; mentor engineers; and promote responsible agentic patterns and engineering excellence. Top Skills: Ai/Ml ModelsJavaJavaScriptLarge Language ModelsMulti-Agent SystemsObservability AnalyticsServicenow PlatformTypescript GameChanger

Artificial Intelligence Engineer

5 Days Ago Remote United States 140K-155K Annually Senior level 140K-155K Annually Senior level Computer Vision * Digital Media * Kids + Family * Mobile * Software * Sports Build and operate production-grade AI developer tooling, agentic workflows, and shared infrastructure that improve software development across engineering teams. Responsibilities include AI-assisted code review, testing, issue triage, model integrations, evaluations, monitoring, cost controls, adoption enablement, and cross-functional collaboration with security, platform, quality, product, and design teams. Top Skills: Agentic WorkflowsAi InfrastructureAi SystemsBackend EngineeringDeveloper ToolingEvaluation FrameworksFull-Stack EngineeringLlmsObservabilityRetrievalVendor Integrations Deffai

Software Engineer

5 Days Ago In-Office or Remote 190K-270K Annually Senior level 190K-270K Annually Senior level Artificial Intelligence * Software * Biotech * Pharmaceutical Build and operate production AI systems for FDA regulatory intelligence, including evaluation pipelines, document ingestion and retrieval, multi-agent workflows, data pipelines, cloud infrastructure, and secure multi-tenant services. Collaborate with former FDA experts to translate domain judgment into product requirements and evaluation cases. Own architecture, reliability, observability, cost, security, and rapid 0-to-1 delivery across the stack. Top Skills: AlembicAmazon EcrAmazon RdsAmazon S3Anthropic ApiApplication Load BalancerAws EcsAws FargateAws Secrets ManagerClaude Agent SdkCloudflareDockerFastapiGithub ActionsGraphragKnowledge GraphsLanggraphMcpOpentofuPostgresPymupdfPythonPython-DocxReactSQLSqlalchemyTailwind CssTerraformTypescriptVercel Ai SdkVite

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

About the company

NeueHealth is a value-driven healthcare company grounded in the belief that all health consumers are entitled to high-quality, coordinated care. By uniquely aligning the interests of health consumers, providers, and payors, we help to make healthcare accessible and affordable to all populations across the ACA Marketplace, Medicare, and Medicaid.

NeueHealth delivers clinical care to health consumers through our owned clinics - Centrum Health and Premier Medical - as well as unique partnerships with affiliated providers across the country. We also enable providers to succeed in performance-based arrangements through a suite of technology and services scaled centrally and deployed locally. Through our value-driven, consumer-centric approach, we are committed to transforming healthcare and creating a better care experience for all.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.builtincolorado.com
Prepare application

Good distractions

Loading talks and stories from around this role…