Lead Software Engineer

You will work across backend engineering, cloud infrastructure, data science, and applied AI to productionize LLM workflows, RAG systems, prediction and scoring services, model serving, and agentic applications. This role is ideal for an engineer with deep Java expertise and practical Python/ML experience who can make sound architectural and build-versus-buy decisions.

Responsibilities

• Lead the design and development of scalable backend services for the healthcare analytics platform

• Build AI-enabled capabilities including LLM integrations, RAG workflows, predictive and scoring services, model serving, and agentic applications

• Partner with Data Science to move models and proof-of-concepts into reliable production systems

• Develop APIs and services using server-side Java and Python/FastAPI

• Build and maintain ML pipelines, model deployment workflows, and model lifecycle processes

• Use tools such as MLflow for experiment tracking, model management, and deployment

• Design retrieval systems using vector databases, embeddings, and document search

• Evaluate build-versus-buy decisions across AI tooling, model providers, orchestration platforms, and vector stores

10+ years of software engineering experience, including substantial backend or distributed systems work

• Strong server-side Java development experience

• Production experience with Linux, cloud infrastructure, and scalable service architectures

• Hands-on experience building and operating AI or machine learning xrbllit systems in production

• Strong Python experience, including FastAPI

• Experience with LLM applications, LangChain or similar orchestration frameworks, and agentic workflows

• Experience with vector databases, embeddings, RAG architectures, and retrieval systems

• Experience with model serving, ML pipelines, model deployment, and lifecycle management

• Familiarity with MLflow or comparable tools for experiment tracking and model registry

Nice to Haves

• Healthcare, healthcare analytics, health tech, or regulated SaaS experience

• Experience with sensitive data, security, privacy, or compliance-focused systems