Senior AI Developer/Architect

Health, Inc
Austin, TX, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Data Governance Python (Programming Language) Parsing TypeScript AI Infrastructure Data Processing ReactJS Large Language Models Prompt Engineering
+9 more
IT Architecture Technical Debt Kubernetes Information Technology Data Lineage Graphql Machine Learning Operations GPT Legacy Systems

Job description

We’re hiring a Senior AI Developer / AI Architect to lead the technical direction of our AI initiatives. This is a greenfield opportunity-you won’t be inheriting legacy systems or maintaining someone else’s architecture. You’ll be designing and building from the ground up. You’ll own the full stack of decisions: platform selection, model strategy, RAG architecture, agent design, observability, and cost optimization. You’ll shape how we build AI at this company for years to come. If you’ve been waiting for a role where you can build something meaningful without fighting through layers of tech debt and organizational inertia, this is it., * Own AI architecture across cloud platforms (AWS Bedrock, Google Vertex AI)-you’ll make the calls on what we build and how

  • Design RAG systems end-to-end, from document ingestion and chunking strategy through retrieval optimization and generation quality
  • Build agentic systems using modern patterns: MCP (Model Context Protocol), tool-use, function calling, and orchestration frameworks like LangGraph
  • Define observability and evaluation so we know our AI is actually working in production-not just demo-ing well
  • Manage cost at scale-model selection tradeoffs, token economics, and budget forecasting as we grow
  • Establish guardrails and compliance patterns, particularly for healthcare data and HIPAA requirements
  • Mentor and guide implementation-level developers as the team grows
  • Ship production systems-this isn’t a strategy-only role; you’ll write code and deploy real solutions

Requirements

Do you have experience in Team leadership?, Do you have a Master’s degree?, * Bachelor’s degree in Computer Science, Data Science, Engineering, or related field; or equivalent practical experience

  • 5+ years in AI/ML development
  • 2+ years in architectural leadership or technical lead roles
  • Proven track record architecting and deploying AI/ML systems in production environments
  • Experience designing systems that handle sensitive data with appropriate security and compliance controls

Preferred:

  • Master’s degree in Computer Science, AI/ML, or related field
  • Experience in HIPAA-regulated environments
  • Insurance or healthcare payer industry experience
  • Experience building and leading AI/ML teams

Technical Knowledge Required:

  • Deep expertise in AWS Bedrock and/or Google Vertex AI
  • Proficiency with large language models (Claude, GPT, Gemini) and their APIs
  • Hands-on experience building RAG systems end-to-end-including document ingestion, parsing, chunking strategies, embedding models, vector databases, and retrieval optimization
  • Experience with vector databases (Pinecone, pgvector, or similar)
  • Strong background in prompt engineering and LLM integration patterns
  • Hands-on experience with agentic patterns: MCP (Model Context Protocol), tool-use/function calling, ReAct, Plan-and-Execute, or similar approaches
  • Experience with orchestration frameworks (LangGraph, LangChain, or similar)
  • Experience designing and implementing AI observability and evaluation systems
  • Track record of managing AI infrastructure costs and optimizing token economics
  • Proficiency in Python and/or TypeScript for AI/ML development
  • Experience designing secure, scalable API ecosystems (REST, GraphQL)

Preferred:

  • Experience with LLM Ops tooling (LangSmith, Weights & Biases, Arize, Helicone, or similar)
  • Familiarity with HIPAA compliance frameworks and PHI data handling requirements
  • Experience with CI/CD pipelines for ML systems
  • Knowledge of data governance and lineage tracking

Benefits & conditions

  • Competitive salary and benefits package
  • Dynamic and innovative work environment
  • Opportunities for professional growth and development
  • Remote work flexibility

Equal Opportunity Statement

About the company

Health Admins is a leading third-party administrator in the healthcare space. Our Vision is to radically improve the way individuals interact with the healthcare system. We are committed to providing innovative and efficient health care solutions to our clients, ensuring they receive the best possible care and service. Our team is currently seeking a highly skilled and experienced Senior AI Developer to join our dynamic team.

What We Are Looking For

Our ideal candidate will play a crucial role in managing our AI environment, optimizing its performance, and driving continuous improvements to support our business goals and enhance our service delivery.

Every Team Member is Driven by a Commitment to Live out These Values:

  • Be Authentic: Be true and honest
  • Be Helpful: Pitch in and help
  • Be Innovative: Seek & embrace innovation
  • Be Accountable: Do what you say you are going to

Employees are expected to embrace our core values by being “A Hero in Action.” These values lay the foundation for the way we engage with each other and with our clients. They form the guardrails for our decision making and approach to problem solving.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · WWC 2025

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 ¡ WWC 2024

2:52 min

Generating APIs with the Neo4j GraphQL library

William Lyon ¡ LIVE

2:56 min

Open-sourcing a complex parsing library for game data

Johan Hutting Johan Hutting ¡ WWC 2024

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou ¡ Coffee With Developers

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky ¡ WWC 2025

Videos

See all

Related articles

See all