Principal Enterprise QA Architect, AI Health Cloud

BrightSpring Health Services
Louisville, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Louisville, United States of America

Tech stack

API
Artificial Intelligence
Computing Platforms
Automation of Tests
Cloud Computing
Continuous Integration
DevOps
Distributed Systems
Healthcare Effectiveness Data and Information Set
Interoperability
Azure
Strategies of Testing
Cloud Platform System
Spring Cloud
Large Language Models
Multi-Agent Systems
Machine Learning Operations
Microservices

Job description

We are seeking a highly experienced Principal Enterprise QA Architect to define and lead the quality strategy for our AI Health Cloud platform. This is a senior leadership role responsible for architecting enterprise-wide quality engineering, test automation, and validation frameworks across AI/ML platforms, healthcare data pipelines, and cloud-native applications.

You will operate at the intersection of platform architecture, AI/ML systems, and healthcare compliance, ensuring that all solutions-from APIs and microservices to LLM-powered workflows-are highly reliable, secure, explainable, and production-ready.

This role extends beyond traditional QA into Quality Engineering, AI validation, and continuous verification at scale.

Responsibilities

  • Define and lead end-to-end quality architecture across platform, data, AI/ML, and applications
  • Establish enterprise QA standards, frameworks, and governance models
  • Design validation strategies for LLMs, RAG pipelines, vector databases, and agent systems
  • Architect testing strategies for microservices, APIs, and distributed systems
  • Lead development of enterprise automation frameworks
  • Ensure compliance with HIPAA, CMS, NCQA and security standards
  • Collaborate with architects, product, and engineering teams
  • Implement observability-driven quality and continuous improvement

Requirements

  • 15+ years in QA, Quality Engineering, or Test Architecture
  • Strong experience in cloud-native systems and automation frameworks
  • Experience with AI/ML validation and testing
  • Deep knowledge of healthcare data and interoperability standards
  • Expertise in DevOps, CI/CD, and MLOps
  • Strong leadership and stakeholder management

Preferred Qualifications

  • Experience with LLM validation and Responsible AI
  • Familiarity with RAG, vector databases, and agent frameworks
  • Experience in healthcare quality programs (HEDIS, Stars)
  • Advanced degree in relevant field

Benefits & conditions

  • Improved AI model trust and performance
  • Increased automation coverage and faster releases
  • Strong regulatory compliance

Why Join Us

  • Lead the future of AI quality in healthcare
  • Work with top-tier engineers, clinicians, and AI teams
  • Solve complex AI safety and compliance challenges
  • Competitive compensation and flexible work environment

About the company

BrightSpring Health Services, BrightSpring Health Services provides complementary home- and community-based health solutions for complex populations in need of specialized and/or chronic care. Through the Company's service lines, including pharmacy, home health care, and rehabilitation, we provide comprehensive and more integrated care and clinical solutions in all 50 states to over 475,000 customers, clients and patients daily. BrightSpring has consistently demonstrated strong and industry-leading quality metrics across its services lines, while improving the health and quality of life for high-need individuals and reducing overall healthcare system costs. For more information, please visit www.brightspringhealth.com. Follow us on Facebook, LinkedIn, and X.

Apply for this position