AI Quality Engineering / Lead professional

VeeRteq Solutions Inc
Chicago, IL, United States
8 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Testing (Software) Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Software Applications Automation of Tests Bug Tracking Systems Software Bug Management Clinical Data Repository Data Files Medical Software Issue Tracking Systems
+16 more
Machine Learning Language Modeling Scrum Methodology Systems Development Life Cycle Regression Testing Reliability Engineering Software Engineering Software Testing Automation Framework Systems Integration Test Execution Engine Enterprise Software Applications Large Language Models AI Platforms Machine Learning Operations Multiplatform Dynatrace

Job description

  • Design, develop, and execute AI Quality Engineering strategies supporting AI-powered applications, large language model (LLM) solutions, intelligent automation, agentic systems, and enterprise AI platforms.
  • Build and implement scalable AI Quality Engineering practices, including AI-native testing approaches, validation processes, runtime quality controls, reusable testing accelerators, and automated testing frameworks.
  • Lead AI validation activities including functional testing, prompt validation, workflow testing, regression testing, release validation, runtime quality assurance, and production reliability support.
  • Partner with AI Engineering, AIOps, LLMOps, Security, Governance, Clinical, Data, and Product teams to deliver scalable AI Quality Engineering processes across enterprise AI initiatives.
  • Support runtime reliability through observability, telemetry, distributed tracing, monitoring, drift detection, incident response, and operational quality assurance for AI-enabled systems.
  • Develop and maintain AI evaluation frameworks, validation datasets, quality scoring methodologies, and automated testing workflows that improve the reliability and scalability of AI solutions.
  • Collaborate with Clinical, Operational, and Engineering stakeholders to validate healthcare workflows, payer operations, and AI-enabled business processes while supporting responsible AI deployment through human-in-the-loop validation practices.
  • Coordinate testing activities across Agile delivery teams, including sprint planning, test execution, defect management, issue tracking, release readiness, risk identification, and production support.
  • Mentor Quality Engineers and provide technical guidance that promotes engineering excellence, AI-enabled testing modernization, continuous improvement, and adoption of modern Quality Engineering practices.
  • Research, evaluate, and recommend emerging AI Quality Engineering, testing automation, observability, and runtime assurance technologies to continuously improve enterprise AI.

Requirements

Engineering Degree BE/ME/BTech/MTech/BSc/MSc.

Technical certification in multiple technologies is desirable.

Skills: -

Mandatory skills

  • Experience in Quality Engineering, Quality Assurance, software testing, enterprise application delivery, technology operations, or related technology functions required.
  • Min 8 or more years of experience providing technical leadership for testing initiatives, automation programs, or enterprise technology delivery projects required.
  • Experience supporting Quality Engineering or Quality Assurance across enterprise platforms, APIs, healthcare applications, operational workflows, or integrated business systems required.
  • Strong knowledge of software development life cycle (SDLC), Agile methodologies, test automation frameworks, defect management, release validation, and production support processes required.
  • Experience validating AI-powered applications, intelligent automation, machine learning, large language model (LLM), or AI-enabled business workflows preferred.
  • Experience with AI Quality Engineering practices, AI-assisted testing, runtime observability, monitoring, telemetry, or reliability engineering preferred.
  • Strong analytical, problem-solving, organizational, communication, collaboration, and leadership skills required.
  • Demonstrated ability to manage multiple priorities and deliver results within fast-paced, highly collaborative enterprise environments required.
  • Experience in healthcare technology, payer operations, clinical workflows, or other regulated industries supporting AI governance and responsible AI deployment preferred., Quality LLM, OpenAI, AIOps, LLMOps, Quality Engineering AI Quality Engineering practices, AI-assisted testing, runtime observability, monitoring, telemetry, or reliability engineering. VeeRteq Solutions is an Equal Opportunity Employer

Skills: Agile Programming Methodologies, Analysis Skills, Application Programming Interface (API), Artificial Intelligence (AI), Automation, Bug Tracking/Defect Management, Business Processes, Business Solutions, Clinical Data, Continuous Improvement, Data Sets, Enterprise Applications, Functional Testing, Healthcare, Healthcare Software, Incident Response, Leadership, Machine Learning, Mentoring, Modeling Languages, Multiplatform/Cross-Platform, Multitasking, Problem Solving Skills, Production Support, Quality Assurance, Quality Engineering, Regression Testing, Reliability Engineering, Risk Analysis, Scalable System Development, Software Development Lifecycle (SDLC), Software Testing, Sprint Planning, System Integration (SI), Team Player, Technical Delivery, Technical Leadership, Technical Operations, Telemetry, Test Automation, Test Harness, Test Plan/Schedule, Testing, Validation Testing

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:06 min

Elevating the QA engineering role for complex challenges

Ondřej Gróf Ondřej Gróf · World Congress 2026 Europe

2:36 min

Choosing between managed AI platforms and custom governance

Péter Farkas Péter Farkas · Europe 2026 Virtual

3:38 min

Reusing email software standards for HTTP file uploads

Imran Nazar · World Congress 2023

1:01 min

Connecting frontend application performance to user retention and revenue

Dani Coll Dani Coll · World Congress 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:21 min

Automating complete quality assurance pipelines with artificial intelligence

Evelyn Haslinger · LIVE

Videos

See all

Related articles

See all