Lead Ai Engineer w/. Agentic Test Automation

Vsg Business Solutions

McLean, VA, United States

2 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Amazon Web Services Automation of Tests Github JSON Python (Programming Language) Machine Learning Microsoft UI Automation Data Driven Tests SQL Databases

+8 more

Test Data GitHub Copilot Large Language Models Playwright Virtual Agents Webhooks GPT Microservices

Job description

Lead Machine Learning Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) As a Capital One Machine Learning Engineer (MLE), you’ll be part of an Agile team dedicat…

3 days ago, Sr. Distinguished AI Engineer (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an i…
3 days ago, Lead Machine Learning Engineer (Manager IC) At Capital One, we are changing banking for good by creating responsible and reliable AI-powered systems. Our investments in technology …
3 days ago +

Requirements

Looking for a hands-on Lead AI Engineer who can build LLM/agentic solutions specifically for test automation and engineering quality workflows. This is a development-heavy role, not a traditional QA/management position. Must-Have Skills

GenAI / LLM / Agentic AI
Hands-on experience building LLM-powered agents
Tool-using / multi-step agent workflows, guardrails
Prompting, structured JSON outputs, evaluation, hallucination reduction
AI for test generation, test maintenance, failure analysis, reporting, and requirements review
GitHub / GitHub Copilot
Strong GitHub Copilot experience
GitHub Actions, reusable workflows, composite actions
PR checks, branch protection, CODEOWNERS, GitHub APIs/webhooks
Test Automation - MUST HAVE
Karate API/contract/data-driven testing
Playwright UI automation, selectors, parallel execution, trace/video
Strong knowledge of API, UI, integration, contract and negative/edge-case testing
AI + Test Reporting
Aggregate test results across multiple microservices/pipelines
Failure clustering, trend analysis, root-cause suggestions
GenAI-generated release-readiness / quality reports
Quality/Requirements Agents
Build AI checks for acceptance criteria, missing requirements, test data, dependencies, edge cases
Integrate quality gates into GitHub/CI workflows, AI/Agentic Engineer + strong Test Automation Engineer - someone who has actually built AI agents and automation frameworks, not just used ChatGPT/Copilot.