Senior QA Automation Engineer, AI & Data Platforms

Main Digital
Vienna, VA, United States
2 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Testing (Software) Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Software System Penetration Testing Automation of Tests Microsoft Azure Software Bug Management Cloud Computing Code Coverage Continuous Integration Data Validation
+29 more
Data Integration DevOps Distributed Systems Github Junit Machine Learning Release Management E2e Testing Selenium Software Engineering Software Systems Software Quality Assurance (SQA) Software Testing Automation Framework Strategies of Testing Web Content Accessibility Guidelines Postman Model Validation Cypress (Programming Language) Backend Pytest Containerization Gitlab-ci Kubernetes Playwright Data Management Restful APIs Docker Jenkins Vulnerability Analysis

Job description

You will work closely with software engineering, data science, product, and delivery teams to embed quality throughout the software development lifecycle. You will help ensure solutions are reliable, secure, scalable, and ready for deployment in highly regulated and government environments., The right candidate brings a strong understanding of modern QA engineering, automated testing, CI/CD, API and data validation, and cloud-deployed applications. Experience testing AI/ML solutions and working within government or other compliance-driven environments is particularly valuable., Reporting to our Delivery Operations Manager, as a Full-Time Specialist on our team, you will work hybrid onsite in Vienna, VA, and you will own and execute comprehensive quality engineering strategies across application, data, and AI/ML solutions. In this client-facing consulting role, you will partner directly with engineering teams and program stakeholders to identify risks early, improve test coverage, automate repeatable testing, and establish clear release-readiness criteria.

Requirements

We are looking for an experienced Senior Quality Assurance Automation Engineer to support complex, client-facing technology initiatives spanning AI/ML, data platforms, cloud applications, and modern software solutions. This role is ideal for a senior QA professional who combines hands-on automation expertise with the ability to establish quality standards, influence engineering practices, and communicate effectively with both technical teams and client stakeholders., * 6-10 years of software quality assurance or quality engineering experience, including at least 3 years operating at a senior or lead level. \n

  • Demonstrated experience designing, building, and maintaining scalable test automation frameworks. \n

  • Strong hands-on experience with modern automated testing tools and frameworks such as Selenium, Playwright, Cypress, PyTest, JUnit, Postman, or comparable technologies. \n

  • Experience developing automated functional, regression, integration, API, and end-to-end testing. \n

  • Experience integrating automated testing into CI/CD pipelines and DevOps workflows using platforms such as GitHub Actions, GitLab CI/CD, Jenkins, Azure DevOps, or similar tools. \n

  • Experience testing AI/ML, data-intensive, or analytics applications, including validating model outputs and underlying data. \n

  • Understanding of AI/ML testing considerations such as model accuracy, bias, drift, data quality, edge cases, and unexpected model behavior. \n

  • Experience testing REST APIs, distributed applications, data integrations, and backend services. \n

  • Experience testing applications deployed in cloud and containerized environments using technologies such as AWS, Azure, Docker, or Kubernetes. \n

  • Strong understanding of the software development lifecycle, Agile/Scrum delivery, test strategy, defect management, and release management. \n

  • Strong ability to identify, document, reproduce, prioritize, and communicate defects and quality risks. \n

  • Experience operating in government, public-sector, regulated, or compliance-driven environments requiring formal documentation, traceability, and audit readiness. \n

  • Ability to communicate technical quality risks and recommendations clearly to engineering teams, program leadership, clients, and non-technical stakeholders. \n

  • Strong analytical, problem-solving, documentation, and written and verbal communication skills. \n

  • Ability to work effectively in a client-facing consulting environment involving multiple stakeholders, priorities, and delivery deadlines. \n

  • Experience with AI/ML model pipelines, data validation, model accuracy testing, bias evaluation, or model performance monitoring is highly valuable. \n

  • Experience with healthcare, Medicaid, program-integrity, or similar government applications is valuable. \n

  • Knowledge of security testing concepts, vulnerability scanning, and coordination of penetration testing. \n

  • Experience performing accessibility testing for government-facing applications, including familiarity with Section 508 and WCAG requirements. \n

  • ISTQB certification or a comparable professional software testing/quality assurance credential is a plus. \n

Benefits & conditions

n \n

  • Design, develop, execute, and maintain comprehensive test strategies, test plans, test cases, and automated testing frameworks across AI, data, and application solutions. \n

  • Lead quality engineering activities across the full technology stack, including frontend applications, APIs, backend services, databases, integrations, data pipelines, and AI/ML components. \n

  • Build and maintain automated test suites that increase regression coverage and integrate effectively with CI/CD pipelines. \n

  • Determine the appropriate balance of unit, integration, API, UI, regression, system, and end-to-end testing based on technical architecture and delivery risk. \n

  • Partner with data science and engineering teams to develop validation strategies for AI/ML solutions, including model accuracy, data quality, bias, drift, edge conditions, and unexpected outputs. \n

  • Develop and execute API and integration testing strategies to validate functionality, data integrity, system behavior, and interoperability between services. \n

  • Establish and continuously improve quality standards, testing methodologies, automation practices, defect-management processes, and release-readiness criteria. \n

  • Identify, reproduce, document, and track defects with precision, working directly with engineers to triage issues, determine severity and priority, validate fixes, and mitigate release risk. \n

  • Build and maintain test environments, reusable test data, test-data management processes, and supporting QA infrastructure. \n

  • Support government and contractual compliance requirements by maintaining test documentation, requirements traceability, test results, validation evidence, and audit-ready quality artifacts. \n

  • Contribute to shift-left quality practices through design and requirements reviews, code review participation, developer test guidance, and early identification of quality risks. \n

  • Partner with software engineers to improve unit, integration, and automated test coverage and help establish quality ownership across the development lifecycle. \n

  • Validate releases across cloud and containerized environments and troubleshoot environment-specific quality issues. \n

  • Support security, performance, accessibility, and other non-functional testing requirements as needed. \n

  • Define and report meaningful quality metrics, including automated test coverage, execution results, defect trends, escaped defects, regression health, and overall release readiness. \n

  • Communicate testing status, risks, defects, dependencies, and release recommendations clearly to engineering leadership, program teams, and client stakeholders. \n

  • Serve as a senior quality engineering resource within the delivery team, helping improve QA practices, automation maturity, and overall product quality across engagements. \n

\n

\n

WHAT WE OFFER:

\n

\n

Celebrated by Inc. 5000 for our rapid growth and award-winning workplace, Main Digital invites you to join our collaborative and forward-thinking team. As a Certified Women-Owned Small Business (WOSB), we champion diversity in tech. Our diverse teams combine management consulting expertise, innovative digital design, and advanced product engineering. Driven by our six core values, we lead in intelligent automation, platform technologies, and Agile methodologies to create unparalleled digital experiences. Join us as we empower people to create new possibilities through process and technology, re-imagining the ways of work and enhancing experiences with digital transformation.

\n

\n

Ready to innovate? Explore a career offering competitive compensation, comprehensive benefits, and extensive development opportunities. Apply today and shape the future with us!

\n

\n

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…