> Markdown version of [/jobs/ext/1206920-senior-ai-ml-test-engineer](https://www.wearedevelopers.com/jobs/ext/1206920-senior-ai-ml-test-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior AI/ML Test Engineer - **Company:** Strategic Inc - **Location:** Washington, DC, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Automation of Tests, Continuous Integration, Data Infrastructure, Machine Learning, Systems Integration, Cloud Platform System, Integration Tests, Devsecops - **Published:** July 8, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9016346/senior-aiml-test-engineer ## About the Role * Active TS/SCI clearance and the ability to pass a CI polygraph within 30 days. * Bachelor's degree in IT or STEM related field, or additional relevant experience in lieu of a degree. * 8+ years of experience supporting AI/ML testing, system integration, or operational evaluation activities. * Experience designing or supporting automated testing pipelines, evaluation workflows, or distributed compute environments. * Familiarity with AI/ML model evaluation, integration testing, and performance assessment methodologies. * Experience troubleshooting complex integration and infrastructure challenges within mission or enterprise environments. * Strong analytical, technical, and communication skills with experience supporting customer briefings and technical assessments. Desired: * Experience supporting DoD, NGA, or Intelligence Community programs. * Familiarity with cloud-based architectures, containerized workflows, and DevSecOps environments. * Experience with automated testing frameworks, CI/CD pipelines, and AI/ML operational environments. * Familiarity with drift detection, data capture pipelines, annotation workflows, and model performance analytics. * Experience supporting operational AI/ML evaluation environments and mission-focused testing activities. ## Description Strategic ACI is seeking a Senior AI/ML Test Engineer to support advanced AI/ML Test & Evaluation (T&E) activities for mission-critical national security programs. The Senior AI/ML Test Engineer is responsible for integrating MT&E capabilities into the ST&E environment and ensuring end-to-end evaluation workflows operate effectively within operationally realistic data and compute environments. This role designs, develops, and executes integration testing activities focused on latency, throughput, runtime performance, and operational scalability of AI/ML evaluation pipelines. The Senior AI/ML Test Engineer supports the implementation of automated evaluation processes including data capture, drift detection, annotation workflows, and evaluation orchestration aligned with ST&E mission requirements. The position provides senior-level technical leadership during the establishment of the evaluation architecture, resolving complex integration challenges between evaluation tools, AI/ML models, infrastructure components, and operational environments. This role supports MT&E and ST&E initiatives across evolving AI-enabled mission systems and operational workflows., * Integrate MT&E capabilities into the ST&E environment supporting operational AI/ML evaluation activities. * Design and execute integration testing for AI/ML evaluation workflows, including latency, throughput, runtime performance, and scalability assessments. * Develop and support automated evaluation processes including data capture, annotation workflows, drift detection, and evaluation orchestration. * Establish and refine scalable evaluation architectures supporting AI/ML model testing across operationally realistic compute and data environments. * Resolve complex integration issues involving AI/ML evaluation tools, datasets, infrastructure, and operational mission systems. * Analyze system performance, data variability, infrastructure constraints, and operational impacts affecting evaluation reliability and scalability. * Support development and optimization of automated T&E pipelines enabling repeatable and rapid model assessment workflows. * Collaborate with AI/ML engineers, software developers, data scientists, and mission stakeholders to support operational evaluation objectives. * Provide technical leadership and guidance to mid-level engineers supporting steady-state execution and maintenance of evaluation environments. * Deliver technical findings, integration recommendations, and customer briefings supporting mission-focused AI/ML deployment decisions. ## Related Videos - [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing) - [DevSecOps: Injecting Security into Mobile CI/CD Pipelines](https://www.wearedevelopers.com/videos/273-devsecops-injecting-security-into-mobile-ci-cd-pipelines) - [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning) - [Building Reliable Serverless Applications with AWS CDK and Testing](https://www.wearedevelopers.com/videos/812-building-reliable-serverless-applications-with-aws-cdk-and-testing) - [Hiring AI Native Talents](https://www.wearedevelopers.com/videos/100268-hiring-ai-native-talents) - [DevSecOps: Security in DevOps](https://www.wearedevelopers.com/videos/36-devsecops-security-in-devops) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)