> Markdown version of [/jobs/ext/1299656-ai-test-engineer](https://www.wearedevelopers.com/jobs/ext/1299656-ai-test-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Test Engineer - **Company:** ECS Corporate Services, LLC - **Location:** Ashburn, VA, United States - **Experience:** Experienced - **Salary:** $125,000.0 - $150,000.0 - **Contract:** Permanent contract - **Skills:** JavaScript (Programming Language), Artificial Intelligence, Data Analysis, Automation of Tests, Unix, Code Coverage, Continuous Integration, Custom Software, Data Validation, Relational Databases, Perl (Programming Language), Integrated Development Environments, Python (Programming Language), Machine Learning, Selenium, Software Engineering, SQL Databases, System Testing, Test Execution Engine, Strategies of Testing, Scripting, Information Technology, Virtual Agents, Api Management - **Published:** July 16, 2026 - **Apply:** https://www.disabledperson.com/jobs/73691384-ai-test-engineer ## About the Role * U.S. Citizenship; Must be able to obtain and maintain a Public Trust determination. * Bachelor's degree in Computer Science, Electrical Engineering, or a related technical field. * 2-4+ years of AI Test and Validation experience. * Experience working on custom development software projects. * Strong collaboration with cross-functional teams to identify testing requirements and optimize test coverage. * Experience with system testing metrics, best practices, and methodologies. * Utilization of Python and Selenium for automated testing of machine learning models. * Experience working with software development teams. * Experience analyzing test results and providing actionable insights to improve model accuracy. * Experience designing and implementing comprehensive test strategies for AI-driven applications. * Experience participating in requirements and design reviews, developing test plans, writing and executing test cases in a fast-paced software development environment. * Experience conducting data analysis, data verification and problem-solving. * Experience with statistical reporting and analysis. * Competency in developing and executing test plans for various AI applications, ensuring compliance with industry standards. * Expertise in one or more scripting languages (e.g., Unix/Linux, PERL, Java script) and relational database technologies (SQL, schema design). * Ability to work as a member of a self-organizing team without daily direct supervision. * Ability to communicate effectively within a large, dynamic team environment. * Ability to support three days in-office. * Willingness to try new things and grow. ## Description Everforth ECS is seeking an AI Testing Engineer to work minimum of 3 business days onsite at our Fairfax, VA corporate office and/or our Ashburn, VA customer site., The Artificial Intelligence (AI) Test Engineer will be part of a team of experts charged with providing support in the areas of model analysis and model development capabilities in response to Custom and Border Protection's (CBP) Project Outrider. Program scope includes model analyses and assessments to identify mission and operational impacts and make appropriate performance enhancement recommendations. You will be responsible for: * The development and execution of test plans for AI models and applications, identifying, documenting, and analyzing defects, inconsistencies, and anomalies in AI outputs. * Collaboration with development teams to improve AI model performance and ensure quality standards. * Implementing automation frameworks for AI evaluation, including dataset checks, API testing, and CI/CD integration. * Defining AI quality metrics and KPIs such as accuracy, latency, cost, and fairness. Salary Range: 125,000-150,000 ## Related Videos - [WeAreDevelopers LIVE - Node and Package Security](https://www.wearedevelopers.com/videos/2138-wearedevelopers-live-node-and-package-security) - [Proactive monitoring and smoke testing in your production environment](https://www.wearedevelopers.com/videos/139-proactive-monitoring-and-smoke-testing-in-your-production-environment) - [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing) - [JavaScript? No. Java Scripts! - Scripting with Java](https://www.wearedevelopers.com/videos/2094-javascript-no-java-scripts-scripting-with-java) - [Old tools, new tricks](https://www.wearedevelopers.com/videos/1916-old-tools-new-tricks) - [Are Classical Automation Frameworks Dead? How AI Agents Are Transforming QA](https://www.wearedevelopers.com/videos/100243-are-classical-automation-frameworks-dead-how-ai-agents-are-transforming-qa) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [The 8 Best Code Testing Tools](https://www.wearedevelopers.com/magazine/402-the-8-best-code-testing-tools) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Transforming Software Development: The Role of AI and Developer Tools](https://www.wearedevelopers.com/magazine/527-transforming-software-development-the-role-of-ai-and-developer-tools)