Integration & Test Automation Engineer (AI Platform)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+33 more
Job description
We are seeking an Integration & Test Automation Engineer to strengthen our multi-stage DevSecOps workflows and ensure our platform meets reliability, security, and quality standards across development, staging, and production. In this role, you will create and maintain high-coverage automated test suites, validate system integrations (including AI components), and work hands-on with CI/CD pipelines and cloud-based test environments.
You’ll collaborate cross-functionally with software, system engineering & quality, and platform release teams. You’ll also engage with customer-facing test activities and have an opportunity to influence how we validate state-of-the-art AI-enabled engineering solutions., * Develop, maintain, and enhance automated unit, integration, regression, and end-to-end test suites using tools like Pytest, JUnit, and Selenium/Cypress.
- Validate integrations between APIs, microservices, model-based systems engineering (MBSE) layers, and AI pipeline components.
- Work closely with system engineers to plan, automate, and execute comprehensive model-based systems engineering (MBSE) test scenarios.
- Integrate automated test executions into GitLab CI/CD pipelines, ensuring robust stage gating (local, dev, staging, prod).
- Design and implement thorough test plans, including system, performance, security, and UAT testing; track coverage/metrics against exit criteria.
- Build, deploy, and test environments using Kubernetes, Docker, and infrastructure automation with Terraform and/or AWS CloudFormation.
- Write scripts/tools in Python, Bash, PowerShell, and TypeScript to support test automation, data setup, CI/CD hooks, and system validation; apply Regex for data parsing/validation as appropriate.
- Leverage Prometheus/Grafana to validate system metrics as part of test runs and post-deployment checks.
- Quickly analyze test failures, assist development teams in debugging, and support defect tracking and resolution throughout the delivery cycle.
- Engage with Developers, Systems Engineers, and Platform/Quality teams from requirements discovery through deployment and handover
Requirements
- Bachelor’s (8-10 years) or Master’s degree (6-8 years) or PhD (3-5 years) in Computer Science, Engineering, or a closely related field.
- 2-5 years in software/system testing or QA roles, preferably in complex, CI/CD-driven environments.
- Proficiency in developing automated test scripts using modern frameworks (e.g., Pytest for Python, JUnit, Selenium/Cypress for web UI, etc.).
- Experience testing REST APIs, microservices, and containerized (Docker/Kubernetes) applications.
- Hands-on with GitLab, automated pipelines, code branching/merging, and artifact promotion strategies.
- Direct experience running tests or deploying environments on AWS and/or Azure.
- Comfortable working jointly with Dev, Quality, and Ops teams, and engaging in customer-driven test/acceptance cycles.
- Analytical and proactive mindset in defect isolation, root-causing, and proposing corrective actions.
- Ability to obtain/maintain Secret Clearance.
Preferred Skills:
- Familiarity with load testing tools, DAST/IAST, or other runtime security scanning.
- Experience using Prometheus/Grafana for test validation and system observability.
- Exposure to evaluating AI model outputs or integrating model quality into test plans (MLflow or similar).
- Familiarity with digital engineering concepts, SysML, or model-based system workflows.
- Experience preparing test reports, validation evidence, and supporting formal acceptance reviews.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.clearancejobs.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Navigating the AI Shift
Transforming Software Development: The Role of AI and Developer Tools
The 8 Best Code Testing Tools
Dev Digest 121 - AI goes offline