Integration & Test Automation Engineer (AI Platform)

Arcfield, Inc.
United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Systems Engineering Automation of Tests Microsoft Azure Bash Shell Cloud Computing Continuous Integration Software Debugging Monitoring of Systems Junit
+33 more
Python (Programming Language) Load Testing Windows PowerShell Regular Expressions Prometheus Webui Selenium Systems Modeling Language System Testing Systems Integration TypeScript Web Application Frameworks Delivery Pipeline Grafana Test Scripts Cypress (Programming Language) Gitlab Git Cloudformation SC Clearance Pytest AI Platforms Gitlab-ci Kubernetes Infrastructure Automation Frameworks Information Technology Machine Learning Operations Restful APIs Terraform Devsecops Docker Microservices Dynamic Application Security Testing

Job description

We are seeking an Integration & Test Automation Engineer to strengthen our multi-stage DevSecOps workflows and ensure our platform meets reliability, security, and quality standards across development, staging, and production. In this role, you will create and maintain high-coverage automated test suites, validate system integrations (including AI components), and work hands-on with CI/CD pipelines and cloud-based test environments.

You’ll collaborate cross-functionally with software, system engineering & quality, and platform release teams. You’ll also engage with customer-facing test activities and have an opportunity to influence how we validate state-of-the-art AI-enabled engineering solutions., * Develop, maintain, and enhance automated unit, integration, regression, and end-to-end test suites using tools like Pytest, JUnit, and Selenium/Cypress.

  • Validate integrations between APIs, microservices, model-based systems engineering (MBSE) layers, and AI pipeline components.
  • Work closely with system engineers to plan, automate, and execute comprehensive model-based systems engineering (MBSE) test scenarios.
  • Integrate automated test executions into GitLab CI/CD pipelines, ensuring robust stage gating (local, dev, staging, prod).
  • Design and implement thorough test plans, including system, performance, security, and UAT testing; track coverage/metrics against exit criteria.
  • Build, deploy, and test environments using Kubernetes, Docker, and infrastructure automation with Terraform and/or AWS CloudFormation.
  • Write scripts/tools in Python, Bash, PowerShell, and TypeScript to support test automation, data setup, CI/CD hooks, and system validation; apply Regex for data parsing/validation as appropriate.
  • Leverage Prometheus/Grafana to validate system metrics as part of test runs and post-deployment checks.
  • Quickly analyze test failures, assist development teams in debugging, and support defect tracking and resolution throughout the delivery cycle.
  • Engage with Developers, Systems Engineers, and Platform/Quality teams from requirements discovery through deployment and handover

Requirements

  • Bachelor’s (8-10 years) or Master’s degree (6-8 years) or PhD (3-5 years) in Computer Science, Engineering, or a closely related field.
  • 2-5 years in software/system testing or QA roles, preferably in complex, CI/CD-driven environments.
  • Proficiency in developing automated test scripts using modern frameworks (e.g., Pytest for Python, JUnit, Selenium/Cypress for web UI, etc.).
  • Experience testing REST APIs, microservices, and containerized (Docker/Kubernetes) applications.
  • Hands-on with GitLab, automated pipelines, code branching/merging, and artifact promotion strategies.
  • Direct experience running tests or deploying environments on AWS and/or Azure.
  • Comfortable working jointly with Dev, Quality, and Ops teams, and engaging in customer-driven test/acceptance cycles.
  • Analytical and proactive mindset in defect isolation, root-causing, and proposing corrective actions.
  • Ability to obtain/maintain Secret Clearance.

Preferred Skills:

  • Familiarity with load testing tools, DAST/IAST, or other runtime security scanning.
  • Experience using Prometheus/Grafana for test validation and system observability.
  • Exposure to evaluating AI model outputs or integrating model quality into test plans (MLflow or similar).
  • Familiarity with digital engineering concepts, SysML, or model-based system workflows.
  • Experience preparing test reports, validation evidence, and supporting formal acceptance reviews.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

4:15 min

Refactoring test code dependencies with Maven and JUnit

Benjamin Bischoff Benjamin Bischoff · Europe 2026 Virtual

2:06 min

Elevating the QA engineering role for complex challenges

Ondřej Gróf Ondřej Gróf · WWC Europe 2026

1:48 min

Structuring and naming conventions for unit test methods

Annelore Egger Annelore Egger · WWC 2025

3:45 min

Fusing developer experience and platform engineering for agentic SDLC

Julia Kordick Julia Kordick · WWC Europe 2026

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all