QA Automation Engieer (MCP and AI Infrastructure)

PHOTON, LLC
Dallas, TX, United States
2 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Testing (Software) JavaScript (Programming Language) Artificial Intelligence Automation of Tests Code Coverage Computer Programming Distributed Systems Github JSON Apache JMeter Python (Programming Language) Load Testing
+22 more
Node.Js OAuth Regression Testing TypeScript WebSocket AI Infrastructure Data Logging Performance Testing Evaluation Pipelines Large Language Models Software Security Rate Limiting Pytest Gitlab-ci Information Technology Virtual Agents JestJS Model Context Protocol Docker SDET Jenkins Web Api

Job description

We are seeking an experienced QA Automation Engineer to build and maintain automated testing solutions for Model Context Protocol (MCP) servers and AI agent integrations. The role focuses on functional testing, protocol compliance, performance testing, and reliability to ensure production-ready AI infrastructure., * Develop automated MCP test harnesses using TypeScript or Python to validate tools, resources, prompts, and JSON-RPC error handling.

  • Implement functional, schema validation, and contract regression tests within CI/CD pipelines.
  • Design and execute load, stress, soak, and concurrency tests to evaluate MCP server performance and reliability.
  • Build evaluation pipelines to validate AI agent tool selection, multi-step workflows, and failure recovery.
  • Establish logging, monitoring, and alerting for server health, authentication, and rate limiting.
  • Collaborate with AI and engineering teams to improve test coverage and production reliability.

Requirements

  • 5+ years of experience in QA Automation, Software Testing, or SDET roles, particularly with backend APIs and distributed systems.
  • Hands-on experience testing MCP servers using MCP client SDKs or custom JSON-RPC test frameworks.
  • Strong programming skills in TypeScript/Node.js or Python.
  • Experience with testing frameworks such as Vitest, Jest, or Pytest.
  • Practical experience with performance testing tools such as k6, Locust, or JMeter.
  • Experience integrating automated tests into GitHub Actions, GitLab CI, or Jenkins.
  • Knowledge of Docker and CI/CD pipelines.
  • Strong analytical, troubleshooting, and communication skills.
  • Bachelor’s degree in Computer Science or equivalent., * Experience testing Streamable HTTP, SSE, WebSockets, and stateful sessions.
  • Familiarity with OAuth 2.1, API security, and sandboxing.
  • Experience with LLM agent evaluation, tool-calling benchmarks, or prompt regression testing.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…