> Markdown version of [/jobs/ext/2769705-ai-test-automation-engineer](https://www.wearedevelopers.com/jobs/ext/2769705-ai-test-automation-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Test Automation Engineer

- **Company:** GPC LLC
- **Location:** Birmingham, AL, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Automation of Tests, Software Quality Assurance (SQA), TypeScript, Large Language Models, Playwright
- **Published:** September 7, 2026
- **Apply:** https://jobs.military.com/career/330965/senior-ai-test-automation-engineer-alabama-al-birmingham

## About the Role

* 5+ years of experience in test automation engineering, software quality assurance, or a related role.
, * 1-2+ years of hands-on experience testing or evaluating LLM-powered applications, including building eval datasets, defining pass/fail criteria for nondeterministic outputs, and using LLM-as-judge or heuristic evaluators.
, * Hands-on experience with LangSmith for tracing, evaluation, and observability of LLM applications , including creating datasets, running experiments, and configuring evaluators.
, * Hands-on experience with LangGraph, including graph-based agent workflows, state and context management, and tool calling.
, * Hands-on experience building and maintaining automated test suites using Playwright, preferably with TypeScript.



## Related Videos

- [AI as a Test Designer: Transforming Experience into Automated Testing](https://www.wearedevelopers.com/videos/1984-ai-as-a-test-designer-transforming-experience-into-automated-testing)
- [Boost Productivity with AI: Figma & Playwright MCP Workflows - Aris Markogiannakis](https://www.wearedevelopers.com/videos/1768-boost-productivity-with-ai-figma-playwright-mcp-workflows-aris-markogiannakis)
- [How to add test automation to your project: The good, the bad, and the ugly](https://www.wearedevelopers.com/videos/1668-how-to-add-test-automation-to-your-project-the-good-the-bad-and-the-ugly)
- [Do TypeScript without TypeScript](https://www.wearedevelopers.com/videos/327-do-typescript-without-typescript)
- [Are Classical Automation Frameworks Dead? How AI Agents Are Transforming QA](https://www.wearedevelopers.com/videos/100243-are-classical-automation-frameworks-dead-how-ai-agents-are-transforming-qa)
- [Continuous Accessibility](https://www.wearedevelopers.com/videos/100170-continuous-accessibility)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [The 8 Best Code Testing Tools](https://www.wearedevelopers.com/magazine/402-the-8-best-code-testing-tools)
- [The Best AI Chatbots: ChatGPT and Other Alternatives](https://www.wearedevelopers.com/magazine/236-the-best-ai-chatbots-chatgpt-and-other-alternatives)
- [13 AI Tools for Developers](https://www.wearedevelopers.com/magazine/302-13-ai-tools-for-developers)
- [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market)
- [The State of WebDev AI 2025 Results: What Can We Learn?](https://www.wearedevelopers.com/magazine/581-the-state-of-webdev-ai-2025-results-what-can-we-learn)