> Markdown version of [/jobs/ext/2722604-ai-evaluation-engineer](https://www.wearedevelopers.com/jobs/ext/2722604-ai-evaluation-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Evaluation Engineer

- **Company:** Deposco, Inc.
- **Location:** Alpharetta, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Agile Methodology, Artificial Intelligence, Automation of Tests, Unit Testing, Software Quality, Continuous Integration, Relational Databases, Github, JSON, Python (Programming Language), MySQL, Object-Oriented Software Development, Scrum Methodology, Requirements Traceability, Software Engineering, Strategies of Testing, Extensible Markup Language (XML), Scripting, Atlassian Tools, Integration Frameworks, Virtual Agents, Restful APIs, Jenkins
- **Published:** September 4, 2026
- **Apply:** https://startup.jobs/ai-evaluation-engineer-deposco-8129548

## About the Role

* Four-year degree in Computer Science/Engineering preferred
 * 2+ years experience in software quality testing
 * 2+ years of Agile Experience
 * 2 years Python Experience preferred
 * Experience in integration platforms preferred
 * Thorough understanding of the Software Development Life Cycle (SDLC), encompassing requirements gathering, design, and testing, with hands-on experience in modern testing methodologies and tools
 * Proficient in working with JSON and XML message formats
 * Familiarity with Atlassian products such as JIRA and Confluence
 * Experience working in agile environments and using continuous integration tools such as GitHub
 * Solid knowledge of relational databases, with the ability to write MySQL queries to validate test results
 * Practical exposure to RESTful automation tools
 * Competence in at least one object-oriented programming language; scripting skills are an added advantage
 * Capable of working independently or collaboratively in a fast-paced, dynamic environment under tight deadlines
 * Strong analytical and organizational abilities, with aptitude for handling multiple projects simultaneously
 * Demonstrates initiative, accountability, and ownership of projects and quality assurance activities

## Description

* Engage in requirements and project meetings to fully understand goals and deliverables
 * Review and analyze project requirements to pinpoint gaps and ensure they are suitable for creating test cases
 * Design and maintain automated tests using Java or Python for our omnichannel solutions
 * Employ automated testing tools for RESTful services connected to marketplace integrations
 * Identify marketplace-specific use cases, performing manual tests when necessary, while progressing toward automation
 * Develop automated acceptance and unit tests within an agile environment
 * Utilize Jenkins and other CI tools for automation of development, build, deployment, and testing workflows
 * Collaborate closely with product owners as part of a Scrum team to clarify requirements
 * Examine test results from a technical perspective and provide detailed feedback to the development team
 * Assist in troubleshooting production issues through coordinated testing and support efforts
 * Create essential QA documentation, including test plans, scripts, strategies, and requirement traceability matrices


## Related Videos

- [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json)
- [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray)
- [Continuous testing - run automated tests for every change!](https://www.wearedevelopers.com/videos/190-continuous-testing-run-automated-tests-for-every-change)
- [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure)

## Related Articles

- [The 8 Best Code Testing Tools](https://www.wearedevelopers.com/magazine/402-the-8-best-code-testing-tools)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [13 AI Tools for Developers](https://www.wearedevelopers.com/magazine/302-13-ai-tools-for-developers)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)