> Markdown version of [/jobs/ext/3538277-agentic-ai-systems-evaluation-engineer](https://www.wearedevelopers.com/jobs/ext/3538277-agentic-ai-systems-evaluation-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Agentic AI] Systems Evaluation Engineer

- **Company:** HP View all jobs
- **Location:** Houston, TX, United States (Remote available)
- **Experience:** Expert
- **Salary:** $90,000.0 - $110,000.0
- **Contract:** Contract
- **Skills:** Java (Programming Language), JavaScript (Programming Language), Microsoft Windows, Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Amazon Web Services, Software Applications, Microsoft Azure, C++ (Programming Language), Linux, DevOps, Python (Programming Language), Software Architecture, Software Engineering, SQL Databases, ReactJS, Agentic-AI, Kubernetes, Information Technology, Docker, User Administration, Programming Languages, Microservices
- **Published:** October 2, 2026
- **Apply:** https://www.careerjet.com/job/usa8bc77d90e9325ec237265143ee495ef/eaa

## About the Role

* Four-year or Graduate Degree in Computer Science, Statistics, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.
 * Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.

 * Strong analytical skills

 * Experience with benchmarking methodologies

Preferred Qualifications

 * AI systems evaluation.
 * Telemetry analytics
 * Performance benchmarking.
 * Linux and Windows validation experience

Preferred Certifications

 * Programming Language/s Certification (Java, C++, Python, JavaScript, or similar)

Knowledge & Skills

 * Agile Methodology
 * Amazon Web Services
 * Application Programming Interface (API)
 * Automation
 * C++
 * Computer Science
 * DevOps
 * Docker (Software)
 * Full Stack Development
 * Java (Programming Language)
 * JavaScript (Programming Language)
 * Kubernetes
 * Microservices
 * Microsoft Azure
 * Python (Programming Language)
 * React.js
 * Scalability
 * Software Development
 * Software Engineering
 * SQL (Programming Language)

## Description

This role is responsible for defining measurement methodology and benchmarks to quantify customer outcomes, platform performance, and AI workload effectiveness ensuring the technical design, development, installation, and maintenance of state-of-the-art software applications and services for our products. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools. The role builds & maintains relationships with stakeholders across different departments and provide guidance & coaching to reportees in executing their tasks/responsibilities.
*Houston in-office requirement: 4-days
Responsibilities

 * Define success metrics.
 * Create benchmarking frameworks.
 * Analyze customer outcomes.
 * Produce executive performance reports.

 * Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts.
 * Interacts with user management regarding project status and user requirements to promote an environment with improved productivity and satisfaction.
 * Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians.
 * Identifies, recommends and implements changes to enhance effectiveness of engineering, implementation and service strategies, Identify opportunities, develop technical solutions, prepare proposals, and secure new installation, retrofit, and service projects. This Jobot Job is hosted by: Courtney Hoogerv…
 + 6 days ago


## Related Videos

- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better)
- [Hiring AI Native Talents](https://www.wearedevelopers.com/videos/100268-hiring-ai-native-talents)
- [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [Will AI replace Software Engineers?](https://www.wearedevelopers.com/magazine/340-will-ai-replace-software-engineers)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)