> Markdown version of [/jobs/ext/3555304-agentic-ai-ai-runtime-ml-model-systems-engineer](https://www.wearedevelopers.com/jobs/ext/3555304-agentic-ai-ai-runtime-ml-model-systems-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Agentic AI] AI Runtime / ML Model Systems Engineer

- **Company:** HP View all jobs
- **Location:** Houston, TX, United States (Remote available)
- **Experience:** Expert
- **Salary:** $90,000.0 - $110,000.0
- **Contract:** Contract
- **Skills:** Java (Programming Language), JavaScript (Programming Language), Abstraction Layers, Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Amazon Web Services, Software Applications, Systems Engineering, Microsoft Azure, C++ (Programming Language), DevOps, Programming Tools, Python (Programming Language), Machine Learning, Software Architecture, Software Engineering, SQL Databases, ReactJS, Agentic-AI, Kubernetes, Information Technology, ONNX (Open Neural Network Exchange) Format, TensorRT, Docker, Programming Languages, Microservices
- **Published:** October 2, 2026
- **Apply:** https://www.careerjet.com/job/us4e77084014fa36c09b17062a3b21b9cb/eaa

## About the Role

* Four-year or Graduate Degree in Computer Science, Information Technology, Software Engineering, or any other related discipline or commensurate work experience or demonstrated competence.
 * Typically has 7-10 years of work experience, preferably in software designing & development, software architecture, programming languages, or a related field.
 * Strong AI runtime expertise.
 * Optimize inference execution., * ONNX, TensorRT, OpenVINO.
 * NPU/GPU scheduling.
 * Edge AI deployment.

Knowledge & Skills

 * Agile Methodology
 * Amazon Web Services
 * Application Programming Interface (API)
 * Automation
 * C++
 * Computer Science
 * DevOps
 * Docker (Software)
 * Full Stack Development
 * Java (Programming Language)
 * JavaScript (Programming Language)
 * Kubernetes
 * Microservices
 * Microsoft Azure
 * Python (Programming Language)
 * React.js
 * Scalability
 * Software Development
 * Software Engineering
 * SQL (Programming Language)

## Description

This role is responsible for developing runtime abstraction layers and intelligent model placement systems across heterogeneous compute resources.. In this role, you will ensure the technical design, development, installation, and maintenance of state-of-the-art software applications and services for the company. The role plays a crucial role in building technical solutions to help other developers/engineers deliver faster with modern software and application development tools.
*Houston in-office requirement: 4 days
Responsibilities

 * Build runtime abstraction frameworks.
 * Implement model placement policies.
 * Develop xPU routing logic.
 * Optimize inference execution.

 * Leads the building of various software development projects and platforms while aligning them with business and security strategies and requirements.
 * Builds standards, designs, and automates the deployment of software.
 * Designs and develops solutions that protect and manage software products and data.
 * Contributes to technology strategy and engineering roadmaps around software engineering; executes strategic software engineering proof of concepts.
 * Supervises the work of external engineering vendors, analyzing the testing performed by vendors, and provides feedback and expertise to technicians., Identify opportunities, develop technical solutions, prepare proposals, and secure new installation, retrofit, and service projects. This Jobot Job is hosted by: Courtney Hoogerv…
 + 6 days ago


## Related Videos

- [Watch Tests Go Brrrr! : Getting Started with Cypress in ReactJS](https://www.wearedevelopers.com/videos/282-watch-tests-go-brrrr-getting-started-with-cypress-in-reactjs)
- [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure](https://www.wearedevelopers.com/videos/1532-agentic-ai-from-theory-to-practice-developing-multi-agent-ai-systems-on-azure)
- [Agentic DevOps: How AI-Powered Automation Transforms Software Delivery on GitHub and Azure](https://www.wearedevelopers.com/videos/1539-agentic-devops-how-ai-powered-automation-transforms-software-delivery-on-github-and-azure)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)