> Markdown version of [/jobs/ext/2638811-ai-ml-ops-engineer-data-reporting-onsite](https://www.wearedevelopers.com/jobs/ext/2638811-ai-ml-ops-engineer-data-reporting-onsite). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI/ML Ops Engineer - Data & Reporting, Onsite

- **Company:** PRIMUS Global Services, Inc
- **Location:** Austin, TX, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** A/B Testing, Artificial Intelligence, Continuous Integration, Github, Graph Database, Python (Programming Language), Machine Learning, Routing, Regression Testing, Prometheus, TypeScript, Datadog, Large Language Models, Grafana, Multi-Agent Systems, Gitlab, Machine Learning Operations, Virtual Agents, Jenkins
- **Published:** August 15, 2026
- **Apply:** https://www.dice.com/job-detail/4a6bae8b-9c67-4a5e-8a7b-4e612b031627

## About the Role

We have an immediate need for an experienced Senior AI/ML Ops Engineer with strong expertise in LLM evaluation, MLOps, AI agent reliability, Python, CI/CD, observability, and production AI systems to design, build, and operate a comprehensive evaluation and monitoring platform for LLM-powered agents.

This is an onsite position based in Austin, TX, with a preference for local candidates and candidates with prior Apple experience, for a candidate with deep experience in Python, TypeScript, LLMs, LLM Evaluation, AI Agents, MLOps, ML Engineering, CI/CD, GitHub Actions, GitLab, Jenkins, Buildkite, OpenTelemetry, Datadog, Grafana, Prometheus, LangSmith, Langfuse, Arize Phoenix, Braintrust, W&B Weave, RAG Pipelines, Multi-Agent Systems, Agent Orchestration, LLM-as-a-Judge, Golden Datasets, Regression Testing, Automated Scoring, Prompt Management, Model Routing, A/B Testing, Experimentation, Causal Inference, Knowledge Graphs, Monitoring, Alerting, Incident Response, RCA, and Production Observability.



## Related Videos

- [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)
- [Enabling automated 1-click customer deployments with built-in quality and security](https://www.wearedevelopers.com/videos/83-enabling-automated-1-click-customer-deployments-with-built-in-quality-and-security)
- [DevOps for AI: running LLMs in production with Kubernetes and KubeFlow](https://www.wearedevelopers.com/videos/1222-devops-for-ai-running-llms-in-production-with-kubernetes-and-kubeflow)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)