> Markdown version of [/jobs/ext/3087824-devops-engineer-ai-model-evaluator](https://www.wearedevelopers.com/jobs/ext/3087824-devops-engineer-ai-model-evaluator). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Devops Engineer - Ai Model Evaluator

- **Company:** Mercor
- **Location:** Madrid, Spain
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Cloud Engineering, Continuous Integration, Cursor (Graphical User Interface Elements), DevOps, Reliability Engineering, Google Cloud, Kubernetes, Terraform
- **Published:** September 26, 2026
- **Apply:** https://www.buscojobs.com.es/devops-engineer-ai-model-evaluator-en-madrid-ID-372855761

## About the Role

scenarios.Time CommitmentSprint based project that runs in ***** hour stretches based on client requirement.Compensation$400 per accepted task.Typical tasks take approximately 2-3 hours after ramp-up.Compensation is tied to accepted work.Who Should Apply2+ years of professional DevOps, SRE, or Cloud Engineering experience.Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.Ability to evaluate model-generated infrastructure and reliability engineering solutions.
xghoner Experience supporting production-scale systems is preferred.
#J-*****-Ljbffr

## Description

About the RoleNo deje pasar esta oportunidad, inscríbase rápidamente si su experiencia y habilidades coinciden con lo que se indica en la siguiente descripción.Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project.Contributors help evaluate and improve frontier AI coding models through structured technical assessments.The work focuses on realistic infrastructure engineering workflows and model evaluation.Spots are limited and filling quickly on a first come, first serve basis.What You'll DoUse frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.Identify bugs, edge cases, reliability issues, and failure modes.Compare outputs from multiple frontier models and assess their strengths and weaknesses.Apply professional engineering judgment to realistic infrastructure engineering scenarios.Time CommitmentSprint based project that runs in ***** hour stretches based on client requirement.Compensation$400 per accepted task.Typical tasks take approximately 2-3 hours after ramp-up.Compensation is tied to accepted work.Who Should Apply2+ years of professional DevOps, SRE, or Cloud Engineering experience.Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.Ability to evaluate model-generated infrastructure and reliability engineering solutions.xghoner Experience supporting production-scale systems is preferred.#J-*****-Ljbffr


## Related Videos

- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [Agentic DevOps: How AI-Powered Automation Transforms Software Delivery on GitHub and Azure](https://www.wearedevelopers.com/videos/1539-agentic-devops-how-ai-powered-automation-transforms-software-delivery-on-github-and-azure)
- [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment)

## Related Articles

- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)