DevOps Engineer - AI Model Evaluator
Mercor
Brussel, Belgium
4 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.be
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
€176,800.0
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Amazon Web Services
Microsoft Azure
Cloud Engineering
Continuous Integration
Cursor (Graphical User Interface Elements)
DevOps
Reliability Engineering
Datadog
Google Cloud
Kubernetes
Infrastructure Automation Frameworks
+1 more
Terraform
Job description
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Requirements
Must-Have
- 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
- Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.be
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
CH
Chris Heilmann
about 2 years ago
CH
Chris Heilmann
Dev Digest 121 - AI goes offline
about 2 years ago
CH
Chris Heilmann
Dev Digest 137 - AI'm not sure about this
almost 2 years ago
BR
Benjamin Ruschin
Navigating the AI Shift
11 months ago
DC
Daniel Cranney
Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters
over 1 year ago
DC
Daniel Cranney
Dev Digest 213: Petrol Prices, Agentic Workflows, AI Skills and CODE100!
5 months ago