DevOps Engineer for AI Model Evaluation
Amazon.com, Inc.
Seattle, WA, United States
8 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$176,800.0
Working hours
Regular working hours
Job source
Tech stack
Microsoft Windows
Artificial Intelligence
Amazon Web Services
Microsoft Azure
Cloud Engineering
Continuous Integration
Cursor (Graphical User Interface Elements)
Linux
DevOps
Reliability Engineering
Datadog
Kubernetes
+2 more
Infrastructure Automation Frameworks
Terraform
Job description
This role supports a Frontier Code Agents initiative at a leading AI research lab, focused on evaluating and improving advanced AI coding models by performing structured technical assessments of realistic infrastructure engineering workflows and model outputs. Key Responsibilities
- Use frontier AI coding agents to perform and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations that involve cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
- Identify bugs, edge cases, reliability problems, and likely failure modes in model outputs.
- Compare outputs from multiple frontier models, assessing relative strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure and reliability engineering scenarios.
Requirements
- Minimum 2 years of professional experience in DevOps, SRE, or Cloud Engineering.
- Hands-on experience with one or more cloud platforms, such as AWS, Azure, or GCP.
- Familiarity with Kubernetes, Terraform, CI/CD pipelines, and observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
- Experience supporting production-scale systems is preferred., Are you experienced in managing Windows and Linux systems with a passion for building highly-available infrastructure at massive scale? Join us in driving cloud innovation and auto…
- 11 days ago
Benefits & conditions
- $400 paid per accepted task.
- Typical tasks take approximately 2 to 3 hours of work after ramp-up.
- Compensation is tied to accepted work.
- Metadata indicates an hourly reference rate of $85 per hour.
Eligibility
- Role is open to remote applicants. No specific work authorization or sponsorship information was provided in the source; applicants should confirm they are eligible to work in their location.
About the company
LiveView Technologies
- Seattle, WA
- $151,200 per year ABOUT LVT is redefining how businesses operate in the physical world, moving beyond traditional security solutions to deliver AI-driven, actionable intelligence that makes sites …
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
LM
Luis Minvielle
over 2 years ago
BR
Benjamin Ruschin
Navigating the AI Shift
11 months ago
BB
Benedikt Bischof
MLOps And AI Driven Development
over 4 years ago
CH
Chris Heilmann
Dev Digest 137 - AI'm not sure about this
almost 2 years ago
CH
Chris Heilmann
Dev Digest 120 - Apple and peers
about 2 years ago
CH
Chris Heilmann
Dev Digest 121 - AI goes offline
about 2 years ago