DevOps Engineer for AI Model Evaluation

Amazon.com, Inc.
Seattle, WA, United States
8 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$176,800.0
Working hours
Regular working hours

Tech stack

Microsoft Windows Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Engineering Continuous Integration Cursor (Graphical User Interface Elements) Linux DevOps Reliability Engineering Datadog Kubernetes
+2 more
Infrastructure Automation Frameworks Terraform

Job description

This role supports a Frontier Code Agents initiative at a leading AI research lab, focused on evaluating and improving advanced AI coding models by performing structured technical assessments of realistic infrastructure engineering workflows and model outputs. Key Responsibilities

  • Use frontier AI coding agents to perform and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations that involve cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
  • Identify bugs, edge cases, reliability problems, and likely failure modes in model outputs.
  • Compare outputs from multiple frontier models, assessing relative strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure and reliability engineering scenarios.

Requirements

  • Minimum 2 years of professional experience in DevOps, SRE, or Cloud Engineering.
  • Hands-on experience with one or more cloud platforms, such as AWS, Azure, or GCP.
  • Familiarity with Kubernetes, Terraform, CI/CD pipelines, and observability tooling.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.
  • Experience supporting production-scale systems is preferred., Are you experienced in managing Windows and Linux systems with a passion for building highly-available infrastructure at massive scale? Join us in driving cloud innovation and auto…
  • 11 days ago

Benefits & conditions

  • $400 paid per accepted task.
  • Typical tasks take approximately 2 to 3 hours of work after ramp-up.
  • Compensation is tied to accepted work.
  • Metadata indicates an hourly reference rate of $85 per hour.

Eligibility

  • Role is open to remote applicants. No specific work authorization or sponsorship information was provided in the source; applicants should confirm they are eligible to work in their location.

About the company

LiveView Technologies

  • Seattle, WA
  • $151,200 per year ABOUT LVT is redefining how businesses operate in the physical world, moving beyond traditional security solutions to deliver AI-driven, actionable intelligence that makes sites …

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · WWC 2025

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

1:36 min

Visualizing memory limits and isolating suspicious endpoints

Dina Matveev Dina Matveev · Europe 2026 Virtual

4:15 min

Introduction to artificial intelligence driven development

Natalie Pistunovich · LIVE

3:55 min

Demonstrating .NET installation on Debian and Azure Linux

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

3:22 min

Evaluating advanced artificial intelligence platforms for daily recruitment

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

Videos

See all

Related articles

See all