Systems Engineer - Evaluation Engineering

We are looking for a Distributed Systems Engineer to own the infrastructure powering our core Siri Agentic Evaluation Platform. Evaluation is no longer just a static test suite-it is a highly dynamic, massive-scale distributed problem. Our platform enables teams to run high-throughput agentic simulations, orchestrate multi-model judging pipelines, and generate real-time observability dashboards across billions of tokens and complex data types., In this role, you will design the execution engine that coordinates these complex evaluation loops. You will build systems that remain deterministic, fault-tolerant, and cost-efficient, even when coordinating massive parallel requests across heterogeneous device types(iPhones, Mac, iPads etc).

MS in computer science or equivalent

7+ years of experience as distributed systems engineer, platform engineer or equivalent

Systems & Backend Languages: Strong proficiency in languages optimized for concurrency and enterprise scale, such as Python (asyncio) or Java

API Design & Ecosystems: Deep expertise in designing robust, versioned production APIs using gRPC/Protobuf, GraphQL, or REST (FastAPI)

Preferred Qualifications

Relational & Analytical Databases: Strong experience modeling complex relational data and trace hierarchies using PostgreSQL, combined with high-throughput analytical query layers.

Orchestration & Messaging: Experience designing asynchronous, event-driven architectures using Kafka, AWS SQS/SNS, RabbitMQ, or Redis Streams.

Cloud Native Architecture: Advanced experience with Kubernetes (orchestration, custom operators, service meshes like Istio or Linkerd) and cloud providers (AWS, GCP, or Azure).

Experience building Agentic RAG platforms or developer-facing infrastructure tooling.

Infrastructure-as-Code (IaC): proficiency with Terraform to manage infrastructure declaratively.

CI/CD & DevEx: Experience building automated, containerized deployment pipelines (GitHub or ArgoCD) with an emphasis on keeping developer feedback loops fast and reliable.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.