> Markdown version of [/jobs/ext/4447321-systems-engineer-evaluation-engineering](https://www.wearedevelopers.com/jobs/ext/4447321-systems-engineer-evaluation-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Systems Engineer - Evaluation Engineering - **Company:** Apple Inc. - **Location:** Cupertino, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Test Suite, Application Programming Interfaces (APIs), Amazon Web Services, Systems Engineering, Microsoft Azure, Cloud Engineering, Databases, Continuous Integration, Relational Databases, Distributed Systems, Fault Tolerance, Github, Protocol Buffers, Python (Programming Language), PostgreSQL, Microsoft Message Queuing, RabbitMQ, Redis, Google Cloud, Istio, Retrieval-Augmented Generation, Delivery Pipeline, Concurrency, Siri, Fastapi, Event Driven Architecture, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Apache Kafka, Build Tools, Linkerd (Service Mesh), Graphql, Api Design, Terraform - **Published:** October 24, 2026 - **Apply:** https://www.dice.com/job-detail/0359bd71-fba6-4c7f-bc1b-2b4964f677d0 ## About the Role MS in computer science or equivalent 7+ years of experience as distributed systems engineer, platform engineer or equivalent. Systems & Backend Languages: Strong proficiency in languages optimized for concurrency and enterprise scale, such as Python (asyncio) or Java. API Design & Ecosystems: Deep expertise in designing robust, versioned production APIs using gRPC/Protobuf, GraphQL, or REST (FastAPI). Cloud Native Architecture: Advanced experience with Kubernetes (orchestration, custom operators, service meshes like Istio or Linkerd) and cloud providers (AWS, Google Cloud Platform, or Azure). Preferred Qualifications Relational & Analytical Databases: Strong experience modeling complex relational data and trace hierarchies using PostgreSQL, combined with high-throughput analytical query layers. Orchestration & Messaging: Experience designing asynchronous, event-driven architectures using Kafka, AWS SQS/SNS, RabbitMQ, or Redis Streams. Experience building Agentic RAG platforms or developer-facing infrastructure tooling. Infrastructure-as-Code (IaC): proficiency with Terraform to manage infrastructure declaratively. CI/CD & DevEx: Experience building automated, containerized deployment pipelines (GitHub or ArgoCD) with an emphasis on keeping developer feedback loops fast and reliable. ## Description Siri Agentic Evaluation Platform. Evaluation is no longer just a static test suite-it is a highly dynamic, massive-scale distributed problem. Our platform enables teams to run high-throughput agentic simulations, orchestrate multi-model judging pipelines, and generate real-time observability dashboards across billions of tokens and complex data types., In this role, you will design the execution engine that coordinates these complex evaluation loops. You will build systems that remain deterministic, fault-tolerant, and cost-efficient, even when coordinating massive parallel requests across heterogeneous device types(iPhones, Mac, iPads etc).