Cloud Architect

• Build a realistic digital workspace centered on the Drive folders you use daily. Include architecture docs, runbooks, RFCs, incident post-mortems, capacity plans, cost reports, SRE review decks, and email threads. Represent platforms like HashiCorp Terraform, Datadog/Splunk, GitHub Actions, and Okta.
• Design multi-step tasks grounded in your real workflows. Require navigation of multiple apps, files, and stakeholders to challenge frontier AI agents.
• Collaborate with other cloud-computing experts to design environments, shape task scope, and review scenarios for realism and rigor.
• Work asynchronously with research teams to refine task designs and evaluation criteria for cloud-computing agent benchmarks.
• Contribute to frontier AI research and benchmarking. Your work directly informs how leading labs train and evaluate the next generation of AI systems., PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Must-Have

• 3+ years of full-time experience at a major hyperscaler (AWS, Azure, GCP, Oracle Cloud), a cloud-data platform (Snowflake, Databricks), or a Fortune 500 platform/infrastructure team.
• Background in cloud architecture, site reliability engineering, platform engineering, DevOps/DevSecOps, or cloud FinOps.
• Day-to-day use of HashiCorp Terraform/Pulumi, Splunk/Datadog, GitHub Actions/CircleCI, and Okta/Microsoft Entra ID.
• Strong analytical thinking and writing skills.

Preferred

• Certifications: AWS Solutions Architect/SysOps/DevOps, Azure Solutions Architect, GCP Professional Cloud Architect, CKA/CKAD.