> Markdown version of [/jobs/ext/1899430-software-engineer-evaluation-infrastructure-organization](https://www.wearedevelopers.com/jobs/ext/1899430-software-engineer-evaluation-infrastructure-organization). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, Evaluation Infrastructure Organization

- **Company:** WAABI PARTNERS
- **Location:** San Francisco, CA, United States (Remote available)
- **Experience:** Expert
- **Salary:** $127,000.0 - $223,000.0
- **Contract:** Permanent contract
- **Skills:** Training Data, Artificial Intelligence, Big Data, Cloud Computing, Databases, Computer Literacy, Data Files, Extract Transform Load (ETL), Distributed Systems, Python (Programming Language), Machine Learning, Systems Development Life Cycle, Requirements Management, Software Engineering, Web Services, Data Processing, Scripting, System Availability, Generative AI, Information Technology, Code Testing, Data Management, Data Pipelines
- **Published:** July 31, 2026
- **Apply:** https://www.careerbuilder.com/job-details/senior-software-engineer-evaluation-infrastructure-san-francisco-ca--864ed2c7-8ce5-4a6c-9771-2a6dcce7fd0f

## About the Role

MS/Bachelors degree with 2+ years of industry experience in Computer Science, Machine Learning and/or similar technical field(s) of study.

 - Proficient in Python programming and strong software engineering fundamentals with real-world experience writing high quality, well-structured, and well-tested code.

 - Open-minded and collaborative team player with the willingness to help others.

 - Passionate about self-driving technologies, solving hard problems, and creating innovative solutions.

Bonus Points:

 - Experience in data processing pipelines, ETL pipelines, distributed computing.

 - Experience in building highly reliable and scalable web services

 - Understanding of cloud job orchestration, monitoring, and instrumentation best-practices.

 - Experience in evaluating complex ML models or self-driving software stacks., Algorithms, Analysis Skills, Artificial Intelligence (AI), Best Practices, Cloud Computing, Computer Science, Computer Skills, Data Management, Data Processing, Data Sets, Database Extract Transform and Load (ETL), Disability Accommodations, Distributed Computing, Establish Priorities, High Availability, Instrumentation, Interviewing Skills, Legal, Logistics, Machine Learning, Machine Tool, Metrics, Military, Performance Analysis, Performance Modeling, Problem Solving Skills, Project Planning, Python Programming/Scripting Language, Requirements Management, Scalable System Development, Simulation, Software Engineering, Software Evaluation, Startup, Statistics, Team Building, Team Player, Technical Delivery, Training Data Sets, Web Services

## Description

The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system's performance across all development stages. In this role, you will work closely with the systems & safety teams, responsible for defining the requirements & evaluation criteria, and simulation teams to leverage Waabi World, our highly realistic closed-loop simulation engine built with the latest in generative AI technologies to deliver the evaluation capabilities needed to support the safe development of the next generation of autonomous vehicles!

You will…

 - Develop the tooling, infrastructure, and pipelines to support complex statistical analyses of driving performance scale.

 - Implement metrics and tags to provide a holistic understanding of model performance and enable the discovery of interesting scenarios for training and evaluation.

 - Develop and maintain a high availability query service to enable low-latency analysis and curation over large volumes of metric and tag data

 - Work with large datasets from various sources including real world driving as well as Waabi World, our high-fidelity simulator.

 - Champion engineering excellence, ensuring high-quality, well structured and tested code.

 - Assist in project roadmap planning, prioritisation, and delivery.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Data Science, ML & AI in the Oil and Gas Industry at NDT Global - Dr. Katja Träumner](https://www.wearedevelopers.com/videos/1308-data-science-ml-ai-in-the-oil-and-gas-industry-at-ndt-global-dr-katja-traumner)
- [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases)
- [JavaScript? No. Java Scripts! - Scripting with Java](https://www.wearedevelopers.com/videos/2094-javascript-no-java-scripts-scripting-with-java)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1146-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Best Coding Boot Camps in Germany](https://www.wearedevelopers.com/magazine/237-best-coding-boot-camps-in-germany)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [Best Countries for Software Engineers](https://www.wearedevelopers.com/magazine/267-best-countries-for-software-engineers)