Senior Software Engineer, Compute Infrastructure

As an engineer on this team, you won’t just manage infrastructure; you will build it as a product. You will tackle the hard problems of distributed systems: sub-second container/MicroVM startup times, multi-tenant security isolation, and building a unified orchestration layer that scales across AWS, Azure, and GCP. What You’ll Do

• Design and build the next generation of our Serverless platform, focusing on high availability, low latency, and scale-to-zero efficiency.
• Build a single compute stack that supports heterogeneous workloads, including GPU instance qualification for AI training and stateful execution for Lakebase.
• Solve Multi-Cloud Complexity: Develop platform-level abstractions that allow Databricks to run seamlessly across all major cloud providers.
• Optimize everything from the API gateway down to the host-level networking and container orchestration.
• Work alongside industry experts who have built world-class systems like Borg, Kubernetes, and Uber’s infrastructure.

• 5+ years of production-level experience in one of: Python, Java, Scala, C++, or a similar language
• 4+ years of experience developing large-scale distributed systems from scratch
• Experience with Kubernetes, Docker, or MicroVM technologies (e.g., Firecracker) and a strong grasp of cloud provider internals (AWS/Azure/GCP).
• You aren’t just a user of tools; you understand how to build them from the ground up when existing solutions fail at our scale.

Multi-cloud is core to Databricks product strategy. Compute serves as the layer that abstracts the cloud from the rest of the company. Building unified infrastructure on top of heterogeneous clouds is a challenge that few companies experience.