Sr. Staff Software Engineer - Observability, Insights & Governance

Databricks
Mountain View, CA, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$228,600.0 - $314,250.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Data Analysis Databases Data Governance Data Structures Distributed Systems SQL Databases Datadog Large Language Models Backend Information Technology Data Analytics
+2 more
Dynatrace Databricks

Job description

At Databricks, observability and governance are what turn a massive, multi-tenant data and AI platform into one customers can trust at scale. We are looking for a senior technical leader to drive strategy and execution across three closely related teams at the heart of that mission: Query Observability, SQL Warehouse Management, and Account-Level Observability and Governance.

Query Observability builds the performance and observability tooling, ingesting very large volumes of query telemetry and turning it into history views, execution plans, performance insights, and recommendations that help customers run workloads reliably at scale. Beyond query observability, you will be responsible for building observability and actionable insights at compute level, workspace level, and account level so that admins can confidently manage large accounts.

This is a new technical leadership role responsible for setting the durable architecture across all these surfaces, raising the engineering bar of the combined team, and shaping the next generation of agentic experiences that let users - and the systems they run on - investigate, diagnose, and act on insights across query, warehouse, workspace, and account levels.

The Impact You Will Have

  • Establish the long-term technical direction across query observability, warehouse management, and account-level governance, and own the multi-year architecture all three surfaces are built on.
  • Design and lead high-impact projects that move the needle on performance, reliability, and cost transparency for customers.
  • Build the next generation of agentic observability and governance - extensible experiences that let users and automated agents investigate, diagnose, and act on telemetry across query, warehouse, and account.
  • Partner deeply with Databricks SQL, Unity Catalog, AI, security, and platform teams to integrate end-to-end visibility and governance across the data plane and control plane.
  • Mentor senior engineers, set the technical standards across the group, and recruit top talent into observability, insights, and governance.
  • Champion reliable, high-quality software and the operational practices that let a focused team confidently support product surfaces used by tens of thousands of customers.

Requirements

Do you have experience in Tooling?, Do you have a Bachelor’s degree?, * 12+ years building and operating large-scale distributed systems, observability or governance platforms, databases, or backend infrastructure.

  • A proven track record as a technical leader on teams operating in complex, multi-stakeholder environments - driving long-term architecture while still delivering incremental customer impact.
  • Deep computer science fundamentals (algorithms, data structures, systems design) applied to real-world, high-throughput problems.
  • Experience with one or more of: observability and telemetry pipelines, query engines and query analytics, distributed tracing and metrics, time-series storage, data governance, or large-scale logging systems.
  • Strong cross-functional communication skills - able to align engineering, product, and infrastructure partners across multiple teams on technical strategy and trade-offs.
  • BS in Computer Science or equivalent practical experience (MS/PhD a plus).
  • Bonus: experience building agentic experiences using LLMs .

Pay Range Transparency

Benefits & conditions

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above.

Zone 1 Pay Range $228,600-$314,250 USD, At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees.

About the company

Databricks is the data and AI company. More than 10,000 organizations worldwide - including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark , Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:36 min

Visualizing memory limits and isolating suspicious endpoints

Dina Matveev Dina Matveev · Europe 2026 Virtual

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:08 min

Analyzing error logs and root causes using artificial intelligence

Nishil Patel Nishil Patel · WWC 2025

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

Videos

See all

Related articles

See all