> Markdown version of [/jobs/ext/516217-database-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/516217-database-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Database Engineer - Databricks

- **Company:** Profiles
- **Location:** Irvine, CA, United States
- **Experience:** Experienced
- **Salary:** $150,000.0
- **Contract:** Temporary to permanent
- **Skills:** Artificial Intelligence, Airflow, Databases, Directed Acyclic Graph (Directed Graphs), Information Engineering, Software Debugging, Distributed Data Store, Python (Programming Language), Microsoft SQL Server, Query Optimization, Standard Sql, SQL Databases, Data Streaming, Connectivity Problems, Apache Spark, Indexer, Data Lakes, Pyspark, Databricks
- **Published:** June 13, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=9347ce44f6eb275f

## About the Role

Do you have experience in Spark?, * 3+ years of hands-on data engineering experience in a production environment.

 * Deep Databricks expertise including notebooks, Jobs, Workflows, Unity Catalog governance, and Databricks Certification.
 * Strong Python, PySpark, and SQL skills for building and debugging distributed data transformations.
 * Solid MSSQL/SQL Server experience with focus on query optimization, indexing, and performance diagnostics.
 * Production experience with Apache Airflow - authoring, scheduling, and debugging DAGs.

## Description

* Own day-to-day operation and reliability of Databricks jobs, pipelines, compute/cluster configuration, Delta Lake tables, and SQL warehouses.
 * Develop and optimize Spark transformations across bronze/silver/gold medallion layers including incremental loads via Auto Loader and Structured Streaming.
 * Administer governance and access through Unity Catalog consistent with PII containment in a regulated lending environment.
 * Monitor and control DBU consumption and cluster costs through alerting and right-sizing to keep platform spend predictable.
 * Diagnose and resolve pipeline failures, data quality issues, schema drift, and connectivity problems end-to-end while maintaining runbooks and documentation.

About Profiles:
An award-winning creative and marketing workforce solutions provider. For 25+ years, Profiles has combined deep industry expertise with forward-thinking innovation to help organizations build, scale, and transform their teams. Anyone can fill a role. What we do goes beyond this, supporting workforce strategies that drive competitive advantage in an AI-powered landscape. Offering contract, contract to hire, direct hire, embedded teams, and consulting services nationwide. Join our network. New job opportunities are listed daily - careerprofiles.com.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)