> Markdown version of [/jobs/ext/819877-sr-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/819877-sr-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr. Data Engineer (Databricks)

- **Company:** Insight Global
- **Location:** Los Angeles, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Amazon Web Services, Amazon S3, Big Data, Continuous Integration, Database Design, Github, Python (Programming Language), Performance Tuning, SQL Databases, Apache Spark, Real Time Data, Software Version Control, Data Pipelines, Databricks
- **Published:** June 23, 2026
- **Apply:** https://dejobs.org/x/x/DC0B12473F4E4423A75E3AA6E02801FB/job/

## About the Role

5-7+ years of experience as a data engineer with:

 * Strong, hands-on experience with Databricks (critical, primary platform)
 * Apache Spark for large-scale data processing
 * Advanced Python and SQL (performance tuning and complex transformations)
 * DBT for data modeling and pipeline development
 * Experience designing and maintaining robust data pipelines
 * Experience working under full CI/CD governance
 * Source control using GitHub
 * AWS exposure, including sourcing data from S3 - Familiarity with Airflow
 * Conceptual knowledge of tools such as Monte Carlo or Atlan
 * Experience supporting data quality, observability, or governance initiatives
 * Exposure to media, ad tech, or large-scale enterprise data
 * Experience optimizing both batch and real-time data workflows

## Description

The data engineer will be focused on building and optimizing scalable data pipelines, data models, and database designs that support analytics and operational use cases.

The ideal candidate is a high-throughput, senior-level data engineer who can ramp effectively, work within full CI/CD governance, and contribute at or above squad productivity once up to speed.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)