> Markdown version of [/jobs/ext/3013920-sr-databricks-engineer](https://www.wearedevelopers.com/jobs/ext/3013920-sr-databricks-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Databricks Engineer - **Company:** Diverse Lynx LLC - **Location:** Louisville, KY, United States - **Experience:** Expert - **Salary:** $124,800.0 - $135,200.0 - **Contract:** Temporary to permanent - **Skills:** Microsoft Azure, Cloud Storage, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Transformation, Data Systems, Data Warehousing, DevOps, Dimensional Modeling, Apache Hive, Python (Programming Language), Performance Tuning, Azure Data Lake, SQL Databases, Unstructured Data, Data Ingestion, Azure Data Factory, Apache Spark, Git, Data Lakes, Pyspark, Deployment Automation, Video Streaming, Stream Processing, Azure Synapse Analytics, Software Version Control, Data Pipelines, Databricks - **Published:** September 20, 2026 - **Apply:** https://www.careerjet.com/job/usbc8d907cfd629cc449cbd49655346a32/eaa ## About the Role * 6+ years of experience in Data Engineering. * 3+ years of hands-on experience with Azure Databricks. * Strong expertise in PySpark, Spark SQL, and Delta Lake. * Experience with Azure Data Factory (ADF). * Strong knowledge of Azure Data Lake Storage (ADLS). * Experience with data warehousing concepts and dimensional modeling. * Proficiency in SQL and Python. * Experience with Git-based version control systems. * Understanding of CI/CD processes and DevOps practices. * Strong problem-solving and analytical skills. Preferred Skills: * Experience with Delta Live Tables (DLT). * Knowledge of Unity Catalog and Databricks governance frameworks. * Exposure to Azure Synapse Analytics. * Experience with streaming technologies and real-time data processing. * Databricks or Azure Cloud certifications. ## Description * We are looking for a highly skilled Senior Databricks Engineer with strong hands-on experience in Azure Cloud and Azure Databricks . * The ideal candidate will be responsible for designing, developing, and Eligible to workimizing scalable data engineering solutions, building robust data pipelines, and supporting enterprise analytics and data platform initiatives., * Design, develop, and maintain scalable data pipelines using Azure Databricks . * Develop ETL/ELT workflows for processing large volumes of structured and unstructured data. * Work with Azure Data Lake Storage (ADLS Gen2), Azure Blob Storage, and other Azure data services. * Implement data transformation and processing using PySpark, Spark SQL, and Databricks notebooks. * Eligible to workimize Spark jobs for performance, scalability, and cost efficiency. * Collaborate with business stakeholders, data architects, and analytics teams to deliver data solutions. * Build and manage data ingestion frameworks from multiple source systems. * Implement CI/CD pipelines and deployment automation for Databricks workloads. * Ensure data quality, governance, security, and compliance standards are followed. * Troubleshoot production issues and provide performance tuning recommendations. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)