> Markdown version of [/jobs/ext/3571101-databricks-data-engineer](https://www.wearedevelopers.com/jobs/ext/3571101-databricks-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Databricks Data Engineer

- **Company:** Insight Global
- **Location:** Dania Beach, FL, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Clean Code Principles, Adaptable Database Systems, Application Programming Interfaces (APIs), Microsoft Azure, Databases, Continuous Integration, Information Engineering, Data Governance, Data Integrity, Extract Transform Load (ETL), Data Mining, Data Retrieval, DevOps, Interoperability, Python (Programming Language), Microsoft SQL Server, Performance Tuning, Query Optimization, Cloud Services, Azure DevOps Pipelines, SQL Databases, SQL Server Agent, SQL Server Integration Services, Data Streaming, Transact-SQL, Data Processing, Azure Data Factory, Sql Optimization, Database Optimization, Database Performance, Git, Data Lakes, Pyspark, Data Lineage, Data Analytics, Microsoft Tfs, Restful APIs, Software Version Control, Data Pipelines, Databricks
- **Published:** October 3, 2026
- **Apply:** https://www.techcareers.com/job.asp?id=3417380383&tx=KL6767FFJ&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54

## About the Role

§ 6+ years of hands-on expertise with Azure Databricks, Python, PySpark, and Delta Lake. § 6+ years of proven experience with Azure Data Factory for orchestrating and monitoring pipelines. § STRONG T-SQL Coding! There will be a coding excersize on interview § Strong SQL Server / T-SQL experience with a focus on query optimization, indexing strategies, and coding best practices. § Demonstrated experience in SSIS package design, deployment, and performance tuning. § Hands-on knowledge of Unity Catalog for governance. § Experience with Git (Azure DevOps Repos) and CI/CD practices in data engineering projects. * Microsoft Certified: Azure Data Engineer Associate (DP-203) * Microsoft Certified: Azure Solutions Architect Expert or equivalent advanced Azure certification * Databricks Certified Data Engineer Associate or Professional Additional Microsoft SQL Server or Azure certifications demonstrating advanced database and cloud expertise

## Description

? Data Pipeline Development: Design, build, and optimize ETL/ELT pipelines using Azure Databricks (PySpark, Delta Lake) and Azure Data Factory (ADF). ? Data Flows & Transformations: Develop pipelines, data flows, and complex transformations with ADF, PySpark, and T-SQL for seamless data extraction, transformation, and loading. ? Data Processing: Develop Databricks Python notebooks for tasks such as joining, filtering, and pre-aggregation. ? Database & Query Optimization: Optimize database performance through SQL query tuning, index optimization, and code improvements to ensure efficient data retrieval and manipulation. ? SSIS & Migration Support: Maintain and enhance SSIS package design and deployment for legacy workloads; contribute to migration and modernization into cloud-native pipelines. ? Collaboration & DevOps: Work with cross-functional teams using Git (Azure Repos) for version control and Azure DevOps pipelines (CI/CD) for deployment. ? Data Governance & Security:
Partner with governance teams to integrate Microsoft Purview and Unity Catalog for cataloging, lineage tracking, and role-based security. ? API & External Integration: Implement REST APIs to retrieve analytics data from diverse external data feeds, enhancing accessibility and interoperability. ? Automation: Automate ETL processes and database maintenance tasks using SQL Agent Jobs, ensuring data integrity and operational reliability. ? Advanced SQL Expertise: Craft and optimize complex T-SQL queries to support efficient data processing and analytical workloads.