> Markdown version of [/jobs/ext/1977380-senior-data-engineer-azure-databricks](https://www.wearedevelopers.com/jobs/ext/1977380-senior-data-engineer-azure-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer (Azure Databricks)

- **Company:** Akaasa Technologies
- **Location:** Houston, TX, United States
- **Experience:** Expert
- **Salary:** $140,000.0 - $150,000.0
- **Contract:** Temporary to permanent
- **Skills:** Unity 3d, Microsoft Azure, Continuous Integration, Data Architecture, Data Governance, Extract Transform Load (ETL), Data Systems, Standard Sql, DataOps, Scala (Programming Language), SQL Databases, YAML, Enterprise Data Management, Data Processing, Azure Data Factory, Data Lakes, Pyspark, Deployment Automation, Data Management, Data Pipelines, Alteryx, Databricks
- **Published:** August 7, 2026
- **Apply:** https://www.careerjet.com/jobad/us8ab80e138365a273fcbb08947a59683e

## About the Role

* Strong hands-on experience with Azure Databricks engineering and development.
 * Expertise in building data pipelines using:

 * PySpark
 * SQL
 * Scala
 * Delta Lake
 * Experience with Databricks Workflows and Jobs for production orchestration.
 * Strong knowledge of Databricks Unity Catalog including governance, security, and lineage.
 * Experience with Azure DevOps, CI/CD pipelines, YAML, and deployment automation.
 * Experience migrating legacy data solutions into modern cloud data platforms.
 * Strong understanding of enterprise data architecture and data engineering best practices.

Others Qualifications / Certifications

 * Databricks certifications highly preferred:

 * Databricks Certified Data Engineer Associate
 * Databricks Certified Data Engineer Professional
 * Microsoft certifications preferred:

 * Azure Data Engineer Associate (DP-203)
 * Azure Fundamentals (AZ-900) or equivalent Azure knowledge
 * Experience converting Alteryx workflows into PySpark/SQL solutions is a major plus.
 * Familiarity with legacy ETL modernization and reverse-engineering existing workflows.

## Description

Our client is seeking a Senior Data Engineer with deep hands-on expertise in Azure Databricks to design, develop, and manage enterprise-scale data platforms. The ideal candidate will have strong experience with Databricks Workflows, Delta Lake, PySpark, Unity Catalog, Azure DevOps, and CI/CD automation.
This role will focus on building code-driven data solutions, modernizing legacy data platforms, and migrating existing workflows into scalable Databricks-based architectures., * Design, develop, and optimize end-to-end data pipelines using Azure Databricks, Delta Lake, PySpark, SQL, and Scala.

 * Build and manage production workflows using Databricks Workflows and Jobs for pipeline orchestration and automation.
 * Lead migration efforts from legacy data platforms into modern Databricks environments.
 * Convert legacy ETL workflows (including Alteryx workflows) into scalable PySpark/SQL-based solutions.
 * Implement data governance, security, access controls, schemas, and lineage using Databricks Unity Catalog.
 * Develop and maintain CI/CD processes for Databricks deployments using Azure DevOps, YAML pipelines, and automation frameworks.
 * Optimize data processing performance, reliability, and scalability across enterprise data platforms., Need Azure Engineer Location: Houston ,TX/ Cleveland, OH Duration: 12 Months The primary purpose of this position is to provide technical leadership and engineering support fo…
 + 28 days ago
+


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)