> Markdown version of [/jobs/ext/2248715-azure-data-lead](https://www.wearedevelopers.com/jobs/ext/2248715-azure-data-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Data Lead

- **Company:** Saim Technologies
- **Location:** New York, NY, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Microsoft Azure, Cloud Engineering, Information Engineering, Extract Transform Load (ETL), Data Systems, Software Design Patterns, Distributed Systems, Apache Hive, Python (Programming Language), Microsoft SQL Server, SQL Azure, Object-Oriented Software Development, Oracle (Applications), Oracle SQL Developer, Performance Tuning, Azure Data Lake, Software Engineering, SQL Databases, Data Processing, Azure Data Factory, Apache Spark, Caching, Fastapi, Data Lakes, Pyspark, Data Lakehouse, Azure Synapse Analytics, Data Pipelines, Databricks
- **Published:** August 26, 2026
- **Apply:** https://www.dice.com/job-detail/f37cc42e-bc55-48df-a09b-9144cf386fa1

## About the Role

joins, Adaptive Query Execution, Delta optimization) and benchmark converted applications against original Python implementations. Core Skills Python (expert), OOP, and advanced Python design patterns PySpark, Spark SQL, and SQL Azure Databricks, Azure Data Factory, ADLS Gen2 Apache Spark, Delta Lake, Data Lakehouse architecture, distributed computing Must-have (per requisition): Python, Azure Databricks, Azure Data Factory (ADF), MS SQL, Oracle PL/SQL. Good to have: PySpark; certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python. Experience & Expected Outcome Senior data engineering leader with proven delivery of large-scale Databricks modernization programs. Expected outcome: existing Python applications converted into scalable, cost-efficient, enterprise-grade data solutions on Azure Databricks with proven performance parity.

## Description

Azure Senior Data Lead Leads modernization of Python applications into scalable PySpark solutions on Azure Databricks Role Purpose Lead the modernization and migration of existing Python object-oriented applications into scalable PySpark and Spark SQL data-processing solutions on Azure Databricks bringing a strong blend of software engineering, data engineering, cloud architecture, and performance optimization. Key Responsibilities Analyze existing Python OOP applications and redesign single-node processing logic for distributed Spark execution. Design, develop, and deploy enterprise-scale data pipelines on Azure Databricks; build reusable PySpark frameworks and utility modules. Implement Delta Lake solutions using the Bronze Silver Gold architecture. Build robust ETL/ELT pipelines with Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics. Implement data quality, reconciliation, validation, and monitoring frameworks. Optimize Spark jobs (partitioning, bucketing, caching, broadcast


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi)
- [HTTP headers that make your website go faster](https://www.wearedevelopers.com/videos/1676-http-headers-that-make-your-website-go-faster)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)