DataBricks Lead

We are seeking a highly experienced DataBricks Lead with deep expertise in Azure and Databricks to design and implement scalable, high-performance lakehouse solutions within a manufacturing environment. The ideal candidate will drive end-to-end data architecture, ensuring robust data ingestion, governance, quality, and performance., * Design and implement scalable, secure, and high-performance data architectures on Azure Databricks

• Develop and optimize data pipelines, ingestion frameworks, and lakehouse solutions
• Implement robust data quality, validation, and testing frameworks
• Lead Teradata to Databricks migration initiatives, ensuring data integrity and performance
• Define and manage metadata structures and governance frameworks
• Ensure data governance, security, and compliance using Unity Catalog and Azure tools
• Collaborate with cross-functional teams, business stakeholders, and engineering teams
• Drive performance tuning and cost optimization across the data platform

• Strong expertise in Databricks and Apache Spark (PySpark/Scala)
• Hands-on experience with Delta Lake and Medallion Architecture (Bronze/Silver/Gold)
• Extensive experience with Microsoft Azure services (ADLS, ADF, Synapse, Event Hubs)
• Proven experience in Data Ingestion frameworks (batch and streaming)
• Strong implementation experience in Data Quality (DQ) frameworks
• Deep understanding of metadata management and metadata table structures
• Experience in Teradata migration to Databricks/Azure platforms
• Solid expertise in validation and testing approaches for data pipelines
• Knowledge of Unity Catalog and data governance best practices
• Strong SQL skills and data modeling experience (star/snowflake schemas)
• Experience with CI/CD pipelines (Azure DevOps, GitHub Actions), * Experience in Manufacturing or Automotive domain
• Relevant Azure and Databricks certifications
• Strong leadership and stakeholder management skills

At Staffworxs, we don t just connect talent we power transformation. Headquartered in Frisco, TX, with teams in Bengaluru and Hyderabad, we combine global reach with deep expertise. Our Digital & Data Analytics practice drives growth and innovation for some of the world s top brands, who continue to retain us as their trusted partner. If you re ready to make an impact, you re in the right place.