Sr. Databricks Engineer

• We are looking for a highly skilled Senior Databricks Engineer with strong hands-on experience in Azure Cloud and Azure Databricks .
• The ideal candidate will be responsible for designing, developing, and Eligible to workimizing scalable data engineering solutions, building robust data pipelines, and supporting enterprise analytics and data platform initiatives., * Design, develop, and maintain scalable data pipelines using Azure Databricks .
• Develop ETL/ELT workflows for processing large volumes of structured and unstructured data.
• Work with Azure Data Lake Storage (ADLS Gen2), Azure Blob Storage, and other Azure data services.
• Implement data transformation and processing using PySpark, Spark SQL, and Databricks notebooks.
• Eligible to workimize Spark jobs for performance, scalability, and cost efficiency.
• Collaborate with business stakeholders, data architects, and analytics teams to deliver data solutions.
• Build and manage data ingestion frameworks from multiple source systems.
• Implement CI/CD pipelines and deployment automation for Databricks workloads.
• Ensure data quality, governance, security, and compliance standards are followed.
• Troubleshoot production issues and provide performance tuning recommendations.

• 6+ years of experience in Data Engineering.
• 3+ years of hands-on experience with Azure Databricks.
• Strong expertise in PySpark, Spark SQL, and Delta Lake.
• Experience with Azure Data Factory (ADF).
• Strong knowledge of Azure Data Lake Storage (ADLS).
• Experience with data warehousing concepts and dimensional modeling.
• Proficiency in SQL and Python.
• Experience with Git-based version control systems.
• Understanding of CI/CD processes and DevOps practices.
• Strong problem-solving and analytical skills.

Preferred Skills:

• Experience with Delta Live Tables (DLT).
• Knowledge of Unity Catalog and Databricks governance frameworks.
• Exposure to Azure Synapse Analytics.
• Experience with streaming technologies and real-time data processing.
• Databricks or Azure Cloud certifications.