Azure Data Engineer

• Design, develop, and maintain robust data pipelines using Databricks, PySpark, Azure Data Factory, and Python.
• Implement scalable data solutions with a strong focus on data governance, data quality, and data lineage.
• Develop and optimize data processing workflows to support reliable and high-quality data delivery.
• Work with cloud-based data engineering technologies to build and maintain enterprise-grade data solutions., * Exposure to modern data technologies including Databricks, PySpark, Azure Data Factory, and Python.
• Opportunity to contribute to data governance, data quality, and data lineage initiatives.
• A professional environment focused on building robust and scalable data solutions.

• 10+ years of experience in Data Engineering.
• Strong hands-on experience with Databricks.
• Strong experience with PySpark.
• Experience with Azure Data Factory (ADF).
• Strong Python scripting skills.
• Experience implementing data governance, data quality, and data lineage.
• Proven experience designing and maintaining robust data pipelines.

You should possess the ability to:

• Build scalable and reliable data pipelines.
• Apply data governance and data quality principles across data solutions.
• Implement effective data lineage practices.
• Develop efficient data processing solutions using PySpark and Python.
• Work effectively with Databricks and Azure Data Factory.
• Troubleshoot and optimize data pipelines and processing workflows.