Senior Data Engineer
Role details
Job location
Tech stack
Job description
- Streamlining and optimizing Azure DevOps pipelines
- Developing and maintaining Infrastructure as Code (IaC) on Azure
- Collaborating with engineers and squads to define clear technical requirements
- Setting up and promoting DevOps best practices
- Providing test automation support
- Improving deployment, monitoring and operational processes..
Requirements
Do you have experience in Scalability?, We are looking for a Senior DevOps Engineer with strong experience in Azure Cloud platforms. You take ownership, value standards, and have a proactive mindset towards automation, reliability and scalability., * Minimum 5 years of experience as a Platform / DevOps Engineer
-
Strong hands-on experience with Azure Cloud and Azure DevOps
-
Experience with Databricks and Apache Airflow
-
Programming experience with Python and PySpark
-
Proven experience in automating deployment and operational workflows
-
Strong communication skills and ability to coach and support fellow DevOps engineers
-
Comfortable working in a complex, high-impact and fast-paced environment
-
Write Python logic to produce data to central data lake
-
Implement data transfer controls to ensure high data quality
-
Provide automated insights in the health of daily batch system
-
Collaborating with other team members, squads and defining clear requirements
-
Setting up and guiding the team towards best practices
-
Streamlining Airflow operations