> Markdown version of [/jobs/ext/3519644-azure-data-engineer](https://www.wearedevelopers.com/jobs/ext/3519644-azure-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Azure Data Engineer - **Company:** STAFIDE - **Location:** Amsterdam, Netherlands - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Data Analysis, Automation of Tests, Microsoft Azure, Big Data, Cloud Database, Computer Programming, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Mining, Data Security, Data Systems, Database Queries, Python (Programming Language), Standard Sql, SQL Databases, Technical Data Management Systems, Data Processing, Azure Data Factory, Pyspark, Data Management, Data Pipelines, Databricks - **Published:** October 2, 2026 - **Apply:** https://www.adzuna.nl/details/5905659981 ## About the Role * 8-10 years of overall professional experience in data engineering, cloud data engineering, or related technology roles. * Strong hands-on experience with Azure Data Factory for data orchestration, movement, and transformation. * Strong experience with Azure Databricks for developing and managing scalable data processing solutions. * Strong programming skills in Python. * Hands-on experience with PySpark for large-scale data processing. * Experience implementing CI/CD pipelines using Azure DevOps. * Good knowledge of SQL and experience working with large datasets. * Experience developing and maintaining ETL/ELT data pipelines. * Understanding of data security, compliance, and cloud data engineering best practices. * Strong problem-solving and analytical skills. * Experience working independently as well as collaboratively within cross-functional teams. ## Description * Design, develop, and maintain complex and scalable data pipelines using Azure Data Factory (ADF) and Azure Databricks. * Build and optimize large-scale data processing solutions using PySpark and Databricks. * Develop robust ETL/ELT solutions in Python for data extraction, transformation, and loading. * Collaborate with cross-functional teams to understand data requirements and deliver efficient data engineering solutions. * Implement and maintain CI/CD pipelines using Azure DevOps for automated testing, integration, and deployment. * Develop, test, and maintain reliable data solutions aligned with technical and business requirements. * Monitor, troubleshoot, and optimize data pipelines to ensure performance, scalability, and reliability. * Work with large datasets and use SQL for data querying and data management. * Ensure data solutions follow applicable security, compliance, and engineering best practices. * Stay updated with the latest trends, technologies, and best practices in Azure cloud data engineering., * Design and develop scalable data pipelines using Azure Data Factory and Azure Databricks. * Develop efficient PySpark applications for processing and transforming large volumes of data. * Write clean, maintainable, and reusable Python-based data engineering solutions. * Build and manage automated CI/CD workflows in Azure DevOps. * Perform data extraction, transformation, loading, validation, and integration across different data sources. * Optimize data pipelines and Databricks workloads for performance and scalability. * Monitor pipelines, identify failures or bottlenecks, and implement appropriate solutions. * Troubleshoot data processing and pipeline-related issues effectively. * Write SQL queries for data analysis, transformation, and validation. * Work with stakeholders to understand requirements and translate them into technical data solutions. * Follow appropriate data security, governance, compliance, and development standards. * Document technical solutions, data processes, pipelines, and deployment procedures. * Adapt to new Azure services, cloud data engineering technologies, and industry best practices. What We Bring to the Table: * An opportunity to work on enterprise-scale Azure cloud data engineering projects. * Exposure to Azure Data Factory, Azure Databricks, PySpark, Python, Azure DevOps, and SQL. * Opportunities to design and optimize large-scale data pipelines and processing frameworks. * A collaborative environment involving cross-functional technical and business teams. * Opportunities to contribute to cloud data modernization, automation, and CI/CD initiatives. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)