> Markdown version of [/jobs/ext/2812100-azure-databricks-engineer](https://www.wearedevelopers.com/jobs/ext/2812100-azure-databricks-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Azure Databricks Engineer - **Company:** Stafide - **Location:** Amsterdam, Netherlands - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Microsoft Azure, Continuous Integration, Data Architecture, Information Engineering, Data Transformation, Data Systems, Python (Programming Language), Scaled Agile Framework, SQL Databases, Data Streaming, YAML, Data Processing, Reliability of Systems, Infrastructure as Code (IaC), Pyspark, Infrastructure Automation Frameworks, Deployment Automation, Bicep, Data Pipelines, Databricks - **Published:** September 10, 2026 - **Apply:** https://www.careerjet.nl/job/nlcbc9e92f1552cd144bd57dd4ab101ade/eaa ## About the Role * Strong hands-on experience with Azure Databricks as a core data engineering platform. * Strong proficiency in Python, PySpark, and SQL. * Hands-on experience developing batch and streaming data pipelines. * Experience with data modeling, transformation, and optimization within Databricks environments. * Good understanding of Azure cloud services relevant to data engineering. * Experience with Azure DevOps, CI/CD, and YAML-based pipeline configurations. * Hands-on experience with Infrastructure as Code, particularly ARM/Bicep. * Experience working in Agile engineering and delivery environments. * Understanding of modern cloud-based data architectures and end-to-end data engineering solutions. * Strong communication, collaboration, troubleshooting, and problem-solving skills. You Should Possess the Ability to: * Build scalable, high-performance, and reliable data processing solutions using Azure Databricks. * Develop efficient PySpark and SQL-based data transformations. * Design and manage complex batch and streaming workloads. * Optimize data pipelines, processing performance, and resource utilization. * Troubleshoot complex data engineering issues and improve system reliability. ## Description * Design, develop, and maintain scalable and reliable data processing solutions using Azure Databricks. * Build and manage robust batch and streaming data pipelines within Databricks environments. * Develop and optimize data transformation and processing solutions using Python, PySpark, and SQL. * Design and optimize data models to support scalable processing, performance, and reliability. * Manage multiple parallel data processing workflows and shared data sources efficiently. * Implement and maintain CI/CD pipelines using Azure DevOps and YAML-based configurations. * Apply Infrastructure as Code (IaC) using ARM/Bicep for deployment and infrastructure automation. * Monitor, troubleshoot, and optimize data processing workloads and Databricks environments. * Collaborate with cross-functional engineering and business teams to deliver reliable and maintainable data solutions. * Contribute to Agile development practices and continuously improve engineering standards, system stability, and performance. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Back(end) to the Future: Embracing the continuous Evolution of Infrastructure and Code](https://www.wearedevelopers.com/videos/440-back-end-to-the-future-embracing-the-continuous-evolution-of-infrastructure-and-code) - [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Software Developer Salary in The Netherlands [2023]](https://www.wearedevelopers.com/magazine/217-software-developer-salary-in-the-netherlands-2023)