> Markdown version of [/jobs/ext/42969-azure-databricks-engineer](https://www.wearedevelopers.com/jobs/ext/42969-azure-databricks-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Azure Databricks Engineer - **Company:** Stafide - **Location:** Amsterdam, Netherlands - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Microsoft Azure, Information Engineering, Data Systems, Python (Programming Language), SQL Databases, Data Streaming, YAML, Data Processing, Parallel Computation, Technical Debt, Pyspark, Bicep, Data Pipelines, Databricks - **Published:** May 28, 2026 - **Apply:** https://www.careerjet.nl/jobad/nlf08483d1ca54dacc51d469b04ceb9237 ## About the Role * 8-10 years of overall professional experience, with strong expertise in Azure Databricks and Data Engineering. * Deep hands-on experience with Azure Databricks as the primary technology platform. * Strong proficiency in Python, PySpark, and SQL. * Proven experience building and managing streaming and batch data processing solutions. * Strong experience designing and maintaining scalable Databricks data models and architectures. * Solid understanding of Azure cloud services and YAML-based CI/CD pipelines. * Hands-on experience with Infrastructure as Code (ARM/Bicep). * Experience working within Agile methodologies and delivery environments. * Broader understanding of modern end-to-end data solution architectures is an advantage. * Strong communication and collaboration skills. You Should Possess the Ability to: * Build scalable, high-performance, and reliable data processing solutions. * Design pragmatic and maintainable architectures while avoiding unnecessary complexity. * Manage multiple data workloads and parallel processing scenarios efficiently. * Troubleshoot, optimize, and improve complex data environments. * Make well-informed technical decisions in evolving architectural landscapes. * Collaborate effectively across engineering and business teams. * Drive continuous improvement with a strong quality-first mindset. ## Description * Design, develop, and maintain scalable and reliable data processing solutions using Azure Databricks. * Build and manage robust streaming and batch data pipelines within complex Databricks environments. * Design and optimize data models to support scalable processing and performance requirements. * Manage multiple parallel data processing workflows using shared source datasets. * Develop and maintain data transformation logic using Python, PySpark, and SQL. * Implement and manage CI/CD pipelines using Azure and YAML-based configurations. * Utilize Infrastructure as Code (ARM/Bicep) for deployment and infrastructure automation. * Collaborate with cross-functional teams to ensure high-quality, maintainable, and reliable solutions. * Continuously improve system stability, performance, and engineering practices while minimizing technical debt. * Contribute actively within Agile teams to deliver scalable and sustainable data solutions. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Back(end) to the Future: Embracing the continuous Evolution of Infrastructure and Code](https://www.wearedevelopers.com/videos/440-back-end-to-the-future-embracing-the-continuous-evolution-of-infrastructure-and-code) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Software Developer Salary in The Netherlands [2023]](https://www.wearedevelopers.com/magazine/217-software-developer-salary-in-the-netherlands-2023)