> Markdown version of [/jobs/ext/1557847-lead-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/1557847-lead-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer- Databricks - **Company:** Marktplaats BV - **Location:** Amsterdam, Netherlands - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Data Validation, Information Engineering, Data Governance, Database Applications, Python (Programming Language), Simple Data Format, Software Engineering, SQL Databases, Parquet, Apache Spark, Containerization, Data Lakes, Pyspark, Kubernetes, Data Management, Machine Learning Operations, Terraform, Docker, Databricks - **Published:** July 15, 2026 - **Apply:** https://www.adzuna.nl/details/5726347291 ## About the Role For this position the ideal candidate has 10+ years of hands-on experience in Software Development/Data Engineering. Prior experience building and operating data platforms is a plus. * Experience with Databricks (Lakehouse, ML/MosaicAI, Unity Catalog, MLflow, Mosaic AI, model serving etc). * Proven experience on building cloud native data intensive applications (both real time and batch based). AWS experience is preferred. * Strong background in Data Engineering to support other Data Engineers, Back Enders and Data Scientists in building data products and services. * Hands-on experience of building and maintaining Spark applications. Python and PySpark(Scala Spark is a plus) * Experienced in AWS Cloud usage and data management (automation, data governance, cost optimisation, delivering reliable & scalable data solutions) * Ensure data quality, schema governance and monitoring across pipelines. * Experience with orchestrators such as Airflow, Databricks workflows. * Solid experience with containerization and orchestration technologies (e.g., Docker, Kubernetes). * Fundamental understanding of various Parquet, Delta Lake and other OTFs file formats. * Proficiency on an IaC tool such as Terraform or Terragrunt. * Data validation/analysis skills & proficiency in SQL is considered as a foundational skill. * Collaborate in a small, fast moving team with high levels of autonomy and impact. * Strong written and verbal English communication skill and proficient in communicating with non-technical stakeholders. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Best Companies in the Netherlands: Top 25 Companies in 2023 ](https://www.wearedevelopers.com/magazine/193-best-companies-in-the-netherlands-top-25-companies-in-2023) - [Software Developer Salary in The Netherlands [2023]](https://www.wearedevelopers.com/magazine/217-software-developer-salary-in-the-netherlands-2023) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Find Tech Jobs in Amsterdam](https://www.wearedevelopers.com/magazine/279-how-to-find-tech-jobs-in-amsterdam) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [How to land a developer job in Amsterdam](https://www.wearedevelopers.com/magazine/36-how-to-land-a-developer-job-in-amsterdam)