> Markdown version of [/jobs/ext/2725114-apache-spark-specialist](https://www.wearedevelopers.com/jobs/ext/2725114-apache-spark-specialist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Apache Spark Specialist - **Company:** Nebul - **Location:** Amsterdam, Netherlands - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Airflow, Cloud Computing, Cloud Computing Security, Continuous Integration, Information Engineering, Distributed Data Store, Apache Hadoop, Python (Programming Language), Open Source Technology, Performance Tuning, Prometheus, Data Processing, Grafana, Apache Spark, Caching, Electronic Medical Records, Data Lakes, Kubernetes, Infrastructure Automation Frameworks, Machine Learning Operations, Databricks - **Published:** September 5, 2026 - **Apply:** https://startup.jobs/big-data-engineer-spark-nebul-8164008 ## About the Role * 4-7 years of experience working with Apache Spark in production environments. * Strong deep-dive knowledge of Spark internals: performance tuning, partition strategies, caching, and shuffle management. * Hands-on deployment experience in Kubernetes, cloud infrastructure, or on-prem clusters. * Solid understanding of distributed data platforms (e.g., Databricks, EMR, Hadoop, Lakehouse architectures). * Strong scripting and automation skills (Python / Scala preferred). * Ability to translate client needs into technical architectures and operational models. * Familiarity with cloud-security principles and infrastructure-as-code practices. Bonus Points * Experience with GPU acceleration for Spark, RAPIDS, or ML workloads. * Exposure to high-security or regulated environments (government, critical industry). * Knowledge of observability stacks (Prometheus, Grafana) and orchestration (Airflow, Argo). * Contributions to open-source or performance engineering work. * Background in data engineering or MLOps., * Based in the Netherlands (commutable to Leiden). * Valid EU work permit (no sponsorship currently available). * Fluent in English (Dutch not required). ## Description We're looking for an Apache Spark Specialist to take a leading role in designing, deploying, and managing Nebul's accelerated, fully-managed Spark proposition - enabling our customers to extract value from data at scale with top-tier performance and security. You will be responsible for architecting Spark environments optimized for GPU acceleration and distributed compute, ensuring seamless integration with Nebul's sovereign cloud stack. This role combines deep technical ownership with solution innovation: from deploying high-performance clusters, to shaping the product experience and supporting early customer implementations. This is not a maintenance role - it is an opportunity to build and evolve a flagship data capability from the ground up. What You'll Do * Architect, deploy, and operate scalable Apache Spark environments on Nebul's sovereign AI cloud. * Design and optimize Spark workloads for GPU-accelerated and distributed performance. * Define and implement best practices for security, monitoring, governance, and data protection. * Partner closely with product, engineering, and customer teams to shape our managed Spark offering. * Evaluate and integrate complementary technologies (e.g., Delta Lake, Lakehouse components, tooling). * Support early customer pilots and translate feedback into roadmap improvements. * Develop automation and CI/CD deployment models to ensure reliability, repeatability, and efficiency. * Document architectures, operational procedures, and performance benchmarks. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Flex your Energy: Building a Cloud-Native Platform for Renewable Energy Communities](https://www.wearedevelopers.com/videos/1990-flex-your-energy-building-a-cloud-native-platform-for-renewable-energy-communities) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [HTTP headers that make your website go faster](https://www.wearedevelopers.com/videos/1676-http-headers-that-make-your-website-go-faster) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [All your telemetry data from any source in one place](https://www.wearedevelopers.com/videos/57-all-your-telemetry-data-from-any-source-in-one-place) ## Related Articles - [Software Developer Salary in The Netherlands [2023]](https://www.wearedevelopers.com/magazine/217-software-developer-salary-in-the-netherlands-2023) - [How to land a developer job in Amsterdam](https://www.wearedevelopers.com/magazine/36-how-to-land-a-developer-job-in-amsterdam) - [Best Companies in the Netherlands: Top 25 Companies in 2023 ](https://www.wearedevelopers.com/magazine/193-best-companies-in-the-netherlands-top-25-companies-in-2023) - [The Best Tech Hubs in Europe: 5 Best Cities For Software Engineers](https://www.wearedevelopers.com/magazine/246-the-best-tech-hubs-in-europe-5-best-cities-for-software-engineers) - [How to Find Tech Jobs in Amsterdam](https://www.wearedevelopers.com/magazine/279-how-to-find-tech-jobs-in-amsterdam) - [The Netherlands – Europe’s powerhouse for software development?](https://www.wearedevelopers.com/magazine/31-the-netherlands-europe-s-powerhouse-for-software-development)