Databricks Data Engineer

As a Databricks Data Engineer, you will be a trusted adviser to our clients, designing and building reliable ETL/ELT pipelines in Databricks. You will apply the medallion architecture and Delta Lake best practice, optimize clusters for performance and cost, and embed data quality to deliver reliable data products. You will work closely with cloud platform engineers to ensure data solutions are secure, scalable, and easy to operate., * Develop, optimize, and operate ETL/ELT pipelines in Databricks using PySpark, SparkSQL, and Scala;

• Run migration programmes to Databricks, including legacy ETL processes into scalable data pipelines;
• Build robust data pipelines on Databricks for real time and batch processing;
• Configure and manage Databricks clusters and jobs for cost and performance efficiency;
• Apply CI/CD to automate testing and deployment of notebooks, jobs, and pipelines;
• Drive adoption of Databricks Lakehouse architecture and data engineering practice across our clients.

Naturally you are keen to discover and learn new things each day and you are confident and rely on your self-worth. But most importantly, be the true you. The one and only you. With your personal strengths, view of the world and unique personality. You need the following qualifications for the position of Databricks Data Engineer:

• A technical Master’s degree, preferably in Data Science, Big Data, Econometrics, Physics, Mathematics, Computer Science, Artificial Intelligence, or a related field;
• At least 4 years of work experience in data engineering; consulting experience is a plus;
• Strong hands-on experience with Databricks and Apache Spark (PySpark and Spark SQL);
• Deep understanding of Delta Lake and medallion architecture;
• Proficiency in SQL and one or more data engineering related programming languages (Python, Scala, etc);
• Relevant Databricks certifications (Data Engineer Associate/Professional, Spark Developer Associate, Data Analyst Associate);
• Excellent command of English and Dutch.

Pulled from the full job description

• Health insurance
• Profit sharing
• Pension plan, * You’ll receive a profit-sharing bonus, on top of your fixed salary.
• Continuous professional growth. Join our development program.
• A work-from-home office setup allowance to make sure you have everything you need for an ergonomically designed workstation and internet allowance.
• Work part-time (32 hours a week) or full-time (40 hours a week).
• Flexible and hybrid working, in accordance with team and client commitments.
• 26 days of paid annual leave, and the opportunity to purchase additional leave.
• A good mobility scheme: the choice of various options such as a lease car, travel by public transport, a cash option or a combination of these.
• A laptop and iPhone. The iPhone can also be used for personal purposes.
• A time for time arrangement that creates flexibility for personal moments that matter.
• A good pension scheme with a personal contribution of only 2%.
• An opportunity to take part in our collective health insurance scheme.
• An opportunity to benefit from tax-efficient facilities such as company fitness, a bicycle scheme or the opportunity to lease a bicycle.
• The opportunity to use 55 hours of babysitting service per calendar year if your child is 12 years old or younger.
• A flexible budget, which you can use to make choices in flexible benefits, for example purchasing extra leave days or financing a bicycle plan.
• Various leave options tailored to meet your individual needs, from parental leave (also for rainbow families) to the flexibility of exchanging three national holidays for non-national holidays.