Senior Data Engineer
Role details
Job location
Tech stack
Job description
We are on the lookout for a Senior Data Engineer based in our Amsterdam office with exceptional skills and experience to enhance our data infrastructure, which is vital for our core business. The ideal candidate will possess deep expertise in data engineering, with hands-on experience in PostgreSQL, AWS (e.g. Redshift, S3), Apache Airflow, Python, and dbt., * Architect, (re)build, optimize, and maintain efficient data pipelines, managing large-scale data integration into PostgreSQL, Amazon S3, and Amazon Redshift, including 3rd-party tool data ingestions.
- Oversee the expansion and implementation of our Amazon S3 data lake, broadening its utility to encompass both structured and unstructured data for advanced analytics and machine learning.
- Normalization of PostgreSQL tables and query optimization for transformation layer.
- Setting up and maintaining a scalable dbt infrastructure.
- Optimization of data models/transformations in dbt to facilitate effective data analysis and reporting, prioritizing data accuracy and consistency for tools like Looker or Tableau.
- Uphold and implement data governance, ensuring data security and compliance across PostgreSQL, Amazon S3, and Amazon Redshift.
- Collaborate with various teams to comprehend and fulfill data needs, converting business requirements into technical solutions.
- Monitor and fine-tune the performance of all data infrastructure elements, guaranteeing high availability, peak performance, and cost efficiency.
- Guide the adoption of new data engineering technologies, tools, and workflows, including ELT processes and analytics platforms.
Requirements
Do you have experience in Tableau?, Do you have a Master's degree?, * You are based in the Netherlands
-
Bachelor's or Master's degree in a relevant field like Computer Science, Engineering, or IT.
-
5-8 years of experience in data engineering, specializing in data pipelines and architecture design.
-
Proficiency in SQL, with extensive experience in Amazon Redshift and preferably PostgreSQL.
-
Expertise in managing Amazon S3 data lakes and familiarity with associated AWS services.
-
Expertise in setting up ELT pipelines.
-
Skilled in data modeling and transformation tools, preferably dbt.
-
Skilled in data orchestration tools, preferably Apache Airflow.
-
Experience with building pipelines in spark/pyspark and proficient in spark optimisation.
-
In-depth understanding of data governance, security, and compliance principles.
-
Analytical and problem-solving capabilities, along with the ability to collaborate effectively across diverse teams.
-
Excellent communication and leadership skills, proven by past experiences in leading successful data-driven projects.
Benefits & conditions
- A competitive salary based on your experience.
- Join our enthusiastic and professional team with colleagues from all over the world.
- A dynamic and rapidly growing scale-up in Amsterdam.
- Unlimited skin checks for you.
- Regular team events