Senior Data Engineer

SkinVision
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Information Engineering
Data Governance
Data Infrastructure
Data Integration
Data Security
Python
PostgreSQL
Machine Learning
Query Optimization
SQL Databases
Tableau
Unstructured Data
System Availability
Data Lake
PySpark
Information Technology
Looker Analytics
Data Pipelines
Redshift

Job description

We are on the lookout for a Senior Data Engineer based in our Amsterdam office with exceptional skills and experience to enhance our data infrastructure, which is vital for our core business. The ideal candidate will possess deep expertise in data engineering, with hands-on experience in PostgreSQL, AWS (e.g. Redshift, S3), Apache Airflow, Python, and dbt., * Architect, (re)build, optimize, and maintain efficient data pipelines, managing large-scale data integration into PostgreSQL, Amazon S3, and Amazon Redshift, including 3rd-party tool data ingestions.

  • Oversee the expansion and implementation of our Amazon S3 data lake, broadening its utility to encompass both structured and unstructured data for advanced analytics and machine learning.
  • Normalization of PostgreSQL tables and query optimization for transformation layer.
  • Setting up and maintaining a scalable dbt infrastructure.
  • Optimization of data models/transformations in dbt to facilitate effective data analysis and reporting, prioritizing data accuracy and consistency for tools like Looker or Tableau.
  • Uphold and implement data governance, ensuring data security and compliance across PostgreSQL, Amazon S3, and Amazon Redshift.
  • Collaborate with various teams to comprehend and fulfill data needs, converting business requirements into technical solutions.
  • Monitor and fine-tune the performance of all data infrastructure elements, guaranteeing high availability, peak performance, and cost efficiency.
  • Guide the adoption of new data engineering technologies, tools, and workflows, including ELT processes and analytics platforms.

Requirements

Do you have experience in Tableau?, Do you have a Master's degree?, * You are based in the Netherlands

  • Bachelor's or Master's degree in a relevant field like Computer Science, Engineering, or IT.

  • 5-8 years of experience in data engineering, specializing in data pipelines and architecture design.

  • Proficiency in SQL, with extensive experience in Amazon Redshift and preferably PostgreSQL.

  • Expertise in managing Amazon S3 data lakes and familiarity with associated AWS services.

  • Expertise in setting up ELT pipelines.

  • Skilled in data modeling and transformation tools, preferably dbt.

  • Skilled in data orchestration tools, preferably Apache Airflow.

  • Experience with building pipelines in spark/pyspark and proficient in spark optimisation.

  • In-depth understanding of data governance, security, and compliance principles.

  • Analytical and problem-solving capabilities, along with the ability to collaborate effectively across diverse teams.

  • Excellent communication and leadership skills, proven by past experiences in leading successful data-driven projects.

Benefits & conditions

  • A competitive salary based on your experience.
  • Join our enthusiastic and professional team with colleagues from all over the world.
  • A dynamic and rapidly growing scale-up in Amsterdam.
  • Unlimited skin checks for you.
  • Regular team events

Apply for this position