Data Engineer
LEVY PROFESSIONALS
Amsterdam, Netherlands
6 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Amsterdam, Netherlands
Tech stack
Data Validation
Information Engineering
ETL
Data Warehousing
SQL Databases
PySpark
Data Lineage
Databricks
Job description
If you have deep experience with ETL pipelines, migration scripts, validation frameworks and data quality automation - this project is for you. You will join the current team consists and help drive a full end-to-end migration. Your responsibilities together with the other 10 team members will be:
- Validate migrated data for completeness, accuracy, and quality
- Develop, review, and run migration scripts (Databricks, PySpark, SQL)
- Build validation scripts and frameworks to automate checks
- Ensure data lineage and traceability across all layers of the data warehouse
- Support the team with technical expertise and guidance during the migration process
- Document migration, validation processes, and data lineage for audits
Requirements
Do you have experience in SQL?, * 5+ years in Data Engineering / ETL / Data Validation
- Strong experience with data migrations and data model transitions
- Hands-on in Databricks (PySpark, SQL)
- Deep understanding of data quality frameworks and automated validation
- Experience with data modelling (Erwin or Kimball)
- Knowledge of data lineage frameworks
