Senior Data Engineer -OVAM000435

ITProposal
Brussel, Belgium
23 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Languages
Dutch

Tech stack

Agile Methodology Microsoft Azure Big Data Cloud Computing Databases Extract Transform Load (ETL) Data Transformation Data Migration Data Systems Python (Programming Language) Machine Learning Performance Tuning
+13 more
Cloud Services Standard Sql DataOps SQL Databases Data Build Tool (dbt) Kubernetes Infrastructure Automation Frameworks Information Technology Data Management Terraform Data Pipelines Legacy Systems Databricks

Job description

We are looking for a Senior Data Engineer to support the modernization of a large-scale data platform within the public sector. The project focuses on replacing legacy systems through a phased modernization approach, improving data management, increasing scalability, and enabling advanced analytics and machine learning initiatives. You will be responsible for designing, developing, and maintaining modern cloud-based data solutions, supporting data migration activities, and building scalable data pipelines using Azure technologies. Responsibilities

  • Design, build, and maintain scalable data platforms on Microsoft Azure.
  • Develop and optimize ETL/ELT pipelines and data transformation processes.
  • Perform complex data migration from legacy environments to modern cloud platforms.
  • Develop and maintain Databricks solutions for large-scale data processing.
  • Work with SQL to design and optimize databases and queries.
  • Deploy and manage workloads using Kubernetes.
  • Collaborate with architects, analysts, and development teams to deliver high-quality data solutions.
  • Support data quality, governance, and performance optimization.
  • Contribute to cloud infrastructure improvements and automation where applicable.
  • Participate in Agile project delivery.

Requirements

  • Bachelor’s or Master’s degree in Engineering, Computer Science, Information Technology, or equivalent experience.
  • Minimum 5 years of experience as a Data Engineer or in a similar role.
  • Strong hands-on experience with Microsoft Azure.
  • Proven experience with Databricks.
  • Proven experience with data migration projects.
  • Strong SQL expertise.
  • Experience working with Kubernetes.
  • Experience within the public sector.
  • Experience within the waste management/environmental sector.
  • Native-level Dutch (CEFR C2) is mandatory.

Preferred Skills

  • Experience with dbt (Data Build Tool).
  • Experience with Python.
  • Experience with Terraform.
  • Previous experience within the Flemish Government.
  • Experience with cloud infrastructure automation.
  • Knowledge of modern data engineering best practices.

Technical Environment

  • Microsoft Azure
  • Azure Databricks
  • SQL
  • Kubernetes
  • dbt
  • Python
  • Terraform
  • Data Migration
  • Cloud Data Platforms

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.be

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · WWC 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · WWC 2022

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all