Senior Data Engineer

Madello Consulting
Antwerpen, Belgium
1 day ago
Apply on www.vdab.be
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Languages
Dutch, English
Job source

Tech stack

Query Performance Java (Programming Language) Application Programming Interfaces (APIs) Microsoft Azure Big Data Cloud Database Databases Continuous Integration Data Architecture Information Engineering Data Governance Data Integration
+22 more
Extract Transform Load (ETL) Data Structures Data Systems Data Warehousing Relational Databases Python (Programming Language) Query Optimization Release Management Power BI DataOps SQL Databases Data Streaming Data Processing Apache Spark Data Layers Microsoft Fabric Data Lineage Deployment Automation Data Management Data Delivery Software Version Control Data Pipelines

Job description

Data Pipeline Engineering

  • Design, build, optimise, and maintain scalable data pipelines.
  • Develop reliable data-processing workflows for large data volumes.
  • Integrate data from multiple source systems.
  • Build reusable and maintainable data-processing components.
  • Monitor and improve pipeline performance and reliability.

Microsoft Fabric Development

  • Develop solutions using Microsoft Fabric.
  • Work with Fabric pipelines, dataflows, and notebooks.
  • Build and maintain modern analytics and data-processing workloads.
  • Support scalable ingestion, transformation, and processing patterns.
  • Optimise Fabric-based data solutions for performance and maintainability.

Data Integration

  • Integrate relational databases, APIs, files, applications, and other data sources.
  • Design robust ingestion and transformation processes.
  • Develop reusable data-integration patterns.
  • Validate and monitor source-to-target data flows.
  • Ensure reliable and consistent data delivery.

Lakehouse & Data Warehouse Architecture

  • Design and maintain cloud-based lakehouse and warehouse solutions.
  • Implement medallion architecture using Bronze, Silver, and Gold layers.
  • Support modern Azure-based data architectures.
  • Contribute to domain-oriented and data-mesh concepts where applicable.
  • Ensure scalability, maintainability, and reuse across data products.

Data Modelling

  • Translate reporting and analytics needs into data models.
  • Develop reliable and reusable analytical datasets.
  • Apply dimensional-modelling principles.
  • Work with Kimball-based modelling concepts.
  • Optimise data structures for reporting and business intelligence.

Python & SQL Engineering

  • Develop data-processing logic using Python.
  • Use Python for ETL and data-engineering workloads.
  • Develop and optimise SQL queries.
  • Improve query performance.
  • Support database-related analysis and troubleshooting.

Reporting & Analytics Support

  • Support Power BI and analytics environments.
  • Prepare trusted datasets for reporting.
  • Work with reporting specialists to understand analytical requirements.
  • Improve the reliability and consistency of reporting data.
  • Support self-service and enterprise analytics needs.

Data Governance & Quality

  • Contribute to data-governance standards.
  • Implement data-quality controls.
  • Support metadata and lineage practices.
  • Identify and resolve data-quality issues.
  • Promote consistent data-management practices across the platform.

CI/CD & DataOps

  • Support CI/CD for data solutions.
  • Use version control for data engineering artefacts.
  • Automate deployments across environments.
  • Improve release and deployment processes.
  • Apply modern DataOps and engineering practices.

Documentation & Collaboration

  • Document pipelines, dataflows, data models, and a

Requirements

  • Minimum 5 years of experience as a Data Engineer.
  • Experience with cloud-based data architectures on Azure.
  • Experience with lakehouse or data-warehouse concepts.
  • Strong Microsoft Fabric experience, specifically:
  • Pipelines
  • Dataflows
  • Notebooks
  • Experience integrating data from multiple source systems.
  • Experience supporting reporting and analytics environments.
  • Minimum 3 years of Python experience within a data-engineering context.
  • Experience with Python, Java, or Scala for data flows and ETL processes.
  • Strong SQL knowledge.
  • Query optimisation experience.
  • Dutch language proficiency at CEFR C2 level.

Should Have

  • Experience within a public-sector, municipal, or complex enterprise environment.
  • ETL design and implementation.
  • CI/CD for data solutions.
  • Version control.
  • Automated deployment of data solutions.
  • Database experience.
  • Medallion architecture.
  • Bronze, Silver, and Gold data layers.
  • Power BI.
  • Spark or Spark-based processing.
  • Data governance.
  • Data-quality management.
  • Data lineage.
  • Kimball dimensional modelling.
  • Lakehouse architecture.
  • Data Mesh.
  • Domain-oriented data architecture.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.vdab.be
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:48 min

Standardizing data access schemas with OData

Florian Bader Florian Bader · World Congress 2026 Europe

Videos

See all

Related articles

See all