Senior Data Engineer

Data Ingestion & Pipelines

• Design and implement ingestion pipelines from heterogeneous sources such as files, APIs and relational databases.
• Implement incremental and streaming ingestion pipelines.
• Ensure pipeline reliability, idempotency and end-to-end traceability.

Data Transformation & Modeling

• Develop transformation models following a Medallion Architecture (Bronze / Silver / Gold).
• Implement data historization strategies such as SCD Type 2, upsert and append-only.
• Develop exports towards Delta Lake.

Delta Lake & ACID Transactions

• Manage and maintain Delta Lake tables.
• Ensure transactional consistency across multiple data domains.
• Work with ACID transactions and Time Travel capabilities.

Orchestration

• Implement and maintain data assets and pipelines.
• Monitor pipeline runs and handle failures.
• Automate alerts and monitoring processes.

Data Governance & Lineage

• Push technical and business metadata to the data governance platform.
• Maintain end-to-end data lineage.
• Contribute to governance documentation, DUA, SLA and related standards.

Data Exposure & BI

• Develop endpoints to expose the Gold data layer.
• Collaborate with BI and reporting teams to feed dashboards.
• Support the development of BI solutions.

• Python - Confirmed / Strong experience
• SQL - Confirmed / Advanced SQL
• Data Engineering / ETL / ELT - Confirmed
• dbt / dbt-core - models, snapshots, macros, tests and profiles
• Delta Lake - ACID transactions, Time Travel, OPTIMIZE, VACUUM
• Relational databases - MSSQL and PostgreSQL
• Data Governance - Confirmed
• Metadata Management - Confirmed
• Experience with a data orchestrator such as Dagster, Airflow or equivalent
• Experience with Linux / OpenShift
• Experience developing Data & BI solutions
• Strong understanding of Data Lake / Data Warehouse / Lakehouse architectures
• Experience working with complex, multi-domain data pipelines
• Ability to work independently and take ownership of technical deliverables

PLUS SKILLS

• Dagster
• Kafka / Debezium - real-time data capture and CDC
• Apache Spark / Spark SQL
• DuckDB
• DataHub / OpenMetadata
• Power BI / Power BI Report Server (PBIRS)
• Apache Superset
• Strong knowledge of Medallion Architecture
• Experience in highly secured or restricted-access environments
• PowerShell in a Windows development environment
• Experience with real-time / streaming data architectures
• English: Professional working proficiency - required
• French: Professional working proficiency - preferred
• Dutch: Nice to have

SOFT SKILLS

• Strong sense of ownership and responsibility
• Rigorous and autonomous approach to complex data engineering tasks
• Solution-oriented mindset
• Strong documentation skills
• Ability to explain complex technical concepts to non-technical stakeholders
• Team player
• Curious and eager to learn
• Strong communication and collaboration skills, We are looking for a Senior Data Engineer who can take ownership of Data Engineering activities from end to end, with a strong focus on data quality, governance, lineage, security and pipeline reliability.