> Markdown version of [/jobs/ext/2337837-senior-data-engineer-consultant](https://www.wearedevelopers.com/jobs/ext/2337837-senior-data-engineer-consultant). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer Consultant - **Company:** Keystone Solutions - **Location:** Brussel, Belgium - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Microsoft Windows, Application Programming Interfaces (APIs), Airflow, Apache HTTP Server, Business Intelligence Development, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Security, Data Warehousing, Relational Databases, Linux, Apache Hive, Python (Programming Language), PostgreSQL, Meta-Data Management, Microsoft SQL Server, OpenShift, Windows PowerShell, Power BI, SQL Databases, Macros, Sql Optimization, Beeline, Apache Spark, Pandas, Data Lakes, Debezium, Real Time Data, Apache Kafka, Data Pipelines - **Published:** August 25, 2026 - **Apply:** https://be.indeed.com/viewjob?jk=00f5b1833c6b3ab1 ## About the Role * Proficiency in Python. * Proficiency in SQL. * Proven experience with dbt-core (models, snapshots, macros, tests, profiles). * Good knowledge of DuckDB as an embedded analytical query engine. * Experience with Delta Lake (ACID transactions, time travel, OPTIMIZE/VACUUM). * Knowledge of relational databases: MSSQL, PostgreSQL (advanced SQL, CDC). * Experience with a data orchestrator: Dagster, Airflow, or equivalent. * Comfortable with Linux/OpenShift and using PowerShell (Windows dev environment). * Familiarity with governance tools: DataHub, OpenMetadata, or equivalent. * Experience in BI development. Preferred Skills: * Experience with Kafka/Debezium for real-time data capture. * Knowledge of Spark (Spark SQL, Thrift Server, Beeline). * Experience with Power BI Report Server (PBIRS) or Apache Superset. * Awareness of data security in restricted access environments. * Knowledge of Lakehouse concepts (Medallion architecture), DWH, and Datalake. Soft Skills: * Rigorous and autonomous in managing complex multi-domain pipelines. * Ability to document technical decisions and simplify for non-technical stakeholders. * Team spirit. * Curious and solution-oriented mindset., * Dagster - Level: Junior - Most recent: Any time * Data acquisition (ETL, ELT, ...) - Level: Confirmed - Most recent: Any time * Data architecture - Level: Junior - Most recent: Any time * data engineering - Level: Confirmed - Most recent: Any time * Data Governance - Level: Confirmed - Most recent: Any time * DataHub - Level: Junior - Most recent: Any time * datalake - Level: Junior - Most recent: Any time * dbt - Level: Junior - Most recent: Any time * Kafka - Level: Junior - Most recent: Any time * Metadata management - Level: Confirmed - Most recent: Any time * POWER BI - Level: Junior - Most recent: Any time * Python (from a Data Engineer perspective), Pandas & Apache Spark - Level: Confirmed - Most recent: Any time * SPARK - Level: Junior - Most recent: Any time * SQL - Level: Confirmed - Most recent: Any time ## Description * Design and deploy data ingestion pipelines from heterogeneous sources: files, APIs, relational databases. * Implement pipelines for incremental and streaming ingestion. * Ensure reliability, idempotence, and traceability of each pipeline. * Develop transformation models on Bronze, Silver, and Gold layers (Medallion architecture). * Implement best practices for data historization (e.g., SCD2, upsert, append only). * Develop exports to Delta Lake. * Manage and maintain Delta Lake tables. * Guarantee transactional consistency of data in a multi-domain environment. * Implement and maintain orchestration assets. * Monitor runs, manage errors, and automate alerts. * Push technical and business metadata to the data platform. * Maintain end-to-end lineage. * Contribute to the drafting of DUA, SLA, and associated governance documents. * Develop endpoints to expose the Gold layer to BI dashboards. * Collaborate with reporting teams for BI dashboard feeding. ## Related Videos - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) - [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript) - [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Software Developer Salary in The Netherlands [2023]](https://www.wearedevelopers.com/magazine/217-software-developer-salary-in-the-netherlands-2023) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)