Data Engineer - Azure Databricks & Power BI

Pauwels Consulting
Brussel, Belgium
3 days ago
Apply on europa.eu
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Languages
Dutch, English, French
Job source

Tech stack

Agile Methodology Microsoft Azure Continuous Integration Information Engineering Document-Oriented Databases Python (Programming Language) Machine Learning Performance Tuning Scrum Methodology Power BI SAP Knowledge Warehouse SQL Databases
+12 more
Azure Data Factory Apache Spark Pandas Data Lakes Pyspark Scikit Learn SAP S/4HANA Machine Learning Operations Software Version Control Data Pipelines Key Vault Databricks

Job description

  • Design, develop, and optimize data pipelines using Azure Databricks and Azure Data Factory to support organizational use cases.
  • Industrialize models and indicator calculations to ensure they run reliably in production through scheduling, monitoring, and quality checks.
  • Build and support Power BI reports including data modeling, DAX measures, and performance optimization.
  • Refine and validate existing anomaly detection models using statistical methods and Isolation Forest.
  • Collaborate with stakeholders to translate business requirements into technical deliverables within the data lifecycle.
  • Document data flows and calculation logic to ensure a smooth handover and maintain technical best practices.

Requirements

  • 5+ years of experience in data science and data engineering roles.
  • Strong expertise with Azure Databricks and Azure services including Data Factory, Storage, Key Vault, and Azure DevOps.
  • In-depth experience with Spark, PySpark, and Delta Lake within Lakehouse architectures.
  • Advanced proficiency in SQL and Python libraries such as pandas and scikit-learn.
  • Proven track record building Power BI reports including semantic modeling, DAX, and visual design.
  • Knowledge of statistics and machine learning, specifically anomaly detection techniques.
  • You possess the ability to quickly understand and take over existing code bases and models developed by others.
  • You are proactive, solution-oriented, and demonstrate strong communication skills.
  • You are fluent in English with native or bilingual proficiency in Dutch or French.

Nice to Haves

  • Experience with MLOps practices such as MLflow, model versioning, and CI/CD.
  • Professional certifications in Databricks, Microsoft Azure (DP-100), or Power BI (PL-300).
  • Basic SAP knowledge with S/4HANA as a data source.
  • Experience working in Agile or Scrum environments.
  • Background in the public transport, mobility, or energy sectors.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on europa.eu
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

3:33 min

Refactoring data science workflows using Rapids QDF and Pandas

Paul Graham Paul Graham · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all