Data Engineer (Python, Azure, Databricks & PySpark)

Bridge Industrial bv.
Brussels Metropolitan Area, Belgium
11 days ago
Apply on www.adzuna.be
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
Dutch, English, French
Job source

Tech stack

Artificial Intelligence Confluence Microsoft Azure Software Quality Distributed Computing Environment R (Programming Language) Python (Programming Language) Machine Learning Power BI Markdown Standard Sql Git
+7 more
Pandas Pyspark Vba Programming Language Data Analytics Streamlit Framework Data Pipelines Databricks

Job description

You will contribute to the development of scalable data solutions supporting grid planning, scenario management and data-driven decision-making, working with technologies such as Azure, Databricks, Python and PySpark., * Design, develop and maintain scalable data pipelines on Azure and Databricks

  • Collect, transform and integrate data from multiple sources
  • Ensure data quality, governance and traceability across the data platform
  • Develop data models and analytical datasets for grid studies and scenario management
  • Support AI, Machine Learning and advanced analytics use cases
  • Optimize data workflows through monitoring, automation and performance improvements
  • Develop dashboards and reporting solutions using Power BI or Streamlit
  • Translate business requirements into technical and data-driven solutions
  • Maintain technical documentation using Markdown and Confluence

Requirements

  • Proven experience as a Data Engineer, Data Scientist or Data & AI Engineer
  • Strong knowledge of Python, Pandas/Polars and SQL
  • Hands-on experience with Azure, Databricks and PySpark
  • Good understanding of scalable and distributed data processing
  • Experience building data pipelines, datasets and data products
  • Knowledge of Power BI, Streamlit, R or VBA is a plus
  • Familiarity with AI/ML concepts and Git
  • Experience in the energy, utilities or power systems sector is a strong advantage
  • Strong focus on code quality, maintainability and knowledge sharing
  • Fluent in English; Dutch and/or French is a strong advantage
  • Willing to work 3 days per week on-site in Brussels

What we offer

  • An exciting role within a leading player in the Belgian and European energy sector
  • The opportunity to contribute to the energy transition through innovative digital solutions
  • A technically challenging environment using Azure, Databricks, Python and PySpark
  • A professional and collaborative environment with room for expertise and initiative

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.be
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:33 min

Refactoring data science workflows using Rapids QDF and Pandas

Paul Graham Paul Graham · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all