Data engineer- Databricks

CGI
Brussels, Belgium
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
Dutch, English, French
Experience level
Senior

Job location

Brussels, Belgium

Tech stack

Agile Methodologies
Amazon Web Services (AWS)
Amazon Web Services (AWS)
JIRA
Azure
Cloud Database
Computer Programming
Databases
Data Architecture
Information Engineering
Data Infrastructure
ETL
Data Systems
Data Warehousing
Document-Oriented Databases
Python
Scrum
Salesforce
SAP IS-U
SQL Databases
Automated Data Processing (ADP)
Data Processing
Delivery Pipeline
Spark
Information Technology
Atlassian Tools
Data Analytics
Amazon Web Services (AWS)
Dataiku
Databricks

Job description

Design, implement, and maintain scalable data architectures using databases, AWS data lakes, and data warehouses. Develop and optimize ETL pipelines to seamlessly integrate data from multiple sources. Create unified, gold-standard data sources for analysis and reporting. Ensure data accuracy, consistency, and quality throughout its lifecycle. Manage and optimize data infrastructure for efficiency, storage, and cost-effectiveness. Work closely with cross-functional teams to ensure scalability, security, and performance of data systems. Build and maintain automated data processing pipelines using Python, Spark, and SQL. Collaborate with business stakeholders to understand and implement data-driven solutions. Document data architectures, pipelines, and processes for seamless knowledge sharing. Promote and apply best practices in data engineering across IT and business teams.

Requirements

Are you a data enthusiast eager to design and optimize cutting-edge data architectures? Do you thrive in a collaborative environment where your expertise can drive real business impact? Do you want to contribute to the energy transition with innovative data solutions and help our clients become data-driven organizations?, 5-7 years of proven experience as a Senior Data Engineer or in a similar role Strong expertise in Data Platform Management Hands-on experience with AWS services (S3, Athena, Glue, Redshift) Experience with Databricks (preferably on AWS) Strong programming skills in Python, Spark, SQL, or other data engineering languages Experience with data processing technologies Familiarity with Agile methodologies (Scrum, Kanban) Knowledge of DataIku for advanced analytics and automation Experience with Azure DevOps & release pipelines AWS Certification in Cloud Data Engineering is a plus!

Good to Have: Experience in the utilities market Knowledge of technical systems like Salesforce, SAP ISU Familiarity with Agile tools such as Azure DevOps or Jira Understanding of financial closing reports Additional AWS certifications (Solution Architect, Systems Administrator)

Soft Skills: Team player who thrives in a collaborative, multicultural environment Strong communication skills, especially in translating technical concepts for nontechnical business leaders Adaptability to evolving technologies and changing project requirements Proven organizational skills and keen attention to detail

Native Dutch or French with good communication in English Education : Bachelor or master degree with a focus on Information Technology, or equivalent

Apply for this position