Cloud Data Engineer with Azure & Databricks certifications

Base 3
Brussels, Belgium
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Brussels, Belgium

Tech stack

Automation of Tests
Azure
Cloud Computing Security
Cloud Database
Software Quality
Code Review
Data Architecture
Information Engineering
ETL
Identity and Access Management
Python
Key Management
Operational Databases
Performance Tuning
Azure
Scala
Software Engineering
SQL Databases
YAML
Data Logging
Data Processing
Azure
Spark
Data Lake
PySpark
Terraform
Software Version Control
Data Pipelines
Databricks

Job description

  • Design, develop, test, and maintain scalable data engineering solutions on Microsoft Azure and Databricks.
  • Build robust and reusable ETL/ELT pipelines using Python, PySpark, Scala, and SQL.
  • Develop data processing applications for ingestion, transformation, enrichment, validation, and serving of analytical datasets.
  • Implement reliable batch and streaming data workflows using Azure Databricks, Delta Lake, and modern data lakehouse patterns.
  • Contribute to application design, code quality, performance optimization, and maintainability of data engineering solutions.
  • Develop reusable libraries, utilities, frameworks, and technical components to accelerate data product delivery.

Requirements

  • 5+ years of hands-on experience in data engineering, application development, or cloud-based data platform development.
  • Strong hands-on development experience with:
  • Python
  • PySpark
  • Scala
  • SQL
  • ETL/ELT development
  • Solid experience with the Azure Databricks ecosystem, including:
  • Databricks notebooks and jobs
  • Spark clusters
  • Delta Lake
  • Lakehouse architecture
  • Performance tuning and optimization
  • Experience designing, developing, and operating production data pipelines.
  • Good knowledge of Azure data services such as:
  • Azure Data Lake Storage
  • Azure Data Factory
  • Azure Key Vault
  • Azure DevOps
  • Azure monitoring/logging capabilities
  • Experience with CI/CD pipelines, preferably using Azure DevOps YAML pipelines.
  • Strong understanding of software engineering practices, including version control, automated testing, modular development, and code reviews.
  • Understanding of cloud security, access management, observability, and cost-aware development practices.
  • Working knowledge of Terraform or infrastructure-as-code concepts is a plus, but not the primary focus of the role.

Apply for this position