Databricks Data Engineer

Next Ventures Ltd
Brussel, Belgium
24 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Third Normal Form Data Analysis Microsoft Azure Computer Programming Continuous Integration Information Engineering Data Governance Data Mart Data Vault Modeling Data Warehousing Dimensional Modeling Github
+11 more
Python (Programming Language) Machine Learning Role-Based Access Control Standard Sql Azure Data Lake Azure Data Factory Apache Spark Pyspark Star Schema Terraform Databricks

Job description

Next Ventures is currently supporting a global IT consultancy with expanding their Databricks capacity.

For this we are looking for 3 Databricks Data engineers hybrid in Brussels - Details below.

Technical Skills

  • Solid experience (min. 5 years) with Databricks and the Apache Spark ecosystem, preferably on Azure Databricks.
  • Strong programming skills in Python and PySpark for data engineering.
  • Very good SQL skills and understanding of data modelling techniques (eg star schema/dimensional modelling; data vault or 3NF is a plus).
  • Hands-on experience building data warehouses/data marts or analytical data stores for reporting and analytics.
  • Experience with Azure Data Lake, Azure Data Factory or similar ingestion/orchestration tools is a strong plus.
  • Familiarity with CI/CD (Azure DevOps, GitHub Actions) and infrastructure-as-code (Terraform or similar).
  • Understanding of data governance, security and compliance in the cloud (RBAC, PII handling, auditing).
  • Knowledge of analytics/ML concepts and how to prepare data for data science teams is a plus.

If you’re interested send a CV to (see below)

The post Databricks Data Engineer appeared first on Next Ventures.

Requirements

  • Solid experience (min. 5 years) with Databricks and the Apache Spark ecosystem, preferably on Azure Databricks.
  • Strong programming skills in Python and PySpark for data engineering.
  • Very good SQL skills and understanding of data modelling techniques (eg star schema/dimensional modelling; data vault or 3NF is a plus).
  • Hands-on experience building data warehouses/data marts or analytical data stores for reporting and analytics.
  • Experience with Azure Data Lake, Azure Data Factory or similar ingestion/orchestration tools is a strong plus.
  • Familiarity with CI/CD (Azure DevOps, GitHub Actions) and infrastructure-as-code (Terraform or similar).
  • Understanding of data governance, security and compliance in the cloud (RBAC, PII handling, auditing).
  • Knowledge of analytics/ML concepts and how to prepare data for data science teams is a plus.

About the company

Next Ventures is currently supporting a global IT consultancy with expanding their Databricks capacity.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on computerjobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

Videos

See all

Related articles

See all