Azure Data Engineer

ITproposal B.V.
Eindhoven, Netherlands
2 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Eindhoven, Netherlands

Tech stack

Sql Data Warehouse
Artificial Intelligence
Azure
Batch Processing
Information Engineering
Data Systems
Python
Machine Learning
NoSQL
Azure
SQL Databases
Data Streaming
Unstructured Data
Data Processing
Google Cloud Platform
Data Storage Technologies
Azure
PySpark
Kubernetes
Data Management
Terraform
Data Pipelines
Serverless Computing
Databricks

Job description

We are looking for an experienced Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The role involves working with modern data platforms, streaming pipelines, and cloud-based architectures to support enterprise data processing and analytics., * Design and develop data pipelines and data platforms on Azure.

  • Build and manage batch and streaming data processing using Databricks and PySpark.
  • Work with structured and unstructured data using SQL and NoSQL databases.
  • Implement serverless and event-driven architectures using Azure services.
  • Manage and optimize data storage solutions such as Azure Data Lake (ADLS).
  • Develop infrastructure and deployment using Terraform.
  • Collaborate with cross-functional teams to support data engineering and analytics initiatives.

Requirements

  • Strong experience with Microsoft Azure
  • Python programming
  • SQL and NoSQL databases
  • Databricks and PySpark (Structured Streaming & Batch processing)
  • Experience with Azure ADLS, Event Hub, Event Grid, SQL Data Warehouse
  • Experience with Azure Functions and Serverless Architecture
  • Knowledge of Terraform (theoretical knowledge required, practical experience preferred)

Good to Have

  • Experience with ARM Templates
  • Knowledge of Azure Data Factory
  • Exposure to Kubernetes and Google Cloud Platform (GCP)
  • Understanding of Machine Learning and AI

Apply for this position