Azure Data Engineer
ITproposal B.V.
Eindhoven, Netherlands
2 days ago
Role details
Contract type
Contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Eindhoven, Netherlands
Tech stack
Sql Data Warehouse
Artificial Intelligence
Azure
Batch Processing
Information Engineering
Data Systems
Python
Machine Learning
NoSQL
Azure
SQL Databases
Data Streaming
Unstructured Data
Data Processing
Google Cloud Platform
Data Storage Technologies
Azure
PySpark
Kubernetes
Data Management
Terraform
Data Pipelines
Serverless Computing
Databricks
Job description
We are looking for an experienced Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The role involves working with modern data platforms, streaming pipelines, and cloud-based architectures to support enterprise data processing and analytics., * Design and develop data pipelines and data platforms on Azure.
- Build and manage batch and streaming data processing using Databricks and PySpark.
- Work with structured and unstructured data using SQL and NoSQL databases.
- Implement serverless and event-driven architectures using Azure services.
- Manage and optimize data storage solutions such as Azure Data Lake (ADLS).
- Develop infrastructure and deployment using Terraform.
- Collaborate with cross-functional teams to support data engineering and analytics initiatives.
Requirements
- Strong experience with Microsoft Azure
- Python programming
- SQL and NoSQL databases
- Databricks and PySpark (Structured Streaming & Batch processing)
- Experience with Azure ADLS, Event Hub, Event Grid, SQL Data Warehouse
- Experience with Azure Functions and Serverless Architecture
- Knowledge of Terraform (theoretical knowledge required, practical experience preferred)
Good to Have
- Experience with ARM Templates
- Knowledge of Azure Data Factory
- Exposure to Kubernetes and Google Cloud Platform (GCP)
- Understanding of Machine Learning and AI