Senior Azure Data Engineer
GeekSoft Consulting
Eindhoven, Netherlands
2 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Eindhoven, Netherlands
Tech stack
Azure
Data Warehousing
High-Level Architecture
Python
Machine Learning
SQL Azure
NoSQL
SQL Databases
Data Logging
Data Ingestion
Azure
Data Lake
PySpark
Kubernetes
Terraform
Data Pipelines
Serverless Computing
Databricks
Job description
- Help design, build and continuously improve the clients online platform.
- Research, suggest and implement new technology solutions following best practices/standards.
- Take responsibility for the resiliency and availability of different products.
- Be a productive member of the team.
Requirements
- 3+ years of experience in Python development.
- Strong experience with SQL and NoSQL databases.
- Hands-on experience with Databricks, PySpark, including batch and structured streaming.
- Experience working with Azure services including ADLS, Azure Databricks, Event Hub, Azure SQL Data Warehouse, Azure Functions, and Serverless Architecture.
- Good understanding of Terraform; hands-on experience is preferred.
- Experience designing and implementing scalable data engineering solutions based on high-level architecture.
- Experience building data ingestion, transformation, and preprocessing pipelines using Azure Databricks.
- Ability to work with customers to understand data pipeline, data lake, and migration requirements.
- Experience monitoring Azure DevOps and Databricks pipelines and supporting production environments.
- Willingness to learn and work with Azure monitoring and logging services.
- Experience with ARM Templates and Azure Data Factory.
- Knowledge of Kubernetes.
- Exposure to Machine Learning and AI.
Benefits & conditions
- A challenging, innovating environment.
- Opportunities for learning where needed.
Deze baan Landelijk gemiddeld IT ICT vacatures gemiddeld Nederland gemiddeld Data-analist