EM
Eli McGarvie
Data Engineer Salary UK
over 3 years ago
Azure Data Engineer - Streaming To Batch Pipelines
MPower Plus
Madrid, Spain
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.buscojobs.com.es
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Extract Transform Load (ETL)
Python (Programming Language)
Azure Data Lake
Scala (Programming Language)
Data Streaming
Azure Data Factory
Pyspark
Data Pipelines
Job description
MPower Plus is seeking a Data Engineer specializing in Streaming to Batch Migration in Madrid.You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models.This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark.The ideal candidate will have proven experience in designing and implementing data pipelines.#J-*****-Ljbffr
Requirements
You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models. This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark. The ideal candidate will have proven experience in designing and implementing data pipelines. #J-*****-Ljbffr
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.buscojobs.com.es
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlists6:08 min
Applying software engineering environments and testing to data pipelines
Matthias Niehoff · World Congress 2024
6:23 min
Visualizing data pipelines using Azure Machine Learning Designer
Jose Luis Latorre Millas · LIVE
1:50 min
Lowering pipeline latency with data streaming
Nathaniel Okenwa · World Congress 2024
4:32 min
Harnessing Spark with Python using PySpark and Py4J
Ayon Roy · LIVE
47 sec
Building modern data pipelines for legacy exports
Dr. Alexander Wachtel +1 · World Congress 2025
3:37 min
Scaling machine learning pipelines from prototypes to petabytes
Julian Joseph · LIVE
Videos
See allRelated articles
See all
.gif)
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
.gif)
BB
Benedikt Bischof
MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production
about 4 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
.png)
LM
Luis Minvielle
How to Become an AI Engineer
almost 3 years ago