> Markdown version of [/jobs/ext/2085291-azure-data-engineer-streaming-to-batch-pipelines](https://www.wearedevelopers.com/jobs/ext/2085291-azure-data-engineer-streaming-to-batch-pipelines). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Data Engineer - Streaming To Batch Pipelines

- **Company:** MPower Plus
- **Location:** Madrid, Spain
- **Contract:** Permanent contract
- **Skills:** Extract Transform Load (ETL), Python (Programming Language), Azure Data Lake, Scala (Programming Language), Data Streaming, Azure Data Factory, Pyspark, Data Pipelines
- **Published:** August 16, 2026
- **Apply:** https://www.buscojobs.com.es/azure-data-engineer-streaming-to-batch-pipelines-en-madrid-ID-367466109

## About the Role

You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models.
This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark.
The ideal candidate will have proven experience in designing and implementing data pipelines.
#J-*****-Ljbffr

## Description

MPower Plus is seeking a Data Engineer specializing in Streaming to Batch Migration in Madrid.You will design and implement solutions using Azure Data Factory and manage Azure Data Lake Storage while optimizing data models.This full-time position requires a mid-senior level of expertise, with responsibilities including building ETL pipelines in Python, Scala, and PySpark.The ideal candidate will have proven experience in designing and implementing data pipelines.#J-*****-Ljbffr


## Related Videos

- [Python-Based Data Streaming Pipelines Within Minutes](https://www.wearedevelopers.com/videos/1233-python-based-data-streaming-pipelines-within-minutes)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Implementing continuous delivery in a data processing pipeline](https://www.wearedevelopers.com/videos/73-implementing-continuous-delivery-in-a-data-processing-pipeline)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)