> Markdown version of [/jobs/ext/1926566-data-engineer-build-real-time-data-pipelines-ml](https://www.wearedevelopers.com/jobs/ext/1926566-data-engineer-build-real-time-data-pipelines-ml). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer: Build Real-Time Data Pipelines & Ml - **Company:** Schwarz Digits - **Location:** Madrid, Spain - **Contract:** Permanent contract - **Skills:** Agile Methodology, Apache Hive, Python (Programming Language), Microsoft SQL Server, MongoDB, SQL Databases, Apache Spark, Kubernetes, Cassandra, Apache Kafka, Data Pipelines - **Published:** August 5, 2026 - **Apply:** https://www.buscojobs.com.es/data-engineer-build-real-time-data-pipelines-ml-en-madrid-ID-365590290 ## About the Role Required skills include Python, SQL, Spark, Kafka, Kubernetes, Hive, and experience with SQL Server and MongoDB/Elk/Cassandra. Agile experience and a passion for learning are essential in this collaborative, multilingual #J-*****-Ljbffr ## Description Schwarz Digits seeks a Data Engineer to craft scalable data solutions in Barcelona, Spain.You will build and optimize batch and real?time pipelines, develop ML?driven features, and work closely with stakeholders to translate business needs into robust data architectures.Required skills include Python, SQL, Spark, Kafka, Kubernetes, Hive, and experience with SQL Server and MongoDB/Elk/Cassandra.Agile experience and a passion for learning are essential in this collaborative, multilingual#J-*****-Ljbffr ## Related Videos - [Maximising Cassandra's Potential: Tips on Schema, Queries, Parallel Access, and Reactive Programming](https://www.wearedevelopers.com/videos/1167-maximising-cassandra-s-potential-tips-on-schema-queries-parallel-access-and-reactive-programming) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way) - [40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs](https://www.wearedevelopers.com/videos/208-40-minutes-to-build-a-serverless-covid-19-rest-and-graphql-apis) - [Accelerating GenAI Development: Harnessing Astra DB Vector Store and Langflow for LLM-Powered Apps](https://www.wearedevelopers.com/videos/966-accelerating-genai-development-harnessing-astra-db-vector-store-and-langflow-for-llm-powered-apps) - [Building Real-Time AI/ML Agents with Distributed Data using Apache Cassandra and Astra DB](https://www.wearedevelopers.com/videos/782-building-real-time-ai-ml-agents-with-distributed-data-using-apache-cassandra-and-astra-db) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)