> Markdown version of [/jobs/ext/1942969-data-engineer-scala-spark-aws](https://www.wearedevelopers.com/jobs/ext/1942969-data-engineer-scala-spark-aws). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer (Scala Spark AWS - **Company:** Open Digital Services - **Location:** Madrid, Spain - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Data Analysis, Apache HTTP Server, JIRA, Software Quality, Collaborative Software, Databases, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Systems, DevOps, Distributed Computing Environment, Apache Hive, Identity and Access Management, Python (Programming Language), Machine Learning, Cisco Nexus Switches, Operational Databases, Performance Tuning, Cloud Services, Standard Sql, Scala (Programming Language), Software Engineering, SONAR (Symantec), Workflow Management Systems, Cloud Platform System, Apache Spark, Git, Data Lakes, Pyspark, Apache Flink, Spark Streaming, Splunk, Software Version Control, Data Pipelines, Jenkins - **Published:** August 6, 2026 - **Apply:** https://www.jobleads.com/es/job/ebdeb387be8c1d08a06d667bbba406d95 ## About the Role * 5+ years of experience in Data Engineering, Big Data Engineering, Software Engineering or similar technical roles. Required * Experience building production-grade data pipelines in large-scale or complex data environments. Required * Hands-on experience working with Apache Spark in real projects, preferably with Scala. Required * Experience working with cloud data platforms. Required * Experience in banking, fintech or regulated environments. Preferred Language * Fluent Spanish. Preferred * Professional English. Required Hard Skills * Strong experience with Spark-based distributed processing. Required * Strong Python or Scala coding skills for data engineering use cases. Required * Solid SQL knowledge and experience working with relational and analytical databases. Required * Experience designing and optimizing ETL/ELT processes. Required * Experience with AWS or similar cloud ecosystems; ideally S3, Glue, Athena, EMR, Redshift, IAM or Lake Formation. Required * Experience with Git and collaborative software development practices. Required * Understanding of data quality, validation, monitoring and performance optimization. Required * Experience with CI/CD or DevOps tools such as Jenkins, Sonar, Nexus, Jira, Splunk or similar. Preferred * Experience with Apache Flink, Spark Streaming or near-real-time applications. Preferred * Experience with Apache Iceberg, Delta Lake or modern lakehouse formats. Preferred * Experience with Airflow or workflow orchestration tools. Preferred Soft Skills * Strong problem-solving skills and ability to work autonomously. Required * Ownership mindset and focus on building reliable, maintainable solutions. Required * Ability to communicate clearly with technical and non-technical stakeholders. Required * Collaborative approach and ability to work across Data Engineering, Data Science, ML and business teams. Required * Curiosity and willingness to learn new tools, frameworks and cloud services. Required ## Description As a Senior Data Engineer within the Data Management department, you will design, build and optimize scalable data solutions that support analytics, machine learning, reporting and business-critical decision-making. This position can be Madrid-based with two days a week in the office, or remote within Spain. You will work with large and complex data environments, developing robust data pipelines and distributed processing solutions using Spark-based technologies. This role is ideal for someone with strong data engineering fundamentals, hands-on experience with PySpark or Spark SQL, and the ability to build reliable production data solutions in cloud environments. To succeed in this role, you will be responsible for: * Designing, developing and optimizing large-scale data pipelines using Apache Spark, mainly with Scala/Spark. * Building and maintaining batch and near-real-time data processing solutions for high-volume data environments. * Creating reliable, reusable and well-structured datasets consumed by Analytics, Data Science, Machine Learning and business teams. * Working with cloud data platforms, ideally AWS, to process, transform, store and expose data efficiently. * Implementing data quality, validation, monitoring and documentation practices across data pipelines. * Collaborating with Data Engineering, Data Science, Machine Learning, Architecture and business teams to understand requirements and deliver practical data solutions. * Contributing to engineering best practices around code quality, testing, version control, CI/CD and automation. ## Related Videos - [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture) - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)