> Markdown version of [/jobs/ext/33191-data-engineer](https://www.wearedevelopers.com/jobs/ext/33191-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Edmunds - **Location:** Torrent, Spain (Remote available) - **Salary:** €125,000.0 - €159,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Systems Engineering, Business Systems, Cloud Computing, Computer Programming, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Software Design Patterns, Python (Programming Language), Object-Oriented Software Development, Software Maintenance, Scala (Programming Language), Software Construction, Software Engineering, SQL Databases, Data Streaming, Unstructured Data, Data Processing, Cloud Platform System, Apache Spark, Information Technology, Real Time Data, Build Process, Data Management, Data Lakehouse, Functional Programming, Data Delivery, Data Pipelines, Databricks - **Published:** May 29, 2026 - **Apply:** https://www.opcionempleo.com/jobad/esbaa1bd20b296df791b90cbf5295a7ef5 ## About the Role * Programming Expertise: High proficiency in at least one object oriented or functional programming language (Almost all of our codebase is in Scala and Python ). * Data Processing: Fluency in SQL and demonstrated experience writing ETL Jobs and working with data at scale. * Streaming/Real-Time: Experience writing and maintaining real time / streaming data pipelines. * Core Tooling: Familiarity with some of the following: Spark, Scala, Python, AWS, Databricks, Airflow. * Software Design: Demonstrated ability to design and write maintainable software, paired with an understanding of software engineering best practices, object oriented analysis & design, and design patterns & algorithms. * System Modernization: Experience enhancing and evolving existing systems. * Professional Skills: Demonstrated problem solving, troubleshooting, and communication skills especially in a hybrid and remote environment. * Platform & Deployment: Familiarity with cloud-based data platforms (particularly Databricks and AWS), CI/CD build pipelines. * Desire to Learn: Desire to learn new technologies. ## Description Edmunds is looking for a data engineer to help us manage the data explosion dilemma! As a Data Engineer, you will architect and scale the foundational data platforms that power Edmunds' analytics, AI/ML initiatives, and business intelligence. You will be joining a strong, determined and results-oriented Data Engineering team that is transforming Edmunds from IT to real time data-driven. In this high-impact technical leadership role, you'll be helping the company make real time decisions based on the torrent of data it receives, empowering analytics on existing products as well as providing insights on potential new opportunities for growth. You aren't just maintaining pipelines; you are defining the architecture that dictates how Edmunds leverages data across the enterprise. What You'll Do: * Pipeline Architecture: Create and maintain scalable, maintainable and reliable data pipelines that process very large quantities of structured and unstructured data in both batch and real time. * Platform Leadership: Enhance and maintain the data lakehouse that powers the core of the company's decision making process. * Core Systems Engineering: Work hands-on with our transactions and pricing pipelines, building and optimizing data workflows using Spark, Databricks, SQL, Scala, and Python. * Process Engineering: Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. * Infrastructure & Cloud: Support infrastructure and build processes, working within AWS to deploy and maintain reliable, scalable data systems. * Cross-functional Collaboration: Work with stakeholders including the Executive, Product, and Data teams to assist with data-related technical issues and support their data infrastructure needs. * Technical Guidance: Design solutions, troubleshoot pipeline issues, and ensure data quality across critical business systems while collaborating with team members with a goal of improving personal knowledge of the systems, ensuring that code changes meet business goals and technology best practices. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Building the platform for providing ML predictions based on real-time player activity](https://www.wearedevelopers.com/videos/944-building-the-platform-for-providing-ml-predictions-based-on-real-time-player-activity) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)