> Markdown version of [/jobs/ext/1444386-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1444386-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** PepsiCo - **Location:** Legutio, Spain - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Data Analysis, Automation of Tests, Microsoft Azure, Big Data, Cloudera Impala, Software Quality, Database Design, Software Debugging, Enterprise Information Management, Apache Hadoop, Apache Hive, Python (Programming Language), SQL Databases, Snowflake, Pyspark, Data Pipelines - **Published:** July 26, 2026 - **Apply:** https://es.indeed.com/viewjob?jk=fd62684ed0587954 ## About the Role * 5+ years of experience in designing and building systems for collecting, storing, and analysing data at scale * Required skills: Python, PySpark, SQL,Airflow , DBT, Big Data - Hadoop (Hive/Impala), AWS, Azure, Snowflake * Strong interpersonal skills to effectively interact with client/onshore personnel to understand specific Enterprise Information Management requirement and develop solutions based on those requirement * Experience in Retail, E-commerce or Financial Services domain is preferred. * Very strong analytical skills with the demonstrated ability to research and make decisions based on the day-to-day and complex customer problems required * Hands on experience of handling large data sets and use of python/PySpark/SQL/Hive/Impala for data analysis * Strong record of achievement, solid analytical ability, and an entrepreneurial hands-on approach to work. * Outstanding written and verbal communication skills * Deep understanding of database design and engineering ## Description * Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics. * Contribute to best practices for engineering, and coding as part of a world class engineering team in PepsiCo. * Work with the product team leveraging our core technology platforms * Collaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms. * Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineers * Introduce new tools / practices to improve data and code quality; this includes researching / sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers * Support data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issues * Extremely comfortable working with data, including managing large number of data sources, analysing data quality, and pro-actively working with client's data/ IT teams to resolve issues ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)