Senior Data Engineer

PepsiCo
Álava, Spain
14 days ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Data Analysis Automation of Tests Microsoft Azure Big Data Cloud Computing Cloudera Impala Software Quality Information Engineering Data Warehousing Database Design
+12 more
Software Debugging Enterprise Information Management Apache Hadoop Apache Hive Python (Programming Language) Machine Learning Software Engineering SQL Databases Snowflake Pyspark Data Analytics Data Pipelines

Job description

Overview The next great shift in consumer behavior driven by technological disruption is underway, and it’s happening in the food & beverage industry.As other sectors have shifted to Digital Commerce-first business models in recent years, food & beverage has continued to rely predominantly on traditional brick & mortar models, but this is changing rapidly.New technologies are transforming every aspect of reaching consumers, from the rise of digital marketing and online grocery platforms to the creation of supply chain tools that enable speedy at-home delivery.Although PepsiCo is a large multinational, the PepsiCo Global Digital Commerce Team prides itself on having the entrepreneurial, action-oriented culture of an exciting startup business.Our group includes startup founders, Silicon Valley veterans, food & beverage experts, and seasoned executives from digital transformation leaders such as Amazon and Walmart.Our goal is to build the technological products and capabilities that will reinvent our industry and make us the #1 food & beverage business in Digital Commerce for decades to come To deepen our efforts to seize this opportunity and lead the food & beverage industry into its remarkable next chapter, PepsiCo - a global company with powerhouse brands including Frito-Lay, Gatorade, Pepsi-Cola, Quaker, and Tropicana - is expanding its Global Digital Commerce Team to power International Growth.We’re looking for the greatest minds in data & analytics, data engineering, software development, machine learning optimization and more.All with the aim to empower out International expansion and delight our consumers through addressing of current and future facing butsiness challenges that are complex and require insightful and impactful solutions.We are looking for seasoned data engineers to join our team as we continue to grow our capability footprint across regions.The DE engineer will apply Data Warehouse and Cloud techniques to build truly Global Data Product which lays a foundation to all of our current and future Capabilities.ResponsibilitiesOwn data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics.Contribute to best practices for engineering, and coding as part of a world class engineering team in PepsiCo.Work with the product team leveraging our core technology platformsCollaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms.Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineersIntroduce new tools / practices to improve data and code quality; this includes researching / sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineersSupport data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issuesExtremely comfortable working with data, including managing large number of data sources, analysing data quality, and pro-actively working with client’s data/ IT teams to resolve issuesQualifications5+ years of experience in designing and building systems for collecting, storing, and analysing data at scaleRequired skills: Python, PySpark, SQL,Airflow , DBT, Big Data - Hadoop (Hive/Impala), AWS, Azure, SnowflakeStrong interpersonal skills to effectively interact with client/onshore personnel to understand specific Enterprise Information Management requirement and develop solutions based on those requirementExperience in Retail, E-commerce or Financial Services domain is preferred.Very strong analytical skills with the demonstrated ability to research and make decisions based on the day-to-day and complex customer problems requiredHands on experience of handling large data sets and use of python/PySpark/SQL/Hive/Impala for data analysisStrong record of achievement, solid analytical ability, and an entrepreneurial hands-on approach to work.Outstanding written and verbal communication skillsDeep understanding of database design and engineering

Requirements

Qualifications5+ years of experience in designing and building systems for collecting, storing, and analysing data at scale Required skills: Python, PySpark, SQL,Airflow , DBT, Big Data - Hadoop (Hive/Impala), AWS, Azure, Snowflake Strong interpersonal skills to effectively interact with client/onshore personnel to understand specific Enterprise Information Management requirement and develop solutions based on those requirement Experience in Retail, E-commerce or Financial Services domain is preferred. Very strong analytical skills with the demonstrated ability to research and make decisions based on the day-to-day and complex customer problems required Hands on experience of handling large data sets and use of python/PySpark/SQL/Hive/Impala for data analysis Strong record of achievement, solid analytical ability, and an entrepreneurial hands-on approach to work. Outstanding written and verbal communication skills Deep understanding of database design and engineering

About the company

Álava, España

Overview The next great shift in consumer behavior driven by technological disruption is underway, and it’s happening in the food & beverage industry. As other sectors have shifted to Digital Commerce-first business models in recent years, food & beverage has continued to rely predominantly on traditional brick & mortar models, but this is changing rapidly. New technologies are transforming every aspect of reaching consumers, from the rise of digital marketing and online grocery platforms to the creation of supply chain tools that enable speedy at-home delivery. Although PepsiCo is a large multinational, the PepsiCo Global Digital Commerce Team prides itself on having the entrepreneurial, action-oriented culture of an exciting startup business. Our group includes startup founders, Silicon Valley veterans, food & beverage experts, and seasoned executives from digital transformation leaders such as Amazon and Walmart. Our goal is to build the technological products and capabilities that will reinvent our industry and make us the #1 food & beverage business in Digital Commerce for decades to come To deepen our efforts to seize this opportunity and lead the food & beverage industry into its remarkable next chapter, PepsiCo - a global company with powerhouse brands including Frito-Lay, Gatorade, Pepsi-Cola, Quaker, and Tropicana - is expanding its Global Digital Commerce Team to power International Growth. We’re looking for the greatest minds in data & analytics, data engineering, software development, machine learning optimization and more. All with the aim to empower out International expansion and delight our consumers through addressing of current and future facing butsiness challenges that are complex and require insightful and impactful solutions. We are looking for seasoned data engineers to join our team as we continue to grow our capability footprint across regions.The DE engineer will apply Data Warehouse and Cloud techniques to build truly Global Data Product which lays a foundation to all of our current and future Capabilities. ResponsibilitiesOwn data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics. Contribute to best practices for engineering, and coding as part of a world class engineering team in PepsiCo. Work with the product team leveraging our core technology platforms Collaborate in architecture discussions and architectural decision making that is part of continually improving and expanding these platforms. Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineers Introduce new tools / practices to improve data and code quality; this includes researching / sourcing 3rd party tools and libraries, as well as developing tools in-house to improve workflow and quality for all data engineers Support data pipelines developed by your team through good exception handling, monitoring, and when needed by debugging production issues

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all