Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+9 more
Job description
OverviewIn this role you will help build the global data product foundation that powers PepsiCo’s international growth in digital commerce.You’ll work with a cross-functional team to design, implement, and scale data pipelines and platforms that enable data-driven decisions.You will contribute to engineering best practices and collaborate with product, QA, and IT teams to improve data quality and delivery.This is a chance to shape data infrastructure for a global business and accelerate transformative initiatives in a startup-minded, enterprise environment.ResponsabilidadesOwn end-to-end data pipeline development, including modeling, testing, scalability, and operabilityContribute to engineering best practices within the teamCollaborate with product and technology platforms to implement data solutionsParticipate in architecture discussions and decisions to expand platformsDeliver high quality pipelines through analysis, reviews, test automation, and QA collaborationIntroduce new tools and practices to improve data and code quality, researching or sourcing third-party tools and building in-house toolsSupport pipelines with robust exception handling, monitoring, and debugging production issuesManage multiple data sources, analyze data quality, and coordinate with client IT/data teams to resolve issuesRequisitos principales5+ years designing and building scalable data systemsProficiency in Python, PySpark, SQL, Airflow, DBT, Hadoop (Hive/Impala), AWS, Azure, SnowflakeStrong interpersonal skills to understand Enterprise Information Management requirements and translate to solutionsExperience in Retail, E-commerce, or Financial Services preferredStrong analytical abilities for complex customer problems and data-driven decisionsHands-on experience with large data sets using Python/PySpark/SQL/Hive/ImpalaProven track record of achievement, entrepreneurial hands-on approach, and strong communication skillsDeep understanding of database design and engineeringstrong communicationcollaborationanalytical mindsetPythonPySparkSQL
Requirements
Proficiency in Python, PySpark, SQL, Airflow, DBT, Hadoop (Hive/Impala), AWS, Azure, Snowflake Strong interpersonal skills to understand Enterprise Information Management requirements and translate to solutions Experience in Retail, E-commerce, or Financial Services preferred Strong analytical abilities for complex customer problems and data-driven decisions Hands-on experience with large data sets using Python/PySpark/SQL/Hive/Impala Proven track record of achievement, entrepreneurial hands-on approach, and strong communication skills Deep understanding of database design and engineering strong communication collaboration analytical mindset Python PySpark SQL
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
Making Data Warehouses Fast: A Developer’s Story
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production