Software Engineer - CDP

We are seeking a skilled and experienced Software Engineer to join our team, focusing on the Customer Data Platform (CDP). This role is crucial in building and maintaining the data infrastructure that powers our personalized customer experiences. As a Data Engineer, you will be responsible for managing integrations with 3rd party systems, developing and maintaining ETL processes, and ensuring the reliability and performance of our data orchestration pipelines. You will collaborate closely with cross-functional teams, including product owners, data analysts, and other engineers, to ensure data quality, integrity, and accessibility. Your work will enable data-driven decision-making and drive impactful marketing outcomes across Mars Petcare., * 3rd Party System Integrations: Design, develop, and manage integrations between the CDP and various 3rd party systems, ensuring seamless data flow and compatibility.

• ETL Development and Management: Design, build, and maintain efficient and scalable ETL processes to extract, transform, and load data from diverse sources into the CDP.
• Data Orchestration Pipeline Management: Develop, manage, and optimize data orchestration pipelines using tools like Digdag, ensuring reliable and timely data delivery.
• Data Pipeline Validation and Testing: Develop and execute comprehensive test plans to validate the accuracy and performance of data orchestration pipelines
• CDP Instance Maintenance: Perform general maintenance and troubleshooting of the CDP instance, ensuring optimal performance and stability.
• Data Quality and Governance: Implement data quality checks, validation processes, and data governance policies to ensure data accuracy, consistency, and compliance.
• Performance Optimization: Optimize data pipelines and queries for performance and efficiency, ensuring timely data delivery for business needs.
• Collaboration and Communication: Collaborate with product owners, data analysts, and other engineers to understand data requirements and deliver effective solutions. Communicate technical concepts and findings clearly to both technical and non-technical stakeholders.
• Documentation: Create and maintain technical documentation as needed for data pipelines, data models, and data processes, etc.
• Setup and configure data source authentications
• Implement and manage data ingestion processes from multiple sources
• Assist in setting up and maintaining the customer unification workflows
• Set up and manage the parent segment
• Assist in validating and testing segment creation processes, * Proficiency in SQL: Expert-level knowledge and experience in writing complex SQL queries and optimizing database performance.
• Proficiency in Python: Strong programming skills in Python for data manipulation, automation, and scripting.
• Experience with Digdag: Hands-on experience with Digdag for building and managing data orchestration pipelines.
• Experience managing 3rd party system integrations: Proven ability to design and implement integrations with various external systems.
• Strong understanding of ETL processes and data warehousing concepts.
• Experience building and maintaining data pipelines.
• Understanding of data integration and data governance principles.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Experience with Agile methodologies.
• Understanding of data privacy regulations.
• Experience working with Customer Data Platforms (CDPs)
• Understanding of data warehousing concepts and data modeling techniques.

Do you have experience in Scripting?

• An industry competitive salary and benefits package, including company bonus.