SENIOR DATA ENGINEER-REMOTE

We are seeking a hands-on, collaborative Master Data Management (MDM) Data Engineer to join our data platform team. This role involves designing and implementing scalable, cloud-native data architectures and solutions across AWS. You'll work closely with data engineers, developers, and business stakeholders to manage data pipelines from ingestion to modeling, while also building APIs to support analytics, reporting, and business intelligence.

Our technology stack centers around Python and AWS, leveraging services such as S3, PostgreSQL, DynamoDB, Athena, Snowflake, Redshift, Lambda, and Glue. Familiarity with modern data stack technologies, DevOps, and data security best practices is a strong advantage., * Design, develop, and deploy scalable and secure data pipelines and cloud-native architectures (data lakes, warehouses, and streaming pipelines) on AWS.

• Build and maintain ETL/ELT workflows using AWS Glue, Lambda, and Python to support a variety of data integration needs.
• Develop, deploy, and optimize APIs to enable seamless data access for business intelligence, analytics, and operational systems.
• Analyze, debug, and resolve data quality issues and pipeline failures to ensure data accuracy and reliability.
• Collaborate across teams-including data science, analytics, and software engineering-to design and implement reusable data models.
• Ensure efficient, scalable, and secure serverless operations through performance tuning and best practices in AWS environments.
• Create and maintain documentation, architecture diagrams, and data flow maps for internal and external use.
• Implement and manage data governance, security protocols, compliance standards, and privacy best practices.
• Incorporate AI tools, such as ChatGPT, to streamline engineering tasks, documentation, and data exploration.
• Lead integration efforts with third-party APIs and data sources to expand the organization's data capabilities.
• Establish and enforce architectural best practices, CI/CD pipelines, and Infrastructure as Code (IaC) in collaboration with DevOps teams.
• Mentor team members, stay current with AWS innovations, and champion modern data practices across the organization.

• Bachelor's degree in computer science, Information Systems, Analytics, or related field.
• 5+ years of experience in data architecture, engineering, or similar roles.
• 3+ years of hands-on programming experience with Python.
• 3+ years of experience building and managing ETL/ELT data pipelines.
• Strong SQL skills and ability to write performant queries across various data stores.
• Proficient with AWS services: Lambda, Glue, S3, DynamoDB, Athena, Redshift, and Snowflake.
• Solid understanding of OLTP, ODS, and dimensional modeling techniques.
• Experience designing APIs and integrating with API-driven data workflows.
• Strong knowledge of serverless architecture patterns and best practices.
• Excellent problem-solving, analytical, and communication skills.
• Experience in agile development environments with CI/CD workflows.
• Ability to collaborate across engineering, data, and business teams.

Preferred Skills:

• AWS Certifications (e.g., AWS Solutions Architect).
• Experience with modern data stack tools such as dbt, Snowflake, Databricks.
• Familiarity with machine learning pipelines and AI-driven analytics.
• Experience with Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation.
• Background in DevOps and automated deployment strategies for data workflows.
• Experience integrating with ServiceNow application., Qualified candidates must be able to perform the essential functions of this position satisfactorily with or without a reasonable accommodation. Disclaimer: this job post is not necessarily an exhaustive list of all essential responsibilities, skills, tasks, or requirements associated with this position. While this is intended to be an accurate reflection of the position posted, the Company reserves the right to modify or change the essential functions of the job based on business necessity. We will consider for employment all qualified applicants, including those with a criminal history (including relevant driving history), in a manner consistent with all applicable federal, state, and local laws, including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance, the San Francisco Fair Chance Ordinance, and the New York Fair Chance Act.

• Medical
• Dental
• Vision
• Life Insurance/ AD
• Disability Insurance
• Retirement Plan
• Paid Time Off
• Holiday Time Off (varies by site/state)
• Associate Shopping Program
• Health and Wellness Programs
• Discount Marketplace
• Identity Theft Protection
• Pet Insurance
• Commuter Benefits
• Employee Assistance Program
• Flexible Spending Accounts (FSAs)
• Paid Parental Leave
• Personal Leave

Associates may also be eligible for paid and/or unpaid time off benefits in accordance with applicable federal, state, and local laws. For positions in Washington State, Maryland, or to be performed Remotely, click here (https://www.compass-usa.com/wp-content/uploads/2023/08/2023_WageTransparency_CorpAndFoodbuy.pdf) or copy/paste the link below for paid time off benefits information.

We are CDAI-the data and artificial intelligence engine of Compass Group North America. We design and deliver custom, in-house solutions tailored to the unique complexities of food service and hospitality. Our work is grounded in strong data foundations, layered with AI to enhance forecasting, streamline operations, and enable better, faster decision-making across Compass Group. With deep integration into the business and a commitment to white-glove service, CDAI empowers associates, clients, and customers through innovative, future-forward technologies.