Data Engineer (MDM Platform)

Incedo Inc
Raleigh, NC, United States
3 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Airflow Microsoft Azure Cloud Computing Directed Acyclic Graph (Directed Graphs) Data Validation Data Deduplication Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Electronic Data Interchange (EDI) Elasticsearch
+16 more
Python (Programming Language) Performance Tuning Cloud Services Azure Data Lake SQL Databases Data Logging Data Ingestion Snowflake Change Tracking Git Event Driven Architecture Integration Frameworks Data Management Restful APIs Data Pipelines Serverless Computing

Job description

We are looking for a Data Engineer with strong Master Data Management (MDM) platform experience to design, develop, and maintain scalable data pipelines and data integration solutions. The ideal candidate will have hands-on expertise in Snowflake, dbt, Python, Apache Airflow, and Azure technologies, with a solid understanding of MDM concepts, data quality, and enterprise-scale data engineering practices.

WHAT YOU’LL DO

  • Develop end-to-end ETL/ELT pipelines for data ingestion, transformation, standardization, and master data processing.
  • Build and optimize Snowflake SQL queries, dbt models, incremental loads, and data quality tests.
  • Implement MDM workflows including entity matching, survivorship, deduplication, and golden record creation.
  • Design and implement SCD Type 1 and Type 2 processes, change tracking, and historical data management.
  • Develop and orchestrate Apache Airflow DAGs, managing task dependencies, scheduling, retries, and error handling.
  • Integrate Azure Functions, Event Grid, Blob Storage, and ADLS Gen2 for event-driven processing and data exchange.
  • Develop Python-based solutions and integrate Snowflake with Elasticsearch for downstream data publishing.
  • Implement data validation, reconciliation, logging, monitoring, and performance optimization mechanisms.
  • Manage source code, deployments, and release processes using Git and CI/CD pipelines., * Opportunity to work on enterprise-scale MDM and cloud data platforms.
  • Exposure to modern data engineering technologies and architectures.
  • Collaborative and innovation-driven work environment.
  • Continuous learning and career growth opportunities.
  • Flexible hybrid work model.

Requirements

  • 3-5 years of experience in Data Engineering, Data Integration, or MDM-related roles.
  • Strong hands-on experience with Snowflake, SQL, dbt, Python, and Apache Airflow.
  • Experience developing and maintaining ETL/ELT pipelines in cloud-based environments.
  • Working knowledge of Azure services, Elasticsearch, and REST APIs.
  • Strong understanding of data modeling, data quality frameworks, incremental loading, and SCD Type 2 implementations.
  • Experience with Git, CI/CD pipelines, troubleshooting, and production support.
  • Understanding of Master Data Management concepts and best practices.
  • Strong analytical, problem-solving, and communication skills.

Good to Have

  • Prior experience working on MDM platforms and data governance initiatives.
  • Healthcare or pharmaceutical domain experience.
  • Experience with Snowpark.
  • Knowledge of event-driven architectures and modern data processing frameworks.

About the company

Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive innovation and business growth through technology. With over 4,000 professionals across the US, Canada, Latin America, and India, Incedo combines expertise in AI, data analytics, and digital engineering to deliver impactful solutions across Banking & Payments, Telecom, Hi-Tech, Wealth Management, and Life Sciences. At Incedo, we foster a culture of innovation, collaboration, and continuous learning, empowering our people to solve complex challenges and shape the future of technology.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…