Markit EDM Developer

CYNET SYSTEMS INC.
Fort Mill, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 125K

Job location

Fort Mill, United States of America

Tech stack

Java
API
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Azure
Big Data
Cloud Computing
Cloud Database
Cloud Engineering
Code Review
Databases
Continuous Integration
Data Governance
Data Infrastructure
Data Transformation
Dataspaces
Relational Databases
Github
Design of User Interfaces
Hive
Python
PostgreSQL
Microsoft SQL Server
Node.js
Octopus Deploy
Oracle Applications
Performance Tuning
Scrum
Prometheus
SQL Stored Procedures
SQL Databases
Data Streaming
Enterprise Data Management
Data Logging
Data Processing
Snowflake
Grafana
Spark
Spring-boot
Indexer
Gitlab
GIT
Cloudformation
Event Driven Architecture
Amazon Web Services (AWS)
Containerization
Data Lake
PySpark
Material Design
Kubernetes
Infrastructure Automation Frameworks
Data Lineage
Collibra
Deployment Automation
Amazon Web Services (AWS)
Kafka
Functional Programming
Cloudwatch
REST
Terraform
Stream Processing
Splunk
Software Version Control
Docker
Jenkins
Redshift
Databricks
Microservices

Job description

  • Lead design and development of enterprise MDM solutions on Markit EDM CADIS.
  • Architect and implement Core Matcher frameworks, entity resolution, survivorship rules, and Golden Record creation and lifecycle management.
  • Develop end-to-end data mastering pipelines including Data Constructors, Data Porters, Data Flows, and Rules Engines.
  • Ensure scalability, reusability, and performance optimization.
  • Design and develop Workflow UI components including WF Pages, WF Elements, and user-driven stewardship flows.
  • Implement data governance workflows, approval, exception handling, and audit trails.
  • Enable data lineage transparency and stewardship across domains, especially Party/Client.
  • Implement real-time data processing and notifications using Apache Kafka and event-driven EDM triggers.
  • Design near real-time mastering and synchronization patterns.
  • Integrate EDM into enterprise event ecosystems.
  • Develop and expose RESTful APIs using Data Generators and Process Launchers.
  • Integrate with microservices architecture using Spring Boot, Java, and Node.js.
  • Deploy and manage EDM solutions on AWS or Azure equivalent including AWS Glue, Lambda, S3, RDS, and eventing.
  • Integrate EDM with modern data platforms such as Snowflake, Databricks, and Redshift.
  • Design hybrid architecture for EDM golden source and Data Lake analytical layer.
  • Work with Python, PySpark, and Spark SQL for data transformation, enrichment pipelines, and large-scale data processing.
  • Handle ingestion from APIs, flat files, streaming feeds, and databases.
  • Optimize large-volume batch and streaming pipelines.
  • Build and maintain CI/CD pipelines for EDM using GitHub, GitLab, Octopus Deploy, Jenkins, and Azure DevOps.
  • Use Infrastructure as Code (IaC) tools such as Terraform and CloudFormation.
  • Implement automated deployments, environment promotion, and version control strategies.
  • Work with Docker and Kubernetes for microservices deployment and integration layers around EDM.
  • Enable scalable, resilient cloud-native deployments.
  • Implement monitoring and logging using Splunk, ELK, Prometheus, Grafana, and CloudWatch.
  • Perform performance tuning of matchers and batch jobs, and conduct root cause analysis and production support.
  • Design and optimize databases across SQL Server, Oracle, PostgreSQL, and cloud-native warehouses.
  • Develop complex SQL, stored procedures, and indexing and performance tuning strategies.
  • Lead onsite-offshore model delivery and act as technical SME and solution architect for EDM.
  • Collaborate with Business Analysts, Data Architects, and Scrum Teams.
  • Conduct code reviews, design reviews, and release governance.

Requirements

  • 5-10 years of experience in MDM with 5+ years in Markit EDM IHS.
  • Strong expertise in Core Matcher design, data mastering pipelines, and Workflow/UI development.
  • Hands-on experience with Kafka or equivalent streaming, AWS cloud services, and REST API development.
  • Strong database experience across RDBMS and cloud data warehouses.
  • Experience with CI/CD, Git, and Terraform.
  • Proficiency in Python or Spark-based data processing., * Experience with Markit EDM Cloud 19x.
  • Strong domain knowledge in Party, Client, and Instrument MDM.
  • Experience with Databricks, Snowflake ecosystems, and microservices architecture using Spring Boot and Node.js.
  • Experience with Kubernetes and containerization.
  • Exposure to data governance frameworks such as Collibra and Alation.

Skills:

  • Deep expertise in Markit EDM and modern data ecosystem.
  • Strong architecture and system design mindset.
  • Ability to lead complex data platform transformations.
  • Excellent communication and stakeholder management.
  • Strong problem-solving and performance optimization skills.

Apply for this position