MDM Data Engineer
Response Informatics
London, UK
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Microsoft Azure
Big Data
Cloud Computing
Data Architecture
Data Deduplication
Information Engineering
Data Governance
Data Integration
Data Masking
Intrusion Detection Systems
Metadata
+9 more
SQL Databases
Data Layers
Data Lakes
Pyspark
Data Lineage
Data Management
Entity Resolution
Data Pipelines
Databricks
Job description
· Design and implement MDM solutions, including common IDs, Golden Records, entity matching, deduplication, and survivorship rules.
- Integrate data from multiple source systems into the Databricks Lakehouse.
- Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake.
- Build and enhance Bronze, Silver, and Gold data layers.
- Implement data quality, standardization, reconciliation, and validation processes.
- Support Unity Catalog, data lineage, access controls, cataloguing, and data governance.
- Implement data masking and anonymization for sensitive data.
- Build trusted, reusable data layers for cross-platform analytics and intelligence.
- Collaborate with business, architecture, and engineering teams to define MDM and data integration requirements.
Requirements
· Strong experience in Master Data Management (MDM) and data engineering.
- Hands-on expertise in Databricks, PySpark, SQL, Delta Lake, and Lakehouse architecture.
- Experience with Golden Records, common IDs, entity resolution, deduplication, and data quality.
- Good understanding of Unity Catalog, data governance, metadata, and lineage.
- Experience integrating data from multiple enterprise platforms.
- Knowledge of Medallion Architecture and data privacy/anonymization.
Good to Have
· Experience with Informatica MDM/IDMC, Reltio, Profisee, Semarchy, or similar MDM platforms.
- Cloud experience with Azure, AWS, or GCP.
- Exposure to large-scale data modernization or migration programs.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…