Data Engineer

Tenth Revolution Group

London, UK

25 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

3 years minimum

Compensation

£50,000.0 - £75,000.0

Working hours

Regular working hours

Job source

www.reed.co.uk

Tech stack

Amazon Web Services Microsoft Azure Big Data Cloud Database Data Architecture Information Engineering Data Governance Extract Transform Load (ETL) Data Mapping Data Migration Data Profiling Data Security

+16 more

Data Systems Data Warehousing Relational Databases Database Queries Apache Hadoop Information Lifecycle Management Python (Programming Language) Meta-Data Management Standard Sql SQL Databases Google Cloud Apache Spark Data Lineage Data Management Data Pipelines Programming Languages

Job description

Design, develop and deploy enterprise-wide data management solutions.
Build and optimise ETL/ELT pipelines and automated data workflows.
Deliver Data Quality programmes, including data profiling, cleansing, validation and monitoring.
Lead and support complex Data Migration projects across multiple source and target systems.
Define migration strategies, data mapping, transformation logic, validation and reconciliation processes.
Implement and maintain Master Data Management (MDM) solutions and governance processes.
Develop and manage metadata capabilities, including data catalogues, business glossaries and data lineage.
Support Data Governance initiatives, ensuring data security, privacy and compliance standards are maintained.
Work with large and complex datasets using SQL, Python, Spark, Hadoop and modern data technologies.
Collaborate with technical and business stakeholders within Agile delivery environments.
Support data architecture and data modelling activities across enterprise platforms.
Utilise cloud-based data services across Azure, AWS and GCP environments.

Requirements

Proven experience delivering Data Engineering and Data Management solutions within enterprise environments.
Strong experience designing and implementing Data Quality frameworks and programmes.
Demonstrable experience delivering end-to-end Data Migration projects.
Experience with Metadata Management, including data cataloguing, lineage and business glossary development.
Hands-on experience implementing and managing Master Data Management (MDM) solutions.
Strong SQL skills and proficiency in Python or similar programming languages.
Experience with ETL/ELT tools, data warehousing and automated data pipelines.
Knowledge of Spark, Hadoop or similar big data technologies.
Strong understanding of Data Governance principles, policies, controls and data lifecycle management.
Experience working within Agile delivery environments.
Familiarity with dimensional and relational data modelling techniques.
Understanding of data architecture principles and best practices.
Experience with Azure, AWS or GCP data services would be advantageous.
Excellent analytical, problem-solving and stakeholder management skills., * AWS
Data Engineer - SQL
Python
Spark - Azure
GCP - ETL/ELT