Data Engineer

Michael Page

London, UK

3 months ago

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

£104,000.0 - £130,000.0

Working hours

Regular working hours

Job source

careerboard.com

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence JIRA Continuous Integration Data Cleansing Information Engineering Extract Transform Load (ETL) Data Security Data Systems Github Python (Programming Language)

+11 more

Performance Tuning Power BI Cloud Services SQL Databases Feature Engineering Snowflake Data Layers Microsoft Fabric Pyspark Software Version Control Data Pipelines

Job description

This is a hands-on Data Engineer role focused on building and optimising modern data pipelines across Fabric and Snowflake. You’ll play a key role in delivering scalable, secure, and high-performance data solutions that support analytics, reporting, and AI initiatives.

Client Details Our client is an international organisation operating at the intersection of financial services, professional development, and data-driven products. They work with global institutions to deliver specialist solutions that combine domain expertise with technology and analytics. As they continue to evolve their digital capabilities, data is becoming a central pillar in enhancing both their internal operations and client-facing services., * Design and deliver scalable ETL/ELT pipelines across Microsoft Fabric and Snowflake

Build and maintain integrations from multiple data sources (APIs, files, feeds)
Implement medallion architecture (bronze, silver, gold) to support analytics and reporting
Develop data models, schemas, and semantic layers for BI and downstream use
Enable interoperability between OneLake/Fabric and Snowflake environments
Optimise performance, cost efficiency, and reliability of data pipelines
Troubleshoot data quality and performance issues, driving continuous improvement
Implement robust security, governance, and client data segregation controls
Support AI/ML use cases through data preparation, feature engineering, and pipelines
Work closely with cross-functional teams and deliver through Jira-based workflows
Maintain documentation, version control (GitHub), and CI/CD best practices

Requirements

5+ years’ experience in data engineering roles delivering scalable data solutions
Strong expertise in SQL, data modelling, and cloud data platforms
Hands-on experience with Snowflake and Microsoft Fabric (OneLake)
Proficiency in Python and PySpark, including notebooks and automation
Experience building and maintaining ETL/ELT pipelines at scale
Strong understanding of performance optimisation and cost management
Knowledge of data security, governance, and privacy (eg GDPR)
Experience with BI tools (Power BI preferred)
Comfortable working in Agile environments with Jira, CI/CD, and GitHub
Proactive, self-sufficient, and strong collaborator across teams