Data Engineer (FTC)

Local Pensions Partnership
London, UK
27 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Microsoft Azure Databases Continuous Integration Data Architecture Data Validation Data Cleansing Information Engineering Extract Transform Load (ETL) Data Transformation
+19 more
Dimensional Modeling Python (Programming Language) Metadata Raw Data Power BI Software Requirements Analysis SQL Databases Data Streaming Data Storage Technologies Delivery Pipeline Snowflake Parallel Computation Git Powerquery Build Management Data Lakes Information Technology Software Version Control Data Pipelines

Job description

One of the key priorities at LPPI is ensuring that our people work every day in an empowered, supportive, diverse and inclusive culture. Practically, this means recognising and valuing the uniqueness of every individual in terms of background, experience, beliefs and circumstances. This starts with the recruitment process, where we partner with agencies who share our common goal and advertise on a variety of job boards to access the broadest spectrum of candidates. And once successful applicants are on board, we trust our people to work in the way that works best for them which typically involves a mix of office and home working plus an engagement model to ensure frequent two-way feedback., The purpose of this document is to solicit proposals from quali?ed vendors to supply a ā€˜Hands-on’ Data Engineer’s role that aligns with LPPI’s purpose by supporting the delivery of innovative, supportable, and sustainable solutions that help LPPI achieve its vision of being a leading provider of pensions and investments., * Commercial project experience in delivering modern data solution using Medallion Architecture and experienced in

  • Work closely with business analysts, and stakeholders to understand data requirements.
  • Creation of technical specifications and architecture visions covering quality attributes, diagrams, associated risks, technical and system requirements.
  • Collaborate with wider Data Team and Business Analysts to align data models with business needs
  • Build and maintain robust ETL pipelines to extract data from diverse sources (e.g. APIs, databases, flat files).
  • Use Azure Git Repo, Boards and CI/CD deployment pipelines for version control of ETL, SQL & Reports
  • Transform and load raw data into structured formats using business rules, data cleansing and enrichment techniques into a unified schema.
  • Design and implement reporting data models (e.g. star/snowflake schemas) to support analytics
  • Tune ETL activities for efficiency and scalability through data indexing, partitioning, as well as parallel processing strategies to reduce latency and improve throughput
  • Implement data validation rules & cleansing routines to ensure accuracy and consistency.
  • Monitor data pipelines for anomalies, errors, and performance issues
  • Implement access controls and encryption where necessary
  • Document ETL processes, data flows, and transformation logic for transparency and maintainability
  • Design and build interactive, visually compelling Power BI reports and dashboards tailored to business needs.
  • DP-203: Data Engineering on Microsoft Azure or an equivalent certification. Additional certification / courses in use of Gen AI will be beneficial

Requirements

  • Medallion, Delta Lake and metadata driven Architecture using MS Fabric or Synapse Analytics ETL pipelines
  • Data Transformation using SQL Query Language and Python notebooks
  • Data storage and warehouse using SQL DB, delta lake(Gen2), Snowflake
  • Dimensional modelling using Kimball methodology
  • Power BI Interactive Dashboard and Paginated Reports using DAX functions, Power Query.
  • A familiarity in Investment Management and/or Financial Services
  • Commercial experience working with business stakeholders within a cross-functional matrix environment.
  • Experience in the delivery of projects utilising Agile methodologies.
  • Must be able to understand and apply new technologies to stay current with best practices and trends in application and data architecture for financial services.
  • Confidence in handling, interpreting, and presenting complex numerical data and technological challenges in a clear and concise manner.
  • Self-motivated, decisive, with the ability to adapt to change and competing demands.
  • Experience working both independently and within a team-oriented, collaborative environment.
  • Adept at conducting research into project-related issues and products.
  • A proactive, self-motivated team player who can manage a high workload with multiple deadlines and continually strive for improvements in quality, efficiency and presentation.
  • Bachelor’s degree in computer science, engineering, or a related field (or equivalent experience).
  • Maintain a working technical understanding of the complexities in delivering change into an Investment Management organisation, specifically where application eco-system is de-centralised.
  • Good conduct that is consistent with the LPPI values- aligned behaviours

Reasonable adjustment will be made to working arrangements to accommodate a person with a disability who otherwise would be prevented from undertaking the work.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on uk.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt Ā· LIVE

4:09 min

Challenges of interpreting raw data with language models

Clemens Vasters Clemens Vasters Ā· WWC 2025

1:46 min

Traditional data architecture before Microsoft Fabric

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 Ā· WWC 2025

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer Ā· Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou Ā· Coffee With Developers

2:09 min

Uncovering hidden coordinate manipulation communities in binary data

Nolan Royalty Ā· Coffee With Developers

Videos

See all

Related articles

See all