Data Engineer (FTC)

Local Pensions Partnership
Charing Cross, United Kingdom
3 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote
Charing Cross, United Kingdom

Tech stack

API
Agile Methodologies
Artificial Intelligence
Azure
Databases
Continuous Integration
Data Architecture
Data Validation
Data Cleansing
Information Engineering
ETL
Data Transformation
Dimensional Modeling
Python
Metadata
Raw Data
Power BI
Software Requirements Analysis
SQL Databases
Data Streaming
Data Storage Technologies
Delivery Pipeline
Snowflake
Parallel Computation
GIT
Powerquery
Build Management
Data Lake
Information Technology
Software Version Control
Data Pipelines

Job description

One of the key priorities at LPPI is ensuring that our people work every day in an empowered, supportive, diverse and inclusive culture. Practically, this means recognising and valuing the uniqueness of every individual in terms of background, experience, beliefs and circumstances. This starts with the recruitment process, where we partner with agencies who share our common goal and advertise on a variety of job boards to access the broadest spectrum of candidates. And once successful applicants are on board, we trust our people to work in the way that works best for them which typically involves a mix of office and home working plus an engagement model to ensure frequent two-way feedback., The purpose of this document is to solicit proposals from quali?ed vendors to supply a 'Hands-on' Data Engineer's role that aligns with LPPI's purpose by supporting the delivery of innovative, supportable, and sustainable solutions that help LPPI achieve its vision of being a leading provider of pensions and investments., * Commercial project experience in delivering modern data solution using Medallion Architecture and experienced in

  • Work closely with business analysts, and stakeholders to understand data requirements.
  • Creation of technical specifications and architecture visions covering quality attributes, diagrams, associated risks, technical and system requirements.
  • Collaborate with wider Data Team and Business Analysts to align data models with business needs
  • Build and maintain robust ETL pipelines to extract data from diverse sources (e.g. APIs, databases, flat files).
  • Use Azure Git Repo, Boards and CI/CD deployment pipelines for version control of ETL, SQL & Reports
  • Transform and load raw data into structured formats using business rules, data cleansing and enrichment techniques into a unified schema.
  • Design and implement reporting data models (e.g. star/snowflake schemas) to support analytics
  • Tune ETL activities for efficiency and scalability through data indexing, partitioning, as well as parallel processing strategies to reduce latency and improve throughput
  • Implement data validation rules & cleansing routines to ensure accuracy and consistency.
  • Monitor data pipelines for anomalies, errors, and performance issues
  • Implement access controls and encryption where necessary
  • Document ETL processes, data flows, and transformation logic for transparency and maintainability
  • Design and build interactive, visually compelling Power BI reports and dashboards tailored to business needs.
  • DP-203: Data Engineering on Microsoft Azure or an equivalent certification. Additional certification / courses in use of Gen AI will be beneficial

Requirements

  • Medallion, Delta Lake and metadata driven Architecture using MS Fabric or Synapse Analytics ETL pipelines
  • Data Transformation using SQL Query Language and Python notebooks
  • Data storage and warehouse using SQL DB, delta lake(Gen2), Snowflake
  • Dimensional modelling using Kimball methodology
  • Power BI Interactive Dashboard and Paginated Reports using DAX functions, Power Query.
  • A familiarity in Investment Management and/or Financial Services
  • Commercial experience working with business stakeholders within a cross-functional matrix environment.
  • Experience in the delivery of projects utilising Agile methodologies.
  • Must be able to understand and apply new technologies to stay current with best practices and trends in application and data architecture for financial services.
  • Confidence in handling, interpreting, and presenting complex numerical data and technological challenges in a clear and concise manner.
  • Self-motivated, decisive, with the ability to adapt to change and competing demands.
  • Experience working both independently and within a team-oriented, collaborative environment.
  • Adept at conducting research into project-related issues and products.
  • A proactive, self-motivated team player who can manage a high workload with multiple deadlines and continually strive for improvements in quality, efficiency and presentation.
  • Bachelor's degree in computer science, engineering, or a related field (or equivalent experience).
  • Maintain a working technical understanding of the complexities in delivering change into an Investment Management organisation, specifically where application eco-system is de-centralised.
  • Good conduct that is consistent with the LPPI values- aligned behaviours

Reasonable adjustment will be made to working arrangements to accommodate a person with a disability who otherwise would be prevented from undertaking the work.

Apply for this position