Senior Data Engineer - Manchester

FDM Group
15 days ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote

Tech stack

Artificial Intelligence
Data analysis
Azure
Data as a Services
Data Architecture
Information Engineering
Data Governance
ETL
Data Transformation
Data Systems
Software Debugging
Distributed Data Store
Role-Based Access Control
Power BI
SQL Databases
Data Streaming
Data Storage Technologies
Spark
GIT
Powerquery
Build Management
Data Lake
Data Management
Azure
Software Version Control
Data Pipelines
Serverless Computing
Databricks

Job description

FDM is a global business and technology consultancy seeking a Senior Data Engineer to work for our client within the transport sector. This is initially a 3-month contract with the potential to extend and will be a hybrid role based in Manchester. Our client is seeking an experienced Senior Data Engineer with a strong background in Azure Data Services and Data Fabric to support the design, build, and optimisation of enterprise-grade data solutions. The role requires hands-on expertise in developing advanced data pipelines, architecting data lake structures, aligning governance frameworks, and enabling robust reporting capabilities. The ideal candidate will be someone who can take end-to-end ownership of data engineering initiatives and deliver solutions aligned with enterprise data architecture and governance principles., * Design and build complex ETL/ELT pipelines from scratch, integrating multiple data sources while implementing advanced transformations using Mapping Data Flows

  • Optimise performance and manage dependencies, ensuring robust monitoring/debugging of pipelines
  • Architect and implement hierarchical data storage structures with partitioning and lifecycle policies
  • Define and apply advanced RBAC and ACL-based security models while enabling integration with Synapse, Databricks, and serverless SQL pools for analytics
  • Deliver end-to-end reporting solutions, including data modelling in Power Query and DAX using Power BI to build interactive dashboards and implement row-level security (RLS)
  • Publish, manage and optimise reports in the Power BI service
  • Develop reusable, scalable data transformation scripts and pipelines and optimise Spark jobs for large-scale distributed data processing
  • Implement, and handover CI/CD pipelines for data workflows using Azure DevOps while enforcing Git based version control best practices and automating the testing as well as deployment of data engineering solutions
  • Apply Data Fabric principles to ensure seamless integration, discoverability, and governance across diverse data sources
  • Contribute to the enterprise-wide data fabric strategy by maintaining the implementation and adoption of a unified data platform for analytics, AI, and regulatory requirements

Requirements

Power Bi, Data Governance, Transformations, * Minimum of 5 years' experience as a Senior Data Engineer in Azure cloud environments

  • Strong hands-on skills with ADF, Data Lake, Power BI, and Azure DevOps
  • Demonstrated ability to architect scalable, secure, and governed data platforms
  • Solid understanding of data governance and Data Fabric principles
  • Experience working with data modelling, transformations, and performance optimisation
  • Strong problem-solving skills
  • Solid communication and stakeholder engagement skills

Apply for this position