Senior Data Engineer - Microsoft Fabric

Intelligent Talent is working with a UK wealth management business to appoint a Senior Data Engineer to its small Azure data team. You’ll design and build production data solutions on Fabric, make the technical calls, and take responsibility for how those solutions perform once they’re live and the business depends on them.

The work is a mix of evolving an established platform and greenfield development, so there’s room to build new things as well as improve what’s already there. The business is also adopting AI, with Copilot and AI Foundry already in use.

This is a purely technical role with no line management. Your influence comes from the work you deliver, the problems you solve and the mentoring you give the team’s Data Engineer. You’ll report to the Data Engineering Manager and work closely with the Data Product Manager, Enterprise Architect and Reporting Engineer.

The work

Microsoft Fabric sits at the centre of the platform: Lakehouse, Warehouse, OneLake, pipelines and notebooks, built around a medallion architecture. You’ll use Python, PySpark and advanced SQL to build the pipelines, models and integrations behind the business’s reporting, analytics and wider data needs. You’ll also:

·Integrate internal and third-party systems using APIs and SFTP

·Build automated testing, validation and data quality controls

·Improve performance, reliability, scalability and cloud costs

·Investigate production incidents and fix the underlying cause, not just the symptom

·Improve observability, platform resilience and maintainability

·Contribute to code reviews, CI/CD and controlled deployments using Git and Azure DevOps

·Deliver in an Agile Scrum framework with two-week sprints

·Document designs, pipelines and controls so they stand up to the governance, privacy and security scrutiny of a regulated business

The experience that matters

Already working hands-on with Microsoft Fabric and want a senior role that keeps you close to the engineering?, You must have hands-on Microsoft Fabric experience in your current or most recent role.

Beyond that, we’re most interested in what happened after your solutions went live. What needed fixing? What did you improve? How did they cope as requirements and data volumes changed? Ideally you’ll have spent at least a year in that role working with Fabric, so you’ve lived with your own design decisions.

You’ll also bring:

·Strong Python/PySpark and advanced SQL

·Sound data modelling, ETL/ELT, orchestration and data quality experience

·A good grasp of data governance, privacy and security, and how to evidence controls in your engineering

·Confidence troubleshooting production data workloads

·Experience mentoring or guiding other data engineers

·The ability to explain technical decisions clearly to technical and non-technical colleagues

·Self-motivation and a habit of taking ownership

·Familiarity with AI tools such as Copilot or Azure AI Foundry, as everyone in the business is expected to have a basic level of AI competence

Experience in financial services, wealth management or another regulated industry would be a real advantage.

Location and hybrid working

London is the preferred base, with Birmingham also available. You’ll need to live within about an hour of either office.

The team currently works together in the London or Birmingham office two days a month. Company policy is that everyone must be willing and able to work from the office up to three days a week if required, so please only apply if both work for you.

You must have the right to work in the UK. Sponsorship isn’t available.