> Markdown version of [/jobs/ext/3184481-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3184481-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Nucleus Financial - **Location:** UK (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Business Logic, Microsoft Azure, Big Data, Continuous Integration, Data Warehousing, File Transfer, Python (Programming Language), Key Management, Parsing, SQL Stored Procedures, Data Processing, Cloud Platform System, Data Ingestion, Azure Data Factory, Sql Optimization, Delivery Pipeline, Git, Microsoft Fabric, Azure Synapse Analytics, Data Pipelines, Databricks - **Published:** September 21, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=3ca09a444337e2aa ## About the Role * Advanced SQL: Advanced SQL development, optimisation and troubleshooting, including complex stored procedure logic over bi-temporal, large data volumes. * End to end design ownership: A proven record of designing and delivering pipelines or platforms end to end in a cloud data platform such as Microsoft Fabric, Azure Data Factory, Synapse or Databricks, rather than building only to someone else's design. * Deep data warehousing knowledge: In depth understanding of dimensional modelling using the Kimball methodology, conformed dimensions, slowly changing dimensions, surrogate key strategies and incremental load patterns. * Advanced semantic modelling: Strong semantic model and DAX skills, and a clear view on where logic belongs between the warehouse and the model. * Python and automation: Confident with Python for parsing, automation and data handling, ideally in a notebook environment. * CI/CD and change control: Strong working knowledge of branching strategy, pull request policy, environment promotion and secret management, and experience operating change control in a governed environment. * Data quality by design: Experience designing reconciliation, validation and monitoring controls, and setting the thresholds that decide when a difference is investigated. * Incident leadership: Calm and methodical during a live data incident, able to lead diagnosis and recovery and to communicate clearly while it is happening. * Mentoring: A genuine interest in developing other engineers and raising the standard of the team's output, through review, pairing and day to day support. * Stakeholder management and delivery: Able to manage priorities, expectations and delivery with senior stakeholders, and to push back constructively where a request is not the right answer. * Judgement in ambiguity: Comfortable taking an unclear requirement or an undocumented source feed and turning it into a defined, deliverable piece of work. Desirable Experience: * Microsoft Fabric: Hands on experience with the Fabric Lakehouse, Fabric Data Warehouse, Data Pipelines, Notebooks, Git integration and deployment pipelines. A certification such as DP-700 is welcome but not required. * Regulated financial services: Experience delivering data used for regulatory reporting, and working with audit, risk and compliance reviewers. * Platform and product domain: Wrap, SIPP, pensions or investment platform data. * Secure file based feeds: Experience with encrypted file transfers, key management and automated decryption within a controlled environment. * AI and data agents: An understanding of how curated data supports AI use cases, and the governance those outputs require. ## Description As a Senior Data Engineer you will own the design and delivery of the more complex parts of that platform. You will decide how a new source is onboarded and modelled, what controls it needs before it can be relied on for regulatory and financial reporting, and whether a change is safe to promote. Alongside that you will set the standards the team builds to, lead delivery of significant pieces of work, and develop the engineers around you. It is a hands on engineering role with technical leadership attached, and depending on the shape of the team it may include line management. How we work We work in an Agile cycle alongside a Product Owner. Everything we build is version controlled in Azure DevOps and promoted through Fabric deployment pipelines across development, test and live. Development takes place in an isolated feature workspace, every change is peer reviewed before it reaches production, and anything touching regulatory reporting carries an additional test and approval gate. We cover daily platform health checks, and documentation is treated as part of the build rather than an afterthought. In this role you will be expected to shape that way of working, not simply operate within it. Responsibilities: * Own platform and pipeline design: Lead the design of ingestion pipelines and warehouse models, from the first review of a source feed through to a live, reconciled and documented pipeline in production. * Set the engineering standards: Define and evolve the team's design standards, naming conventions, load patterns and re-runnability requirements, and make sure they are applied consistently across every source. * Own the cross platform model: Lead the design of the conformed layer of the warehouse, resolving differences in identifiers, hierarchies and status models between source platforms so that group level reporting is consistent and reconcilable back to source. * Act as technical approver: Provide in depth peer review, give clear and specific feedback, and make the call on whether a change is designed, tested and evidenced well enough to reach production, particularly for regulatory pipelines and semantic models. * Lead delivery: Work with our Product Owner to scope, break down, estimate and prioritise work, and lead delivery of data and BI projects against business objectives and timelines. * Strengthen the control environment: Design the validation, reconciliation and monitoring controls that sit around the data, own the judgements they depend on such as materiality thresholds, and provide evidence to risk, compliance and audit reviewers. * Lead incident resolution and recovery: Take the lead on complex failures, including code and data rollback, establish root cause, and feed the lesson back into standards, documentation and controls. * Govern the consumption layer: Own semantic model governance, keeping business logic in version controlled warehouse procedures and measures thin, so that a metric means the same thing wherever it is consumed. * Develop the engineers around you: Mentor colleagues through review, pairing and structured knowledge transfer, and make sure no critical pipeline depends on a single person. Line management: Depending on the structure of the team, line manage one or more engineers, covering objectives, development plans, regular one to ones and performance. * * Engage senior stakeholders: Work directly with finance, risk, compliance and business leads to turn requirements into deliverable solutions, and be straight with them about what the data can and cannot answer. * Lead Agile ceremonies: Lead planning, backlog refinement and retrospectives, and drive continuous improvement in how the team works. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)