> Markdown version of [/jobs/ext/2801141-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2801141-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Mirai Talent
- **Location:** Greater London, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Continuous Integration, Information Engineering, Data Governance, Decision-Making Software, DevOps, OAuth, Operational Data Store, Query Optimization, Power BI, Spatial Data Infrastructures, Azure Data Factory, Sql Optimization, Apache Spark, Indexer, Data Management, Pagination, Databricks
- **Published:** September 9, 2026
- **Apply:** https://www.collegerecruiter.com/job/2850546512-senior-data-engineer

## About the Role

You'll ideally have 6+ years' experience across data engineering and wider data management disciplines, including integration, modelling, optimisation and data quality.

This environment will suit someone who has worked with complex, large-scale operational data and understands what good engineering looks like beyond simply getting something into production.

You'll be a standard setter. Someone whose approach to code, review, documentation and engineering discipline becomes the benchmark for others.

You'll also need to be comfortable communicating across technical, business and senior stakeholder groups, mentoring other engineers and constructively challenging both internal teams and external suppliers when quality isn't where it needs to be.

## Description

* Designing and improving engineering patterns across Azure Databricks and Azure Data Factory
 * Setting the optimisation strategy across caching, indexing, partitioning and cost
 * Defining clear data engineering and integration engineering patterns
 * Acting as the engineering quality gate, reviewing internal and third-party code before release
 * Owning DevOps practices end-to-end, including CI/CD, branching standards, environment promotion and release governance
 * Driving automation across the engineering lifecycle, removing repetitive manual processes
 * Working with advanced SQL and existing data engineering patterns
 * Establishing governance across data and algorithms used for analytics and automated decision-making
 * Working closely with analytics engineering and data science to maintain data quality, security and governance
 * Mentoring engineers and helping build the technical capability of the wider team
 * Working with external engineering partners and holding them to a high technical standard

You'll need strong hands-on experience across:

 * Spark
 * Advanced SQL, including query optimisation, indexing and performance diagnosis
 * CI/CD and DevOps
 * Unity Catalog
 * Medallion architecture
 * APIs, including OAuth2, pagination, rate limits and schema drift
 * Data governance and orchestration
 * IoT and telemetry data, particularly high-volume, high-frequency datasets

Exposure to Synapse, Power BI, complex data types or spatial data would be useful too.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Keeping applications secure by evolving OAuth 2.0 and OpenID Connect](https://www.wearedevelopers.com/videos/100152-keeping-applications-secure-by-evolving-oauth-2-0-and-openid-connect)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Delay the AI Overlords: How OAuth and OpenFGA Can Keep Your AI Agents from Going Rogue](https://www.wearedevelopers.com/videos/1637-delay-the-ai-overlords-how-oauth-and-openfga-can-keep-your-ai-agents-from-going-rogue)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)