> Markdown version of [/jobs/ext/2688636-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2688636-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Velocity Talent
- **Location:** London, UK
- **Experience:** Expert
- **Salary:** £75,000.0 - £80,000.0
- **Contract:** Permanent contract
- **Skills:** JavaScript (Programming Language), Application Programming Interfaces (APIs), Business Logic, Microsoft Azure, Big Data, Cloud Computing, Cloud Storage, Code Review, Continuous Integration, Data Validation, Information Engineering, Extract Transform Load (ETL), Data Systems, Data Warehousing, Relational Databases, Database Design, DevOps, R (Programming Language), Python (Programming Language), Metadata, SQL Azure, NoSQL, Standard Sql, SQL Databases, Data Streaming, YAML, Data Processing, Azure Data Factory, Delivery Pipeline, Apache Spark, Git, SC Clearance, Data Lakes, Pyspark, Kubernetes, Data Lineage, Collibra, Apache Kafka, Data Pipelines, Docker, Databricks
- **Published:** September 3, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5868767140

## About the Role

* 10+ years of dedicated data engineering experience managing massive, complex datasets
 * 3+ years of deep, hands-on production experience with Azure Databricks, Spark (PySpark/Scala), and Delta Lake ecosystems
 * Extensive experience across the Azure data suite, specifically Azure Data Factory, Azure Blob Storage, and Azure SQL Database
 * Strong proficiency in Python, Spark, and SQL
 * Practical experience using Azure Purview for governance and cataloguing
 * Working knowledge or exposure to R, YAML, and JavaScript within data workflows
 * Experience with event-driven data such as Kafka or Azure Event Hubs and modern DevOps tooling including Azure DevOps, Git, Docker, and Kubernetes
 * Solid understanding of both SQL and NoSQL database design, data warehousing principles, and data modelling techniques
 * Experience working within financial services, central banking, or an economic data environment is highly advantageous
 * Exceptional ability to bridge the gap between technical infrastructure and economic or analytical business logic
 * Microsoft Certified: Azure Data Engineer Associate or Databricks certifications are preferred
 * SC Clearance required, active or eligible to undergo

## Description

* Design, develop, and maintain robust, scalable ETL/ELT pipelines ingesting data from APIs, relational databases, streaming services, and financial data providers
 * Implement advanced data processing logic for cleaning, enriching, and aggregating large-scale data using Spark and SQL
 * Fine-tune data workloads for maximum performance, throughput, and cloud cost-efficiency
 * Drive the implementation of Azure Databricks services, leveraging Unity Catalog and Delta Lake architectures
 * Develop and maintain data solutions using Python, SQL, R, YAML, and JavaScript
 * Lead hands-on implementation of Azure Purview to manage data quality, governance, metadata, and end-to-end data lineage tracking
 * Establish automated data validation, quality checks, and real-time alerting processes across all production environments
 * Partner with DevOps teams to design, build, and maintain robust CI/CD pipelines for automated environmental deployments
 * Collaborate closely with economists, data scientists, and senior analysts to translate complex analytical needs into production-ready data systems
 * Drive engineering excellence through active participation in code reviews, architectural discussions, and knowledge-sharing sessions

Technologies:

 * Azure
 * CI/CD
 * Cloud
 * Databricks
 * DevOps
 * Docker
 * ETL
 * Git
 * JavaScript
 * Kafka
 * Kubernetes
 * NoSQL
 * Python
 * PySpark
 * SQL
 * Scala
 * Spark
 * Unity
 * GameDev
 * Security


## Related Videos

- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)