> Markdown version of [/jobs/ext/1457268-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1457268-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** CMC Markets UK Plc
- **Location:** London, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Algorithmic Trading, Apache HTTP Server, Continuous Integration, Extract Transform Load (ETL), Linux, Distributed Computing Environment, Python (Programming Language), PostgreSQL, Operational Databases, Reference Data, Standard Sql, SQL Databases, Parquet, Data Storage Technologies, Snowflake, Apache Spark, Git, KDB+, Data Lakes, Dask, Apache Kafka, Data Management, Machine Learning Operations, Video Streaming, Vertica, Data Pipelines, Docker, Databricks
- **Published:** July 27, 2026
- **Apply:** https://www.totaljobs.com/job/senior-data-engineer/cmc-markets-uk-plc-job107753092

## About the Role

* Strong Python and SQL.
 * Experience building scalable, production data pipelines.
 * Expertise with Parquet and modern data storage formats.
 * Deep understanding of high-frequency market data, including tick data, order books and market data normalisation.
 * Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events.
 * Experience with distributed processing (Spark, Polars, Dask, Ray or similar).
 * Experience with Kafka or similar streaming technologies.
 * Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar.
 * Docker, Linux, Git and CI/CD experience.

Highly Desirable

 * Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar.
 * Order book reconstruction
 * Tick-to-bar aggregation
 * Airflow, Dagster, Prefect or MLflow
 * Experience supporting quantitative research or trading systems
 * Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs)

What We're Looking For

The successful candidate will have a strong background in market data engineering with proven experience building reliable, scalable data platforms.

Our non-negotiable requirements are:

 * Expert Python
 * Strong SQL
 * Scalable data pipeline development
 * Apache Parquet
 * Market data normalisation
 * Automated data quality controls
 * Deep tick and market data expertise, Experience in MLOps is advantageous but not essential. We welcome candidates with strong experience in either market data engineering or MLOps, provided they have the skills to build and operate production-grade data platforms.

## Description

* Build scalable ETL/ELT pipelines for batch and streaming market data.
 * Develop production-grade Python and SQL solutions.
 * Ingest, normalise and validate market data, including trades, ticks, Level 1 & 2 quotes, order books, reference data and corporate actions.
 * Implement automated data quality, reconciliation and monitoring frameworks.
 * Optimise data storage using Parquet, Arrow and modern data lake technologies.
 * Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets.


## Related Videos

- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)
- [Microservices architecture as a key element in building trading systems for global finance markets](https://www.wearedevelopers.com/videos/1196-microservices-architecture-as-a-key-element-in-building-trading-systems-for-global-finance-markets)
- [Inside Bitpanda's Tech Stack: Scaling a European Fintech Leader - Markus Dorner](https://www.wearedevelopers.com/videos/1979-inside-bitpanda-s-tech-stack-scaling-a-european-fintech-leader-markus-dorner)
- [Stop Committing Your Secrets - GIt Hooks To The Rescue!](https://www.wearedevelopers.com/videos/573-stop-committing-your-secrets-git-hooks-to-the-rescue)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023)
- [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)
- [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)