Data Operations Engineer

Radley James
Greater London, UK
11 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Algorithmic Trading Business Analytics Applications Data Validation Information Engineering Extract Transform Load (ETL) Systems Theories Python (Programming Language) Cisco Nexus Switches Reference Data DataOps Data Ingestion
+7 more
Apache Spark Pandas Data Lakes Data Management Api Design Data Pipelines Databricks

Job description

One of our clients in the Trading & Market Making space is looking for an engineer to serve as a frontline point of contact for traders, researchers and internal users of data platforms within the London based trading team.

This role sits in the nexus between Data Engineering and Reliability & Operations Engineering, and is an excellent opportunity to work in a dynamic, impactful function within one of the most cutting edge trading environments in the city!

What You’ll Do

  • Serve as frontline POC for traders, internal users and research teams for everything relating to data reliability.
  • Investigate and resolve data quality concerns and freshness anomalies.
  • Monitor ingestion pipelines, processes and real time feeds.
  • Triaging and addressing alerts promptly to minimize impact on trading.
  • Manage relationships with external vendors and resolve upstream issues, specification changes and ensure accurate delivery of datasets.
  • Document and relay clear updates to users during production events.

Technical responsibilities

  • Ingest, configure and operationalise new datasets.
  • Develop and maintain ETL/ELT data pipelines to feed real time trading and research systems.
  • Implement data quality checks, anomaly detection and monitoring frameworks.
  • Build and maintain high performance API’s to expose market and reference data to trading, research and analytics platforms.

Who you are

  • 3+ years in Data Engineering, SRE, SWE or Data Ops roles in high performance, time sensitive environments.
  • Strong Python proficiency, including exposure to libraries such as Pandas, Arrow, and Spark.
  • Strong grasp of data modelling, normalization and API development for large scale analytical or trading systems.
  • Experience with lakehouse architectures (Databricks ideally, or Delta Lake).
  • Exposure to real time and historical market data within Fixed Income, ETFs or Equities would be excellent.
  • Operational instincts - extreme agency and ownership over issues, tackling issues with initiative.

Requirements

  • 3+ years in Data Engineering, SRE, SWE or Data Ops roles in high performance, time sensitive environments.
  • Strong Python proficiency, including exposure to libraries such as Pandas, Arrow, and Spark.
  • Strong grasp of data modelling, normalization and API development for large scale analytical or trading systems.
  • Experience with lakehouse architectures (Databricks ideally, or Delta Lake).
  • Exposure to real time and historical market data within Fixed Income, ETFs or Equities would be excellent.
  • Operational instincts - extreme agency and ownership over issues, tackling issues with initiative.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:33 min

Refactoring data science workflows using Rapids QDF and Pandas

Paul Graham Paul Graham · LIVE

6:58 min

Analyzing production code coverage data using pandas

Markus Harrer Markus Harrer · World Congress 2021

Videos

See all

Related articles

See all