Senior Python Data Engineer - Python, AI, Pre-Trade, Market Data - Cadogan Solutions

The Tier
Charing Cross, United Kingdom
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Charing Cross, United Kingdom

Tech stack

API
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Azure
Big Data
Cloud Computing
Data Distribution Service
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Transformation
Python
Meta-Data Management
Reference Data
Workflow Management Systems
Enterprise Data Management
Cloud Platform System
Snowflake
Spark
Event Driven Architecture
Data Lineage
Data Management
Api Design
Data Pipelines
Databricks

Job description

A Tier 1 Financial Institution is seeking a Python Data Engineer to join a strategic front-office data and technology function responsible for building and modernising enterprise data platforms supporting trading, market data, and business-critical workflows.

This role sits at the intersection of data engineering, platform development, and enterprise data management. The successful candidate will help design and build scalable solutions that improve how data is onboarded, governed, distributed, and consumed across multiple business areas and asset classes.

The environment is highly complex, operating across large-scale market data ecosystems, trading platforms, cloud-native infrastructure, and enterprise data services., 1. Design, develop, and maintain Python-based data engineering solutions supporting strategic data platforms

  1. Build scalable ETL and data ingestion pipelines processing large volumes of market, reference, and business data
  2. Develop data transformation, validation, reconciliation, and quality control frameworks
  3. Engineer solutions that improve the accessibility, governance, and usability of enterprise data assets
  4. Build APIs, automation tooling, and workflow orchestration capabilities to support data distribution and operational processes
  5. Partner with business, operations, and technology stakeholders to understand data requirements and deliver scalable solutions
  6. Contribute to modern cloud-based data platform initiatives across AWS, Azure, and related technologies
  7. Support the onboarding of new data sources and vendor feeds into strategic enterprise platforms
  8. Improve observability, monitoring, lineage, and operational controls across data workflows
  9. Participate in architecture discussions and help shape future-state data platform capabilities

Requirements

The team is looking for engineers who combine strong Python and data engineering expertise with a practical understanding of how enterprise data platforms operate within large financial institutions.

Successful candidates will have experience solving complex data challenges, working across multiple stakeholder groups, and delivering scalable solutions that support critical business functions., 1. Strong commercial experience developing in Python

  1. Experience building enterprise-scale data engineering solutions
  2. Experience designing and supporting ETL/ELT pipelines
  3. Experience working with large and complex datasets
  4. Strong understanding of data quality, validation, reconciliation, and operational controls
  5. Experience working within financial services, investment banking, capital markets, or asset management environments
  6. Ability to work directly with business stakeholders and translate requirements into technical solutions

Desirable Experience

  1. Market data, reference data, or trading data experience
  2. Cloud platforms including AWS, Azure, or GCP
  3. Spark, Databricks, Snowflake, Airflow, DBT, or similar modern data technologies
  4. API development and event-driven architectures
  5. Data governance, metadata management, and data lineage tooling
  6. Experience supporting front-office or investment management functions
  7. Knowledge of entitlement, access control, or data permissioning workflows

Apply for this position