Technical Lead - Pricing & Market Data (Cloud & Data Migration)
Infinity Quest
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Tech stack
Java
Agile Methodologies
Amazon Web Services (AWS)
Audit Trail
Azure
Cloud Computing
Cloud Engineering
Computer Programming
Databases
Data as a Services
Data Architecture
Information Engineering
ETL
Data Migration
Data Retention
Relational Databases
Python
PostgreSQL
NoSQL
Performance Tuning
Scrum
SQL Databases
Enterprise Data Management
Cloud Platform System
Apache Cassandra
System Availability
Spark
Data Lineage
Low Latency
Cloud Migration
Api Design
Data Pipelines
Job description
Technical Leadership & Architecture
- Lead end-to-end technical design and execution of migrating pricing and market data platforms from legacy databases to cloud-native architectures.
- Define scalable, high-performance data models optimised for time-series and write-heavy workloads.
- Ensure solutions meet functional and non-functional requirements including performance, scalability, availability, security, and auditability.
- Document solution architectures, technical decisions, and implementation standards.
Data Migration & Engineering
- Design and govern data migration strategies ensuring functional parity, historical integrity, and data lineage.
- Oversee ETL pipelines, parsers, and system interfaces with a focus on low latency and resilience.
- Define and enforce engineering standards for data quality, performance tuning, and platform reliability.
Business & Stakeholder Engagement
- Work closely with business stakeholders including Trading, Risk, and Quant teams to translate complex business requirements into robust technical solutions.
- Facilitate design reviews, technical workshops, and solution walk-throughs to align stakeholders and secure sign-off.
- Provide clear progress reporting, risk identification, and issue resolution to senior stakeholders.
Delivery & Governance
- Drive delivery within Agile frameworks (SCRUM / Kanban), including estimation, backlog management, and acceptance criteria definition.
- Embed robust controls including audit trails, regulatory compliance, and data retention policies.
- Identify technical risks and proactively drive mitigation strategies.
Team Leadership
- Provide technical leadership to engineering teams, including mentoring and code/design reviews.
- Contribute to hiring decisions and capability building as required.
Requirements
Core Experience
- 7 10+ years of experience in data engineering and technical delivery roles.
- Strong hands-on experience designing and delivering cloud-based data platforms.
- Advanced expertise in Apache Cassandra, including data modelling, replication strategies, and performance tuning.
- Strong background in relational databases (e.g. PostgreSQL) and large-scale cloud migrations.
Technical Skills
- Data architecture for pricing, market data, and financial time-series datasets.
- ETL and data pipeline engineering (Spark-based frameworks desirable).
- Strong programming skills in Python (preferred) or Java.
- Experience optimising SQL and NoSQL performance and defining API-based data services.
- Familiarity with AWS or Azure cloud environments.
- Agile delivery experience using tools such as Azure DevOps or equivalent.
Domain Knowledge
- Solid understanding of pricing and market data domains, including:
- End-of-Day vs real-time pricing
- Curve construction and remarking
- Independent Price Verification (IPV)
- Cross-referencing and bitemporal data concepts
- Experience working in regulated financial environments (e.g. SOX or equivalent controls).
Preferred / Desirable Experience
- Experience with Enterprise Data Management (EDM) platforms (e.g. Gresham or similar).
- Prior involvement in large-scale greenfield builds or legacy-to-cloud migrations.
- Familiarity with market data vendors such as Bloomberg, Refinitiv, Platts, Argus.
Strong attention to detail and commitment to engineering excellence.