Senior Data Engineer

Annapurna
London, UK
18 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
£50,000.0 - £55,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Cloud Computing Data as a Services Information Engineering Data Warehousing Monitoring of Systems Python (Programming Language) Cloud Services DataOps SQL Databases
+7 more
Data Streaming AI Infrastructure Data Ingestion Snowflake Enterprise Integration Machine Learning Operations Data Pipelines

Job description

This is a senior-level opportunity for an experienced Data Engineer who is not only technically hands-on but also eager to shape the core data strategy of a fast-moving InsurTech company. You’ll play a pivotal role in designing and developing robust, scalable data pipelines, AI/ML workflows, and APIs that feed data into every part of the business-from underwriter tools to financial systems.

You’ll work in a modern, fully cloud-based stack (AWS, Snowflake, Python, SQL), with strong opportunities to influence architecture, automation, and data product direction across the company.

What you’ll be doing

  • Design, build, and maintain robust, cloud-native data infrastructure and pipelines
  • Develop and manage metadata-driven data ingestion and transformation processes
  • Support AI and ML infrastructure in partnership with Data Science teams
  • Build APIs and data services to enable self-serve analytics and platform integrations
  • Optimise data warehouse performance and reliability (Snowflake)
  • Monitor data quality, pipeline health, and system observability
  • Partner with cross-functional teams to understand evolving data needs
  • Take ownership of key components and advocate for engineering best practices
  • Mentor junior engineers and contribute to a culture of learning and technical excellence

Requirements

  • 5+ years of experience in data engineering, ideally in a fast-paced product or platform environment
  • Strong experience with AWS cloud services and infrastructure as code
  • Proficiency in SQL, Python, and Snowflake
  • Experience building data pipelines (batch & streaming), APIs, and ML/AI infrastructure
  • Familiarity with DataOps practices, CI/CD pipelines, and modern orchestration tools
  • Strong understanding of data quality, schema evolution, and monitoring in production environments
  • A pragmatic mindset: you value speed and scalability but know where to invest for the long term

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:14 min

Evolution of distributed SQL database architectures

Wei Hu Wei Hu · World Congress 2024

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · World Congress 2026 Europe

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

1:36 min

Evolution from key-value stores to distributed SQL

Wei Hu Wei Hu · World Congress 2025

Videos

See all

Related articles

See all