Real-Time Data Engineer

Sanderson Recruitment Plc

London, UK

30 days ago

Apply on www.careerjet.co.uk

Prepare application

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Compensation

£156,000.0 - £169,000.0

Working hours

Regular working hours

Job source

www.careerjet.co.uk

Tech stack

Amazon Web Services Extract Transform Load (ETL) Relational Databases Distributed Data Store MySQL Operational Data Store Oracle (Applications) Data Streaming Enterprise Data Management Data Processing Sql Optimization Snowflake

+9 more

Sybase Event Driven Architecture Build Management Apache Flink Apache Kafka Data Management Video Streaming Terraform Data Pipelines

Job description

This role focuses on designing and delivering cloud-native, real-time data pipelines, moving operational data from source systems into enterprise data platforms. This is not a traditional Snowflake, dbt, or batch ETL role. We’re looking for an engineer with strong experience in streaming technologies, event-driven architecture, and distributed data systems. The Role

Design and build real-time data pipelines using Apache Flink, Apache Kafka, and AWS Kinesis
Develop scalable event-driven and streaming solutions
Integrate data from source systems including Oracle, MySQL, and Sybase
Build data processing, transformation, enrichment, and quality capabilities
Deliver low-latency data into enterprise data platforms
Create and manage infrastructure using Terraform

Requirements

Strong commercial experience with Apache Flink
Strong experience with Apache Kafka
Experience with AWS Kinesis
Advanced SQL skills and strong relational database knowledge
Experience working with Oracle, MySQL, and Sybase
Hands-on Terraform experience
Proven experience building real-time data pipelines and event-driven architectures
AWS cloud experience