Data Engineer (GCP)

Stott and May

London, UK

3 months ago

Apply on totaljobs.com

Prepare application

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Compensation

£118,300.0

Working hours

Regular working hours

Job source

totaljobs.com

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Business Analytics Applications Application Performance Management Big Data BigQuery Cloud Computing Information Engineering Distributed Systems Electronic Data Interchange (EDI) Python (Programming Language) Cloud Services

+13 more

Software Construction Data Streaming Google Cloud Data Ingestion Spring Cloud Flask (Web Framework) Backend Fastapi Event Driven Architecture Build Management Real Time Data Restful APIs Data Pipelines

Job description

We are looking for a Data Engineer to support the design and development of scalable, cloud-native data platforms on Google Cloud Platform (GCP)., Design and build real-time data ingestion pipelines and event-driven architectures using GCP services.

Develop and maintain data integration solutions connecting to multiple backend systems through APIs.
Build, deploy, and secure RESTful APIs to support data exchange and platform services.
Implement event routing and messaging solutions using distributed system principles.
Develop scalable and reliable cloud-native applications and services.
Collaborate with technical stakeholders to define integration and data flow requirements.
Monitor, troubleshoot, and optimise data processing workflows and API performance.
Ensure security, reliability, and best practices across cloud infrastructure and services.

Requirements

Strong experience with Google Cloud Platform (GCP), including:

Cloud Run
BigQuery
Google Cloud Storage (GCS)
Pub/Sub
Eventarc
Strong Python development experience.
Experience designing and working with distributed systems and event-driven architectures.
Experience building and designing RESTful APIs using Flask and/or FastAPI.
Strong understanding of software engineering best practices and cloud-native development.

Desirable Skills

Experience with Go and/or Java.
Data engineering experience, including data pipeline development and analytics solutions.
Experience working with large-scale data processing platforms.