GCP data engineer

EUROPEAN SOFTWARE SOLUTIONS (UK) LIMITED

Manchester, UK

1 day ago

Apply on www.totaljobs.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.totaljobs.com

Tech stack

Artificial Intelligence Cloud Database Data Architecture Data Validation Information Engineering Extract Transform Load (ETL) Database Development DevOps Python (Programming Language) Standard Sql Google Cloud DevOps Tools - Open-source

+2 more

Real Time Data Data Management

Job description

Google Cloud Platform (GCP) and comparable cloud-based data engineering services
dbt
Python
SQL
ETL/ELT tooling and methodologies
Data modelling and data product development
AI-enabled data development
Testing and validation frameworks
Master Data Management (MDM), including commercial off-the-shelf and bespoke solutions
MDM integration and implementation
Real-time data product patterns
DevOps tooling and deployment practices, The requirement is for two UK-based feature teams, each comprising six resources and led by a Senior Lead Data Engineer. All team members must be based in Bristol or Manchester; London-based delivery is specifically excluded. The teams are required to start immediately, and suppliers must propose resources who are available and capable of being onboarded without delay.
Improve the quality, richness, and consumption-readiness of FDP data.
Deliver FDPs end to end, from ODP selection through design, engagement and shaping, development, DevOps, testing, validation, governance, deployment and go-live.
Define and support MDM architecture and strategy.
Assess and implement commercial off-the-shelf MDM products where appropriate.
Design and develop bespoke MDM solutions.
Deliver MDM integration and implementation activities.
Design and implement real-time data product patterns.
Work within the applicable delivery, architecture, engineering, security and governance standards.
Provide experienced, delivery-ready practitioners; proposals based on academic exercises, speculative hiring or resources requiring extended mobilisation will not be accepted.

Requirements

Expert-level GCP or cloud-based data engineering capability
Advanced practical experience of dbt, Python data engineering and SQL
Strong data modelling and ETL/ELT design skills
Proven end-to-end data product build experience
Experience applying AI-enabled approaches to data development
Strong testing, data validation and quality assurance capability
Data architecture expertise
MDM and enterprise data architecture experience, including strategy, solution selection, integration and implementation
DevOps, deployment, governance, and production go-live experience
Senior technical leadership capable of leading a multidisciplinary feature team