Senior Data Engineer - GCP/BigQuery/Data Products

Atrium Workforce Solutions Ltd
London, UK
4 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
£130,000.0 - £156,000.0
Working hours
Regular working hours

Tech stack

Airflow BigQuery Cloud Engineering Cloud Storage Data Governance Data Infrastructure Data Transformation Data Flow Control Key Management Cloudera SQL Databases Tokenization
+4 more
Google Cloud Collibra Microservices Control M

Job description

The Senior Data Engineers will support the design and delivery of a strategic data capability as part of a major UK banking data transformation programme.

The roles will focus on building scalable and governed data products within Google Cloud Platform. You will contribute to building, testing and deploying multiple data products, supporting a wider migration from incumbent warehouse platforms to a modern cloud-based architecture.

You will work closely with solution architects, fellow data engineers and platform teams to build reliable enterprise data products.

RESPONSIBILITIES

  • Design and develop scalable GCP-based data products.
  • Develop and optimise transformation logic using technologies such as dbt, Dataflow, Dataproc and BigQuery SQL.
  • Collaborate with solution architects, data architects, microservices engineers and platform teams to deliver aligned engineering solutions.
  • Support testing and validation of products including key generation quality, interoperability, lineage and operational resilience.
  • Produce clear technical documentation including pipeline designs, implementation standards and operational runbooks.
  • Work within governance, change management and release processes required in regulated financial services environments.

Requirements

  • Must have 5+ years’ experience working as a Data Engineer in enterprise data environments.
  • Strong communication skills and ability to collaborate across engineering and architecture teams.
  • Strong hands-on experience with Google Cloud Platform including BigQuery, Dataflow, Dataproc and Cloud Storage.
  • Experience working within the banking or regulated financial services sector.
  • Experience working on data platform modernisation or data product-oriented architectures.
  • Strong SQL engineering skills with experience designing transformations for large-scale structured datasets.
  • Experience using dbt or similar transformation frameworks for modular data modelling and deployment.
  • Strong understanding of surrogate keys, business keys, deterministic identifiers and modern data platform key management.
  • Experience handling sensitive data with enterprise controls such as masking, hashing, tokenisation or pseudonymisation.
  • Experience designing pipelines with strong data quality, lineage and traceability controls.
  • Understanding of batch and event-driven processing patterns and operational concerns including monitoring and recovery.
  • Experience working within regulated environments or financial services programmes.

NICE TO HAVE

  • Understanding of Data Mesh or product-aligned data ownership models.
  • Exposure to orchestration tools such as Airflow, Control-M or similar scheduling frameworks.
  • Experience with data governance and metadata tooling such as Dataplex, Collibra or equivalent.
  • Experience supporting migration from Legacy warehouse platforms to cloud-native data platforms.

About the company

Gibbs Consulting Global is supporting a client of ours within the banking sector who are delivering a large-scale data platform modernisation programme. As part of this programme, we are looking for six experienced Senior Data Engineers to support the delivery of a strategic data capability.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

3:27 min

Explaining query execution overhead and caching limitations in BigQuery

Adnan Rahic · JS Congress

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all