Senior Data Engineer - GCP/BigQuery/Data Products
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+4 more
Job description
The Senior Data Engineers will support the design and delivery of a strategic data capability as part of a major UK banking data transformation programme.
The roles will focus on building scalable and governed data products within Google Cloud Platform. You will contribute to building, testing and deploying multiple data products, supporting a wider migration from incumbent warehouse platforms to a modern cloud-based architecture.
You will work closely with solution architects, fellow data engineers and platform teams to build reliable enterprise data products.
RESPONSIBILITIES
- Design and develop scalable GCP-based data products.
- Develop and optimise transformation logic using technologies such as dbt, Dataflow, Dataproc and BigQuery SQL.
- Collaborate with solution architects, data architects, microservices engineers and platform teams to deliver aligned engineering solutions.
- Support testing and validation of products including key generation quality, interoperability, lineage and operational resilience.
- Produce clear technical documentation including pipeline designs, implementation standards and operational runbooks.
- Work within governance, change management and release processes required in regulated financial services environments.
Requirements
- Must have 5+ years’ experience working as a Data Engineer in enterprise data environments.
- Strong communication skills and ability to collaborate across engineering and architecture teams.
- Strong hands-on experience with Google Cloud Platform including BigQuery, Dataflow, Dataproc and Cloud Storage.
- Experience working within the banking or regulated financial services sector.
- Experience working on data platform modernisation or data product-oriented architectures.
- Strong SQL engineering skills with experience designing transformations for large-scale structured datasets.
- Experience using dbt or similar transformation frameworks for modular data modelling and deployment.
- Strong understanding of surrogate keys, business keys, deterministic identifiers and modern data platform key management.
- Experience handling sensitive data with enterprise controls such as masking, hashing, tokenisation or pseudonymisation.
- Experience designing pipelines with strong data quality, lineage and traceability controls.
- Understanding of batch and event-driven processing patterns and operational concerns including monitoring and recovery.
- Experience working within regulated environments or financial services programmes.
NICE TO HAVE
- Understanding of Data Mesh or product-aligned data ownership models.
- Exposure to orchestration tools such as Airflow, Control-M or similar scheduling frameworks.
- Experience with data governance and metadata tooling such as Dataplex, Collibra or equivalent.
- Experience supporting migration from Legacy warehouse platforms to cloud-native data platforms.
About the company
Gibbs Consulting Global is supporting a client of ours within the banking sector who are delivering a large-scale data platform modernisation programme. As part of this programme, we are looking for six experienced Senior Data Engineers to support the delivery of a strategic data capability.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
Best Companies to work for in London: Top 25 Companies in 2023
Making Data Warehouses Fast: A Developer’s Story
Software Engineer Salary London