Google Cloud Platform Data Engineer

iO Associates
Bristol, United Kingdom
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 85K

Job location

Bristol, United Kingdom

Tech stack

Agile Methodologies
Airflow
Automation of Tests
Google BigQuery
Cloud Database
Software Quality
Continuous Integration
Data Governance
Relational Databases
Data Flow Control
Hadoop
Scrum
Release Management
Cloud Services
Cloudera
Software Engineering
Data Streaming
Google Cloud Platform
Spark
GIT
Data Lake
Collibra
Kafka
Machine Learning Operations
Software Version Control
Apache Beam
Legacy Systems

Job description

We are seeking experienced GCP Data Engineers at both Senior and Principal levels to help lead, design, and deliver high-impact cloud data platforms for our clients.

Whether you are focused on constructing resilient, production-ready pipelines or driving end-to-end solution architecture, team leadership, and client engagement, these roles offer direct ownership over complex Google Cloud environments.

What You'll Do

  • Deliver Core GCP Solutions: Develop, test, and deploy scalable batch and streaming data processing jobs using BigQuery, Dataflow, Dataproc, and Pub/Sub.
  • Automate & Orchestrate: Construct resilient automated workflows using Cloud Composer alongside robust CI/CD deployment pipelines.
  • Ensure Data Quality & Governance: Implement automated testing, monitoring, alerting, and quarantine processes so downstream analytics and business users can rely on the data.
  • Lead Technical Delivery: Shape software development life cycle standards-driving best practices across architecture, code quality, testing frameworks, and release management.
  • Collaborate & Align Stakeholders: Translate business goals into solid technical specifications and lead discussions with technical teams and senior client stakeholders to secure buy-in.
  • Coach & Mentor: Share specialist knowledge across the team, supporting engineers of all levels and fostering a culture of continuous learning.

Requirements

  • Hands-on GCP Suite Experience: Proven track record building production-grade solutions using BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
  • Frameworks & Storage: Strong understanding of batch/streaming tools (eg, Apache Spark, Apache Beam) and when to apply different storage paradigms (relational, columnar, document, data lakes).
  • Modern Best Practices: Active practice with version control (Git), automated testing, CI/CD pipelines, and Agile (Scrum/Kanban) methodologies.
  • Communication: Ability to explain technical concepts clearly to non-technical business partners and consult pragmatically on architecture trade-offs.

Bonus Experience:

  • Migration of enterprise-scale Legacy platforms (eg, Hadoop, traditional RDBMS) to GCP.
  • Exposure to streaming platforms like Kafka, MLOps workflows, or data governance tools like Dataplex and Cloud Data Catalog.

Apply for this position