Google Cloud Platform Data Engineer

iO Associates
Manchester, UK
2 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£65,000.0 - £85,000.0
Working hours
Regular working hours

Tech stack

Agile Methodology Airflow Automation of Tests BigQuery Cloud Database Software Quality Continuous Integration Data Governance Relational Databases Data Flow Control Apache Hadoop Scrum Methodology
+15 more
Release Management Cloud Services Cloudera Software Engineering Data Streaming Google Cloud Apache Spark Git SC Clearance Data Lakes Collibra Apache Kafka Machine Learning Operations Software Version Control Apache Beam

Job description

Role: GCP Data Engineer

Location: Hybrid; 2 days per week onsite in Bristol, London, or Manchester

Salary: £65,000 to £85,000 (Dependent on Experience) + Benefits

Security Clearance: Due to the sensitive nature of the client’s programme, candidates must hold active SC Clearance or be eligible to undergo the vetting process. Please note that specific client security restrictions mean this role is strictly restricted to Sole British Nationals.

We are seeking experienced GCP Data Engineers at both Senior and Principal levels to help lead, design, and deliver high-impact cloud data platforms for our clients.

Whether you are focused on constructing resilient, production-ready pipelines or driving end-to-end solution architecture, team leadership, and client engagement, these roles offer direct ownership over complex Google Cloud environments.

What You’ll Do

  • Deliver Core GCP Solutions: Develop, test, and deploy scalable batch and streaming data processing jobs using BigQuery, Dataflow, Dataproc, and Pub/Sub.
  • Automate & Orchestrate: Construct resilient automated workflows using Cloud Composer alongside robust CI/CD deployment pipelines.
  • Ensure Data Quality & Governance: Implement automated testing, monitoring, alerting, and quarantine processes so downstream analytics and business users can rely on the data.
  • Lead Technical Delivery: Shape software development lifecycle standards-driving best practices across architecture, code quality, testing frameworks, and release management.
  • Collaborate & Align Stakeholders: Translate business goals into solid technical specifications and lead discussions with technical teams and senior client stakeholders to secure buy-in.
  • Coach & Mentor: Share specialist knowledge across the team, supporting engineers of all levels and fostering a culture of continuous learning.

What We’re Looking For

  • Hands-on GCP Suite Experience: Proven track record building production-grade solutions using BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
  • Frameworks & Storage: Strong understanding of batch/streaming tools (e.g., Apache Spark, Apache Beam) and when to apply different storage paradigms (relational, columnar, document, data lakes).
  • Modern Best Practices: Active practice with version control (Git), automated testing, CI/CD pipelines, and Agile (Scrum/Kanban) methodologies.
  • Communication: Ability to explain technical concepts clearly to non-technical business partners and consult pragmatically on architecture trade-offs.

Bonus Experience

  • Migration of enterprise-scale legacy platforms (e.g., Hadoop, traditional RDBMS) to GCP.
  • Exposure to streaming platforms like Kafka, MLOps workflows, or data governance tools like Dataplex and Cloud Data Catalog.

Requirements

Whether you are focused on constructing resilient, production-ready pipelines or driving end-to-end solution architecture, team leadership, and client engagement, these roles offer direct ownership over complex Google Cloud environments., * Hands-on GCP Suite Experience: Proven track record building production-grade solutions using BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Composer.

  • Frameworks & Storage: Strong understanding of batch/streaming tools (e.g., Apache Spark, Apache Beam) and when to apply different storage paradigms (relational, columnar, document, data lakes).
  • Modern Best Practices: Active practice with version control (Git), automated testing, CI/CD pipelines, and Agile (Scrum/Kanban) methodologies.
  • Communication: Ability to explain technical concepts clearly to non-technical business partners and consult pragmatically on architecture trade-offs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all