Google Cloud Platform Data Engineer

iO Associates

Bristol, UK

19 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

£65,000.0 - £85,000.0

Working hours

Regular working hours

Job source

www.careerboard.com

Tech stack

Agile Methodology Airflow Automation of Tests BigQuery Cloud Database Software Quality Continuous Integration Data Governance Relational Databases Data Flow Control Apache Hadoop Scrum Methodology

+15 more

Release Management Cloud Services Cloudera Software Engineering Data Streaming Google Cloud Apache Spark Git Data Lakes Collibra Apache Kafka Machine Learning Operations Software Version Control Apache Beam Legacy Systems

Job description

We are seeking experienced GCP Data Engineers at both Senior and Principal levels to help lead, design, and deliver high-impact cloud data platforms for our clients.

Whether you are focused on constructing resilient, production-ready pipelines or driving end-to-end solution architecture, team leadership, and client engagement, these roles offer direct ownership over complex Google Cloud environments.

What You’ll Do

Deliver Core GCP Solutions: Develop, test, and deploy scalable batch and streaming data processing jobs using BigQuery, Dataflow, Dataproc, and Pub/Sub.
Automate & Orchestrate: Construct resilient automated workflows using Cloud Composer alongside robust CI/CD deployment pipelines.
Ensure Data Quality & Governance: Implement automated testing, monitoring, alerting, and quarantine processes so downstream analytics and business users can rely on the data.
Lead Technical Delivery: Shape software development life cycle standards-driving best practices across architecture, code quality, testing frameworks, and release management.
Collaborate & Align Stakeholders: Translate business goals into solid technical specifications and lead discussions with technical teams and senior client stakeholders to secure buy-in.
Coach & Mentor: Share specialist knowledge across the team, supporting engineers of all levels and fostering a culture of continuous learning.

Requirements

Hands-on GCP Suite Experience: Proven track record building production-grade solutions using BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
Frameworks & Storage: Strong understanding of batch/streaming tools (eg, Apache Spark, Apache Beam) and when to apply different storage paradigms (relational, columnar, document, data lakes).
Modern Best Practices: Active practice with version control (Git), automated testing, CI/CD pipelines, and Agile (Scrum/Kanban) methodologies.
Communication: Ability to explain technical concepts clearly to non-technical business partners and consult pragmatically on architecture trade-offs.

Bonus Experience:

Migration of enterprise-scale Legacy platforms (eg, Hadoop, traditional RDBMS) to GCP.
Exposure to streaming platforms like Kafka, MLOps workflows, or data governance tools like Dataplex and Cloud Data Catalog.