Google Cloud Platform Data Engineer

PA Consulting
Bristol, UK
7 days ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£52,000.0 - £92,000.0
Working hours
Regular working hours

Tech stack

Microsoft Excel Agile Methodology Airflow Automation of Tests BigQuery Cloud Computing Cloud Database Cloud Engineering Software Quality Continuous Integration Information Engineering Extract Transform Load (ETL)
+33 more
Data Stores Data Visualization Data Warehousing Relational Databases DevOps Data Flow Control Apache Hadoop PostgreSQL Machine Learning Meta-Data Management Microsoft SQL Server MySQL Oracle (Applications) Scrum Methodology Standard Sql Cloudera Software Engineering Data Streaming Data Processing Google Cloud Data Storage Technologies Feature Engineering Apache Spark Git Event Driven Architecture Data Lakes Collibra Deployment Automation Apache Kafka Data Management Stream Processing Data Pipelines Apache Beam

Job description

  • Lead a team or the solution delivery effort as a subject matter expert in Google Cloud data processing and management capabilities
  • Provide technical support and lead engineering efforts across one or multiple teams
  • Define the end-to-end software development lifecycle in line with modern best practices
  • Develop robust data processing jobs using Google Cloud Dataflow, Dataproc and BigQuery
  • Design and deliver automated data pipelines using orchestration tools such as Cloud Composer
  • Design end-to-end solutions and contribute to architecture discussions beyond data processing
  • Own the development process for the team, putting robust methods and patterns in place across architecture, scope, code quality and deployments
  • Shape team behaviour for specifications, acceptance criteria, estimating stories, sprint planning and documentation
  • Define and evolve our data engineering standards and practices
  • Lead and influence technical discussions with client stakeholders to secure collective buy-in
  • Coach and mentor team members and build their expertise and understanding

Technologies:

  • BigQuery
  • CI/CD
  • Cloud
  • Composer
  • ETL
  • Excel
  • GCP
  • Git
  • Hadoop
  • Support
  • Kafka
  • Kanban
  • Machine Learning
  • MySQL
  • Network
  • Oracle
  • PostgreSQL
  • SQL
  • Spark
  • DevOps

Requirements

  • Experience delivering and deploying production-ready data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc
  • Experience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam
  • Expert understanding of when to use a range of data storage technologies including relational/non-relational, document, row-based/columnar data stores, data warehousing and data lakes
  • Expert understanding of data pipeline patterns and approaches such as event-driven architectures, ETL/ELT, stream processing and data visualisation
  • Experience working with business owners to translate business requirements into technical specifications and solution designs that satisfy the data requirements of the business
  • Experience working with metadata management products such as Cloud Data Catalog and Collibra and data governance tools like Dataplex
  • Experience in developing solutions on GCP using cloud-native principles and patterns
  • Experience building data quality alerting and data quarantine solutions to ensure downstream datasets can be trusted
  • Experience implementing CI/CD pipelines using techniques including git code control/branching, automated tests and automated deployments
  • Comfortable working in an Agile team using Scrum or Kanban methodologies
  • Experience of working on migrations of enterprise-scale data platforms including Hadoop and traditional data warehouses
  • An understanding of machine learning model development lifecycle, feature engineering, training and testing
  • Good understanding or hands-on experience of Kafka
  • Experience as a DBA or developer on RDBMS such as PostgreSQL, MySQL, Oracle or SQL Server
  • Experience designing data applications to meet non-functional requirements such as performance and availability
  • Ability to clearly communicate with clients and peers in written and workshop contexts
  • Ability to explain technical concepts to non-technical audiences at all levels of an organisation
  • Ability to influence and persuade senior and specialist client stakeholders across multiple organisational boundaries without direct authority
  • Confidence in problem solving and troubleshooting
  • Willingness to share specialist knowledge, ideas and solutions
  • Commitment to continuous learning and coaching others

About the company

We are an innovation and transformation consultancy that believes in the power of ingenuity to build a positive human future in a technology-driven world. Our diverse teams of experts combine innovative thinking with breakthrough technologies to progress further, faster. With a global network of FTSE 100 and Fortune 500 clients, we offer unrivalled opportunities for growth and the freedom to excel. We combine strategies, technologies and innovation to turn complexity into opportunity and deliver enduring results, helping build a lasting career. We offer a benefits package that includes private medical insurance, an interest-free season ticket loan, 25 days annual leave with the opportunity to buy 5 additional days, a company pension scheme, an annual performance-based bonus, life and income protection insurance, tax-efficient benefits such as cycle to work, give as you earn and childcare benefits, and voluntary benefits including dental, critical illness and spouse/partner life assurance. We are committed to building an inclusive and supportive culture where diversity thrives, so all our people can excel.

last updated 37 week of 2026

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:18 min

Scaling MySQL databases for massive user growth

Johannes Nicolai Johannes Nicolai +1 · LIVE

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all