GCP Engineer

Thechangepartners
Charing Cross, United Kingdom
12 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 130K

Job location

Charing Cross, United Kingdom

Tech stack

Query Performance
Java
API
Airflow
Azure
Google BigQuery
Cloud Computing
Cloud Computing Security
Cloud Engineering
Cloud Storage
Computer Programming
Data Governance
Data Infrastructure
Data Integration
ETL
Data Systems
Relational Databases
Data Flow Control
Identity and Access Management
Python
Performance Tuning
DataOps
Shell Script
SQL Databases
Data Streaming
Data Processing
Scripting (Bash/Python/Go/Ruby)
Google Cloud Platform
Bullhorn
Data Pipelines
Apache Beam
Redshift

Job description

The role centers on the design, implementation, and refinement of data solutions within the Google Cloud Platform (GCP) ecosystem. You will work within a newly established CDM Operations Team, supporting marketing initiatives across European countries by ensuring seamless data integration and analytics capabilities., * Designing and Architecting Data Solutions: Develop scalable and efficient data systems using BigQuery and other GCP tools to support complex business intelligence needs.

  • Building and Managing Pipelines: Construct, maintain, and refine ETL/ELT pipelines utilizing Dataflow, Apache Beam, and Cloud Composer.
  • Data Integration: Incorporate various data streams-including APIs, relational databases, and streaming platforms-into the BigQuery environment.
  • Performance Tuning: Optimize storage and query performance within BigQuery to ensure high performance and cost efficiency.
  • Implementing Advanced Strategies: Deploy partitioning, clustering, and materialized views to enhance overall query speed.
  • Cloud Infrastructure Management: Configure and manage GCP services such as Cloud Storage, Pub/Sub, and IAM to ensure secure and reliable data operations.
  • Security and Compliance: Adhere to cloud security best practices and implement robust data governance and quality frameworks.
  • Monitoring and Support: Establish alerting systems for data pipelines to prevent failures and provide technical guidance to cross-functional teams.
  • Stakeholder Collaboration: Translate complex business requirements into technical designs while working closely with data analysts and global teams.

Requirements

  • Technical Expertise: Deep proficiency in BigQuery and SQL, with a strong background in data modeling.
  • GCP Hands-on Experience: Proven experience with Cloud Storage, Cloud Composer, Dataflow, and Pub/Sub.
  • Programming Skills: Strong command of Python or Java for data processing and scripting, alongside shell scripting and cloud automation knowledge.
  • ETL/ELT Proficiency: Demonstrated experience in building and maintaining data pipelines within cloud environments.
  • Problem Solving: Excellent analytical skills with the ability to convey technical concepts to non-technical stakeholders.
  • Certifications: Must be a Google Cloud Certified Professional Data Engineer or Associate Cloud Engineer.
  • Desired Extras: Prior experience with Amazon Redshift or Microsoft Azure (specifically ADF) is considered a distinct advantage

This is a critical opportunity to join a fast-paced team where you will keep abreast of IT developments and help shape the data infrastructure for a global market leader.

Please note that the role is based in the UK and operates within a dynamic environment where processes constantly evolve to meet business needs. There is occasional travel to the office just outside of West London.

Benefits & conditions

The Change Partners are working with a tier-1 Consumer Brand who are looking for a GCP Engineer for a full-time ongoing contractor position paying up to £500 per day.

Apply for this position