Data Engineer with Modelling Experience (DE)

Infinity Quest
UK
8 days ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£52,024.0
Working hours
Regular working hours

Tech stack

Geographic Information Systems Airflow BigQuery Cloud Computing Cluster Analysis Databases Continuous Integration Directed Acyclic Graph (Directed Graphs) Information Engineering Data Governance Data Manipulation Languages Data Warehousing
+14 more
Network Topologies Identity and Access Management Python (Programming Language) Metadata Query Optimization Simple Data Format SQL Databases Google Cloud Sql Optimization Gitlab Containerization Graphql Terraform Data Pipelines

Job description

  • Design, build, and maintain scalable data pipelines and transformation workflows
  • Implement and manage CI/CD pipelines within GitLab
  • Deploy and maintain Terraform modules for repeatable infrastructure provisioning
  • Develop and orchestrate Airflow DAGs in Google Cloud Composer
  • Model data at warehouse and graph levels to support platform requirements
  • Manage SpannerDB schema design and querying
  • Apply BigQuery knowledge catalog and data governance practices
  • Collaborate with stakeholders and contribute to large-scale project delivery

Requirements

We are seeking a skilled Data Engineer with strong modelling experience across data warehouse and graph paradigms. The ideal candidate is proficient across the GCP data stack, CI/CD pipelines, infrastructure-as-code, and data governance tooling, and can operate independently in a complex cloud-native environment., SQL & BigQuery

  • Advanced SQL (window functions, arrays and structs, DDL, DML, UDFs, CTEs)
  • Dataform for SQL modelling and transformation tasks
  • BigQuery computational model - partitioning, clustering, query optimisation, pricing model (on-demand vs slots)
  • Knowledge Catalog integrations: CDE identification, metadata, policy tagging, data quality scans (Data Contracts)
  • Understanding of BigQuery IAM access principles
  • Experience using GraphQL

Python

  • Proficient Python development for data engineering tasks

Data Modelling

  • Data warehouse and graph modelling
  • Normalisation and denormalisation
  • Conceptual, logical, and physical modelling
  • SCD and time series modelling
  • Medallion architecture concept
  • Translation of business requirements into modelling outputs

Airflow / Composer

  • DAG creation and execution
  • Utilising Airflow in a cloud environment
  • Integration with GCS, BigQuery, and Dataform

GCS (Google Cloud Storage)

  • Bucket and blob structure
  • Storage classes and retention policies
  • Bucket access management via IAM

GitLab

  • Branch management, commits, merges, repository maintenance
  • CI/CD pipeline setup and execution in GitLab

Terraform (IaC)

  • Terraform fundamentals and GitLab integration
  • Deploying and modifying repeatable modules

SpannerDB

  • Querying Spanner databases
  • Relational modelling and schema design (primary keys, interleaved/global indexes)
  • Use of interleaved tables, strong vs stale reads

Pub/Sub

  • Understanding of event-driven messaging with Pub/Sub

GIS Data

  • Knowledge of GIS data and engines (coordinate conversions, common file formats, BigQuery GIS)

Domain Knowledge

  • Telecommunications: network topology, KPIs, telemetry, asset lifecycle

Stakeholder Management

  • Proven experience in stakeholder engagement on large-scale projects

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

6:14 min

Structuring CI/CD pipelines with integrated security and quality checks

Christoph Ruggenthaler · LIVE

2:52 min

Generating APIs with the Neo4j GraphQL library

William Lyon · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

4:54 min

Implementing geographic salary tiers for compensation equity and fairness

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

Videos

See all

Related articles

See all