Data Engineer with Modelling Experience (DE)
Infinity Quest
UK
8 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£52,024.0
Working hours
Regular working hours
Job source
Tech stack
Geographic Information Systems
Airflow
BigQuery
Cloud Computing
Cluster Analysis
Databases
Continuous Integration
Directed Acyclic Graph (Directed Graphs)
Information Engineering
Data Governance
Data Manipulation Languages
Data Warehousing
+14 more
Network Topologies
Identity and Access Management
Python (Programming Language)
Metadata
Query Optimization
Simple Data Format
SQL Databases
Google Cloud
Sql Optimization
Gitlab
Containerization
Graphql
Terraform
Data Pipelines
Job description
- Design, build, and maintain scalable data pipelines and transformation workflows
- Implement and manage CI/CD pipelines within GitLab
- Deploy and maintain Terraform modules for repeatable infrastructure provisioning
- Develop and orchestrate Airflow DAGs in Google Cloud Composer
- Model data at warehouse and graph levels to support platform requirements
- Manage SpannerDB schema design and querying
- Apply BigQuery knowledge catalog and data governance practices
- Collaborate with stakeholders and contribute to large-scale project delivery
Requirements
We are seeking a skilled Data Engineer with strong modelling experience across data warehouse and graph paradigms. The ideal candidate is proficient across the GCP data stack, CI/CD pipelines, infrastructure-as-code, and data governance tooling, and can operate independently in a complex cloud-native environment., SQL & BigQuery
- Advanced SQL (window functions, arrays and structs, DDL, DML, UDFs, CTEs)
- Dataform for SQL modelling and transformation tasks
- BigQuery computational model - partitioning, clustering, query optimisation, pricing model (on-demand vs slots)
- Knowledge Catalog integrations: CDE identification, metadata, policy tagging, data quality scans (Data Contracts)
- Understanding of BigQuery IAM access principles
- Experience using GraphQL
Python
- Proficient Python development for data engineering tasks
Data Modelling
- Data warehouse and graph modelling
- Normalisation and denormalisation
- Conceptual, logical, and physical modelling
- SCD and time series modelling
- Medallion architecture concept
- Translation of business requirements into modelling outputs
Airflow / Composer
- DAG creation and execution
- Utilising Airflow in a cloud environment
- Integration with GCS, BigQuery, and Dataform
GCS (Google Cloud Storage)
- Bucket and blob structure
- Storage classes and retention policies
- Bucket access management via IAM
GitLab
- Branch management, commits, merges, repository maintenance
- CI/CD pipeline setup and execution in GitLab
Terraform (IaC)
- Terraform fundamentals and GitLab integration
- Deploying and modifying repeatable modules
SpannerDB
- Querying Spanner databases
- Relational modelling and schema design (primary keys, interleaved/global indexes)
- Use of interleaved tables, strong vs stale reads
Pub/Sub
- Understanding of event-driven messaging with Pub/Sub
GIS Data
- Knowledge of GIS data and engines (coordinate conversions, common file formats, BigQuery GIS)
Domain Knowledge
- Telecommunications: network topology, KPIs, telemetry, asset lifecycle
Stakeholder Management
- Proven experience in stakeholder engagement on large-scale projects
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
MH
Michael Hunger
Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?
8 months ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
CH
Chris Heilmann
Dev Digest 120 - Apple and peers
about 2 years ago