> Markdown version of [/jobs/ext/2021991-data-engineer-gcp-aws](https://www.wearedevelopers.com/jobs/ext/2021991-data-engineer-gcp-aws). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer (GCP/AWS) - **Company:** Square One Resources Limited - **Location:** London, UK - **Salary:** £169,000.0 - £195,000.0 - **Contract:** Temporary contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Automation of Tests, BigQuery, Cloud Computing, Cloud Computing Security, Computer Programming, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Warehousing, DevOps, Github, Identity and Access Management, Python (Programming Language), Performance Tuning, Release Management, SQL Databases, Macros, Infrastructure as Code (IaC), Cloudformation, Atlassian Tools, AWS Data Analytics, Bitbucket, Terraform, Data Pipelines, Atlassian Bamboo - **Published:** August 11, 2026 - **Apply:** https://www.careerboard.com/pt/en/find-jobs-in-United-Kingdom/-8C8EA250104CC9F7CE/ ## About the Role Cloud & Platform Engineering * Strong proficiency across AWS and GCP. * On AWS: IAM roles and policies, Lambda, S3, RDS, Redshift. * On GCP: BigQuery, workload optimisation, cost management. Data Engineering Tooling * Hands-on experience building data pipelines for data warehouse environments. * Strong SQL capability including analytical and window functions. * Advanced dbt Cloud experience (models, SCDs, tests, macros, release management). * Airflow workflow design including idempotency, backfills and monitoring. DevOps, CI/CD & IaC * Experience with CI/CD (GitHub, Bitbucket, GitHub Actions, Bamboo). * Infrastructure as Code using Terraform or CloudFormation. * Familiarity with data quality frameworks and automated testing of pipelines. Programming & Modelling * Proficiency in Python. * Strong data modelling expertise: facts/dimensions, SCD patterns, performance optimisation. Security, Data Governance & Operational Resilience * Solid grounding in cloud security best practices and least-privilege IAM. * Understanding of data access controls, regulated environments and governance expectations. Delivery Approach & Ways of Working * Experience working within Agile delivery frameworks. * Use of JIRA and Confluence for delivery management and documentation. * Proven track record collaborating effectively in multi-disciplinary teams across engineering, product and analytics. Specialisations * BigQuery performance tuning and cost optimisation. * DBT Cloud governance (contracts, tests, macros, release processes). * Airflow workflow optimisation and monitoring. * Cross-cloud pipelines and data movement (AWS/GCP). * Security, IAM and data-access design for regulated financial services environments. Experience & Other * Extensive experience in data engineering or equivalent technical roles. * Strong problem-solving capability, comfortable troubleshooting pipeline failures and performance issues. * Strong communication and stakeholder management skills. * Self-starter able to lead components independently while partnering closely with internal teams. * Experience supporting production environments, including incident response and root-cause analysis. * All intellectual property rights retained by client. ## Description The engineer will design, build and operate scalable, secure and analytics-ready data pipelines and models across GCP BigQuery and AWS, delivering: * Airflow-orchestrated data workflows and automations. * DBT Cloud transformations, testing frameworks and environment governance. * Robust CI/CD and Infrastructure as Code (IaC) deployments (GitHub Actions, Bitbucket, Bamboo, Terraform or CloudFormation). * Performance optimisation across data pipelines, SQL, BigQuery and AWS data services. * High-quality technical documentation, production support, incident response and handover to internal teams. * Close collaboration with cross-functional stakeholders including analytics, product and platform engineering. ## Related Videos - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Modularity: Let's dig deeper](https://www.wearedevelopers.com/videos/1200-modularity-let-s-dig-deeper) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)