> Markdown version of [/jobs/ext/2668213-senior-data-engineer-aws-pyspark-snowflake-dbt](https://www.wearedevelopers.com/jobs/ext/2668213-senior-data-engineer-aws-pyspark-snowflake-dbt). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer - AWS/PySpark/Snowflake/DBT

- **Company:** Hamilton Barnes
- **Location:** London, UK
- **Experience:** Expert
- **Salary:** £117,000.0
- **Contract:** Temporary contract
- **Skills:** Query Performance, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Big Data, Continuous Integration, Data as a Services, Data Transformation, DevOps, Github, Machine Learning, Systems Development Life Cycle, Software Engineering, SQL Databases, Sql Optimization, Snowflake, Electronic Medical Records, Git, Pyspark, Infrastructure Automation Frameworks, AWS Data Analytics, Machine Learning Operations, Terraform, Software Version Control, Data Pipelines
- **Published:** September 2, 2026
- **Apply:** https://www.careerboard.com/pt/en/find-jobs-in-United-Kingdom/-D94208C155C07CC5EB/

## About the Role

Candidates should have strong commercial experience with:

 * AWS data stack - S3, EMR, EC2
 * PySpark
 * Snowflake
 * DBT
 * Advanced SQL
 * Production-grade data pipelines
 * Large-scale data processing
 * Data modelling
 * RDV/BDV or similar data modelling patterns
 * Snowflake and query performance optimisation
 * Modular and testable data transformation development
 * Structured SQL transformation frameworks
 * GitHub Actions
 * CI/CD
 * Git/version control
 * Strong software engineering and SDLC practices

Experience or exposure to Infrastructure-as-Code tools such as Terraform is also highly desirable.

Nice to Have

 * Exposure to MLOps
 * Experience supporting data science or machine-learning pipelines
 * Experience working within engineering-led data or product teams

## Description

The successful candidate will have strong hands-on experience building and supporting production-grade data pipelines using AWS, PySpark, Snowflake, SQL and DBT, combined with solid software engineering and DevOps practices., * Design, build and maintain production-grade data pipelines and services across AWS, PySpark, Snowflake and SQL-based transformation frameworks

 * Develop modular, testable and maintainable data models and transformation pipelines using DBT or equivalent SQL transformation frameworks
 * Build and optimise large-scale data processing solutions
 * Improve pipeline reliability through automation, monitoring, validation and dependency management
 * Diagnose and resolve production pipeline failures and data quality issues
 * Manage pipeline reruns, validation and recovery processes for critical data services
 * Optimise Snowflake queries and data models for performance and scalability
 * Contribute to CI/CD and DevOps practices using tools such as GitHub Actions
 * Apply strong software engineering practices including testing, modular development, version control and SDLC standards
 * Contribute to technical design, architecture and solutioning discussions
 * Work closely with cross-functional data, engineering and product teams


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023)