> Markdown version of [/jobs/ext/2174837-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/2174837-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Data Engineer

- **Company:** Simple Machines
- **Location:** London, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Amazon Web Services, Big Data, BigQuery, Cloud Computing, Data Infrastructure, Data Systems, Database Testing, Data Flow Control, Github, Python (Programming Language), PostgreSQL, MongoDB, NoSQL, SQL Databases, Parquet, Pulumi, Data Storage Technologies, Snowflake, Apache Spark, Storage Technologies, Apache Flink, Cassandra, Avro, Terraform, Data Pipelines, Databricks
- **Published:** August 22, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/principal-data-engineer/44365207

## About the Role

operational excellence What We're Looking For Core Engineering Strength Strong Python and SQL Deep experience with Spark and modern data platforms (Databricks / Snowflake) Solid grasp of cloud data services (AWS or GCP) Architecture & Design Judgement Demonstrated ownership of large-scale data platform architectures Strong data modelling skills and architectural decision-making ability Comfortable balancing trade-offs between performance, cost, and complexity Data Platform Experience Built and operated large-scale data pipelines in production Strong data modelling capability and architectural judgement Comfortable with multiple storage technologies and formats Engineering Discipline Infrastructure-as-code experience (Terraform, Pulumi) CI/CD pipelines using tools like GitHub Actions, ArgoCD Data testing and quality frameworks (dbt, Great Expectations, Soda) Delivery & Consulting Mindset Experience in consulting or professional services environments Strong consulting instincts - able to
challenge assumptions and guide clients toward better outcomes Comfortable mentoring senior engineers and influencing technical culture Why Simple Machines You'll work on interesting, high-impact problems You'll build modern platforms, not maintain legacy mess You'll be surrounded by senior engineers who actually know their craft You'll have autonomy, influence, and room to grow If you're a senior data engineer who wants to build properly, think clearly, and deliver real outcomes - we should talk. #J-18808-Ljbffr

## Description

Orchestrate workflows using Airflow, Dataflow, Glue Work at Scale Process and transform large datasets using Spark and Flink Design systems that perform in production - not just on paper Own Data Storage & Performance Work across relational, NoSQL, and analytical stores (Postgres, BigQuery, Snowflake, Cassandra, MongoDB) Optimise storage formats and access patterns (Parquet, Delta, ORC, Avro) Cloud, Security & Governance Implement secure, compliant data solutions with security by design Embed governance without killing developer velocity Consult and Influence Work directly with clients to understand problems and shape solutions Translate business needs into pragmatic engineering decisions Act as a trusted technical advisor, not just an order taker Technical Leadership & Quality Set engineering standards, patterns, and best practices across teams Review designs and code, providing clear technical direction and mentorship Raise the bar on data quality, testing, observability, and


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Why segmenting your infrastructure into tiers makes your infrastructure design better](https://www.wearedevelopers.com/videos/1960-why-segmenting-your-infrastructure-into-tiers-makes-your-infrastructure-design-better)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Unleashing Potential Across Teams: The Power of Infrastructure as Code](https://www.wearedevelopers.com/videos/930-unleashing-potential-across-teams-the-power-of-infrastructure-as-code)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)