> Markdown version of [/jobs/ext/2871274-data-engineer-in-data-platforms](https://www.wearedevelopers.com/jobs/ext/2871274-data-engineer-in-data-platforms). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# data engineer in data platforms

- **Company:** Simple Machines
- **Location:** London, UK
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Data Analysis, Big Data, Cloud Database, Data Infrastructure, Data Systems, Database Testing, Github, Python (Programming Language), NoSQL, SQL Databases, Apache Spark, Storage Technologies, Data Management, Terraform, Data Pipelines, Databricks
- **Published:** September 13, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/data-engineer-in-data-platforms/46644911

## About the Role

to balance performance, cost, and complexity trade-offsExperience building and operating large-scale data pipelines in productionExperience with multiple storage technologies and formatsInfrastructure-as-code experience with Terraform or PulumiExperience with CI/CD pipelines using tools such as GitHub Actions or ArgoCDExperience with data testing and quality frameworks such as dbt, Great Expectations, or SodaExperience in consulting or professional services environmentsStrong consulting instincts and ability to challenge assumptions and guide clients toward better outcomesAbility to mentor senior engineers and influence technical cultureУсловияNo conditions specified #J-18808-Ljbffr

## Description

and GlueProcess and transform large datasets using Spark and FlinkDesign production-ready systemsWork across relational, NoSQL, and analytical data storesOptimise storage formats and access patternsImplement secure, compliant data solutions with security by designEmbed governance while maintaining developer velocityWork directly with clients to understand problems and shape solutionsTranslate business needs into pragmatic engineering decisionsAct as a trusted technical advisorSet engineering standards, patterns, and best practices across teamsReview designs and code, providing technical direction and mentorshipImprove data quality, testing, observability, and operational excellenceТребованияStrong Python and SQL skillsDeep experience with Spark and modern data platforms such as Databricks and SnowflakeSolid understanding of cloud data services in AWS or GCPDemonstrated ownership of large-scale data platform architecturesStrong data modelling and architectural decision-making skillsAbility


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS)](https://www.wearedevelopers.com/videos/254-tomorrow-s-cloud-data-platforms-fully-managed-database-as-a-service-dbaas)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)