> Markdown version of [/jobs/ext/32988-staff-data-platform-engineer](https://www.wearedevelopers.com/jobs/ext/32988-staff-data-platform-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Staff Data Platform Engineer - **Company:** Wayve - **Location:** London, UK (Remote available) - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Cloud Database, Data Transmissions, Data Infrastructure, Data Integrity, Data Systems, Distributed Data Store, Python (Programming Language), Cloud Platform System, Multi-Cloud, Build Management, Apache Kafka, Terraform, Lidar - **Published:** May 29, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=e1095e450fd3f135 ## About the Role Do you have experience in Terraform?, * Proven experience building and operating large-scale data transfer pipelines at multi-TB or PB scale * Experience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be considered * Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting. * Strong cloud platform skills (Azure preferred); experience working with multiple cloud providers (AWS/GCP) is a strong advantage * Proficiency in Python and Terraform * Cloud-to-cloud and networking experience (e.g. blob/object transfer and storage at scale, cross-cloud data movement) * A product mindset: you think about the customer and build solutions that fix real problems, not just implement requirements * Comfort working in a fast-changing environment with evolving requirements: this is a startup within a scale-up * High degree of autonomy and ownership: you take responsibility for outcomes, not just tasks Nice to Have * Experience with Kafka for event-driven transfer observability * Multi-cloud experience across Azure, AWS and/or GCP * Experience working directly with external data partners * Background in autonomous vehicles, robotics or similar data-intensive domains ## Description We're looking for a Staff Data Platform Engineer to own and lead Wayve's Data Transfer Hub project. This is a mission-critical piece of infrastructure that will scale to transfer petabytes of sensor data per day from partner-operated vehicles around the world., * Set technical direction for the Data Transfer Hub, making trade-offs across reliability, throughput, cost, partner constraints, observability and operational support. * Lead the technical design and delivery of the Data Transfer Hub project, ingesting large volumes of video, LiDAR and sensor data from global partners at up to PB/day scale * Design and build parallelised, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event-driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure * Build and operate a globally distributed hub-and-spoke data transfer model to retrieve and share sensor data at scale with partners * Write infrastructure-as-code in Terraform; build pipeline logic primarily in Python * Drive cloud-to-cloud and cross-cloud networking solutions (Azure primary; cross-cloud experience beneficial) * Work in a fast-changing environment: requirements will evolve; high comfort with ambiguity required ## Related Videos - [Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies](https://www.wearedevelopers.com/videos/251-remote-driving-on-plant-grounds-with-state-of-the-art-cloud-technologies) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [How to develop an autonomous car end-to-end: Robotic Drive and the mobility revolution](https://www.wearedevelopers.com/videos/22-how-to-develop-an-autonomous-car-end-to-end-robotic-drive-and-the-mobility-revolution) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers) - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)