> Markdown version of [/jobs/ext/3021652-data-engineer](https://www.wearedevelopers.com/jobs/ext/3021652-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** The Rolewe - **Location:** London, UK - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Systems Engineering, Big Data, C++ (Programming Language), Databases, Data Infrastructure, Elasticsearch, Python (Programming Language), PostgreSQL, NoSQL, Operational Databases, Raw Data, SQL Databases, Apache Spark, Indexer, Gatsby, Data Lakes, Information Technology, Low Latency - **Published:** September 21, 2026 - **Apply:** https://www.apply4u.co.uk/jobs/data-engineer/47726137 ## About the Role jobs and infrastructure for throughput, latency and cost.You'll work closely with our AI researchers and product engineers, with substantial freedom to choose the approach and build the systems yourself.What you bringMust haves:Strong Python and SQL, with experience designing and operating production databases.Solid experience building and operating production data pipelines over large, messy datasets.Expertise with running search systems over large document collections.End-to-end ownership from raw data to user-facing functionality.A good understanding of schema design, indexing and query optimisation.A track record of diagnosing and fixing performance bottlenecks in live systems through profiling and measurement.Nice to Have:Experience with PostgreSQL/pgvector, OpenSearch (or Elasticsearch), Spark/Delta Lake, AWS, NoSQL databases, or Rust/C++ is useful.The FoundersYou'll partner with a founding team of AI PhDs and elite systems engineers:Sanj (CRO): PhD in AI (Gatsby Unit, UCL), ex-Huawei R&D, former lead at Magic Carpet AI (acquired).Chris (CEO): PhD in AI (UCL), published researcher, ex-Dyson and Alan Turing Institute.Angus (CTO): MEng Computer Science, ex-Qualcomm and Coremont (Brevan Howard).What we offerCompetitive Salary + Significant Equity: We want you to have true ownership in the success of the company.Founding Impact: You'll have a direct hand in how we build out the data infrastructure the rest of the product depends on.Support: Full visa sponsorship and private medical insurance.The Environment: Free meals and a seat at the table with an incredibly smart, ambitious team. #J-18808-Ljbffr ## Description through to serving queries. The work includes:Large-scale ingestion. Build and operate high-throughput, resumable pipelines for large datasets, with efficient incremental updates, monitoring and recovery from failures.Document processing and data quality. Extract useful content from complex documents and other formats. Handle malformed records and changing schemas, and validate outputs while preserving structure and metadata.Search and serving. Build keyword, vector and structured search, and design schemas, indexes and partitioning for fast queries over tens to hundreds of millions of records.Connecting information across sources. Link patents, scientific records and supporting documents, preserve dates and versions, and make results traceable to their original sources.Performance engineering. Profile parsing, ingestion, database builds and queries throughout development, testing against representative datasets at realistic scale. Diagnose CPU, memory and storage I/O bottlenecks, and tune ## Related Videos - [How Gatsby Cloud's real-time streaming architecture drives <5 second builds](https://www.wearedevelopers.com/videos/418-how-gatsby-cloud-s-real-time-streaming-architecture-drives-5-second-builds) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Swapping a Data Warehouse at Runtime: Zero-Downtime Migration Without Changing a Single Client](https://www.wearedevelopers.com/videos/100311-swapping-a-data-warehouse-at-runtime-zero-downtime-migration-without-changing-a-single-client) - [Dynamic Entities in .NET: Building Low-Code Systems on Top of Entity Framework Core](https://www.wearedevelopers.com/videos/100218-dynamic-entities-in-net-building-low-code-systems-on-top-of-entity-framework-core) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)