> Markdown version of [/jobs/ext/1163643-ai-data-lead](https://www.wearedevelopers.com/jobs/ext/1163643-ai-data-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Data Lead - **Company:** DeepRec - **Location:** Leeds, UK (Remote available) - **Experience:** Expert - **Salary:** £125,000.0 - £140,000.0 - **Contract:** Permanent contract - **Skills:** Adaptable Database Systems, Artificial Intelligence, Amazon Web Services, Software Applications, Automated Storage and Retrieval Systems, Microsoft Azure, Cloud Computing, Databases, Continuous Integration, Data Retrieval, Database Design, DevOps, Elasticsearch, Information Retrieval, Python (Programming Language), Enterprise Messaging Systems, Standard Sql, Search Technologies, Management of Software Versions, Data Ingestion, Event Driven Architecture, Containerization, Data Management, Full-text Search, Data Pipelines - **Published:** July 3, 2026 - **Apply:** https://find.jobs/jobs-near-me/apply/ats-redirect/?id=2854468912-2 ## About the Role * Proven experience delivering production-grade data platforms and retrieval systems. * Strong expertise with vector databases such as Qdrant, Pinecone, Weaviate, pgvector, or similar technologies. * Experience designing embedding pipelines and retrieval-augmented architectures. * Strong SQL and database design skills. * Excellent Python development experience. * Experience processing and extracting data from complex document formats. * Familiarity with cloud platforms (Azure, AWS, or GCP). * Understanding of containerisation, CI/CD, and modern engineering practices. * Previous experience leading, mentoring, or managing technical teams. * A pragmatic, delivery-focused mindset with a passion for solving real-world problems. Desirable Experience * Full-text search technologies such as Elasticsearch or OpenSearch. * NLP, information retrieval, or document intelligence solutions. * Event-driven architectures and messaging platforms. * Experience working within highly regulated or data-intensive environments. * Contributions to open-source projects or technical communities. ## Description As AI Data Lead, you'll be responsible for designing and delivering scalable data pipelines and retrieval infrastructure that support advanced AI solutions. You'll work across document processing, data ingestion, vector search, embeddings, and retrieval architectures to ensure high-quality data is available for AI-powered applications., * Lead the design and development of data ingestion and processing pipelines for structured and unstructured content. * Build and optimise retrieval systems, embeddings workflows, and vector search infrastructure. * Develop robust parsing and extraction solutions for a variety of document formats. * Establish data quality, governance, versioning, and monitoring standards. * Design scalable data models and database architectures to support AI applications. * Collaborate with engineering and product teams to improve data accessibility and performance. * Mentor and support a team of data-focused engineers, driving best practices and technical excellence. * Contribute to architectural decisions and long-term platform strategy. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How building an industry DBMS differs from building a research one](https://www.wearedevelopers.com/videos/768-how-building-an-industry-dbms-differs-from-building-a-research-one) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Crypto-secure Data Management with In-Database Blockchain](https://www.wearedevelopers.com/videos/632-crypto-secure-data-management-with-in-database-blockchain) - [Automated MS SQL Server database deployments with dacpacs and Azure DevOps](https://www.wearedevelopers.com/videos/334-automated-ms-sql-server-database-deployments-with-dacpacs-and-azure-devops) ## Related Articles - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)