RAG / AI Data Engineer

Diagonal recruitment

Greater London, UK

1 day ago

Apply on www.collegerecruiter.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.collegerecruiter.com

Tech stack

Artificial Intelligence Automated Storage and Retrieval Systems Data Architecture Extract Transform Load (ETL) Python (Programming Language) Machine Learning Standard Sql Unstructured Data Large Language Models Generative AI Build Management Data Pipelines

Job description

Design and build data pipelines to support AI applications
Develop Retrieval-Augmented Generation (RAG) architectures
Create and maintain vector databases and knowledge repositories
Structure, clean and prepare data for AI consumption
Improve retrieval accuracy, relevance and performance
Build scalable data foundations for AI products and agents
Collaborate with architects, engineers and product teams to enable AI delivery

Requirements

Python
SQL
Vector databases (Pinecone, Weaviate, Qdrant, Chroma or similar)
Embedding models and retrieval frameworks
LangChain, LlamaIndex or equivalent
Data pipeline and ETL tooling, * Building data pipelines for AI or ML applications
Designing or implementing RAG architectures
Working with vector databases
Managing structured and unstructured datasets
Optimising retrieval quality and search performance
Agent-based AI systems and workflows, * Strong understanding of data architecture and retrieval systems
Able to balance accuracy, performance and scalability
Comfortable working across structured and unstructured datasets
Interested in practical AI implementation rather than theoretical research
Focused on creating reliable foundations for AI systems
Strong problem-solving and analytical skills