Data Engineer/GenAI Developer

Devonshire Hayes
London, UK
1 day ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Continuous Integration Information Engineering Extract Transform Load (ETL) Data Systems Python (Programming Language) Standard Sql Search Technologies
+16 more
Software Deployment Unstructured Data Large Language Models Snowflake Apache Spark Git Build Management Microsoft Fabric AI Platforms Apache Kafka Machine Learning Operations Restful APIs Data Pipelines Docker Databricks Microservices

Job description

We are seeking an experienced Data Engineer to design and build modern data solutions supporting enterprise AI and Generative AI use cases. This is a hands-on engineering position spanning trusted data pipelines, RAG and LLM services, APIs and production deployment.

What you’ll do:

Design and optimise scalable ETL/ELT pipelines for structured, semi-structured and unstructured data.

Build production-ready RAG pipelines covering ingestion, chunking, embeddings, vector search, retrieval and grounding.

Integrate enterprise data with LLM and AI services through secure, reusable APIs and components.

Take AI use cases from prototype through production, including testing, CI/CD, monitoring and troubleshooting.

Work with data scientists, AI engineers, architects and business stakeholders to deliver measurable outcomes.

Requirements

6-8 years’ hands-on data engineering experience with strong Python and SQL skills.

Strong ETL/ELT and large-scale pipeline experience using Spark, Databricks, Kafka, Airflow or equivalent technologies.

Commercial experience with AWS, Azure or GCP and modern platforms such as Databricks, Snowflake or Microsoft Fabric.

Practical GenAI experience across LLMs, RAG, embeddings, vector databases and frameworks such as LangChain, LlamaIndex or Semantic Kernel.

Strong REST API, microservices, Docker, Git and CI/CD engineering practices, with experience deploying solutions into production.

A sound understanding of data quality, governance, security and responsible AI.

Useful additional experience:

Azure OpenAI, AWS Bedrock or Vertex AI; LLMOps/MLOps, evaluation and observability; agentic AI; complex enterprise or Legacy integration; financial services or insurance.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

Videos

See all

Related articles

See all