> Markdown version of [/jobs/ext/4592523-data-engineer](https://www.wearedevelopers.com/jobs/ext/4592523-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Talent International
- **Location:** London, UK (Remote available)
- **Experience:** Expert
- **Salary:** £130,000.0 - £156,000.0
- **Contract:** Temporary contract
- **Skills:** LangGraph Framework, Artificial Intelligence, Automation of Tests, Microsoft Azure, Cloud Computing, Continuous Integration, Information Engineering, Data Infrastructure, Software Design Patterns, Information Retrieval, Python (Programming Language), Object-Oriented Software Development, OpenAI, Search Technologies, Software Engineering, Data Streaming, Systems Integration, Retrieval-Augmented Generation, Large Language Models, Multi-Agent Systems, Model Validation, Generative AI, Agentic-AI, Event Driven Architecture, Containerization, Data Lakes, Information Technology, CrewAI, AutoGen, Smolagents, Spark Streaming, Data Management, Machine Learning Operations, Model Context Protocol, Data Pipelines, Databricks
- **Published:** November 6, 2026
- **Apply:** https://www.totaljobs.com/job/data-engineer/talent-international-uk-ltd-job108287531

## About the Role

* Experience: 8-12+ years of hands-on experience in data engineering, data science, or production ML/AI environments.
 * Agentic Frameworks: Proven delivery with LangGraph, AutoGen, CrewAI, smolagents, or Model Context Protocol (MCP) integrations.
 * Lakehouse & Data Engineering: Strong background with enterprise Databricks environments (Delta Lake, Unity Catalog, Delta Live Tables/DLT, Spark Structured Streaming, or Autoloader).
 * Cloud & Model Ecosystem: Broad exposure to Azure cloud environments (Azure AI Foundry, Azure OpenAI) or Databricks Mosaic AI ecosystem.
 * Code Craftsmanship: Advanced Python (modular OOP, Pydantic, design patterns) and strong SQL capabilities.
 * Education: Degree or advanced degree (BSc / MSc) in Mathematics, Statistics, Computer Science, Engineering, Econometrics, or related quantitative discipline.

## Description

In this role, you will bridge the gap between rapid frontier AI experimentation and robust, large-scale enterprise data engineering. Working closely with commercial stakeholders, cross-functional squads, and technical leadership, you will translate high-value operational use cases into reliable, production-grade AI pipelines, intelligent agentic workflows, and governed data platforms., * Agentic AI & Prototype Delivery: Architect, build, and deploy multi-agent workflows and task-driven AI systems using frameworks such as LangGraph, LangChain, or AutoGen, turning early proof-of-concepts into resilient production applications.

 * Retrieval-Augmented Generation (RAG): Design and tune enterprise-grade RAG pipelines, including chunking strategy, dense/hybrid retrieval, reranking, and semantic search.
 * Data Platform Engineering: Build scalable, streaming, and batch data processing pipelines across modern cloud lakehouse architectures (Delta Lake, streaming architectures, and unified governance layers).
 * Systematic Evaluation & Benchmarking: Establish continuous model evaluation, reproducibility checks, tracing, and benchmarking frameworks (MLflow, LLM-as-a-judge, golden test suites) to ensure performance, safety, and auditability.
 * Architecture & Backlog Leadership: Set technical standards, define architectural blueprints, shape the product backlog, and lead agile delivery squads while communicating technical trade-offs to commercial business stakeholders.
 * Production MLOps & Governance: Implement modern software engineering and CI/CD practices (OOP in Python, Pydantic, containerisation, automated testing, and cloud gateway governance).