> Markdown version of [/jobs/ext/1542066-principal-ai-data-engineer](https://www.wearedevelopers.com/jobs/ext/1542066-principal-ai-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal AI Data Engineer - **Company:** Deloitte - **Location:** London, UK - **Experience:** Expert - **Salary:** £110,267.0 - **Contract:** Temporary contract - **Skills:** Artificial Intelligence, Data Analysis, Microsoft Azure, Code Reuse, Computer Programming, Continuous Integration, Data Architecture, Extract Transform Load (ETL), Software Design Patterns, DevOps, Github, Python (Programming Language), Network Planning and Design, Object-Oriented Software Development, Open Source Technology, Performance Tuning, Scrum Methodology, Rapid Prototyping Process, SQL Databases, Data Processing, Data Ingestion, Pytorch, Large Language Models, Prompt Engineering, Generative AI, Git, Data Lakes, AI Platforms, Qlikview, Enterprise Integration, Code Inspection, Spark Streaming, Machine Learning Operations, Video Streaming, GPT, Docker, Databricks - **Published:** July 31, 2026 - **Apply:** https://www.adzuna.co.uk/jobs/details/5821999812 ## About the Role * Bachelor or Master or equivalent in Statistics, Mathematics, Econometrics or similar discipline with at least 8-12 years' experience on data science/AI projects. * Deep understanding of LLM families (GPT, Llama, Claude, Mistral) and their reasoning capabilities. * Strong experience with Databricks- DLT, Delta Lake concepts, UC governance. * Solid understanding of streaming technologies (e.g., Spark Structured Streaming, Autoloader) * Programming skills in Python, SQL, or Scala. * Proficiency in data modelling, ETL/ELT processes, and data architecture. * Strong analytical background with problem-solving skills. * Performance tuning concepts like watermarking, late data handling, parallelism & checkpointing. * Hands-on expertise in ADF, and Qlik Replicate for data ingestion and replication. * Experience working in Azure cloud environments. * Experience with GenAI evaluation frameworks and benchmarking methodologies. * Experience in MS Copilot, AI Foundry , Databricks (MosiacAI, MLflow, Agentbricks, Genie) * Strong Git practices and collaborative coding standards. * A passion for and expertise in practicing data science to solve real-world problems. * Excellent oral and written communication skills. * Strong interpersonal skills and enthusiasm for teamwork, as well as the ability to work independently. * Familiarity with the enterprise AI platforms and governance models is a plus. * Strong decision-making abilities, using data-driven insights to make informed choices that align with organizational goals. * Skills in managing conflicts and facilitating effective resolutions to maintain a positive and productive team dynamic. * Ability to engage with and manage expectations of various stakeholders, including executives, project managers, and other teams. * Proficiency in identifying potential risks in data projects and implementing strategies to mitigate them. * Strong commitment and ownership of project delivery. ## Description * Develop and evaluate AI/GenAI/AgenticAI prototypes using tools like Copilot Studio, AI Foundry and Copilot Analyst Agent, Mosiac AI, Genie, AgentBricks, MLflow with a focus on quick wins and enterprise integration. * Build and tune Retrieval-Augmented Generation (RAG) systems, including embedding model selection, prompt engineering, and traceable evaluation. * Design and deploy basic AI agents using frameworks such as LangChain, AutoGen, and smolagents * Communicate complex AI concepts clearly to business stakeholders and cross-functional teams. * Collaborate on E platform enhancements and work within its current limitations. * Deploy models and applications using Azure OpenAI, Azure AI Foundry, Databricks Mosaic Gateway, and Docker. * Follow DevOps best practices including CI/CD pipelines, testing, linting, and GitHub workflows. * Write modular, reusable code using OOP design patterns in Python (Pydantic, PyTorch, etc.). * Operate in agile teams and contribute to sprint planning, reviews, and retrospectives. * Deliver hands on GenAI/AgenticAI systems used directly by commercial teams within Trading & Supply, taking solutions from prototype to production * Apply engineering skills (emphasis on Databricks) and research skills across experimentation, rapid prototyping, and iterative delivery. Someone who puts emphasis on reproducibility and open source, manages large-scale text and structured datasets on Databricks. * Build AI capability, manage stakeholders and communicate effectively to ensure alignment between business needs and AI solutions, and a quick understanding of commercial operations that happen in T&S * Design and run evaluation and testing frameworks for GenAI systems, including benchmarking, reproducibility checks, and structured model assessments * Build solutions using Databricks infrastructure, Genie, MLflow (deployment and tracing and evaluations), LangChain, and LangGraph, and integrate them into scalable AI workflows and architectures * Contribute to system planning, architectural design, and structured testing to ensure long term reliability, performance, and maintainability * Preferably also someone who can set the building blocks and lead building out the backlog ## Related Videos - [Beyond GPT: Building Unified GenAI Platforms for the Enterprise of Tomorrow](https://www.wearedevelopers.com/videos/1525-beyond-gpt-building-unified-genai-platforms-for-the-enterprise-of-tomorrow) - [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Inside the AI Revolution: How Microsoft is Empowering the World to Achieve More](https://www.wearedevelopers.com/videos/869-inside-the-ai-revolution-how-microsoft-is-empowering-the-world-to-achieve-more) - [Streaming AI Responses in Real-Time with SSE in Next.js & NestJS](https://www.wearedevelopers.com/videos/1630-streaming-ai-responses-in-real-time-with-sse-in-next-js-nestjs) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)