> Markdown version of [/jobs/ext/3282086-principal-ai-data-engineer](https://www.wearedevelopers.com/jobs/ext/3282086-principal-ai-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal AI Data Engineer

- **Company:** EPAM Systems, Inc.
- **Location:** London, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Microsoft Azure, Computer Programming, Continuous Integration, Data Architecture, Extract Transform Load (ETL), Software Design Patterns, DevOps, Github, Python (Programming Language), Object-Oriented Software Development, Open Source Technology, Performance Tuning, Scrum Methodology, SQL Databases, Strategies of Testing, Microsoft Power Automate, Pytorch, Large Language Models, Prompt Engineering, Generative AI, Git, Containerization, Data Lakes, Code Inspection, Spark Streaming, Machine Learning Operations, Video Streaming, GPT, Docker, Databricks
- **Published:** September 21, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=598998a0f3428f35

## About the Role

* Bachelor's or Master's degree in Statistics, Mathematics, Econometrics or similar discipline
 * 8+ years of experience in data science and AI projects
 * Deep understanding of large language models (GPT, Llama, Claude, Mistral) and their reasoning capabilities
 * Strong experience with Databricks including DLT, Delta Lake and Unity Catalog governance
 * Solid knowledge of streaming technologies such as Spark Structured Streaming and Autoloader
 * Proficiency in programming with Python, SQL or Scala
 * Expertise in data modeling, ETL/ELT processes and data architecture
 * Good understanding of DevOps practices including Git standards and CI/CD automation
 * Experience working in Azure cloud environments
 * Familiarity with GenAI evaluation frameworks, benchmarking and testing methodologies
 * Excellent problem-solving, communication and stakeholder management skills

Nice to have

 * Understanding of enterprise AI governance models
 * Hands-on experience with Microsoft Copilot, AI Foundry, Databricks MosaicAI and AgentBricks
 * Strong decision-making capabilities and conflict resolution skills
 * Proven ability to identify and mitigate risks in data-centric projects
 * Familiarity with commercial operations in trading and supply environments

## Description

* Develop and evaluate AI/GenAI/AgenticAI prototypes using tools such as Copilot Studio, AI Foundry, Copilot Analyst Agent, Mosaic AI, Genie, AgentBricks and MLflow
 * Build and optimize Retrieval-Augmented Generation (RAG) systems including embedding model selection, prompt engineering and traceable evaluation
 * Design and deploy basic AI agents using frameworks such as LangChain, AutoGen and smolagents
 * Deploy models and applications leveraging Azure OpenAI, Azure AI Foundry, Databricks Mosaic Gateway and containerization with Docker
 * Follow DevOps best practices including CI/CD pipelines, testing, linting and GitHub workflows
 * Write modular reusable Python code using OOP design patterns and frameworks such as Pydantic and PyTorch
 * Emphasize reproducibility, open-source practices and performance tuning in end-to-end delivery
 * Operate within agile teams, contributing to sprint planning and collaborative reviews
 * Build scalable AI workflows and architectures using tools like Databricks, Genie and LangChain
 * Lead architectural planning and backlog creation to ensure long-term reliability and maintainability


## Related Videos

- [Beyond GPT: Building Unified GenAI Platforms for the Enterprise of Tomorrow](https://www.wearedevelopers.com/videos/1525-beyond-gpt-building-unified-genai-platforms-for-the-enterprise-of-tomorrow)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Livecoding with AI](https://www.wearedevelopers.com/videos/1201-livecoding-with-ai)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Inside the AI Revolution: How Microsoft is Empowering the World to Achieve More](https://www.wearedevelopers.com/videos/869-inside-the-ai-revolution-how-microsoft-is-empowering-the-world-to-achieve-more)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)