Principal AI Data Engineer

EPAM Systems, Inc.

London, UK

12 days ago

Apply on www.indeed.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Working hours

Regular working hours

Job source

www.indeed.com

Tech stack

Artificial Intelligence Microsoft Azure Computer Programming Continuous Integration Data Architecture Extract Transform Load (ETL) Software Design Patterns DevOps Github Python (Programming Language) Object-Oriented Software Development Open Source Technology

+19 more

Performance Tuning Scrum Methodology SQL Databases Strategies of Testing Microsoft Power Automate Pytorch Large Language Models Prompt Engineering Generative AI Git Containerization Data Lakes Code Inspection Spark Streaming Machine Learning Operations Video Streaming GPT Docker Databricks

Job description

Develop and evaluate AI/GenAI/AgenticAI prototypes using tools such as Copilot Studio, AI Foundry, Copilot Analyst Agent, Mosaic AI, Genie, AgentBricks and MLflow
Build and optimize Retrieval-Augmented Generation (RAG) systems including embedding model selection, prompt engineering and traceable evaluation
Design and deploy basic AI agents using frameworks such as LangChain, AutoGen and smolagents
Deploy models and applications leveraging Azure OpenAI, Azure AI Foundry, Databricks Mosaic Gateway and containerization with Docker
Follow DevOps best practices including CI/CD pipelines, testing, linting and GitHub workflows
Write modular reusable Python code using OOP design patterns and frameworks such as Pydantic and PyTorch
Emphasize reproducibility, open-source practices and performance tuning in end-to-end delivery
Operate within agile teams, contributing to sprint planning and collaborative reviews
Build scalable AI workflows and architectures using tools like Databricks, Genie and LangChain
Lead architectural planning and backlog creation to ensure long-term reliability and maintainability

Requirements

Bachelor’s or Master’s degree in Statistics, Mathematics, Econometrics or similar discipline
8+ years of experience in data science and AI projects
Deep understanding of large language models (GPT, Llama, Claude, Mistral) and their reasoning capabilities
Strong experience with Databricks including DLT, Delta Lake and Unity Catalog governance
Solid knowledge of streaming technologies such as Spark Structured Streaming and Autoloader
Proficiency in programming with Python, SQL or Scala
Expertise in data modeling, ETL/ELT processes and data architecture
Good understanding of DevOps practices including Git standards and CI/CD automation
Experience working in Azure cloud environments
Familiarity with GenAI evaluation frameworks, benchmarking and testing methodologies
Excellent problem-solving, communication and stakeholder management skills

Nice to have

Understanding of enterprise AI governance models
Hands-on experience with Microsoft Copilot, AI Foundry, Databricks MosaicAI and AgentBricks
Strong decision-making capabilities and conflict resolution skills
Proven ability to identify and mitigate risks in data-centric projects
Familiarity with commercial operations in trading and supply environments

Benefits & conditions

EPAM Employee Stock Purchase Plan (ESPP)
Protection benefits including life assurance, income protection and critical illness cover
Private medical insurance and dental care
Employee Assistance Program
Competitive group pension plan
Cyclescheme, Techscheme and season ticket loans
Various perks such as free Wednesday lunch in-office, on-site massages and regular social events
Learning and development opportunities including in-house training and coaching, professional certifications, and courses
If otherwise eligible, participation in the discretionary annual bonus program
If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program