Lead Data & AI Engineer
EPAM Systems, Inc.
Amsterdam, Netherlands
10 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Languages
English
Job source
Tech stack
Artificial Intelligence
Application Integration Architecture
Microsoft Azure
Cloud Engineering
Computer Programming
Continuous Integration
Data Architecture
Information Engineering
Data Governance
Extract Transform Load (ETL)
Data Systems
Distributed Computing Environment
+17 more
Github
Python (Programming Language)
Machine Learning
Performance Tuning
Azure Active Directory
Data Streaming
Feature Engineering
Azure Data Factory
Data Build Tool (dbt)
Prompt Engineering
Containerization
Data Lakes
Pyspark
Machine Learning Operations
Software Version Control
Data Pipelines
Databricks
Job description
- Design and implement robust data architectures using cloud-native technologies
- Build large-scale ETL/ELT workflows to process heterogeneous datasets
- Create data models optimized for AI/ML pipelines and advanced analytics
- Develop streaming and batch pipelines leveraging tools like Azure Data Factory and Databricks
- Operationalize ML solutions, integrating feature stores, model registries and inference endpoints
- Collaborate with data scientists to deploy and monitor AI models using enterprise MLOps frameworks
- Integrate GenAI-assisted development methods into data workflows for automation and efficiency
- Ensure data governance, lineage, cataloging and quality frameworks across platforms
- Optimize platform performance, manage compute cost efficiency and enable observability for critical workloads
- Contribute to best practices, mentoring engineering teams in advanced data and AI engineering
Requirements
- 5+ years working in data engineering, with proven architecture and leadership experience
- Advanced proficiency in SQL for performance tuning at large scale
- Strong programming skills in Python, with applied experience in data engineering workflows
- Expertise in PySpark for distributed data processing
- Hands-on experience with Databricks, including Delta Lake and performance optimization
- Knowledge of Azure Data Factory for orchestration of pipelines (ETL/ELT)
- Familiarity with AI/ML pipeline development, including integration of models into production
- Demonstrated exposure to Gen AI-assisted development workflows for accelerating data engineering tasks
- Strong knowledge of CI/CD for data and ML pipelines (GitHub Actions, Azure DevOps) and experience with large-scale environments
- English proficiency at B2 level (Upper-Intermediate) or higher
Nice to have
- Prompt Engineering knowledge and experience building RAG workflows
- Familiarity with Microsoft Foundry platforms
- Version control and CI/CD experience with GitHub
- Understanding of ETL/ELT optimization patterns beyond Azure stack
- Knowledge of data mesh or lakehouse architectural concepts
- Hands-on exposure to dbt (data build tool), MKDocs and similar developer productivity tooling
Benefits & conditions
- 26 paid holiday days
- Pension plan scheme
- Disability insurance (WGA Shortfall insurance)
- Long-term disability insurance (WIA Top up insurance)
- EPAM Employee Stock Purchase Plan (ESPP)
- Commuting to work - costs reimbursement
- Laptop + corporate simcard + corporate mobile device (subject to certain eligibility requirements)
- Bike lease
- Employee Assistance Program
- Corporate Programs including Employee Referral Program with rewards
- Learning and development opportunities including in-house training and coaching, professional certifications, and courses
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
LM
Luis Minvielle
almost 3 years ago
BR
Benjamin Ruschin
Navigating the AI Shift
about 1 year ago
BB
Benedikt Bischof
MLOps And AI Driven Development
over 4 years ago
EM
Eli McGarvie
Data Engineer Salary UK
over 3 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
about 2 years ago
CH
Chris Heilmann
Dev Digest 121 - AI goes offline
over 2 years ago