AI Data Engineer
Asenium Consulting
Municipality of Madrid, Spain
2 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
IntermediateJob location
Remote
Municipality of Madrid, Spain
Tech stack
Artificial Intelligence
Data analysis
Azure
Data as a Services
Information Engineering
Data Governance
Data Systems
DevOps
Document Management Systems
Github
Python
Machine Learning
Azure
SQL Databases
Unstructured Data
Data Processing
Data Ingestion
Azure
Microsoft Fabric
Data Lake
Collibra
Deployment Automation
Machine Learning Operations
Azure
Software Version Control
Data Pipelines
Serverless Computing
Databricks
Job description
For one of my customer in Europe we are looking for a AI Data Engineer with experience in Microsoft Fabric., We are looking for an experienced AI Data Engineer with deep hands-on knowledge of Microsoft Fabric, Azure Data services, and modern data engineering practices. The ideal candidate will build, optimize, and maintain scalable data pipelines supporting advanced analytics and AI/ML initiatives across the organization., Data Engineering & Architecture
- Design, build, and maintain scalable data pipelines on Microsoft Fabric (Data Factory, Dataflows, Lakehouse, Warehouse, OneLake).
- Develop robust data ingestion, transformation, and orchestration processes using Azure Data Factory, Azure Databricks, Azure Synapse, and Azure Functions.
- Implement and optimize Delta Lake architectures for structured and unstructured data.
- Build reusable data products to support AI, machine learning, and analytics workloads.
AI & Advanced Analytics Integration
- Partner with Data Scientists and ML Engineers to operationalize models using Azure Machine Learning, Fabric Data Science experiences, or Databricks.
- Prepare and feature-engineer datasets tailored for AI workloads.
- Automate MLOps workflows, model monitoring, and deployment pipelines.
Governance, Quality & Security
- Implement data quality frameworks, observability, monitoring, and lineage using Fabric and Azure Purview.
- Ensure compliance with governance, data privacy, and security standards.
- Manage CI/CD pipelines for data code using Azure DevOps or GitHub.
Collaboration & Stakeholder Engagement
- Collaborate with business analysts, product owners, and domain experts to understand requirements and deliver high-value data solutions.
- Maintain documentation of data sources, data models, pipelines, and best practices.
- Provide technical guidance and mentorship to junior developers.
Requirements
- 3+ years of experience as a Data Engineer, AI Engineer, or similar role.
- Strong hands-on experience with Microsoft Fabric (Lakehouse, Data Engineering, Data Factory, Data Pipelines).
- Knowledge of Azure Data Services.
- Proficiency in Python and SQL for data processing and transformation.
- Experience building data lakehouse architectures and Delta Lake pipelines.
- Knowledge of modern DevOps/MLOps practices, including version control, testing, and automated deployment.
- Familiarity with data governance frameworks using Azure Purview or Fabric governance.
