Lead - Data Integration
Mpower Plus UK Ltd
Charing Cross, United Kingdom
yesterday
Role details
Contract type
Contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Charing Cross, United Kingdom
Tech stack
Artificial Intelligence
Azure
Continuous Delivery
Data Architecture
Data Integration
ETL
Data Mining
Query Optimization
SQL Databases
Systems Integration
Data Processing
Data Ingestion
Azure
Data Pipelines
Databricks
Job description
- Hands-on experience working with Azure Data Factory and Databricks, including designing, deploying, and optimizing data pipelines, workflows, and compute clusters
- Strong proficiency in SQL, with the ability to write efficient queries, troubleshoot issues, and improve performance
- Experience using a variety of data ingestion techniques and frameworks to integrate data from multiple sources
- Solid understanding of data architecture and data modelling, with the ability to align solutions to business objectives
- Good knowledge of ETL processes, covering data extraction, transformation, and loading across different environments
- In-depth familiarity with the Azure ecosystem and Databricks platform for scalable data solutions
- Experience implementing CI/CD pipelines to support automated development, testing, and deployment
- Exposure to integrating AI-driven capabilities to enhance data processing and delivery efficiency
Requirements
- Hands-on experience working with Azure Data Factory and Databricks, including designing, deploying, and optimizing data pipelines, workflows, and compute clusters
- Strong proficiency in SQL, with the ability to write efficient queries, troubleshoot issues, and improve performance
- Experience using a variety of data ingestion techniques and frameworks to integrate data from multiple sources
- Solid understanding of data architecture and data modelling, with the ability to align solutions to business objectives
- Good knowledge of ETL processes, covering data extraction, transformation, and loading across different environments
- In-depth familiarity with the Azure ecosystem and Databricks platform for scalable data solutions
- Experience implementing CI/CD pipelines to support automated development, testing, and deployment
- Exposure to integrating AI-driven capabilities to enhance data processing and delivery efficiency