Data Engineer
Meritus Talent
Charing Cross, United Kingdom
2 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 156KJob location
Charing Cross, United Kingdom
Tech stack
Azure
Big Data
Cloud Computing
Continuous Integration
ETL
Data Security
Distributed Data Store
Github
Python
Azure
SQL Databases
Azure
Spark
PySpark
Software Version Control
Data Pipelines
Databricks
Job description
- Design and develop scalable data pipelines using modern cloud technologies.
- Build and optimise distributed data processing solutions using Databricks, Spark and Python.
- Develop and maintain data integration workflows using Azure Data Factory.
- Work with large datasets stored in Azure Data Lake environments.
- Collaborate with architects, analysts and engineering teams to deliver reliable and secure data solutions.
- Contribute to improving data quality, performance and operational monitoring across the platform.
Requirements
- Strong experience with Azure Databricks, Azure Data Factory and Azure Data Lake.
- Advanced Python, SQL and Spark (PySpark) development experience.
- Experience building and optimising ETL/data pipelines in cloud environments.
- Knowledge of CI/CD and version control (Azure DevOps, GitHub or similar).
- Experience working with large-scale distributed data processing systems.
About the company
A leading UK financial institution is seeking an experienced Data Engineer to support the development and enhancement of a modern cloud-based data platform. This role will focus on building scalable data pipelines and supporting the evolution of a cloud-first data architecture.
