Senior Data Engineer (Azure)

DataArt
Charing Cross, United Kingdom
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Charing Cross, United Kingdom

Tech stack

Azure
Big Data
Cloud Computing
Core Foundation
ETL
Data Visualization
Data Warehousing
Python
SQL Azure
Performance Tuning
Software Engineering
SQL Databases
Azure
Snowflake
Data Management
Tools for Reporting
Data Pipelines
Serverless Computing
Databricks

Job description

Project overview: The project focuses on building a modern, enterprise-grade data platform that serves as a core foundation for data-driven decision-making across multiple lines of business.

  • Position overview: We are seeking an experienced Senior Data Engineer to join a high-performing data team working on a large-scale, cloud-based platform. In this role, you will design, build, and maintain robust data pipelines and data warehousing solutions that enable analytics, reporting, and business intelligence initiatives.

  • This role requires regular collaboration with stakeholders and on-site presence at the client's Central London office 3-4 days per week.

  • Responsibilities: Design, build, and maintain scalable data pipelines using Azure and Snowflake

  • Develop and optimize ETL / ELT processes for batch and micro-batch data workloads

  • Work with Azure Data Factory, Azure SQL, Azure Storage, and Azure Functions

  • Design and maintain data warehouse models (dimensions, facts, star/snowflake schemas)

  • Apply best practices in Kimball and Inmon data warehousing methodologies

  • Write, optimize, and maintain complex SQL queries supporting analytics and reporting

  • Ensure data quality, consistency, and reconciliation across multiple data sources

  • Collaborate with Business Intelligence teams to support dashboards and reporting tools

  • Participate in technical requirements gathering and solution design discussions

  • Contribute to data platform architecture design, including performance and infrastructure considerations

  • Troubleshoot issues and continuously improve system performance and reliability

Requirements

Do you have experience in Software development?, * 7+ years of experience in software development

  • 5+ years of experience working with data-intensive systems

  • At least 2 years of hands-on experience with cloud-based data platforms (Azure preferred)

  • Strong hands-on experience with the Azure Data Platform, including: Azure Data Factory, Azure SQL, Azure Storage, Azure Functions

  • Strong SQL expertise, including data modeling and complex ETL-based SQL development

  • Proven experience building periodic and micro-batch pipelines

  • Solid understanding of data warehouse architecture and data loading strategies

  • 1+ year of hands-on experience with Snowflake

  • Strong analytical and problem-solving skills with a focus on data quality

  • Experience working with large datasets in enterprise environments

  • Nice to have: Advanced experience with Snowflake (performance tuning, optimization, cost management)

  • Proficiency in Python and/or Databricks

  • Experience designing end-to-end data platform architectures

  • Previous experience supporting enterprise BI platforms

  • Exposure to CI/CD pipelines and infrastructure-as-code concepts

Apply for this position