Azure Data Engineer

Tenth Revolution Group
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 130K

Job location

Tech stack

Azure
Big Data
Continuous Integration
Data Governance
Data Infrastructure
ETL
Data Migration
Data Systems
Data Warehousing
Azure
Data Processing
Data Ingestion
Azure
Spark
Event Driven Architecture
Microsoft Fabric
PySpark
Data Management
Cloud Migration
Stream Processing
Azure
Data Pipelines
Databricks

Job description

We're partnering with an end-user organisation undertaking a major data migration and cloud modernisation programme and are looking for an experienced Azure Data Engineer to support the transition to a modern Azure-based data platform.

This role will play a key part in migrating Legacy data environments, building scalable cloud-native solutions, and enabling the business to maximise the value of its data assets. The Role

As an Azure Data Engineer, you will be responsible for designing, developing and optimising data pipelines and data platform capabilities within Azure. Working closely with architects, analysts and business stakeholders, you'll help deliver a modern, scalable and high-performing data ecosystem., * Design and develop scalable data pipelines within Azure

  • Support the migration of Legacy data platforms and workloads to the cloud
  • Build and optimise ETL/ELT processes for data ingestion and transformation
  • Develop and maintain Databricks notebooks and workflows
  • Integrate data from multiple systems and applications
  • Ensure data quality, governance and security standards are maintained
  • Optimise data processing performance and platform efficiency
  • Collaborate with business and technical stakeholders to deliver data solutions
  • Support the evolution of a modern cloud-based data platform

Requirements

The successful candidate will have strong Azure Data Engineering experience, with particular expertise in Databricks and large-scale data migration projects., * Proven experience as an Azure Data Engineer

  • Strong hands-on experience with Azure Databricks
  • Experience delivering data migration and cloud transformation projects
  • Strong SQL development skills
  • Experience with PySpark and/or Spark
  • Azure Data Factory
  • Azure Data Lake
  • ETL/ELT pipeline development
  • Data modelling and warehousing concepts
  • Experience working with large-scale datasets

Desirable Skills

  • Azure Synapse Analytics
  • Microsoft Fabric
  • CI/CD and Azure DevOps
  • Experience within enterprise-scale environments
  • Knowledge of data governance and security best practice
  • Real Time data processing and event-driven architectures

Apply for this position