Lead Fabric Data Engineer

Robert Walters
Kilsby, United Kingdom
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 137K

Job location

Remote
Kilsby, United Kingdom

Tech stack

Airflow
Amazon Web Services (AWS)
Python
Microsoft SQL Server
Kusto Query Language
Spark
Microsoft Fabric
PySpark
Legacy Systems

Job description

  • Optimise Fabric: Build, refine, and optimize Event Houses, Eventstreams, and Kusto environments.
  • Enhance Pipelines: Drive Spark notebooks and Lakehouse development for peak efficiency.
  • Support Migration: Resolve Real Time migration issues from Legacy systems to Fabric.
  • Bridge Ecosystems: Connect and align existing AWS and SQL Server infrastructure with Fabric.
  • Decommissioning of SQL Server

Requirements

  • Fabric Specialist expert in Microsoft Fabric - specifically Kusto (KQL) and Event Houses.
  • Brilliant Python/PySpark skills with a proven track record of pipeline optimization.
  • A strong background in SQL Server is essential here.
  • Desirable If you bring solid knowledge of AWS and Apache Airflow it's a big plus.

About the company

Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates

Apply for this position