Lead Fabric Data Engineer
Robert Walters
Kilsby, United Kingdom
2 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 137KJob location
Remote
Kilsby, United Kingdom
Tech stack
Airflow
Amazon Web Services (AWS)
Python
Microsoft SQL Server
Kusto Query Language
Spark
Microsoft Fabric
PySpark
Legacy Systems
Job description
- Optimise Fabric: Build, refine, and optimize Event Houses, Eventstreams, and Kusto environments.
- Enhance Pipelines: Drive Spark notebooks and Lakehouse development for peak efficiency.
- Support Migration: Resolve Real Time migration issues from Legacy systems to Fabric.
- Bridge Ecosystems: Connect and align existing AWS and SQL Server infrastructure with Fabric.
- Decommissioning of SQL Server
Requirements
- Fabric Specialist expert in Microsoft Fabric - specifically Kusto (KQL) and Event Houses.
- Brilliant Python/PySpark skills with a proven track record of pipeline optimization.
- A strong background in SQL Server is essential here.
- Desirable If you bring solid knowledge of AWS and Apache Airflow it's a big plus.
About the company
Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates