Senior Data Engineer - West Yorkshire - £80k

17918
York, United Kingdom
4 days ago
Apply on www.apply4u.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£70,000 - £80,000
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Databases Continuous Integration Data Architecture Information Engineering Data Governance Data Infrastructure Data Integration Extract Transform Load (ETL) Data Systems DevOps
+13 more
Data Flow Control Apache Hive Python (Programming Language) Standard Sql SQL Databases Apache Spark Build Management Microsoft Fabric Data Lakes Deployment Automation Star Schema Stream Processing Data Pipelines

Job description

Senior Data Engineer Microsoft Fabric Location: West Yorkshire Working pattern: Hybrid, 2 days per week onsite Salary: £70-80k We are looking for a Senior Data Engineer with strong hands on Microsoft Fabric experience to help design and build a modern data platform supporting analytics, AI and operational use cases. Microsoft Fabric is a key requirement for this role, so we are looking for someone who has used the platform in a genuine delivery environment rather than someone with only limited exposure. Key responsibilities Design and build end to end ETL and ELT solutions using Microsoft Fabric Build scalable data pipelines using Dataflow Gen2 and Fabric Notebooks Develop and maintain Lakehouse solutions using Medallion architecture Work with SQL, Python, Spark SQL and Delta Lake Integrate data from APIs, databases, CRM, ERP and third party platforms Support both batch and real time data processing Develop semantic models and work with Star Schema and Kimball modelling Implement

Requirements

CI/CD and automated deployment of data solutions Build monitoring, data quality, lineage and observability into data pipelines Work closely with Data Architects, BI teams and wider business stakeholders Essential experience Strong commercial experience with Microsoft Fabric Hands on experience with Dataflow Gen2, Fabric Notebooks and Lakehouse architecture Strong SQL and Python skills Experience with Spark and Spark SQL Proven experience designing scalable ETL and ELT pipelines Data Lake and Delta Lake experience Experience integrating data from multiple structured and unstructured sources Good understanding of CI/CD, DevOps and modern data engineering practices Able to work onsite in West Yorkshire 2 days per week Experience with Semantic Models, DAX, Kimball modelling, Microsoft Fabric certifications such as DP 700, and data governance would also be beneficial. WKCL1_UKTJ

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.apply4u.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…