Data Engineer

TXP
Brierley Hill, United Kingdom
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 135K

Job location

Brierley Hill, United Kingdom

Tech stack

Information Engineering
ETL
Data Warehousing
Python
SQL Databases
Data Processing
Jupyter
Microsoft Fabric
Data Lake
PySpark
Data Management
Azure
Databricks

Job description

We are currently recruiting for a Data Engineer to be part of a team on a Business Data Service Project, which is a Data Warehouse Replacement & Report simplification project. You will be responsible for ensuring all data products and solutions created in the business insights ecosystem are fit for purpose, resilient, robust and reliable.

You will play a pivotal role that builds, tests and deploys Data Warehouse solutions. This will cover the life cycle for the planning, ingestion, transformation, consolidation and aggregation of data from source to target in the Data Warehouse environment.

Requirements

  • Strong experience developing ETL/ELT pipelines using PySpark and Python
  • Hands-on experience with Microsoft Fabric lakehouse or similar cloud data platforms (Azure Synapse Analytics, Databricks)
  • Proficiency in working with Jupyter/Fabric Notebooks for data engineering workflows
  • Solid understanding of data lakehouse architecture patterns and medallion architecture
  • Experience working with Delta Lake or similar lakehouse storage formats
  • Strong SQL skills for data manipulation, transformation, and quality validation

Apply for this position