Data Engineer

i Jobs
Gloucester, United Kingdom
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 52K

Job location

Gloucester, United Kingdom

Tech stack

ETL
Software Debugging
Python
SQL Databases
Data Lake
Data Pipelines
Databricks

Job description

  • Analyze and document existing data pipelines, including diagrams and data-flow mapping.
  • Develop and automate ETL pipelines using Python.
  • Work with Databricks notebooks, Delta Lake, and Databricks Genie bots.
  • Design, optimize, and debug ETL pipelines.
  • Use SQL for querying, validation, and optimization in the Lakehouse environment.

Requirements

  • Advanced skills in Python for ETL pipeline development.
  • Strong experience with Databricks and related tools.
  • Proven ability to design and optimize ETL pipelines.
  • Strong SQL skills.

Nice to Have

  • Experience with the West of England Combined Authority (WECA).

Apply for this position