Senior Data Engineer

Talent Smart
Sheffield, United Kingdom
2 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Sheffield, United Kingdom

Tech stack

Automation of Tests
Big Data
Continuous Integration
Data Systems
Delivery Pipeline
Data Lake
PySpark
Data Pipelines
Databricks

Job description

About the Role

We are looking for a highly capable Data Engineer to take ownership of delivering data solutions in a fast-paced, enterprise environment. This is a hands-on role suited to someone who thrives with autonomy, takes initiative, and can engage directly with stakeholders without heavy oversight.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines on a modern data lake platform
  • Work extensively with Databricks and PySpark to process and transform large datasets
  • Support and enhance existing data pipelines while contributing to new platform capabilities
  • Collaborate directly with internal customers to understand requirements and deliver solutions
  • Drive improvements in testing practices, including transitioning toward test automation
  • Contribute to deployment pipelines and CI/CD best practices
  • Operate independently with minimal supervision while maintaining high delivery standards
  • Support both operational stability and ongoing transformation initiatives

Key Skills & Experience

  • Strong hands-on experience with:
  • Databricks
  • PySpark
  • Data lake architectures
  • Proven experience building and maintaining data pipelines in production environments
  • Exposure to automation in testing and improving engineering practices
  • Experience with deployment pipelines/CI-CD (preferred)
  • Ability to work independently and take ownership of deliverables
  • Strong stakeholder management and communication skills
  • Comfortable interacting directly with internal customers and translating business needs into technical solutions

Requirements

  • Strong hands-on experience with:
  • Databricks
  • PySpark
  • Data lake architectures
  • Proven experience building and maintaining data pipelines in production environments
  • Exposure to automation in testing and improving engineering practices
  • Experience with deployment pipelines/CI-CD (preferred)
  • Ability to work independently and take ownership of deliverables
  • Strong stakeholder management and communication skills
  • Comfortable interacting directly with internal customers and translating business needs into technical solutions

Apply for this position