Lead Data Engineer

Sanderson Recruitment Plc
Normanton, United Kingdom
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 88K

Job location

Normanton, United Kingdom

Tech stack

Microsoft Windows
Agile Methodologies
Cloud Computing
Computer Programming
System Configuration
Continuous Integration
Data Infrastructure
Data Structures
Linux
Document-Oriented Databases
Python
NoSQL
Performance Tuning
Query Optimization
Rapid Application Development
Ansible
Data Processing
Scripting (Bash/Python/Go/Ruby)
Test Driven Development
Infrastructure Automation Frameworks
Integration Frameworks
Real Time Data
Terraform
Data Pipelines
Serverless Computing
Jenkins

Job description

  • Design, develop, test and document data pipelines aligned to business requirements
  • Perform logical and physical database design
  • Enhance data platform capabilities to address evolving data and analytics challenges
  • Analyse data workflows and identify opportunities for optimisation and improvement
  • Ensure consistency between data models and overall architecture, including entity definitions and relationships
  • Conduct root cause analysis on data issues to support business decision-making and continuous improvement

Technologies:

  • Ansible
  • Cloud
  • Support
  • Jenkins
  • Linux
  • NoSQL
  • Python
  • Serverless
  • Terraform
  • Windows
  • TDD

More:

We are building and enhancing a secure, scalable data platform for a high-profile government programme. Our team works with both batch and real-time data using modern cloud technologies and frameworks to ingest data from multiple sources, transform it into the correct formats, and enable reliable access for downstream users. We promote a collaborative, delivery-focused culture where our people are encouraged to take ownership, experiment, solve complex problems, and support each other in achieving shared goals. Open, timely communication and accountability are central to how we work, and we are committed to respect, equality, diversity, and inclusion. We also support reasonable adjustments during the recruitment process for anyone who needs them.

Requirements

  • Experience building data pipelines using modern data processing frameworks
  • Familiarity with Agile or rapid application development methodologies
  • Strong understanding of data modelling and different data structures, including when to apply them
  • Hands-on experience with public cloud platforms, ideally including services such as compute, storage, serverless and data processing tools
  • Experience configuring and tuning relational and NoSQL databases, including query optimisation
  • Proficiency in programming or scripting languages such as Python
  • Experience working with Test Driven Development practices and supporting tools
  • Familiarity with CI tools such as Jenkins or Drone
  • Knowledge of configuration management tools such as Ansible or Packer
  • Experience using Infrastructure as Code tools, for example Terraform
  • Working knowledge of Linux and Windows environments

Apply for this position