Senior Data Engineer

Yolk Recruitment Ltd
Mountain Ash, UK
10 days ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£63,500.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Business Analytics Applications Automation of Tests Continuous Delivery Continuous Integration Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Security Data Systems Python (Programming Language)
+11 more
DataOps SQL Databases Cloud Platform System Apache Spark Data Lakes Pyspark Git Flow Data Analytics Data Management Software Version Control Databricks

Job description

We are seeking an experienced Senior Data Engineer to lead the development of a modern, secure, cloud-based data platform. This role will be instrumental in shaping the organisation’s data capabilities, delivering trusted analytics and reporting solutions, and establishing the foundations for future AI and advanced data initiatives.

This is a hands-on position requiring a blend of architecture, engineering expertise, governance, and stakeholder engagement., * Design, build, and evolve a scalable cloud data platform and supporting architecture.

  • Develop and maintain robust ELT/ETL pipelines, ensuring high standards of reliability, performance, and security.
  • Establish and embed DataOps and DataSecOps practices, including CI/CD, testing, version control, and automated quality controls.
  • Deliver governed data models and reporting structures that enable trusted, self-service analytics.
  • Implement data governance, security, privacy, and access control frameworks.
  • Monitor and improve data quality, integrity, and consistency across multiple systems.
  • Provide technical leadership, mentoring, and best-practice guidance to colleagues.
  • Partner with business stakeholders to understand requirements and deliver practical, value-driven data solutions.
  • Drive continuous improvement across data engineering, reporting, and analytics capabilities.

Requirements

  • Strong expertise in SQL and Python (PySpark desirable).
  • Proven experience designing and building cloud-based data platforms from inception.
  • Hands-on experience with Databricks, Spark, modern data lake/lakehouse architectures, and data integration pipelines.
  • Strong understanding of data security, governance, access controls, and handling sensitive data.
  • Experience implementing CI/CD, Git-based workflows, automated testing, and deployment practices.
  • Solid data modelling experience for analytics and business intelligence.
  • Track record of delivering scalable reporting and self-service analytics environments.
  • Experience mentoring team members and promoting engineering best practices.
  • Excellent problem-solving, communication, and stakeholder management skills.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.reed.co.uk

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

5:02 min

Mapping Git flow branches to application tester segments

Majid Hajian · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all