Data Engineer

RedRock Resourcing
Birmingham, UK
14 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Microsoft Azure Data as a Services Data Governance Data Systems DevOps Azure Data Factory Apache Spark Pyspark Git Flow Terraform Data Pipelines Databricks

Job description

You’ll be responsible for designing, building, and maintaining end-to-end data pipelines, taking data from source systems through to curated datasets ready for reporting and analytics.

Working closely with architecture and delivery teams, you’ll help shape a high-quality, governed, and observable data platform.

What You’ll Be Doing

  • Build and maintain Azure & Databricks pipelines
  • Develop scalable ELT processes using PySpark
  • Implement data quality, lineage, and security controls
  • Own CI/CD pipelines and Infrastructure as Code (Terraform)
  • Ensure pipelines are testable, observable, and easy to troubleshoot
  • Optimise data services for performance and cost efficiency
  • Collaborate with stakeholders to translate requirements into data solutions
  • Contribute to Agile delivery with clear documentation and best practices

Requirements

  • Strong experience with Azure Data Platform & Databricks
  • Hands-on with PySpark / Spark-based processing
  • Experience with Terraform & CI/CD pipelines
  • Solid understanding of data governance, quality, and lineage
  • Familiarity with Git-based workflows and DevOps practices
  • Strong communication skills and ability to work with cross-functional teams
  • Work on a modern lakehouse architecture
  • Be part of a forward-thinking data team
  • Influence engineering standards and platform design
  • Deliver impactful data solutions at scale

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

5:02 min

Mapping Git flow branches to application tester segments

Majid Hajian · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

Videos

See all

Related articles

See all