Data Engineer
RedRock Resourcing
Birmingham, UK
14 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.collegerecruiter.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Data as a Services
Data Governance
Data Systems
DevOps
Azure Data Factory
Apache Spark
Pyspark
Git Flow
Terraform
Data Pipelines
Databricks
Job description
You’ll be responsible for designing, building, and maintaining end-to-end data pipelines, taking data from source systems through to curated datasets ready for reporting and analytics.
Working closely with architecture and delivery teams, you’ll help shape a high-quality, governed, and observable data platform.
What You’ll Be Doing
- Build and maintain Azure & Databricks pipelines
- Develop scalable ELT processes using PySpark
- Implement data quality, lineage, and security controls
- Own CI/CD pipelines and Infrastructure as Code (Terraform)
- Ensure pipelines are testable, observable, and easy to troubleshoot
- Optimise data services for performance and cost efficiency
- Collaborate with stakeholders to translate requirements into data solutions
- Contribute to Agile delivery with clear documentation and best practices
Requirements
- Strong experience with Azure Data Platform & Databricks
- Hands-on with PySpark / Spark-based processing
- Experience with Terraform & CI/CD pipelines
- Solid understanding of data governance, quality, and lineage
- Familiarity with Git-based workflows and DevOps practices
- Strong communication skills and ability to work with cross-functional teams
- Work on a modern lakehouse architecture
- Be part of a forward-thinking data team
- Influence engineering standards and platform design
- Deliver impactful data solutions at scale
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.collegerecruiter.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
over 3 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
almost 2 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
CH
Chris Heilmann
Dev Digest 120 - Apple and peers
about 2 years ago