Senior Data Engineer (Databricks)

iO Associates
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 60K

Job location

Tech stack

Azure
Cloud Storage
Continuous Integration
Information Engineering
ETL
Data Security
Data Systems
Data Visualization
Python
Microsoft SQL Server
Systems Integration
Data Processing
Azure
Backend
PySpark
Stream Processing
Data Pipelines
Databricks

Job description

  • Building and maintaining a unified data platform for global data processing.
  • Developing reusable and scalable data solutions using Databricks, Python/PySpark, and Azure.
  • Working closely with the data visualisation team to align back-end and front-end needs.
  • Designing secure data access models and integrating external data sources via Azure Data Factory.
  • Supporting CI/CD processes, implementing testing practices, and optimising performance.
  • Troubleshooting and resolving data-related issues to keep things running smoothly.

Requirements

  • Strong understanding of data engineering principles, Lakehouse architecture, ETL/ELT, warehousing, and stream processing.
  • Hands-on experience with Azure Databricks, Python/PySpark, SQL Server, and Azure Blob Storage.
  • A track record of building secure, scalable data pipelines and solving complex problems.
  • Great communication and documentation skills with a proactive, improvement-focused mindset.

Benefits & conditions

  • Up to £60,000 salary depending on experience
  • Hybrid working model (Birmingham HQ)
  • 25 days holiday + bank holidays
  • Life assurance, free onsite gym, and regular social events
  • Ongoing training and professional development opportunities

About the company

Are you a Data Engineer looking to work on large-scale, global data solutions that actually make an impact? This is a fantastic opportunity to join a market-leading automotive technology company that's shaping the future of connected data and intelligent platforms worldwide. You'll be joining a collaborative, forward-thinking data team focused on building a modern, scalable data infrastructure that powers insights for thousands of dealerships across the globe.

Apply for this position