Data Engineer (ADF, Databricks)
Role details
Job location
Tech stack
Job description
We're looking for a Data Engineer to support the development of our modern data platform and contribute to our transition toward metadata driven and configuration led engineering. This role is ideal for someone with strong fundamentals in data engineering who is ready to grow into more advanced automation focused work.
You will build and maintain data pipelines, contribute to reusable engineering patterns, and work alongside senior engineers to uplift automation, data quality, and delivery standards.
What will your day-to-day look like?
Engineering Delivery
- Build, maintain, and enhance data pipelines using Azure Data Factory, Databricks, Python and T SQL.
- Apply parameterisation, configuration, and reusable components in ADF and Databricks where appropriate.
- Support the creation of metadata driven patterns by implementing components and contributing to framework evolution.
- Assist in developing and refining data models and data warehouse layers.
- Ensure pipelines are performant, reliable, and aligned with engineering and governance standards.
Collaboration & Continuous Improvement
- Work closely with senior engineers, analysts, and architects to understand requirements and deliver robust, well designed solutions.
- Contribute to code reviews, documentation, and quality improvement initiatives.
- Participate in DevOps practices such as CI/CD, automated testing, and version control.
Operational Support
- Troubleshoot and resolve pipeline issues, ensuring stability and data accuracy.
- Monitor pipeline performance and help implement improvements.
- Support continuous optimisation and lifecycle management.
Requirements
- 3+ years T SQL including joins, transformations, stored procedures, and performance basics
- 3+ years Azure Data Factory, including pipeline development, parameter usage, and basic templates
- 3+ years Databricks experience (PySpark, Delta Lake, notebooks)
- 2+ years Python Experience
- Experience working with data warehouses and structured modelling concepts
- Strong understanding of ETL/ELT practices and data centric engineering
Desirable
- Exposure to metadata driven or config driven engineering practices
- Basic PySpark optimisation or Delta Lake performance tuning
- Experience using Azure DevOps (repos, pipelines)
- Understanding of data governance, data quality tooling, or lineage concepts
- Experience in regulated environments or financial services, * Do you have proficient experience in ADF, Databricks and Python?, * Data engineer: 3 years (required)
Benefits & conditions
- A first stage call with the internal recruitment team (15 minute call)
- On site technical test (up to 2 hours)
- A face-to face or-video call with the hiring manager (45 minutes)
What's In It For You
- £50,000 + up to 20% of your annual salary, paid as a bonus.
- This role can be based at either our Blackpool or Manchester office.
- 37.5 hours per week. We offer flexible working hours between our core hours of 8am- 6pm, Monday to Friday.
- The opportunity to complete formal qualifications and learn on the job in a successful, growing organisation.
- And many more benefits to support your wellbeing and professional development., Job Types: Full-time, Permanent
Pay: £50,000.00 per year
Benefits:
- Casual dress
- Company events
- Company pension
- Cycle to work scheme
- Discounted or free food
- Free parking
- Health & wellbeing programme
- On-site parking
- Sick pay