Data Engineer
Role details
Job location
Tech stack
Job description
Ever wanted more say in the architecture, the tools, the direction and not just the tickets in the sprint?
This might be your kind of role.
We're right at the start of our data journey. Not maintaining something someone else built five years ago, but designing and building a modern Databricks Lakehouse on Azure from the ground up and we need a Data Engineer who's as curious about why we're doing it as how we're doing it.
The role
Because we're at the beginning, you'll help shape the architecture, influence standards and frameworks, work across a broad range of data challenges and see your work directly impact executive and operational decision-making across the business, both in the UK and internationally.
You'll:
- Design and build scalable data pipelines (ETL/ELT) pulling from core platforms, cloud storage, databases and APIs
- Turn raw, messy, disparate data into curated, analysis-ready datasets
- Work with Python, Spark and SQL every day
- Develop models and schemas using a medallion architecture approach
- Help shape our data architecture with the Data Architect
- Implement governance, quality checks and access controls (Unity Catalogue)
- Optimise for performance, reliability and scalability in Azure
- Contribute to CI/CD and DevOps practices in Azure DevOps
But here's the bit that makes this different:
You won't just be "building pipelines", you'll be building understanding.
You'll care about what the data is telling the business and be curious about what decisions it informs. You'll ask, "Is this the best way to do it?", and then you'll make it better.
What you'll be doing
Anyone can move data from A to B, but really good looks like this:
- Pipelines that are elegant, scalable and observable
- Clean, well-documented models analysts actually enjoy working with
- Thoughtful performance tuning
- Governance built in, not bolted on
- Constant refinement and efficiency improvements
We're working with a wide and interesting range of data sources from financial, operational, external and structured (and maybe not-so-structured).
There's plenty of variety and plenty of opportunity to improve things.
If you get a quiet satisfaction from shaving minutes off a job runtime, refactoring something clunky into something beautiful, or discovering a better tool to solve a problem you'll fit right in.
Requirements
Do you have experience in Unity?, * Hands-on expertise with Databricks
- Confidence in Python, Spark and SQL
- Experience building pipelines in Azure
- A solid understanding of data modelling and scalable architectures
But just as important:
You're inclusive and curious and care about doing things properly and enjoy solving problems others can't. You like working in a small team where your voice matters.
This isn't a "sit quietly and code what you're told" environment.
You'll have a genuine say in how we do things, how we design things, and where we're heading next.
Benefits & conditions
- The Tech you'll Get to Play With: Databricks, Azure (cloud-native data services), Python, Spark & SQL
- This is your chance to work with modern, "shiny" tools and influence what we adopt next.
- Use workflow tools such as ADF / Airflow and big data technologies (Spark, Hadoop, Kafka)
- Private healthcare for you and your family
- Company pension scheme
- Flexible benefits (gym membership, tech, health assessments and more)
- Access to an online wellbeing centre
- Discounts with a wide range of retailers
- 25 days' holiday plus bank holidays, increasing with service, with buy/sell options
- Electric Vehicle / Plug-in Hybrid Vehicle scheme
About Bibby Financial Services
We're a global organisation operating in nine countries, supporting over 9,000 SMEs worldwide. Following the completion of a £1bn securitisation deal, we're increasing our lending to UK businesses at a time when support really matters and this role plays a vital part in making that happen.
If You're Thinking…
"I want to build something properly."
"I want to understand the business impact of what I'm building."
"I want to work with modern tools and have a real say."
Then let's talk.