Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+22 more
Job description
We’re working with a truly disruptive FinTech that is continuing to invest heavily in its data and technology capability. With a growing Data Science function and around 3-5TB of new data being processed each week, they’re looking for a Senior Data Engineer to help build and evolve the platform behind it. This isn’t necessarily a traditional Data Engineering profile. They’re open to people from Data Engineering, Platform, DevOps or Systems Engineering backgrounds, but strong data foundations and hands-on Databricks experience are key. The role You’ll work within a cross-functional team, helping continue the move towards a Databricks-native environment and building reliable, scalable data and platform capabilities. You’ll be working across:
- Databricks, Python, SQL and Spark
- High-volume data ingestion and transformation
- Production ETL/ELT pipelines
- APIs, SFTP/FTPS and automated data retrieval
- CI/CD, automated testing and deployment
- Platform reliability, monitoring and troubleshooting
- Azure infrastructure, security and governance
- Data Science, ML and increasingly agentic workflows
The focus is production engineering rather than building AI models, creating the foundations that allow Data Science and automated workflows to operate effectively.
Requirements
Databricks is the big one. Alongside that, we’re looking for strong Python, SQL/Spark and ETL/ELT experience, good knowledge of databases and data warehousing, including dimensional/Kimball principles, plus an understanding of platform, DevOps and systems engineering. They also value genuine technical curiosity. If you keep up with new technology, experiment with AI/deep learning or have side projects outside your day job, they’ll want to hear about them. A STEM background is beneficial, but not essential. Nice to have
- Databricks Asset Bundles, Lakeflow Jobs/Pipelines, Unity Catalog, Volumes and/or Lakebase
- Agentic or AI-enabled engineering workflows, LLM integrations or AI coding tools
- Playwright/Selenium
- Docker/Kubernetes
- Terraform/Bicep
- Agile development environments
- Scala, PowerShell and YAML
About the company
The team You’ll join a highly technical, collaborative team working closely with a growing Data Science function. Ideally you’ll spend around two days per week in the Manchester office, but it’s an output-driven environment with plenty of autonomy. Diversity & Inclusion We welcome applications from people of all backgrounds and experiences. If the role interests you but you don’t tick every box, we’d still encourage you to apply. Different experiences, perspectives and routes into technology are valued.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Top Big Data Technologies That You Need to Know
Dev Digest 132 - Binging WADFlix?
Dev Digest 120 - Apple and peers