Data Engineer

Databricks, Inc.
Manchester, UK
1 day ago
Apply on www.careerjet.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Systems Engineering Automation of Tests Microsoft Azure Databases Continuous Integration Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Retrieval
+22 more
Data Warehousing DevOps File Transfer Protocol (FTP) SSL Extension Python (Programming Language) Windows PowerShell Scala (Programming Language) Selenium SQL Databases YAML File Transfer Protocol (FTP) Data Ingestion System Availability Large Language Models Apache Spark Deep Learning Kubernetes Playwright Bicep Terraform Data Pipelines Docker Databricks

Job description

We’re working with a truly disruptive FinTech that is continuing to invest heavily in its data and technology capability. With a growing Data Science function and around 3-5TB of new data being processed each week, they’re looking for a Senior Data Engineer to help build and evolve the platform behind it. This isn’t necessarily a traditional Data Engineering profile. They’re open to people from Data Engineering, Platform, DevOps or Systems Engineering backgrounds, but strong data foundations and hands-on Databricks experience are key. The role You’ll work within a cross-functional team, helping continue the move towards a Databricks-native environment and building reliable, scalable data and platform capabilities. You’ll be working across:

  • Databricks, Python, SQL and Spark
  • High-volume data ingestion and transformation
  • Production ETL/ELT pipelines
  • APIs, SFTP/FTPS and automated data retrieval
  • CI/CD, automated testing and deployment
  • Platform reliability, monitoring and troubleshooting
  • Azure infrastructure, security and governance
  • Data Science, ML and increasingly agentic workflows

The focus is production engineering rather than building AI models, creating the foundations that allow Data Science and automated workflows to operate effectively.

Requirements

Databricks is the big one. Alongside that, we’re looking for strong Python, SQL/Spark and ETL/ELT experience, good knowledge of databases and data warehousing, including dimensional/Kimball principles, plus an understanding of platform, DevOps and systems engineering. They also value genuine technical curiosity. If you keep up with new technology, experiment with AI/deep learning or have side projects outside your day job, they’ll want to hear about them. A STEM background is beneficial, but not essential. Nice to have

  • Databricks Asset Bundles, Lakeflow Jobs/Pipelines, Unity Catalog, Volumes and/or Lakebase
  • Agentic or AI-enabled engineering workflows, LLM integrations or AI coding tools
  • Playwright/Selenium
  • Docker/Kubernetes
  • Terraform/Bicep
  • Agile development environments
  • Scala, PowerShell and YAML

About the company

The team You’ll join a highly technical, collaborative team working closely with a growing Data Science function. Ideally you’ll spend around two days per week in the Manchester office, but it’s an output-driven environment with plenty of autonomy. Diversity & Inclusion We welcome applications from people of all backgrounds and experiences. If the role interests you but you don’t tick every box, we’d still encourage you to apply. Different experiences, perspectives and routes into technology are valued.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

2:56 min

Provisioning a secure container infrastructure with Bicep

Matthias Falkenberg +1 · World Congress 2022

1:35 min

Centralizing configuration logic with native YAML block references

Matthieu Vincent Matthieu Vincent · Europe 2026 Virtual

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

4:09 min

Selecting infrastructure tools and determining proper abstraction layers

Alayshia Knighten Alayshia Knighten · World Congress 2024

Videos

See all

Related articles

See all