Data Platform Lead

Sf Technology
Warrington, UK
6 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Artificial Intelligence Data Analysis Computing Platforms Microsoft Azure Continuous Integration Information Engineering Data Governance Data Infrastructure Dataspaces DevOps High-Level Architecture Python (Programming Language)
+9 more
SQL Databases Enterprise Data Management Technical Debt Microsoft Fabric Pyspark Data Management Software Coding Data Pipelines Databricks

Job description

Reporting directly to the Head of Data, you’ll become the technical authority for the data platform, owning its architecture and technical direction while leading a small Data Engineering team.

This isn’t a role centred around writing code all day. Equally, it isn’t a high-level architecture position that is disconnected from engineering.

You need to understand modern Data Engineering properly, be able to challenge technical decisions and guide experienced engineers, but your real value will come from architecture, recommendations, technical leadership and your ability to determine how the platform should evolve.

You’ll be responsible for:

  • Owning the architecture and technical roadmap for the enterprise data platform.
  • Taking technical ownership of an established Microsoft Fabric estate and shaping its continued evolution.
  • Making architectural decisions across Lakehouse, ingestion, transformation, modelling, integration, security and platform design.
  • Ensuring the platform is scalable, resilient, secure and maintainable as adoption grows.
  • Establishing strong engineering standards across CI/CD, testing, deployment, monitoring, observability and data quality.
  • Developing reusable engineering patterns and avoiding solutions that create unnecessary technical debt.
  • Leading and developing a small Data Engineering team, providing technical direction and challenging designs where required.
  • Working closely with Data Management and Governance colleagues around lineage, quality, ownership and controls.
  • Working directly with senior business and technology stakeholders, explaining complex technical decisions and making clear recommendations.
  • Ensuring the platform provides the foundations for the organisation’s wider Analytics, AI and automation strategy.

Requirements

We’re not interested in somebody simply matching a long list of technologies.

We want someone who has already taken meaningful ownership of a modern data platform and can demonstrate the decisions and recommendations they’ve made along the way., * Significant experience across Data Platform Architecture and/or Data Engineering leadership.

  • Experience owning or significantly influencing the architecture and technical direction of an enterprise data platform.
  • Strong knowledge of the Microsoft Azure data ecosystem.
  • Experience with Microsoft Fabric and an understanding of how its wider capabilities fit together.
  • Strong understanding of modern Lakehouse / Medallion architecture and Data Engineering principles.
  • Experience establishing engineering standards across CI/CD, DevOps, testing, data quality and monitoring.
  • Enough technical depth across areas such as SQL, Python/PySpark and data pipelines to challenge and guide experienced engineers.
  • Experience leading, mentoring or developing Data Engineering teams.
  • Good understanding of data governance, security and lineage.
  • The confidence to hold your own with senior stakeholders, challenge thinking and explain why architectural decisions matter to the wider business.

We’re also open to senior Data Platform leaders coming from broader Azure / Databricks

environments where the architecture, engineering leadership and platform ownership experience is strong.

About the company

We’re supporting a large, established UK organisation that has made significant investment into modernising its Data & Analytics capability.

Over the last 12 months, the business has migrated its legacy data estate onto a modern Microsoft Fabric platform. The foundations are now in place.

The next challenge is turning that foundation into a scalable enterprise data platform that accelerates Analytics, enables AI and supports the development of high-value data products across the organisation., The interesting part of this role is where the organisation is in its journey.

You’re not inheriting a failing legacy environment and spending the next two years firefighting. Significant work has already gone into creating the modern data foundation.

The opportunity now is to decide what comes next.

You’ll have genuine ownership of the platform’s technical direction, direct access to the Head of Data and significant influence over how Data Engineering develops across the organisation.

For someone who enjoys being senior enough to shape the architecture, technical enough to challenge it and commercially minded enough to explain why it matters, it’s a genuinely influential opportunity. #J-18808-Ljbffr

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all