Lead Data Engineer

Sphere Digital Recruitment

Greater London, UK

2 days ago

Apply on www.collegerecruiter.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

£75,000.0

Working hours

Regular working hours

Job source

www.collegerecruiter.com

Tech stack

Artificial Intelligence Data Analysis Code Review Continuous Integration Information Engineering Data Governance Data Infrastructure Data Security Distributed Computing Environment Python (Programming Language) Power BI SQL Databases

+4 more

Snowflake Data Management Data Pipelines Databricks

Job description

Leading the design and delivery of a modern cloud data platform supporting analytics, AI and client-facing data products
Owning data pipeline architecture across ingestion, transformation and data product layers
Setting and maintaining data engineering standards, patterns and best practices across squads
Mentoring and leading a small team of Data Engineers and working closely with Analytics Engineers and Data Scientists
Remaining hands-on with complex technical delivery, architecture decisions and code reviews
Defining CI/CD, testing, observability and infrastructure-as-code standards for data pipelines
Ensuring strong data governance, security controls and compliance across all datasets
Partnering with Product and commercial teams on data initiatives and client data onboarding
Supporting analytics, BI and AI/ML use cases with well-structured, documented and reliable data models

Requirements

5+ years’ experience in data engineering or data platform roles
Strong hands-on experience with SQL, Python and distributed data processing
Proven experience building and operating modern cloud data platforms
Experience with technologies such as Snowflake, Databricks and Power BI
Strong understanding of CI/CD, infrastructure-as-code and data quality practices
Solid knowledge of data security, access controls and governance
Comfortable operating as a hands-on technical leader, mentoring others and influencing standards
Strong stakeholder communication skills