WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Senior Data Engineer

Morgan McKinley
London, UK
22 days ago
Apply on www.reed.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£85,000.0
Working hours
Regular working hours
Job source
www.reed.co.uk

Tech stack

Artificial Intelligence Amazon Web Services Information Engineering Apache Hive Python (Programming Language) Enterprise Data Management Sql Optimization Data Lakes Pyspark Data Pipelines Databricks

Job description

I’m currently looking for a Senior Data Engineer to come on board for a growing client who is going on a transformation journey. You will play a key role in designing, building, and scaling the enterprise data platform that underpins analytics, reporting, automation, and AI initiatives across the business.

This role will be remote - once a month travel into the office.

Requirements

Strong data engineering background

Strong hands-on experience with Databricks, including PySpark, Spark SQL, Delta Lake

Worked with Finance Data Advanced SQL and Python development skills. Proven experience building and optimising enterprise-scale data pipelines Experience working with AWS Cloud platform

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.reed.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

5:14 min

Executing Databricks jobs with built-in Airflow operators

Alan Mazankiewicz · LIVE

2:38 min

Overview of Databricks and interactive data processing

Alan Mazankiewicz · LIVE

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

Videos

See all
Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Fully Orchestrating Databricks from Airflow thumbnail
39:14
LIVE • almost 5 years ago

Fully Orchestrating Databricks from Airflow

Alan Mazankiewicz

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Alibaba Big Data and Machine Learning Technology thumbnail
43:57
LIVE • almost 6 years ago

Alibaba Big Data and Machine Learning Technology

Qiyang Duan

The Data Mesh as the end of the Datalake as we know it thumbnail
37:21
LIVE • over 5 years ago

The Data Mesh as the end of the Datalake as we know it

Mario Meir-Huber

Related articles

See all