WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Lead Data Engineer (Contract) - ADF, Databricks & SparkSQL

Response Informatics
Salford, UK
7 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
www.collegerecruiter.com

Tech stack

Information Technology Consulting Continuous Integration Python (Programming Language) Azure Data Factory Apache Spark Pandas Data Pipelines Databricks

Requirements

A leading IT consulting firm in Salford is seeking a Data Engineer to design and develop metadata-driven data pipelines using Azure Data Factory and Databricks. The ideal candidate will have expertise in optimizing data workflows with SparkSQL and Pandas, and experience with CI/CD for deployments. This role involves collaborating with cross-functional teams and ensuring data quality and governance. The position is contract-based and requires proficiency in Python or Scala. #J-18808-Ljbffr

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

5:19 min

Executing queries and scheduling pipeline jobs within DataWorks

Qiyang Duan · LIVE

3:33 min

Refactoring data science workflows using Rapids QDF and Pandas

Paul Graham Paul Graham · LIVE

2:04 min

Comparing offline data analytics with online stream processing

Artem Volk Artem Volk +1 · World Congress 2024

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15
World Congress 2026 Europe • about 2 months ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source thumbnail
29:50
World Congress 2026 Europe • about 2 months ago

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source

Viktoria Semaan

Advanced Typing in TypeScript thumbnail
28:44
World Congress 2022 • about 4 years ago

Advanced Typing in TypeScript

Lars Hupel

Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

Implementing continuous delivery in a data processing pipeline thumbnail
34:00
LIVE • almost 6 years ago

Implementing continuous delivery in a data processing pipeline

Álvaro Martín Lozano

Related articles

See all