WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer - TWE46529

twentyAI Ltd
London, UK
14 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
£130,000.0
Working hours
Regular working hours
Job source
www.collegerecruiter.com

Tech stack

Artificial Intelligence Data Architecture Data Infrastructure Extract Transform Load (ETL) Python (Programming Language) Open Source Technology Software Tools Standard Sql Data Ingestion Large Language Models Apache Spark Data Pipelines
+1 more
Databricks

Job description

  • Designing, building and maintaining data ingestion pipelines and ETL/ELT workflows
  • Developing robust data engineering solutions using Python and SQL
  • Building scalable data pipelines that support multiple business functions
  • Working closely with technical and business stakeholders to deliver strategic solutions
  • Solving complex engineering challenges and taking ownership from design through to delivery
  • Contributing to the evolution of a modern on-premise data platform

Requirements

  • Excellent Python and SQL skills
  • Experience building ETL/ELT pipelines and data ingestion frameworks
  • Strong understanding of data architecture and data movement between systems
  • Experience with modern data engineering tools and frameworks
  • Extensive experience working closely with business stakeholders
  • Experience with Apache Spark and Databricks is desirable
  • Experience in Financial services, commodities or another fast-paced commercial environment is highly advantageous
  • Exposure to AI technologies such as LangChain, agentic AI or open-source LLMs is beneficial

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

4:06 min

Using ClickHouse as a foundation for fast analytics

Hellmar Becker Hellmar Becker · World Congress 2026 Europe

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

1:59 min

Evolving roles in AI driven software teams

Ignacio Riesgo Ignacio Riesgo +1 · World Congress 2024

2:04 min

Comparing offline data analytics with online stream processing

Artem Volk Artem Volk +1 · World Congress 2024

Videos

See all
Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source thumbnail
29:50
World Congress 2026 Europe • 3 months ago

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source

Viktoria Semaan

How building an industry DBMS differs from building a research one thumbnail
30:34
World Congress 2023 • almost 3 years ago

How building an industry DBMS differs from building a research one

Markus Dreseler

OLTP in the Lakehouse: Redefining Data for AI Workloads thumbnail
24:36
Europe 2026 Virtual • 3 months ago

OLTP in the Lakehouse: Redefining Data for AI Workloads

Oleksandra Bovkun

Let's Get Aggregated: Custom UDAFs in Spark thumbnail
19:58
World Congress 2025 • about 1 year ago

Let's Get Aggregated: Custom UDAFs in Spark

Nikolai Nikolaev

Related articles

See all