Data Engineer

Datatech Analytics
Greater London, UK
14 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Information Engineering Extract Transform Load (ETL) Data Systems Software Debugging Python (Programming Language) Standard Sql SQL Databases Apache Spark Pyspark AWS Data Analytics

Job description

The team uses Claude extensively to support development, debugging, testing and documentation. You’ll combine AI-assisted development with strong Python, SQL and Spark fundamentals to produce reliable, well-tested solutions.

What you’ll be doing

  • Designing, building and optimising scalable AWS data pipelines and ETL/ELT processes
  • Developing data solutions using Python, SQL and Spark
  • Processing large and complex behavioural datasets
  • Improving data quality, reliability, performance and monitoring
  • Using Claude and other AI-assisted development tools to support delivery
  • Collaborating with engineers, analysts and data scientists
  • Identifying opportunities to automate and improve data workflows
  • Contributing ideas as the platform and its data products continue to evolve

Requirements

  • Hands-on data engineering experience using Python and SQL
  • Practical Spark or PySpark experience
  • A good understanding of scalable ETL/ELT design and data quality
  • Experience using Claude or another AI-assisted development tool, with the ability to review and validate generated code
  • Strong communication skills and an interest in working within a small, collaborative team

This is an opportunity to work with cutting-edge data and AI technology, take ownership beyond one narrow area and help shape a platform as the business grows.

Applicants must already have the right to work in the UK, as sponsorship is not available for this position.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:37 min

Classifying and anonymizing data during system design

Reto Kaeser · LIVE

4:06 min

Using ClickHouse as a foundation for fast analytics

Hellmar Becker Hellmar Becker · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

1:59 min

Evolving roles in AI driven software teams

Ignacio Riesgo Ignacio Riesgo +1 · World Congress 2024

Videos

See all

Related articles

See all