Data Engineer - AWS, Spark & AI

Datatech Analytics
London, UK
5 days ago
Apply on datatech.org.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£60,000.0 - £75,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Big Data Information Engineering Extract Transform Load (ETL) Data Systems Data Visualization Python (Programming Language) SQL Databases Apache Spark AWS Data Analytics Data Pipelines

Job description

·Design, build and optimise scalable data pipelines and ETL/ELT processes. ·Develop and maintain data engineering solutions using Python, SQL and Spark. ·Work with large and complex datasets, ensuring data quality, reliability and performance. ·Use AI-assisted development tools to support coding, problem solving and delivery. ·Collaborate with engineering, analytics and data science teams to develop effective data solutions. ·Identify opportunities to automate processes and improve the scalability and efficiency of data workflows.

Requirements

·Strong hands-on data engineering experience. ·Strong coding fundamentals across Python and SQL. ·Hands-on experience working with Spark for large-scale data processing. ·Hands-on experience working with AWS data services. ·Experience designing and developing scalable data pipelines and ETL/ELT processes. ·Practical experience using AI-assisted development tools such as Claude within your day-to-day work. ·Strong communication skills and the ability to work effectively within a fast-moving, collaborative environment.

If you’re a Data Engineer with strong technical fundamentals who wants the freedom to innovate, explore how AI is changing engineering and help shape a data platform as the business scales, we want to hear from you. Apply today!

Benefits & conditions

Salary: £60,000-£75,000 Dependent on Experience London: Hybrid working - 3 days per week in the office, 2 days home-based Job Ref: J13171

Join a fast-growing technology start-up where you’ll have the freedom to experiment with cutting-edge data and AI technologies, solve interesting problems and make a visible impact from day one.

Working alongside a talented team of engineers, analysts and data scientists, you won’t be confined to one small part of the platform. You’ll build scalable pipelines, work with large volumes of consumer data and explore new ideas at a pace that is often difficult to achieve within a larger organisation.

You’ll bring strong Python, SQL and Spark fundamentals, along with genuine enthusiasm for how AI is transforming data engineering. You’ll already be using AI-assisted development tools such as Claude, while having the technical ability to understand, review and challenge the code they produce.

About the company

Datatech is one of the UK’s leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: www.datatech.org.uk

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on datatech.org.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:37 min

Classifying and anonymizing data during system design

Reto Kaeser · LIVE

1:59 min

Evolving roles in AI driven software teams

Ignacio Riesgo Ignacio Riesgo +1 · World Congress 2024

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all