Data Engineer
Anson McCade
London, UK
6 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Starter
Working hours
Regular working hours
Job source
Tech stack
Clean Code Principles
Artificial Intelligence
Amazon Web Services
Automation of Tests
Microsoft Azure
Big Data
Continuous Integration
Extract Transform Load (ETL)
Data Transformation
Data Warehousing
Python (Programming Language)
Machine Learning
+18 more
NoSQL
Scrum Methodology
SQL Databases
Systems Architecture
Test-Driven Development (TDD)
Apache Spark
Generative AI
Build Management
Data Lakes
Kubernetes
Infrastructure Automation Frameworks
Performance Monitor
Operational Systems
Video Streaming
Terraform
Software Version Control
Data Pipelines
Docker
Job description
- Develop and deploy machine learning models into production and monitor performance.
- Design and build scalable ETL/ELT pipelines using batch and streaming technologies.
- Work with large-scale datasets, data modelling and data transformation.
- Connect operational systems with analytics and BI platforms.
- Identify and resolve data quality and pipeline issues.
- Develop high-quality code, documentation and automated tests.
- Work within an Agile/Scrum environment.
- Collaborate with technical teams, clients and stakeholders.
- Keep up to date with emerging technologies, particularly Generative AI.
Requirements
We are looking for experience in some of the following:
- Strong Python skills.
- AWS, Azure or GCP.
- Data warehousing and data lake architectures.
- ETL/ELT, SQL and NoSQL databases.
- Spark, Kinesis or other distributed/streaming technologies.
- CI/CD, TDD and version control.
- Docker, Kubernetes and Infrastructure as Code such as Terraform.
- Data modelling and system architecture.
- Experience delivering an AI/ML project.
- Strong communication, problem-solving and stakeholder management skills.
- Team leadership and decision-making experience for senior-level roles.
Consultancy experience is beneficial but not essential; client-facing experience from other environments will also be considered.
Benefits & conditions
Salary: Competitive salary and package, dependent on experience Travel: Ad hoc travel to client sites across the UK, * Competitive salary and benefits package.
- 25 days’ annual leave.
- Private medical insurance.
- 3 additional days’ leave for charitable work.
- Career development and exposure to leading data, cloud and AI technologies.
Important Security Clearance Requirement
Any offer of employment is subject to satisfactory BPSS and DV security clearance.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
over 3 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
LM
Luis Minvielle
How to Become an AI Engineer
almost 3 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago
LM
Luis Minvielle
Where To Find Software Engineering Jobs
over 2 years ago