SC cleared Junior Data Engineer

Neweasy
London, UK
1 day ago
Apply on www.reed.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Starter
Compensation
£100,100.0 - £102,700.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Amazon Web Services Amazon S3 Big Data Data Systems Database Queries Python (Programming Language) Operational Data Store Software Engineering SQL Databases Cloud Platform System Data Ingestion
+5 more
Apache Spark SC Clearance Kubernetes Apache Kafka Data Pipelines

Job description

We’re looking for a Junior Data Engineer to join a long-term central government data programme.

This is a hands-on role supporting the movement, transformation and processing of operational data into a large-scale data platform.

You’ll work as part of an established engineering team, building and maintaining data pipelines and supporting data solutions in production., * Build and maintain data pipelines

  • Support data ingestion, transformation and processing
  • Work with large and complex datasets
  • Develop solutions using Python and/or Java
  • Use SQL to query, manipulate and transform data
  • Work with cloud-based data platforms
  • Troubleshoot pipeline and data issues
  • Support solutions through development and into production
  • Collaborate with engineers and technical teams across the programme

Requirements

  • Commercial Data Engineering or data-focused software engineering experience
  • Python and/or Java
  • Strong SQL skills
  • Experience building or maintaining data pipelines
  • Experience with cloud-based data platforms
  • Good understanding of production engineering environments

Experience with any of the following would be beneficial:

AWS, Kafka, Kubernetes, Spark, Glue, Athena, Redshift, S3 or Lake Formation.

You don’t need experience with every technology listed. We’re looking for strong engineering fundamentals, hands-on ability and experience working with data in production environments.

Previous experience within central government, policing, national security or another complex public sector environment would be beneficial. Security Clearance

Existing SC clearance is preferred, although candidates who are eligible to obtain SC clearance will also be considered.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.reed.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann Chris Heilmann +3 · LIVE

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · World Congress 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

Videos

See all

Related articles

See all