Data Engineer (Security Clearence)

FDM Group

London, UK

7 days ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

£51,306.0

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Microsoft Excel Application Programming Interfaces (APIs) Big Data Databases Data Validation Extract Transform Load (ETL) Data Structures Data Systems Database Storage Structures JSON Python (Programming Language) SQL Databases

+7 more

Systems Integration Data Processing SC Clearance Semi-structured Data Data Management Restful APIs Data Pipelines

Job description

Develop and optimise SQL queries to retrieve, manipulate and analyse complex datasets.
Build data solutions using Python, including working within notebook-based environments.
Integrate data from APIs and investigate issues within API responses and associated datasets.
Work confidently with a variety of data formats, including JSON, CSV and Excel.
Build, manage and improve automated data pipelines supporting both ETL and ELT approaches.
Carry out data validation and quality checks to identify inconsistencies, errors and processing issues.
Diagnose and resolve problems across data pipelines, integrations and datasets.
Design and maintain database structures that support scalable and reliable data solutions.
Work within established government security, delivery and data management environments.

Requirements

Strong hands-on SQL capability, particularly for querying, transforming and analysing data.
Commercial experience using Python for data engineering or data processing.
Experience developing and working within notebook-based environments.
Good understanding of REST APIs and the ability to interpret and troubleshoot responses.
Experience handling structured and semi-structured data, including JSON, CSV and Excel.
Proven experience creating and supporting automated ETL/ELT pipelines.
Strong understanding of data validation, data quality and troubleshooting.
Experience designing databases and underlying data structures.
Active SC clearance is mandatory.
Must have worked within a UK Government department during the last 12 months.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk

Prepare application

Good distractions

Loading talks and stories from around this role…