Active SC - Data Engineer - Remote

Stealth It

2 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Remote

API

Agile Methodologies

Confluence

JIRA

Automation of Tests

Azure

Batch Processing

Code Review

Continuous Integration

Data as a Services

Information Engineering

DevOps

Hive

Python

Performance Tuning

Power BI

SQL Databases

Gitlab

GIT

Microsoft Fabric

Data Lake

PySpark

Terraform

Software Version Control

Data Pipelines

Engineer production-grade data pipelines on Microsoft Fabric (One Lake/Delta Lake, Data Factory, Synapse Notebook Data Engineering), using PySpark/Spark SQL/Python and SQL, with a focus on performance, resilience, testing, and observability.
Support reporting & MI use cases, including transformations and data models that feed downstream tools (eg, Power BI).
Own CI/CD and version control practices (eg, Git/GitLab), review code, and enforce engineering standards.
Coach and mentor engineers, provide technical guidance/code reviews, and contribute to architectural decisions across squads.
Work in Agile delivery, collaborating across product, data, and platform teams using Jira/Confluence; translate requirements into robust engineering tasks.
Embed security and compliance by design, aligning with BPSS/SC constraints and department data-handling policies.

Hands-on expertise in Azure/Fabric: Microsoft Fabric (One Lake/Delta Lake, Data Factory, Synapse Notebook Data Engineering), using PySpark/Spark SQL/Python and SQL for large-scale batch processing.
Data engineering at scale in government or similarly complex domains, including performance tuning and data-quality management.
CI/CD & DevOps: pipelines and IaC (eg, Terraform), automated testing, and release governance.
Version control & collaboration: Git/GitLab, code review, branching strategies, and trunk/PR workflows.
APIs & integration: building/consuming data services to move and expose data safely and reliably.
Agile ways of working with Jira/Confluence; clear stakeholder communication and concise technical documentation.
Security clearance: BPSS (minimum) and SC-cleared or SC-clearable for UK government work.