Data Engineer

True North Consulting Group Ltd
London, UK
1 day ago
Apply on www.securityclearedjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£94,900.0
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Big Data Continuous Integration Information Engineering Data Transformation Data Warehousing Identity and Access Management Python (Programming Language) Standard Sql SQL Databases Workflow Management Systems
+12 more
Electronic Medical Records Git Cloudformation SC Clearance Deployment Automation AWS Data Analytics Cloudwatch Amazon Simple Queue Service (SQS) Terraform Data Pipelines OpenSearch Docker

Job description

We’re looking for AWS Data Engineers to join a growing team delivering data transformation programmes within secure environments.

This role is ideal for engineers who enjoy building scalable data platforms, developing robust data pipelines, and working with modern AWS-native technologies. You’ll help design, build, and maintain high-performance data solutions that support business-critical decision-making while ensuring security, reliability, and scalability.

What You’ll Be Doing

  • Developing and maintaining data pipelines using Python, SQL, and Apache Airflow.
  • Designing scalable data workflows and orchestration processes.
  • Building and optimising solutions using AWS data services.
  • Containerising applications and data workloads using Docker.
  • Monitoring, troubleshooting, and improving data platform performance.
  • Working closely with developers, architects, and stakeholders to deliver secure, resilient solutions.
  • Supporting CI/CD processes and automation across the data engineering lifecycle.
  • Ensuring best practices around security, governance, and data quality are maintained.
  • Contributing to documentation, process improvement, and knowledge sharing initiatives.

Requirements

  • Strong Python development skills.
  • Solid SQL expertise.
  • Experience with Apache Airflow for workflow orchestration and monitoring.
  • Hands-on experience with Docker.
  • Strong AWS experience including:
  • Redshift
  • OpenSearch
  • Lambda
  • Glue
  • Step Functions
  • AWS Batch
  • Experience with Git and collaborative development workflows.
  • Familiarity with CI/CD pipelines and deployment automation.
  • Understanding of AWS security principles, IAM, and role-based access controls.
  • Strong troubleshooting and problem-solving skills.

Desirable

  • Experience with Athena, SQS, EMR, CloudWatch, or CloudTrail.
  • Terraform or CloudFormation experience.
  • Experience working within consultancy or client-facing environments.
  • Knowledge of data warehousing and large-scale data transformation programmes.
  • Experience working within secure or regulated environments.

Benefits & conditions

  • £365 per day inside IR35.
  • Long-term programme work.
  • Exposure to complex cloud and data transformation projects.
  • Modern AWS data stack.
  • Collaborative engineering environment.
  • Opportunities to work alongside experienced cloud, data, and platform specialists.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.securityclearedjobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…