Data Engineer
True North Consulting Group Ltd
London, UK
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.securityclearedjobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£94,900.0
Working hours
Regular working hours
Job source
Tech stack
Airflow
Amazon Web Services
Big Data
Continuous Integration
Information Engineering
Data Transformation
Data Warehousing
Identity and Access Management
Python (Programming Language)
Standard Sql
SQL Databases
Workflow Management Systems
+12 more
Electronic Medical Records
Git
Cloudformation
SC Clearance
Deployment Automation
AWS Data Analytics
Cloudwatch
Amazon Simple Queue Service (SQS)
Terraform
Data Pipelines
OpenSearch
Docker
Job description
We’re looking for AWS Data Engineers to join a growing team delivering data transformation programmes within secure environments.
This role is ideal for engineers who enjoy building scalable data platforms, developing robust data pipelines, and working with modern AWS-native technologies. You’ll help design, build, and maintain high-performance data solutions that support business-critical decision-making while ensuring security, reliability, and scalability.
What You’ll Be Doing
- Developing and maintaining data pipelines using Python, SQL, and Apache Airflow.
- Designing scalable data workflows and orchestration processes.
- Building and optimising solutions using AWS data services.
- Containerising applications and data workloads using Docker.
- Monitoring, troubleshooting, and improving data platform performance.
- Working closely with developers, architects, and stakeholders to deliver secure, resilient solutions.
- Supporting CI/CD processes and automation across the data engineering lifecycle.
- Ensuring best practices around security, governance, and data quality are maintained.
- Contributing to documentation, process improvement, and knowledge sharing initiatives.
Requirements
- Strong Python development skills.
- Solid SQL expertise.
- Experience with Apache Airflow for workflow orchestration and monitoring.
- Hands-on experience with Docker.
- Strong AWS experience including:
- Redshift
- OpenSearch
- Lambda
- Glue
- Step Functions
- AWS Batch
- Experience with Git and collaborative development workflows.
- Familiarity with CI/CD pipelines and deployment automation.
- Understanding of AWS security principles, IAM, and role-based access controls.
- Strong troubleshooting and problem-solving skills.
Desirable
- Experience with Athena, SQS, EMR, CloudWatch, or CloudTrail.
- Terraform or CloudFormation experience.
- Experience working within consultancy or client-facing environments.
- Knowledge of data warehousing and large-scale data transformation programmes.
- Experience working within secure or regulated environments.
Benefits & conditions
- £365 per day inside IR35.
- Long-term programme work.
- Exposure to complex cloud and data transformation projects.
- Modern AWS data stack.
- Collaborative engineering environment.
- Opportunities to work alongside experienced cloud, data, and platform specialists.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.securityclearedjobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…