AWS Data Engineer

True North Consulting Group Ltd
Manchester, UK
4 days ago
Apply on www.securityclearedjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
Β£85,000
Working hours
Regular working hours

Tech stack

Agile Methodology Airflow Amazon Web Services Confluence Audit Trail Cloud Database Continuous Integration Data as a Services Information Engineering Data Infrastructure Identity and Access Management Python (Programming Language)
+19 more
SQL Databases Workflow Management Systems YAML Data Processing Electronic Medical Records Gitlab Git Cloudformation SC Clearance Containerization Infrastructure Automation Frameworks AWS Data Analytics Cloudwatch Amazon Simple Queue Service (SQS) Terraform Software Version Control Data Pipelines OpenSearch Docker

Job description

We’re looking for experienced AWS Data Engineers to join a growing technology consultancy delivering complex cloud and data solutions.

This is a hands-on engineering role focused on designing, building and maintaining scalable data pipelines and infrastructure using AWS-native services. You’ll work across data orchestration, automation and containerisation, helping deliver secure, reliable and high-performance data solutions.

We’re open to candidates at different experience levels who have strong AWS data engineering expertise and enjoy solving complex technical challenges., * Design, develop and maintain scalable data pipelines using Python, SQL and Apache Airflow.

  • Build and optimise cloud-based data solutions using AWS services including Redshift, Glue, Lambda, Step Functions, Batch and OpenSearch.
  • Develop and manage containerised applications and workflows using Docker.
  • Implement and maintain data orchestration processes, ensuring efficient and reliable data processing.
  • Collaborate with engineering teams and stakeholders to deliver secure, scalable data infrastructure.
  • Monitor, troubleshoot and optimise data pipeline performance and reliability.
  • Work with GitLab or similar tools for version control and CI/CD.
  • Ensure data quality, governance and security best practices are followed.
  • Contribute to technical documentation, automation and continuous improvement initiatives.

Requirements

  • Strong hands-on experience in AWS Data Engineering.
  • Excellent Python programming skills and strong SQL proficiency.
  • Experience using Apache Airflow for workflow orchestration and DAG management.
  • Practical experience with Docker and containerisation.
  • Strong knowledge of AWS data services, particularly Redshift, Glue, Lambda, Step Functions, Batch and OpenSearch.
  • Experience with CI/CD pipelines, Git and YAML-based configurations.
  • Good understanding of AWS security, IAM policies and role-based access control (RBAC).
  • Strong problem-solving skills and the ability to troubleshoot complex data engineering issues.
  • Experience working in Agile environments and collaborating with cross-functional teams.
  • Good communication and stakeholder management skills.

Desirable experience:

  • Additional AWS services such as Athena, SQS, CloudWatch, CloudTrail and EMR.
  • Infrastructure as Code tools such as Terraform or CloudFormation.
  • Experience working in consultancy or client-facing environments.
  • Familiarity with technical documentation tools such as Confluence.

Security Clearance requirements:

  • Must hold active SC Clearance.
  • Must be able to maintain the required level of security clearance throughout the engagement.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.securityclearedjobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…