AWS DevOps Engineer (SC Cleared)

scrumconnect ltd
Newcastle upon Tyne, United Kingdom
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Newcastle upon Tyne, United Kingdom

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Cloud Computing
Information Engineering
Data Structures
Database Queries
DevOps
Dimensional Modeling
Amazon DynamoDB
Identity and Access Management
Python
Log Analysis
SQL Databases
Workflow Management Systems
Jupyter Notebook
Spark
Electronic Medical Records
Infrastructure as Code (IaC)
Gitlab
Containerization
PySpark
Infrastructure Automation Frameworks
Deployment Automation
Integration Frameworks
Cloudwatch
Terraform
Software Version Control
Data Pipelines
Docker

Job description

We are looking for a highly skilled AWS DevOps / Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks., * Translate technical requirements into effective DevOps toolchains to enable product delivery * Design and implement resilient, scalable, and highly available services * Automate infrastructure, deployments, and testing using Infrastructure as Code (IaC) * Ensure deployment strategies are repeatable, scalable, and reliable * Provide technical leadership, mentoring, and coaching to junior team members * Support delivery teams by troubleshooting and resolving complex cloud-related issues * Work with data pipelines and processing frameworks to ensure data quality and reliability * Perform data analysis to identify and resolve root causes of issues * Collaborate with cross-functional teams to deliver end-to-end solutions

Requirements

Strong expertise in AWS cloud services, including: CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, DynamoDB, Lake Formation

  • Experience with Infrastructure as Code (Terraform)

Proficiency in Python, SQL, and familiarity with PySpark * Experience with Apache Spark and data processing frameworks * Hands-on experience with Apache Airflow for workflow orchestration * Experience using Jupyter Notebooks and/or Amazon Athena for data querying and validation * Strong understanding of EMR and log analysis * Experience with GitLab for CI/CD pipelines, release tagging, and version control * Knowledge of Docker and containerisation * Understanding of encryption techniques (server-side and client-side) * Familiarity with Amazon Textract and Comprehend * Strong understanding of data modelling concepts, including dimensional models and slowly changing dimensions

Additional Skills: * Ability to translate customer requirements into functional technical solutions * Familiarity with engineering best practices and standards * Strong understanding of data structures and solution design principles * Experience working in agile delivery environments, As a Disability Confident Level 1 employer, we are committed to providing reasonable adjustments throughout the recruitment process and during employment to ensure equal opportunities for all.

About the company

Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful and innovative technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. We are passionate about user-centred design, agile delivery, and building digital services that make a real difference. Our teams work at the forefront of innovation, helping organisations transform and deliver high-quality, scalable solutions that truly matter., At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed to fostering an inclusive environment where every individual is valued, respected, and supported.

Apply for this position