AWS DevOps Engineer (SC Cleared)
Role details
Job location
Tech stack
Job description
We are looking for a highly skilled AWS DevOps / Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks., * Translate technical requirements into effective DevOps toolchains to enable product delivery * Design and implement resilient, scalable, and highly available services * Automate infrastructure, deployments, and testing using Infrastructure as Code (IaC) * Ensure deployment strategies are repeatable, scalable, and reliable * Provide technical leadership, mentoring, and coaching to junior team members * Support delivery teams by troubleshooting and resolving complex cloud-related issues * Work with data pipelines and processing frameworks to ensure data quality and reliability * Perform data analysis to identify and resolve root causes of issues * Collaborate with cross-functional teams to deliver end-to-end solutions
Requirements
Strong expertise in AWS cloud services, including: CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, DynamoDB, Lake Formation
- Experience with Infrastructure as Code (Terraform)
Proficiency in Python, SQL, and familiarity with PySpark * Experience with Apache Spark and data processing frameworks * Hands-on experience with Apache Airflow for workflow orchestration * Experience using Jupyter Notebooks and/or Amazon Athena for data querying and validation * Strong understanding of EMR and log analysis * Experience with GitLab for CI/CD pipelines, release tagging, and version control * Knowledge of Docker and containerisation * Understanding of encryption techniques (server-side and client-side) * Familiarity with Amazon Textract and Comprehend * Strong understanding of data modelling concepts, including dimensional models and slowly changing dimensions
Additional Skills: * Ability to translate customer requirements into functional technical solutions * Familiarity with engineering best practices and standards * Strong understanding of data structures and solution design principles * Experience working in agile delivery environments, As a Disability Confident Level 1 employer, we are committed to providing reasonable adjustments throughout the recruitment process and during employment to ensure equal opportunities for all.