Senior AWS Data Engineer - SC Cleared
Agilesource Ltd
Altrincham, UK
11 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£56,000.0 - £85,000.0
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Amazon Web Services
Amazon S3
Automation of Tests
Cloud Computing
Continuous Integration
Data as a Services
Information Engineering
Data Infrastructure
Extract Transform Load (ETL)
Data Security
Data Systems
+17 more
Data Warehousing
Python (Programming Language)
Machine Learning
Standard Sql
SQL Databases
Data Streaming
Value Engineering
Data Processing
Apache Spark
SC Clearance
Data Lakes
AWS Data Analytics
Apache Kafka
Data Management
Terraform
Data Pipelines
Databricks
Job description
- Design, build and maintain scalable data platforms and data pipelines within AWS
- Develop robust ETL/ELT processes for ingesting, transforming and processing data from multiple sources
- Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies
- Design data models and storage approaches appropriate to analytical and operational requirements
- Develop solutions using Python, SQL and modern data engineering frameworks
- Apply infrastructure-as-code and automation approaches to the deployment and management of data platforms
- Build data quality, validation, monitoring and observability into engineering solutions
- Ensure security, governance and data protection requirements are considered throughout solution design and delivery
- Work with architects, cloud engineers, security specialists and other SMEs to ensure solutions integrate effectively across the wider technology landscape
- Engage with clients and technical stakeholders to understand requirements, explain technical decisions and provide recommendations
- Troubleshoot complex data, performance and integration issues across development and production environments
- Define and promote data engineering standards, reusable patterns and best practices
- Mentor and support other engineers, encouraging knowledge sharing and continuous improvement
Technologies:
- AI
- AWS
- Lambda
- Redshift
- CI/CD
- Cloud
- Databricks
- ETL
- Support
- Kafka
- Machine Learning
- Python
- SQL
- Security
- Spark
- Terraform, We are seeking experienced Senior AWS Data Engineers for permanent or contract opportunities. This role offers a permanent salary of £50,000 - £85,000 or a contract rate of £400.00 inside IR35. We work closely with architects, engineers, security specialists and client teams to deliver modern, secure and maintainable data solutions, and we value engineering standards, reusable patterns and the development of our team.
Requirements
- Significant hands-on experience as a Data Engineer, ideally within complex enterprise environments
- Strong experience designing and delivering data solutions on AWS
- Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements
- Strong Python and SQL skills
- Experience designing and building scalable ETL/ELT pipelines and data processing workflows
- Good understanding of data modelling, data lakes, data warehouses and modern data platform architectures
- Experience with infrastructure-as-code, ideally Terraform
- Experience with CI/CD and automated testing for data engineering workloads
- Good understanding of data security, governance, access control and data quality
- Experience making technical design decisions and providing engineering leadership within multidisciplinary teams
- Strong troubleshooting and problem-solving skills
- Confidence working directly with clients and communicating technical concepts, decisions and recommendations
- Experience supporting and mentoring other engineers
- Current SC clearance is required due to the nature and timescales of our client engagements.
- AWS certification at Associate or Professional level
- Experience with streaming and event-driven data technologies
- Experience with technologies such as Spark, Kafka or Databricks
- Experience delivering data platforms within public sector, defence or other regulated environments
- Experience working within secure environments and understanding associated security and assurance requirements
- Exposure to machine learning or AI workloads and the data platforms that support them
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.co.uk
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
over 3 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago
LM
Luis Minvielle
Fully Remote Software Engineer Jobs
over 2 years ago
LM
Luis Minvielle
Top-Paying Tech Jobs (with Salaries)
over 2 years ago
LM
Luis Minvielle
The 12 Best Jobs for Software Engineers
over 2 years ago