AWS Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+13 more
Job description
and support the development of other engineers within the team.What You’ll DoDesign, build and maintain scalable data platforms and data pipelines within AWSDevelop robust ETL/ELT processes for ingesting, transforming and processing data from multiple sourcesDesign and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologiesDesign data models and storage approaches appropriate to analytical and operational requirementsDevelop solutions using Python, SQL and modern data engineering frameworksApply infrastructure-as-code and automation approaches to the deployment and management of data platformsBuild data quality, validation, monitoring and observability into engineering solutionsEnsure security, governance and data protection requirements are considered throughout solution design and deliveryWork with architects, cloud engineers, security specialists and other SMEs to ensure solutions integrate effectively across the wider
Requirements
technology landscapeEngage with clients and technical stakeholders to understand requirements, explain technical decisions and provide recommendationsTroubleshoot complex data, performance and integration issues across development and production environmentsDefine and promote data engineering standards, reusable patterns and best practicesMentor and support other engineers, encouraging knowledge sharing and continuous improvementWhat We’re Looking ForSignificant hands-on experience as a Data Engineer, ideally within complex enterprise environmentsStrong experience designing and delivering data solutions on AWSStrong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the right services for different requirementsStrong Python and SQL skillsExperience designing and building scalable ETL/ELT pipelines and data processing workflowsGood understanding of data modelling, data lakes, data warehouses and modern data platform architecturesExperience with infrastructure-as-code, ideally TerraformExperience with CI/CD and automated testing for data engineering workloadsGood understanding of data security, governance, access control and data qualityExperience making technical design decisions and providing engineering leadership within multidisciplinary teamsStrong troubleshooting and problem-solving skillsConfidence working directly with clients and communicating technical concepts, decisions and recommendationsExperience supporting and mentoring other engineersCurrent SC clearance is highly desirable given the nature and timescales of client engagements. Candidates must be eligible to obtain and maintain SC clearance.AWS certification at Associate or Professional levelExperience with streaming and event-driven data technologiesExperience with technologies such as Spark, Kafka or DatabricksExperience delivering data platforms within public sector, defence or other regulated environmentsExperience working within secure environments and understanding associated security and assurance requirementsExposure to machine learning or AI workloads and the data platforms that support them #J-18808-Ljbffr
About the company
We are recruiting on behalf of our client for an experienced Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions.Our client works with organisations operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence.This is a hands-on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide other engineers and influence engineering practices.The RoleAs a Senior Data Engineer, you’ll take a leading role in designing and building modern data platforms, pipelines and services within AWS.You’ll work closely with architects, engineers, security specialists and client teams to understand requirements and turn them into robust, maintainable and secure data solutions.Alongside hands-on engineering, you’ll help establish engineering standards and patterns, contribute to key technical decisions
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
How to Become an AI Engineer
Software Engineer Salary London
Making Data Warehouses Fast: A Developer’s Story