Intermediate Data Engineer
Role details
Job location
Tech stack
Job description
We're seeking an Intermediate Data Engineer to join our Insurance Retail department, supporting development squads with reliable, automated and cloud-ready data solutions. This role is suited to someone who can combine strong SQL, scripting and AWS experience with modern DevOps practices to build, maintain and improve data pipelines, data services and supporting infrastructure., * Building, testing, monitoring and maintaining data pipelines and infrastructure to support the Data Platform using best practices including CI/CD, IaC and DevOps.
- Apply security best practices across data pipelines, cloud infrastructure and operational processes, ensuring data is protected through appropriate access controls, encryption, monitoring and secure engineering practices
- Use AWS services and PostgreSQL/AWS RDS knowledge to design, deliver and support scalable, reliable and secure data solutions, ensuring appropriate governance, resilience and protection of business data.
- Actively embrace AI-assisted engineering practices and demonstrate a willingness to learn, experiment with and responsibly adopt emerging AI tools such as Kiro, GitHub Copilot or equivalent technologies to improve delivery flow, quality, documentation, analysis and operational efficiency.
- Develop and maintain automated deployment, testing and operational workflows using GitLab pipelines, version control, Terraform/OpenTofu and scripting.
- Contribute to data quality, lineage, governance and observability practices to ensure data is trusted, traceable, secure and supportable throughout its lifecycle.
- Investigate data quality, platform reliability, pipeline performance and operational issues, identifying practical improvements, preventative actions and automation opportunities that enable squads to move faster and more safely.
- Working with business stakeholders, analysts and architects to understand business and technical requirements, designing data models and data structures that support reporting, analytics and operational use cases.
- Contribute to database and data platform activities such as upgrades, data migrations, schema updates and platform modernisation initiatives.
- Documenting processes and products, sharing knowledge across the squad and wider business, and supporting the development of less experienced engineers through mentoring, pairing or technical guidance where appropriate.
- Contribute significantly to small-to-medium feature deliveries and multi-person initiatives, collaborating with engineers and stakeholders to deliver reliable outcomes.
Requirements
- Hold, or be willing to obtain, a relevant AWS certification that can be registered against the CDL APN.
- Proven experience working with AWS services relevant to data engineering and operational support, such as RDS, S3, Lambda, ECS, EC2, VPC, CloudWatch and related services.
- Experience with MySql and Oracle databases would be advantageous.
- Strong SQL skills, including PostgreSQL experience, query optimisation awareness and the ability to investigate data or performance issues.
- Good understanding of security principles including least-privilege access, encryption, secrets management, vulnerability remediation and secure handling of sensitive data.
- Experience with CI/CD pipelines, automated testing and deployment practices using GitLab or similar tooling.
- Experience with Infrastructure as Code tools such as Terraform, OpenTofu or CloudFormation.
- Good understanding of version control workflows, branching strategies and GitLab best practice.
- Experience of, or a strong willingness to learn, AI-assisted engineering tools such as Kiro, GitHub Copilot or similar technologies to improve engineering effectiveness and delivery outcomes.
- Familiarity with observability and troubleshooting tooling such as Dynatrace, OpenSearch/Elasticsearch or CloudWatch logs.
- Ability to communicate clearly, analyse problems, work collaboratively and explain technical concepts to both technical and non-technical stakeholders.
- Familiarity with Agile methodologies and operational tooling such as Jira and ServiceNow.
Benefits & conditions
Pulled from the full job description
- Referral programme
- Shuttle service provided
- Free parking
- Company pension
- Cycle to work scheme
- Car scheme
- On-site parking, The salary for the role of Intermediate Data Engineer pays up to £45,000p.a. (Level 4) providing a fantastic opportunity for career progression through CDL's clearly defined career framework (https://progression.cdl.co.uk/)., Hybrid Working (2 Days a Week in the office - SK4 2HD)
- ️ Flexible working.
25 days holiday to start, increasing by 1 day per 1 year of service up to 30 days. Top employer for 10th year running Excellent training and development platform Opportunities for career progression Health and Wellbeing Programme
- Virtual activities, lunch and learns, coffee mornings and meetups.
️ Life and health assurance
- Electric Vehicle Scheme
️ Established Recognition Award System Great Parental Benefits Diversity and Inclusion network Pension scheme Community projects and volunteer days Refer a friend bonus
Campus Benefits: ️ On-site free parking Open plan modern offices Quiet Spaces are also available Shuttle bus to and from the station ️ Subsidised restaurant Games room, pool & table-tennis tables and chill out zone
- ️ Annual Hackathon & Deep Racer Events
Social activities, regular social events through our social group Xtra, including a summer BBQ, competitions, bowling, go-karting, football games, Winter party and much more!
- ️ Car wash, barber, yoga classes, boot camp and massage services all on site
Cycle to work scheme Shower and dry rooms
Diversity and inclusion: We're on a journey to keep innovating, that means welcoming new ideas and ways of thinking. CDL recognises that building a diverse workforce is critical to the success of our business. We strongly encourage applications from a diverse talent pool and welcome the opportunity to discuss flexibility requirements and workplace adjustments with all our applicants.