> Markdown version of [/jobs/ext/1444799-intermediate-data-engineer](https://www.wearedevelopers.com/jobs/ext/1444799-intermediate-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Intermediate Data Engineer - **Company:** CDL Software - **Location:** Stockport, UK - **Experience:** Experienced - **Salary:** £45,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, JIRA, Automation of Tests, Cloud Computing, Databases, Continuous Integration, Data as a Services, Information Engineering, Data Infrastructure, Data Security, Data Structures, Data Systems, Database Queries, DevOps, Elasticsearch, Key Management, PostgreSQL, MySQL, Oracle Databases, Query Optimization, Software Tools, Standard Sql, Software Vulnerability Management, Scripting, GitHub Copilot, Amazon Virtual Private Cloud (VPC), Gitlab, Cloudformation, Amazon Relational Database Service, Git Flow, Infrastructure Automation Frameworks, Deployment Automation, Cloudwatch, Terraform, Software Version Control, Data Pipelines, Dynatrace, Servicenow - **Published:** July 26, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=7e7db5d28b066373 ## About the Role * Hold, or be willing to obtain, a relevant AWS certification that can be registered against the CDL APN. * Proven experience working with AWS services relevant to data engineering and operational support, such as RDS, S3, Lambda, ECS, EC2, VPC, CloudWatch and related services. * Experience with MySql and Oracle databases would be advantageous. * Strong SQL skills, including PostgreSQL experience, query optimisation awareness and the ability to investigate data or performance issues. * Good understanding of security principles including least-privilege access, encryption, secrets management, vulnerability remediation and secure handling of sensitive data. * Experience with CI/CD pipelines, automated testing and deployment practices using GitLab or similar tooling. * Experience with Infrastructure as Code tools such as Terraform, OpenTofu or CloudFormation. * Good understanding of version control workflows, branching strategies and GitLab best practice. * Experience of, or a strong willingness to learn, AI-assisted engineering tools such as Kiro, GitHub Copilot or similar technologies to improve engineering effectiveness and delivery outcomes. * Familiarity with observability and troubleshooting tooling such as Dynatrace, OpenSearch/Elasticsearch or CloudWatch logs. * Ability to communicate clearly, analyse problems, work collaboratively and explain technical concepts to both technical and non-technical stakeholders. * Familiarity with Agile methodologies and operational tooling such as Jira and ServiceNow. ## Description We're seeking an Intermediate Data Engineer to join our Insurance Retail department, supporting development squads with reliable, automated and cloud-ready data solutions. This role is suited to someone who can combine strong SQL, scripting and AWS experience with modern DevOps practices to build, maintain and improve data pipelines, data services and supporting infrastructure., * Building, testing, monitoring and maintaining data pipelines and infrastructure to support the Data Platform using best practices including CI/CD, IaC and DevOps. * Apply security best practices across data pipelines, cloud infrastructure and operational processes, ensuring data is protected through appropriate access controls, encryption, monitoring and secure engineering practices * Use AWS services and PostgreSQL/AWS RDS knowledge to design, deliver and support scalable, reliable and secure data solutions, ensuring appropriate governance, resilience and protection of business data. * Actively embrace AI-assisted engineering practices and demonstrate a willingness to learn, experiment with and responsibly adopt emerging AI tools such as Kiro, GitHub Copilot or equivalent technologies to improve delivery flow, quality, documentation, analysis and operational efficiency. * Develop and maintain automated deployment, testing and operational workflows using GitLab pipelines, version control, Terraform/OpenTofu and scripting. * Contribute to data quality, lineage, governance and observability practices to ensure data is trusted, traceable, secure and supportable throughout its lifecycle. * Investigate data quality, platform reliability, pipeline performance and operational issues, identifying practical improvements, preventative actions and automation opportunities that enable squads to move faster and more safely. * Working with business stakeholders, analysts and architects to understand business and technical requirements, designing data models and data structures that support reporting, analytics and operational use cases. * Contribute to database and data platform activities such as upgrades, data migrations, schema updates and platform modernisation initiatives. * Documenting processes and products, sharing knowledge across the squad and wider business, and supporting the development of less experienced engineers through mentoring, pairing or technical guidance where appropriate. * Contribute significantly to small-to-medium feature deliveries and multi-person initiatives, collaborating with engineers and stakeholders to deliver reliable outcomes. ## Related Videos - [Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies](https://www.wearedevelopers.com/videos/251-remote-driving-on-plant-grounds-with-state-of-the-art-cloud-technologies) - [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data) - [Enabling automated 1-click customer deployments with built-in quality and security](https://www.wearedevelopers.com/videos/83-enabling-automated-1-click-customer-deployments-with-built-in-quality-and-security) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)