Cloud Data Platform Engineer
Role details
Job location
Tech stack
Job description
As our Cloud Data Platform Engineer, you will play a key role in designing, developing and deploying cloud based data platforms that are secure, scalable and cost efficient. Working to industry best practice and aligned to our internal standards, you will help build and maintain the core data lakehouse architecture that underpins analytics and reporting across the group.
You will work closely with the Principal Data Architect, Cloud DBA and Data Engineers to deliver robust, high performing data solutions. Alongside this, you will automate infrastructure deployment, ensure strong security governance, and proactively monitor and optimise performance across the platform.
You will be:
- Supporting the definition, design and deployment of end to end data lakehouse architecture in line with industry best practice.
- Developing, maintaining and versioning Terraform configurations to provision and manage GCP infrastructure.
- Working with the Group Technology Cloud Infrastructure team to standardise deployment methods and contribute to shared modules and tooling.
- Integrating security best practice by managing fine grained access control (IAM) and ensuring data compliance and segregation across BigQuery and Cloud Storage.
- Continuously monitoring and tuning performance, including managing slot capacity and optimising partitioning and clustering to deliver fast and cost efficient queries.
- Creating and maintaining CI/CD pipelines to automate Terraform deployments and Cloud Composer DAG releases.
- Establishing monitoring, logging and alerting across all data platform components to detect issues early and prevent failures.
- Providing Third Line support through deep dive troubleshooting, root cause analysis and resolution of complex GCP data platform issues.
- Creating and updating documentation including architectural diagrams, runbooks and Terraform module guides.
It is a highly technical and collaborative role where you will have real ownership of the cloud data platform and play a key part in shaping the future of data engineering across the group.
This role is for you if…
You enjoy solving complex technical challenges, building secure and scalable cloud solutions and working with modern data engineering tools and platforms. You will thrive in an environment where automation, best practice and continuous improvement are central to success.
Requirements
- Two or more years experience designing, developing or implementing cloud solutions.
- Hands on experience with at least one major cloud provider, ideally Google Cloud Platform.
- Strong cloud infrastructure knowledge, including VPCs, networking, routing, firewall rules and secure connectivity.
- Experience using Terraform to build and manage cloud infrastructure.
- Knowledge of CI/CD tools such as GitHub Actions or Cloud Build.
- The ability to integrate security and compliance requirements into cloud solutions, including IAM, encryption and vulnerability scanning.
- Experience setting up cloud native monitoring and logging tools, such as Google Cloud Operations or Prometheus.
- Proficiency in a scripting language such as Python or Bash to support automation and tooling.
- Experience designing and implementing big data solutions.
- Cloud certifications in engineering, security or architecture (desirable).
- Clear communication skills and the ability to work effectively with developers, operational teams and leadership.
- A proactive, self starting approach and confidence working independently.
If you enjoy shaping modern data platforms, building automation and ensuring cloud environments are secure, reliable and high performing, this could be the ideal next step for you.
Benefits & conditions
- Potential Annual Bonus Scheme: Contribute to our success and get rewarded for it
- Growth and Training: Learn new skills and develop your career with us
- Leave: Enjoy a great holiday allowance, with the option to buy 5 extra days. Take advantage of our enhanced leave for Maternity, Paternity, Shared Parental, and Adoption, plus a paid volunteering day each year
- Discounts: Get 30% off DFS and Sofology products for yourself, plus discounts for friends and family - and savings at big brands like Sainsbury's, ASOS, and IKEA
- Wellbeing Perks: Access healthcare services, an Employee Assistance Programme, and discounted gym memberships
- Pension and Savings: Join our Group Pension and Sharesave schemes
- Life Assurance & Sick Pay: Peace of mind with Life Assurance and Company Sick Pay