Data Operations Engineer

UBDS Group
London, United Kingdom
1 day ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£67,020
Working hours
Regular working hours

Tech stack

Agile Methodology Amazon Web Services Amazon S3 Cloud Computing Cloud Computing Security Cloud Database Data as a Services Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Systems
+32 more
Relational Databases Distributed Computing Environment Github Python (Programming Language) Meta-Data Management Cloud Services DataOps Software Engineering SQL Databases Systems Integration Unstructured Data Data Processing Data Storage Technologies Cloud Platform System Data Ingestion Cloud Monitoring Delivery Pipeline Apache Spark Git Cloudformation Data Lakes Pyspark Gitlab-ci Information Technology Data Lineage Deployment Automation AWS Data Analytics Cloudwatch Terraform Software Version Control Data Pipelines Amazon Redshift

Job description

This is a hands-on engineering role focused on building and maintaining scalable data pipelines, integrating data sources and ensuring the reliability, security and performance of cloud-based data platforms.

You’ll work within multidisciplinary Agile teams, collaborating with Data Architects, Cloud Engineers, Software Developers and delivery colleagues to develop robust data solutions that support analytics, reporting and wider digital transformation.

  • Develop, maintain and optimise data pipelines and integration workflows within AWS.
  • Build and support automated data ingestion, transformation and processing solutions.
  • Work with AWS data services, including S3, Glue, Lambda and associated technologies.
  • Develop and maintain ETL/ELT processes to integrate structured and unstructured data.
  • Use Python and SQL to develop data processing, transformation and automation solutions.
  • Monitor data pipelines, investigate failures and resolve performance or reliability issues.
  • Support data quality, validation and appropriate data governance controls.
  • Work with data storage solutions, including relational databases and cloud-based data lakes.
  • Develop and maintain automated deployments using CI/CD pipelines and version control.
  • Support Infrastructure as Code and cloud automation practices.
  • Contribute to technical design discussions and implementation decisions.
  • Work closely with Data Architects and Engineers to translate requirements into practical technical solutions.
  • Produce clear technical documentation and support operational handover.
  • Contribute to continuous improvement of data engineering practices, automation and platform reliability., At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Requirements

  • Hands-on experience developing and supporting data solutions within AWS.
  • Strong working knowledge of Python and SQL.
  • Experience designing, building and maintaining ETL/ELT pipelines.
  • Experience with AWS data services such as S3, Glue, Lambda or equivalent.
  • Understanding of data integration, transformation and processing principles.
  • Experience working with relational databases and cloud-based data storage.
  • Good understanding of data quality, validation and pipeline monitoring.
  • Experience with Git, CI/CD pipelines and modern software engineering practices.
  • Understanding of cloud security, identity and access management principles.
  • Strong troubleshooting and problem-solving skills.
  • Experience working within Agile, multidisciplinary delivery teams.
  • Ability to take ownership of technical tasks and deliver independently within established standards.
  • Strong communication and collaboration skills.

Experience across some of the following would be beneficial:

  • AWS Redshift, Athena, EMR or Kinesis.
  • Apache Spark or PySpark for distributed data processing.
  • AWS Step Functions or other workflow orchestration technologies.
  • Terraform, CloudFormation or other Infrastructure as Code tooling.
  • GitHub Actions, GitLab CI/CD or AWS CodePipeline.
  • Data lake and lakehouse architectures.
  • Event-driven data processing and streaming technologies.
  • Data modelling, metadata management and data lineage.
  • Cloud monitoring and observability using Amazon CloudWatch or similar.
  • Experience integrating on-premises and cloud-based data sources.
  • Experience working within Government, Defence or other regulated environments.
  • Relevant AWS or data engineering certifications.

This role would suit an experienced Data Engineer who enjoys hands-on technical delivery, solving data challenges and building reliable, scalable data solutions.

You’ll work across modern AWS data environments, developing your expertise in cloud data engineering, automation and platform operations while collaborating with experienced Data, Cloud and Architecture specialists.

You’ll have the opportunity to take ownership of engineering activities, contribute to technical improvements and play

Benefits & conditions

Why people choose to grow their careers at UBDS Group

Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.

UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.

Employee Benefits

  • Training - All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
  • Private medical cover for you and your spouse/partner, offered via Vitality
  • Discretionary bonus based on a blend of personal and company performance
  • Holiday - You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
  • Electric Vehicle leasing with salary sacrifice
  • Contributed Pension Scheme
  • Death in service cover

About the company

At UBDS, we help organisations transform through cloud, cyber security, AI and digital innovation. We’re looking for an experienced Data Operations Engineer to support the development, operation and optimisation of modern data solutions within AWS environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…