Data Engineer

This role is for a Data Engineer to enable the Data Analysts to deliver Analysis and Insights to the rest of the business. You will be part of a Data Engineering team set up to migrate data from a variety of on-prem and cloud sources into the Delta Lakehouse provider, Databricks. You will be part of developing and maintaining the full data pipeline stack and will involve many disciplines, including cloud architect, infrastructure-as-code development; software engineering, and general operational support.

What You'll Be Doing:

• Actively participate in the development and maintenance of core data pipelines.

• Implement and optimize data ingestion, transformation, and integration processes.

• Ensure all code developed is tested with a suite of unit, integration, and infrastructure tests

• Update and maintain documentation on architecture, security, and pipeline code

• Experience with AWS systems including EC2, S3, CloudWatch and ECS.

• Experience with non-relational databases like Databricks

• Experience with data modelling concepts

• Experience with Big Data technology Apache Spark

• Experience with programming languages and SQL

• Hybrid & Flexible Working
• Early Finish Friday - Working week of 34 hours with full-time pay. (Finish at midday on Friday)
• 30 days of annual leave plus bank holidays, with the ability to purchase an additional 5 days.
• Private Medical Insurance + Employee Assistance Programme
• Medicash
• Pension Scheme (Matched to 7%)
• Annual Bonus Scheme
• Family Leave (Enhanced)
• Electric vehicle scheme with on-site charging points*
• Rewards platform with access to discounts at hundreds of shops, restaurants etc.*

• Flexible Benefits

We're Nominet - a world-leading domain name registry operating at the heart of the UK internet. While we're best known for running .UK domains, our DNS expertise also underpins critical internet infrastructure that government services, including the NHS, rely on. As a public benefit company, our work has a positive impact on society. We've donated millions to projects that use technology to improve people's lives and have committed to delivering £60m worth of support over the next three years.