Data Engineer

• We design, deliver, and maintain robust data products and pipelines that support our business operations and scientific research.
• We provide clear documentation on specifications and maintain a deep understanding of each solution at the data, technical, and business process levels.
• We implement data engineering best practices to standardise development, quality testing, and BAU processes.
• We ensure high-quality, FAIR-compliant data is presented to our researchers and keep our data catalogue and dictionaries up to date.
• We build, manage, and scale research-ready products.
• We create structured, reliable, and easily accessible data for the research team.
• We untangle complex data.
• We write clean, efficient code.
• We use Azure services for data pipelines, including Azure Data Factory, Azure Databricks, and DBT.
• We work with modern IT practices, including system and product integration, microservices, data lakes, FAIR principles, and common data models.
• We use DevOps and Terraform in our delivery approach.

Technologies:

• Azure
• Databricks
• DevOps
• Support
• Python
• PySpark
• SQL
• Terraform
• dbt
• microservices
• Cloud

• We are looking for someone educated to degree level in IT, Computer Science, Data Science, or a related subject.
• You should have an analytical and problem-solving mindset, with the ability to untangle complex data.
• You should be comfortable challenging assumptions, asking proactive questions, and designing logical models to make data useful for others, preferably within an R&D environment.
• You should have a solid programming foundation, with strong working knowledge of Python, specifically PySpark, and SQL, and be comfortable writing clean, efficient code to manipulate, transform, and query data.
• You should have proven expertise in designing and implementing data pipelines using Azure services such as Azure Data Factory, Azure Databricks, and DBT.
• You should have a comprehensive understanding of modern enterprise IT practices, especially system and product integration, micro-services, data management, data lakes, FAIR principles, and common data models.
• You should have experience with product lifecycle management principles and tools such as DevOps and Terraform, as well as relational database manipulation and interrogation.
• You should have the ability to collaborate and translate requirements into designs and architecture.

We are a global manufacturing company working on pet nutrition, health, and wellbeing through designed experiments and real-world data. This is an initial 12-month contract with the potential to extend, based in Waltham on the Wolds, with a hybrid working pattern of two days in the office per week and flexibility on working hours. The role sits at the intersection of science and technology, where we collaborate closely with researchers and IT partners to design, develop, and refine a modern data landscape that supports our Petcare strategy of creating a better world for pets. We are committed to equal employment opportunities and encourage all qualified candidates to apply.