Integrations & Data Engineer

Pilgrim's Europe
Uxbridge, United Kingdom
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Uxbridge, United Kingdom

Tech stack

Vbscript
API
Azure
Bash
Computer Programming
Databases
Continuous Integration
Data Integrity
ETL
Data Manipulation Languages
Data Structures
Data Systems
Data Warehousing
DevOps
JSON
Python
Microsoft SQL Server
Node.js
Powershell
SAP Business One
SQL Stored Procedures
Systems Integration
T-SQL
XML
Automated Data Processing (ADP)
Data Processing
GIT
Powerquery
Microsoft Fabric
REST
Software Version Control
Data Pipelines

Job description

This role ensures that business data is collected, transformed, validated, stored, and distributed through resilient automated pipelines, reducing manual processes and enabling reliable analytics, reporting, and system integrations.

The position supports both Business as Usual (BAU) operations and project delivery activities. This includes maintaining the stability and performance of existing integrations and data pipelines, as well as designing and implementing innovative solutions in line with agreed project specifications and architecture standards.

The Integrations & Data Engineer will also be responsible for ensuring that their solutions adhere to modern, secure standards and have scalability in mind. This includes following recognised frameworks and best practices to provide solutions that remain robust, maintainable, and future-proof, supporting the business' evolving needs and compliance requirements., Integration Engineering & Data Pipelines

  • Develop, implement, support, and oversee [AN1] [TS2] data integrations between platforms.
  • Develop and maintain scalable ETL/ELT pipelines to ensure reliable and structured data availability for consumption.
  • Produce and maintain a comprehensive documentation of data schemas, conventions, and definitions.
  • Ensure a high level of data integrity through validation and comprehensive error handling measures.

Process Automation & Workflow Development

  • Design, build and maintain robust data automation workflows to reduce manual processing and improve operational efficiency.
  • Selection of appropriate tools to support automated data processing at scale, while including logic to handle scheduling and retry mechanisms for reliability.
  • Undertake user studies to proactively identify opportunities for efficiency gains through automation.

Operational Support (BAU), Continuous Improvement, & Knowledge Sharing

  • Respond to & resolve escalated support tickets relating to data, integrations, and automations, providing RCA and explanations to the support team.
  • Proactively review & recommend potential improvements, reworks, or changes to existing workflows as part of a continuous improvement mindset.
  • Collaborate with suppliers, partners and external contractors during support and project delivery activities.
  • Write & maintain KB articles for technical documentation and end-user guides.

Project Delivery & Stakeholder Collaboration

  • Provide technical expertise, effort estimation, and risk identification during the planning of projects.
  • Maintain consistent & audience-appropriate communication with project stakeholders during development.
  • Provide timely progress updates, risks and potential blockers to stakeholders and the project manager.

Requirements

Core data & integration skills

  • Strong experience designing, building and maintaining integrations between systems, including working with RESTful APIs as both data sources and destinations.
  • Solid understanding of common data formats such as JSON, XML and CSV.
  • Strong ability to validate, cleanse, manipulate and transform data to for quality, reliability, and accuracy.
  • Experience developing and optimising ETL/ELT pipelines in analytical, reporting, and operational contexts.

Database & platform expertise

Microsoft SQL Server

  • Advanced knowledge of Microsoft SQL Server, including writing DML queries, stored procedures, and functions.
  • Experience managing SQL Server instances (security, users, monitoring, maintenance).

SAP Business One

  • Understanding of core SAP B1 processes and objects (business partners, documents, etc).
  • Experience customising the platform using add-ons such as Boyum B1UP.
  • Familiarity with SAP B1's underlying data structures.

Microsoft Fabric

  • Experience ingesting data from APIs or databases into Fabric.
  • Skilled in using Dataflows, Power Query, and Data Warehouse tooling to cleanse, transform, and prepare data.
  • Ability to publish structured, reliable datasets for analytical and reporting use cases.

Microsoft Azure

  • Hands-on experience with Azure Logic Apps for workflow automation.
  • Experience using Azure Function Apps for high-speed data manipulation and transfer operations.
  • Familiarity with additional Azure data and compute services beneficial to integration workloads.

Programming & automation skills

  • Ability to write and understand T-SQL, VBScript, and Python.
  • Experience of working with DAX, Node.js, PowerShell, or Bash.
  • Experience with automation, workflow orchestration, scheduling, and error-handling logic.
  • Familiarity with version control (e.g., Git), DevOps and CI/CD practices is desirable.

Teamwork, service & communication

  • Strong problem-solving and critical thinking skills with the initiative to identify optimal solutions.
  • Excellent customer service mindset when supporting internal teams and franchise partners.
  • Ability to communicate and explain technical concepts clearly to both technical and non-technical audiences.
  • Experience mentoring or guiding first-line support staff through escalated incident resolution.
  • Confidence in identifying weaknesses in business or technical processes and recommending improvements.
  • Understanding of commercial and operational metrics, and how data solutions support wider business goals.

About the company

At Pilgrim's Europe, we are united by our collective vision: to be the best and most respected company in our industry creating the opportunity of a better future for our team members, fueling growth for our customers and partners and leading the way on sustainability. We work with 17,000+ of the best people in the industry, united by a shared set of core values and a passion for producing the highest quality, most delicious and innovative food, which is enjoyed by millions of people in the UK, Ireland and Europe every day. Pilgrim's Europe builds on the existing unity of our Pilgrim's UK, Moy Park, Pilgrim's Food Masters and Pilgrim's Shared Services businesses. Together, through our unrivalled capabilities, skills and services, we can drive greater synergies and deliver long-term sustainable growth. We combine industry leading fresh pork, lamb and chicken with some of the best-known and most popular brands. Our portfolio includes authentic chilled and frozen ready meals, snacking ranges, added value and food service products. As Pilgrim's Europe we can provide even greater opportunities for our colleagues, suppliers, customers and consumers, building on our rich heritage and strong foundations to ensure a successful future.

Apply for this position