Data Engineer

We're looking for a skilled Data Engineer to help us build and mature United Welsh's modern data platform.

In this role, you will take ownership of the full data engineering life cycle - from ingestion through to transformation and optimisation - ensuring that high quality, well-modelled data is always available for reporting, analytics, and future advanced insight work., You'll work closely with BI Partners, Analysts and colleagues across the Data and Insights team to create trusted, automated and scalable data solutions that help United Welsh become truly data driven., Data platform development

• Design, build, and maintain a cloud-based data platform using Azure Data Factory, Azure Data Lake, and related Microsoft technologies

• Own and deliver ETL/ELT processes and pipelines, using the Bronze- Silver-Gold architecture

• Develop and optimise dataflows that support dashboards, reporting and analytics across the business

Data transformation and curation

• Develop transformation logic that cleans, validates, enriches, and models data for consistency and usability

• Build curated datasets using consistent naming conventions, semantic layers and star-schema modelling

• Drive a transformation-first mindset to support automated reporting, predictive models, and enhanced analytics Quality, governance and documentation

• Maintain high levels of data accuracy, completeness, timeliness, and lineage

• Maintain technical documentation including schemas, data dictionaries and process flows

• Champion strong data governance, ensuring secure and compliant handling of data assets

DevOps, Source Control and CI/CD

• Use Gitbased source control for pipelines and reusable components

• Work with CI/CD pipelines (Azure DevOps preferred) to automate deployment and testing of data artefacts

• Follow structured versioning and change management practices to ensure high-quality releases.

Collaboration and ways of working

• Partner with BI, governance colleagues and business stakeholders to ensure data is available and fit for purpose

• Participate in testing, validation, and continuous improvement of new and existing datasets

• Communicate clearly with both technical and non-technical colleagues

• Take proactive ownership of workload, including prioritisation, estimation, and delivery commitments.

Innovation and continuous improvement

• Explore new technologies, including AI assisted engineering, to enhance data solutions and reduce manual processes

• Identify optimisation opportunities across pipelines, architecture, and developer experience

• Embrace iteration and evolution; Contribute to evolving standards and approaches as the platform grows.

• Proven experience as a Data Engineer with hands-on ETL/ELT development and data integration work

• Strong knowledge of Azure Data Factory, Azure Data Lake and the Microsoft data ecosystem

• Experience working with layered data architectures (Bronze/Silver/Gold) and transformation best practice

• Proficiency in T-SQL, data modelling and pipeline design

• Good understanding of data governance, security and compliance principles

• Experience using Git and CI/CD pipelines (ideally Azure DevOps)

• Ability to work independently while collaborating effectively with cross-functional teams.

Desirable

• Experience with AI-assisted engineering or automation tools

• Experience optimising data pipelines, architectures or developer workflows

• Familiarity with star-schema modelling, semantic layers or advanced analytics environments

• Welsh language skills

Job Types: Full-time, Permanent

Pay: £45,000.00 per year

Benefits:

• Casual dress
• Company events
• Company pension
• Health & wellbeing programme
• On-site parking

Ability to commute/relocate:

• Caerphilly CF83 2AX: reliably commute or plan to relocate before starting work (required)

Work authorisation:

• United Kingdom (required)