Data Engineer

As part of this growth, the business is looking to appoint a Data Engineer to join its expanding Data team. This is an excellent opportunity for a Data Engineer with experience in modern cloud data platforms to play a key role in developing and enhancing a scalable, data-driven environment built around Databricks and Azure technologies.

Working closely with stakeholders across technology and the wider business, you will be responsible for designing, developing and maintaining data pipelines, transforming and integrating data from multiple sources and supporting the delivery of high-quality datasets for reporting and analytics. You will have the opportunity to work with cutting-edge technologies within a collaborative team environment while continuing to develop your technical expertise.

This role would suit a Data Engineer who enjoys building robust data solutions, working with large datasets and contributing to the ongoing evolution of a modern cloud data platform., * Design, build and maintain scalable data pipelines using Databricks and Azure technologies

• Develop and optimise ETL processes to support reporting, analytics and business intelligence requirements
• Work with structured and unstructured data from a variety of internal and external sources
• Support the development and maintenance of data models and data warehouse solutions
• Collaborate with analysts, engineers and business stakeholders to deliver data-driven solutions
• Monitor, troubleshoot and improve data pipeline performance and reliability
• Produce and maintain technical documentation and adhere to engineering best practices

• Commercial experience working with Databricks in a data engineering capacity
• Strong SQL development and data manipulation skills
• Experience building and supporting cloud-based data pipelines within Azure environments
• Knowledge of Azure Data Factory, Azure Data Lake or related Azure data services
• Experience developing ETL processes and data integration solutions
• Understanding of data warehousing principles and modern data architectures
• Experience with Python, PySpark or Spark is highly desirable
• Strong problem-solving skills and ability to work collaboratively within a team environment

• Salary of up to £60,000
• Hybrid working model with offices in Cardiff
• Opportunity to work with modern data technologies including Databricks and Azure
• Ongoing training and professional development opportunities
• Collaborative and supportive team culture
• Clear career progression within a growing data function