Data Engineer

I am currently supporting a well known business in their search for a Data Engineer. The purpose of this role will be to design and build data infrastructure for efficient ETL from diverse sources, including integration and maintenance of analytics tools and ongoing pipeline monitoring and performance optimisation. This sits within the IT Department and has specific responsibilities to Business intelligence.

Data Engineer duties:

• Own and manage the end-to-end data flow lifecycle.
• Design, configure, and maintain data pipelines, platforms, and source systems.
• Integrate, test, and validate new software and technical solutions.
• Ensure the stability, monitoring, and performance optimization of data pipelines.
• Provide technical leadership to support the effective delivery of technical solutions.
• Collaborate with partners, agencies, and business stakeholders to identify, develop, and implement solutions that address data quality issues.
• Support existing business systems and BI solutions through the Service Desk as required.

• Proven capability to understand complex business challenges, challenge assumed solutions and anticipate future business models and evolving technology landscapes.
• Strong attention to detail, with the ability to identify and resolve data anomalies and clearly communicate insights to business stakeholders.
• Broad knowledge of enterprise IT solutions and data models within manufacturing and distribution environments.
• Extensive experience with leading BI technologies, including SSIS, SSRS, SSAS, Power BI, Azure SQL Data Warehouse, Azure Data Factory, and related platforms.
• Advanced T-SQL programming expertise.
• Deep understanding of both SQL and NoSQL database technologies.
• Desirable experience with Python and/or R programming.
• Desirable knowledge of Microsoft ERP systems and data, including Dynamics 365 (D365).
• Experience working within structured project delivery frameworks such as Agile, Kanban, and PRINCE2.