Data Engineer

In this exciting role as a Data Engineer, you’ll play a pivotal role in ensuring OurCoop maximises value from its data assets through the delivery of scalable, secure and reliable data platforms.

You will be responsible for the design, development and operation of data pipelines and architecture that underpin reporting, analytics, AI and data-driven decision-making across the Society. You will drive engineering excellence, platform innovation and continuous improvement while supporting the organisation’s wider data strategy.

Collaborating with the wider Data & Analytics team of managers, engineers and developers, you’ll apply your technical expertise to design and deliver trusted data products and services.

Design, adapt and maintain ETL/ELT processes that ingest, cleanse, transform and structure data, ensuring they remain aligned to changing business requirements, source system changes and data quality standards.

You will demonstrate a knowledge of the structure and meaning of data in both internal and external sources, and help create logical and physical operational data stores, staging areas, models, analytical datasets and data products.

As well as helping to shape the data and analytics strategy, you’ll apply your technical skills and knowledge to design, deliver and implement data solutions, applying industry and team best practices and governance.

Due to the nature of the role, you’ll need a strong working knowledge of the Microsoft technology stack in the data and analytics area including Fabric, Lakehouse Medallion Architecture, ADF, PySpark Notebooks, Azure Data Lake and Storage, and Synapse. We are looking for someone who is a problem solver and who can demonstrate:

• Strong expertise in SQL, Python, PySpark and building data pipelines in Microsoft Fabric technologies.
• Experience designing and operating enterprise data platforms and data warehouses.
• A solid understanding of data concepts and data modelling principles, applied across traditional warehousing and modern data lakes.
• Practical experience using Microsoft Azure DevOps and CI/CD.
• Experience delivering ETL/ELT solutions and modern data architectures.
• Strong understanding of data modelling approaches including Kimball and Medallion architectures.
• Experience implementing data governance, security and quality controls.

Desirable, but not a requirement:

• Experience developing solutions using the wider Microsoft Power Platform (Power BI, Power Apps, Power Automate).
• Experience with dbt, Airflow or equivalent orchestration tools.
• Experience supporting AI, machine learning or advanced analytics platforms.
• Knowledge of Data Mesh principles.
• Experience working within agile delivery frameworks.
• Experience building Azure Functions.

Pulled from the full job description

• Annual leave
• Employee discount
• Enhanced paternity leave