Associate Data Engineer

• Support the development, maintenance, and monitoring of data pipelines across Azure Databricks using SQL and Python (PySpark)
• Identify and troubleshoot pipeline issues, including performance, failures, and data quality concerns
• Apply data quality checks, validation routines, and basic testing to ensure reliable data output
• Use data modelling principles (e.g. dimensional modelling) to support scalable reporting and analytics
• Collaborate with BI teams and stakeholders to deliver accurate data for Power BI reporting
• Contribute to onboarding new data sources and improving data pipeline architecture and stability
• Follow best practices in documentation, code development, version control, and data governance

• Working knowledge of Azure Databricks and Python (with exposure to PySpark) for supporting data pipelines
• Strong SQL skills for querying, validating and troubleshooting data
• Understanding of data pipeline architecture (ingestion, transformation, delivery)
• Familiarity with data modelling concepts (e.g. Dimensional modelling, fact/dimension tables)
• Ability to apply data quality checks, validation and basic testing
• Structure approach to troubleshooting, with clear documentation and effective stakeholder collaboration

In March 2021, Correla was created, as an independently owned business to bring in private investment to fuel innovation in the centre of the energy market and beyond. Correla is derived from correlation, because we're all about exploring and enhancing relationships between data, people, and processes. Our SaaS products and Managed Service solutions combine to power industry innovation, simplify an increasingly complex market, and deliver cost and operational efficiencies. Our goal is to support industry transformation, to move to a net-zero future and to positively impact the end-consumer., At Correla, we are committed to working towards being a more diverse and inclusive workplace where our people can truly be themselves. We recognise the benefits of having talented people from a range of backgrounds and cultures who bring different perspectives, life experiences and diversity of thinking. Our aim is to attract and retain the very best diverse talent to help create an exciting, innovative, and successful business that enables us to deliver an exceptional experience for our customers. We would therefore like to encourage applications from people with varied skillsets and experience and from different backgrounds and sectors to help shape our future.