Data Engineer
Role details
Job location
Tech stack
Job description
As a Data Engineer, you have the incredible opportunity to shape the future of SSEN Distribution's data ecosystem by developing, operating, and optimising Microsoft Azure data integration solutions. Your work in delivering robust data pipelines ensures that curated data is readily available for those who rely on it, empowering business analysts, data scientists, and reporting specialists with easy access to organisational data., * Develop and enhance data integration solutions using Azure, Databricks, and the existing data engineering framework.
- Design and build high-frequency, high-volume streaming data pipelines, including support for LLM/AI solutions.
- Drive operational improvements by streamlining reusable assets and accelerating development cycles.
- Ensure CI/CD best practices and change control processes are followed from development to production.
- Collaborate on architecture design and integration with various source and target systems to mature platform capabilities.
Requirements
Do you have experience in Machine learning?, * Extensive experience with the Microsoft Azure Platform, Databricks, and Machine Learning will be a plus
- Excellent communications & stakeholder management skills - the ability to drive value via end-to-end ownership of business use cases related problems
- Experience with high-frequency high-volume signal data (or comparable datasets), event hub, anomaly detection - proven use case examples in this area
- Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats & structures
- A strong background in delivering using cloud-based Microsoft Azure Data and Analytics capabilities, Microsoft DevOps and Agile delivery
Benefits & conditions
Pulled from the full job description
- Employee discount
- Gym membership
- Private medical insurance
- Cycle to work scheme
- Discounted gym membership, Salary: £35,200 - £52,800 + performance-related bonus and a range of benefits to support your finances, wellbeing and family.
Working Pattern: Permanent | Full Time | Flexible First options available, Enjoy discounts on private healthcare and gym memberships. Wellbeing benefits like a free online GP and 24/7 counselling service. Interest-free loans on tech and transport season tickets, or a new bike with our Cycle to Work scheme. As well as generous family entitlements such as maternity and adoption pay, and paternity leave.