Data Engineer

Somerset Council
3 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 42K

Job location

Remote

Tech stack

Business Systems
Cloud Computing
Continuous Integration
Information Engineering
Data Governance
JSON
Python
Role-Based Access Control
Power BI
SQL Databases
Data Streaming
Microsoft Fabric
Information Technology
Data Pipelines

Job description

  • Secondments considered for internal applicants, please discuss with your Line Manager before applying.

  • This role is a unique learning opportunity for anyone passionate about advancing their skills in artificial intelligence and agentic systems. Whether you are new to AI or looking to deepen your expertise, you will benefit from hands-on experience, tailored training, and dedicated mentoring. We are committed to supporting your professional growth, helping you develop the technical and strategic capabilities needed to thrive in this fast-evolving field., We're working to improve the lives of people in Somerset - and you'll be a key part of that. Your day-to-day work will involve:

  • Build and run reliable data pipelines on Microsoft Fabric You will design and operate repeatable ingestion patterns from our core business systems and trusted external sources. You will implement incremental loads, manage schema change, and orchestrate flows into OneLake across bronze, silver and gold style layers. You will write clean and well documented code, keep data moving on schedule, and resolve issues quickly so colleagues across the organisation can depend on timely data.

  • Shape high quality data models and products You will model entities and relationships, define clear data contracts, and publish curated tables and views that are easy to discover and reuse. You will build semantic models for Power BI with standardised definitions and measures so analysts and service teams can answer questions without rebuilding logic each time.

  • Embed governance security and data quality from the start You will implement validation rules for completeness accuracy and timeliness, monitor data quality, and document lineage in Microsoft Purview so teams can see how data flows from source to insight. You will apply role based access control, manage secrets with Key Vault, and follow information governance and GDPR requirements so sensitive data stays protected and useful.

  • Work closely with analysts service leads and system owners to deliver outcomes You will turn goals into technical work, iterate in small steps, and communicate progress clearly. You will collaborate across ICT analytics and operational services, contribute to shared engineering standards and reviews, and produce run books and handovers that help colleagues support and extend what you build.

  • Modernise and improve the platform continuously You will help migrate legacy data flows and reports into Fabric, simplify overlapping pathways, and improve performance reliability and cost efficiency. You will automate testing and release through CI/CD, stay current with modern data practices, and share learning through our community of practice.

Requirements

We offer ongoing support, training and guidance to help you be the best you can be. This post is ideal for candidates who are keen to grow their skills in modern data engineering and cloud technologies. You do not need prior experience with every tool we use; what matters most is a solid foundation in Python and SQL, an understanding of data principles, and a strong appetite to learn and develop in this fast-moving field.

We offer ongoing support, training and guidance to help you be the best you can be. But it will really help if you:

  • Have experience building and maintaining data pipelines using Python, SQL, and JSON.
  • Understand cloud platforms (especially Microsoft Fabric), lakehouses, and medallion architecture.
  • Know your way around data governance, privacy regulations (GDPR), and secure-by-design principles.
  • Can translate business needs into technical solutions across cross-functional teams.
  • Hold a degree in Computer Science, Engineering, or a related field - and ideally a cloud data engineering certification.

Benefits & conditions

We offer great training and development opportunities, with supportive management. As well as this, we have some fantastic employee benefits available:

  • We promote a healthy work-life balance and offer flexible working arrangements wherever possible, including working from home.
  • Generous annual leave allowance, with the opportunity to purchase additional leave
  • Staff discounts in gyms.
  • Employee Assistance for the times you may need some support and a variety of employee wellbeing services.
  • Auto enrolment onto our generous Pension Scheme and optional pension enhancement through our Additional Voluntary Contribution scheme.
  • A Flexible Benefits Scheme via salary sacrifice to obtain a cycle for work and health screenings.
  • My Staff Shop offering discounts in shops, online shopping, restaurants, cinema tickets, insurance benefits and more, The salary for this role is £37,280 - £41,771 per annum.

Apply for this position