Data Engineer (18 Months FTC)

London Borough of Barnet
London, United Kingdom
2 days ago

Role details

Contract type
Temporary contract
Employment type
Part-time (≤ 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote
London, United Kingdom

Tech stack

API
Artificial Intelligence
Azure
Cloud Computing
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Systems
Data Warehousing
Information Management
Python
Machine Learning
Metadata Repositories
Operational Databases
SQL Databases
Data Streaming
Systems Integration
Feature Engineering
Snowflake
Spark
Data Strategy
Operational Systems
Data Management
Azure
Data Pipelines
Databricks

Job description

This is an exciting time to join Barnet as we grow our Digital, Data and Technology (DDaT) capabilities and accelerate our digital transformation journey. We're investing in smarter services, better use of data, modern technology, and you'll play a key part in shaping this future., We're looking for a Data Engineer to join our Insight & Intelligence Hub, working with a talented team to help design, build and maintain the data infrastructure that powers our analytics, AI and insight functions. You'll work across the organisation to integrate complex datasets, improve data quality, and create robust data pipelines that enable our analysts and data scientists to deliver highvalue insight for services and residents. This is a handson technical role where you'll work with modern cloud technologies, largescale data systems and cuttingedge tools to support predictive analytics, machine learning initiatives and enterprise reporting. If you're excited by engineering challenge, modern data platforms and solving realworld problems, you'll be a great fit. This is a hybrid role. You will be expected to attend monthly in-person team days in our Colindale office. We also come into the office to meet service stakeholders, work together on collaboration, discovery and user testing sessions and department days. Please click here to download the Job description for this role., Develop and maintain the council's Microsoft Azure Data Platform, supporting cloudready, scalable analytics.

  • Build and optimise data pipelines, APIs and integrations across onpremise, cloud and supplierhosted systems.
  • Extract, clean, transform and combine data from a wide range of operational systems to create highquality datasets for insight and machine learning.
  • Work with data scientists to design and maintain pipelines for AI/ML models, including supporting feature engineering, labelling and largescale data flows.
  • Automate manual data processes to improve speed, reliability and accessibility of insight.
  • Lead data engineering projects, including working with external suppliers and supporting more junior colleagues.
  • Implement and maintain data lakehouse architectures, master data management and metadata repositories.
  • Ensure that data workflows comply with security, privacy and governance standards, including anonymisation where required.
  • Optimise the performance of code, pipelines and data systems, resolving issues, bugs and outages.
  • Contribute to the development of data strategy, standards and reusable engineering frameworks across the Hub.
  • Work with colleagues across ICT, Connected Places and service teams to join up data and support emerging technologies (e.g., IoT, geospatial, AI).
  • Support the creation of visualisations and reusable analytical products that enhance decisionmaking. You'll be part of a forwardlooking team that values continuous learning, experimentation and innovation, helping Barnet fully unlock the power of its data.

Requirements

You're an experienced and adaptable data engineering professional who enjoys creating welldesigned, efficient and reliable data solutions. You're comfortable working with complex systems, experimenting with new tools and collaborating with colleagues across technical and nontechnical teams.

You will bring:

  • Strong handson experience with modern data engineering tools and practices, including ETL/ELT, data warehousing and data modelling.
  • Expertise in cloud data platforms, ideally Azure services such as Data Factory, Synapse, Databricks, Spark or Snowflake.
  • Proficiency in Python, SQL and other relevant languages for building pipelines and enabling automation.
  • Experience building and managing production data services, integrating data from multiple systems, and improving data quality.
  • Understanding of data governance, security, information management and UK GDPR.
  • The ability to communicate complex technical concepts clearly for nonspecialist audiences.
  • A collaborative and proactive approach, with confidence leading projects, supporting partners and driving continuous improvement. If you enjoy solving complex data challenges and playing a leading role in a growing data function, this is an excellent opportunity.

Benefits & conditions

What we offer

  • 31 days annual leave, plus public and bank holidays
  • Access to the Local Government Pension Scheme, which provides a valuable guaranteed income in your retirement together with security for your dependents
  • Work-life balance options may include hybrid working, flexitime, job share, home working, part-time
  • A vast range of lifestyle discounts from major retailers, supermarkets, energy suppliers and more
  • Broad range of payroll benefits including cycle to work, eye care vouchers, travel and gym membership
  • Excellent training and development opportunities
  • Employee well- being training programs including confidential employee assistance

About the company

About Barnet Council Barnet is a borough with much to be proud of. Our excellent schools, vibrant town centres, vast green spaces and diverse communities all help make it a great place to live and work. As a council we want to build on these strengths as we move into the future. We are growing and developing as an organisation to meet the challenges facing our borough and we are committed to working with partner organisations and residents to make Barnet even better. As an organisation, our staff are committed to Our Values: Learning to Improve, Caring, Inclusive, Collaborative - which drive everything we do.

Apply for this position