Data Engineer

Active Care Group
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote

Tech stack

Query Performance
Sql Data Warehouse
API
Azure
Business Intelligence
Google BigQuery
Cloud Computing
Information Engineering
Data Integration
ETL
Data Security
Data Warehousing
Relational Databases
Python
Operational Databases
Standard Sql
SharePoint
Software Engineering
Talend
Scripting (Bash/Python/Go/Ruby)
File Transfer Protocol (FTP)
Microsoft Power Automate
Snowflake
Kubernetes
Api Design
REST
Data Pipelines

Job description

We are looking for a Data Engineer to join our small development team and take ownership of the data pipelines and integrations that underpin reporting and operations across the business. You will work closely with the Head of Software Engineering, building and maintaining the systems that move data from a wide range of source platforms into our Snowflake data warehouse, and supporting the applications that depend on it.

This is a hands-on role with significant autonomy. As the dedicated data engineer in the team, you will own work end to end: from investigating a new source system and designing the integration, through to building, testing, scheduling and supporting it in production. The estate is broad and the work is varied, so we are looking for someone who is confident working independently and getting to the bottom of things.

Where you'll be working:

This role is full time, 37.5 hours per week. The role is remote with occasional travel to London.

What you'll be doing:

  • Build, maintain and monitor data pipelines that ingest data from a wide range of source systems into the Snowflake data warehouse, using both scheduled batch and API-based methods.
  • Design and deliver new integrations end to end, including source investigation, data modelling, development, testing and production scheduling.
  • Investigate and resolve pipeline failures and data quality issues, identifying root cause from logs and evidence.
  • Maintain and improve existing ETL jobs, including load strategy, scheduling, performance and warehouse cost management.
  • Work independently and with BI developers to develop and support the data models that feed reporting and internal applications, ensuring accuracy and reliability.
  • Contribute to wider engineering and infrastructure activity, including cloud-hosted services and data security and compliance work.
  • Document pipelines and integrations to support maintainability and handover within the team.

Requirements

Do you have experience in Talend?, * Demonstrable commercial experience designing and maintaining production data pipelines, ideally against a cloud data warehouse such as Snowflake, BigQuery or Redshift.

  • Strong SQL, including the ability to reason about load strategy and query performance.
  • Proficiency in Python for data engineering, including API integration, scripting and orchestration.
  • Experience integrating data from a variety of sources, including relational databases, REST APIs and file-based feeds (CSV, SFTP).
  • Strong problem solving and diagnostic skills, with the ability to investigate issues and propose clear solutions.
  • The ability to work independently and own deliverables in a small team.
  • Excellent written and verbal communication.

Desirable skills and experience

  • Experience with Talend or a comparable ETL tool such as Matillion.
  • Experience with Talend Management Cloud or similar orchestration frameworks.
  • Experience with Microsoft Azure, especially Logic Apps.
  • Experience with the Microsoft Graph API, SharePoint or Power Automate.
  • Awareness of data security and compliance frameworks.
  • Experience working in a regulated sector such as healthcare, social care or finance.

Benefits & conditions

Pulled from the full job description

  • Referral programme
  • Employee assistance programme
  • Company pension, * 25 days plus bank holidays
  • Birthday off
  • Join the Active Learning Hub and benefit from a wide range of e learning and face to face training and development opportunities
  • Active Reward App giving discounts and savings on your weekly shop
  • Free 24 hour confidential Employee Assistance Programme Helpline & App to support with legal, health, wellbeing, relationship and consumer advice
  • A Nest Personal Pension account
  • Access to join a Medicash Health Plan for you and your family to save money on everyday health essentials - like going to the dentist or opticians
  • We recognise outstanding Active Behaviours via the Active Awards programme
  • Enhanced Sick & Maternity Pay benefits
  • Refer a Friend Scheme and earn yourself up to £1500 by recommending someone you know
  • ……and, of course, the support and guidance of our qualified clinical and business leadership teams so that you can really develop your career with Active Care Group

About the company

Come and join one of the UK's largest providers in complex care. We proudly employ over 4000+ people - no matter what your experience, we have jobs for everyone.

Apply for this position