Data Engineer
Role details
Job location
Tech stack
Job description
We are looking for a Data Engineer to join our small development team and take ownership of the data pipelines and integrations that underpin reporting and operations across the business. You will work closely with the Head of Software Engineering, building and maintaining the systems that move data from a wide range of source platforms into our Snowflake data warehouse, and supporting the applications that depend on it.
This is a hands-on role with significant autonomy. As the dedicated data engineer in the team, you will own work end to end: from investigating a new source system and designing the integration, through to building, testing, scheduling and supporting it in production. The estate is broad and the work is varied, so we are looking for someone who is confident working independently and getting to the bottom of things.
Where you'll be working:
This role is full time, 37.5 hours per week. The role is remote with occasional travel to London.
What you'll be doing:
- Build, maintain and monitor data pipelines that ingest data from a wide range of source systems into the Snowflake data warehouse, using both scheduled batch and API-based methods.
- Design and deliver new integrations end to end, including source investigation, data modelling, development, testing and production scheduling.
- Investigate and resolve pipeline failures and data quality issues, identifying root cause from logs and evidence.
- Maintain and improve existing ETL jobs, including load strategy, scheduling, performance and warehouse cost management.
- Work independently and with BI developers to develop and support the data models that feed reporting and internal applications, ensuring accuracy and reliability.
- Contribute to wider engineering and infrastructure activity, including cloud-hosted services and data security and compliance work.
- Document pipelines and integrations to support maintainability and handover within the team.
Requirements
Do you have experience in Talend?, * Demonstrable commercial experience designing and maintaining production data pipelines, ideally against a cloud data warehouse such as Snowflake, BigQuery or Redshift.
- Strong SQL, including the ability to reason about load strategy and query performance.
- Proficiency in Python for data engineering, including API integration, scripting and orchestration.
- Experience integrating data from a variety of sources, including relational databases, REST APIs and file-based feeds (CSV, SFTP).
- Strong problem solving and diagnostic skills, with the ability to investigate issues and propose clear solutions.
- The ability to work independently and own deliverables in a small team.
- Excellent written and verbal communication.
Desirable skills and experience
- Experience with Talend or a comparable ETL tool such as Matillion.
- Experience with Talend Management Cloud or similar orchestration frameworks.
- Experience with Microsoft Azure, especially Logic Apps.
- Experience with the Microsoft Graph API, SharePoint or Power Automate.
- Awareness of data security and compliance frameworks.
- Experience working in a regulated sector such as healthcare, social care or finance.
Benefits & conditions
Pulled from the full job description
- Referral programme
- Employee assistance programme
- Company pension, * 25 days plus bank holidays
- Birthday off
- Join the Active Learning Hub and benefit from a wide range of e learning and face to face training and development opportunities
- Active Reward App giving discounts and savings on your weekly shop
- Free 24 hour confidential Employee Assistance Programme Helpline & App to support with legal, health, wellbeing, relationship and consumer advice
- A Nest Personal Pension account
- Access to join a Medicash Health Plan for you and your family to save money on everyday health essentials - like going to the dentist or opticians
- We recognise outstanding Active Behaviours via the Active Awards programme
- Enhanced Sick & Maternity Pay benefits
- Refer a Friend Scheme and earn yourself up to £1500 by recommending someone you know
- ……and, of course, the support and guidance of our qualified clinical and business leadership teams so that you can really develop your career with Active Care Group