Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+12 more
Job description
We are looking for a Data Engineer to join our small development team and take ownership of the data pipelines and integrations that underpin reporting and operations across the business. You will work closely with the Head of Software Engineering, building and maintaining the systems that move data from a wide range of source platforms into our Snowflake data warehouse, and feeding into applications that depend on it. There is a heavy focus on integration and data movement, this is not a BI/Data analyst-type role it is more leaning into extracting and loading data so experience with APIs, backend systems and data extraction using code is required.
This is a hands-on role with significant autonomy. As the dedicated data engineer in the team, you will own work end to end: from investigating a new source system and designing the integration, through to building, testing, scheduling and supporting it in production. The estate is broad and the work is varied, so we are looking for someone who is confident working independently and getting to the bottom of things. We are willing to provide good mentorship and training for the right candidate, progressing your career through to senior level with the chance to learn using cutting edge technologies and under the wing of an experienced in-house developer. Experience with the specific products matters less than strong, transferable data engineering skills and a willingness to pick up and run with new ingestions and solve problems.
What you’ll be working:
- Monday - Friday
- Dayshift
- Remote, with occasional travel to London
What you’ll be doing:
- Build, maintain and monitor data pipelines that ingest data from a wide range of source systems into the Snowflake data warehouse, using both scheduled batch and API-based methods.
- Design and deliver new integrations end to end, including source investigation, coding, testing and production scheduling.
- Investigate and resolve pipeline failures and data ingestion issues, identifying root cause from logs and evidence.
- Maintain and improve existing ETL jobs, including load strategy, scheduling, performance and warehouse cost management.
- Work independently and with BI developers to feed reporting and internal applications, ensuring accuracy and reliability.
- Contribute to wider engineering and infrastructure activity, including cloud-hosted services and data security and compliance work.
- Document pipelines and integrations to support maintainability and handover within the team.
Requirements
- Demonstrable experience designing and maintaining production data pipelines, against a cloud data warehouse such as Snowflake.
- Strong SQL including ability to provide support for BI developers
- Proficiency in Python for data engineering, including API integration, scripting and orchestration. Prefect is highly desirable.
- Experience integrating data from a variety of sources, including relational databases, REST APIs and file-based feeds (CSV, SFTP). REST API experience and good knowledge of Postman/Apidog etc is highly desirable
- Strong problem solving and diagnostic skills, with the ability to investigate issues and propose clear solutions.
- The ability to work independently and own deliverables in a small team.
- Excellent written and verbal communication.
Our current data stack includes Snowflake (primary data warehouse), Talend (ETL), Azure Logic Apps and Python/Prefect across ingestion and scripting. We integrate with a broad set of source systems spanning reporting, HR and payroll, electronic care records, rostering, recruitment, care planning, finance and service management.
Benefits & conditions
We would particularly welcome a brief example of a data pipeline or integration you have owned from end to end, including any significant problem you diagnosed and resolved.
What to look forward to:
- 25 days plus bank holidays
- Birthday off
- Join the Benefits Hub and benefit from a wide range of e learning and face to face training and development opportunities
- Active Reward App giving discounts and savings on your weekly shop
- Free 24 hour confidential Employee Assistance Programme Helpline & App to support with legal, health, wellbeing, relationship and consumer advice
- A Nest Personal Pension account
- Access to join a Medicash Health Plan for you and your family to save money on everyday health essentials - like going to the dentist or opticians
- We recognise outstanding Active Behaviours via the Active Awards programme
- Enhanced Sick & Maternity Pay benefits
- Refer a Friend Scheme and earn yourself up to £1500 by recommending someone you know
- ……and, of course, the support and guidance of our qualified clinical and business leadership teams so that you can really develop your career with Active Care Group
About the company
Come and join one of the UK’s largest providers in complex care. We proudly employ over 4000+ people - no matter what your experience, we have jobs for everyone.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
Making Data Warehouses Fast: A Developer’s Story
Highest Paying Tech Companies for Developers
Software Engineer Salary London