Data Pipeline Engineer

The Data team is the backbone of the businesses data driven operations. Architects of the data infrastructure to implement and measure the impact of strategy projects and inform how the next generation of the data platform is developed.

You will provide remote technical expertise to client data pipelines into a premium data analytics tool. You are the first to respond to data health failures on key pipelines.

You are technical, with passion for systems and technical teams. Youre comfortable with reading and writing code to identify fixes, making changes and develop systems. Your insights into the product and process will form an essential part of development with theproduct engineering team., * Build and maintain schedules so that pipelines run effectively

• Setting up and maintaining health checks on different pipelines
• Identify, respond, triage, and debug the pipeline when it is broken
• Reading code and writing code changes and/or modifying the monitoring set-up where necessary
• Communicate insights in a way that resonates with partners, wider team, and leadership turn theory into action.
• Communicating outages with the end users of a pipeline
• Contributing to improvements wider systems and monitoring tooling
• On call pager model to cover weekends with time off if weekend covered

Do you have experience in Spark?, * Be comfortable with code for ETL in Python.

• Have a basic understanding of Spark and familiar/interested in learning the basics of tuning Spark jobs.
• Have experience developing and supporting data integration technologies
• Have strong written and verbal communication skills with the ability to skilfully engage with customers on complex topics

Essential:

• Data Analytics knowledge
• Technical ability
• Strong communications and problem-solving skills
• Comfortable with code for ETL in Python

Exceptional training and benefits package we offer a £5,000 a year training budget to help you grow and develop professionally.