Data Engineer - Streaming

This role is a key hire for the business, and would be joining a strong team of individual contributors who work in a highly flexible environment.Experience & Technical Skills

The successful candidate will have experience across a number of the following areas:

• Strong SQL skills with the ability to write and optimise complex queries.
• Commercial experience developing data solutions using Python.
• Experience designing, building and maintaining scalable data pipelines.
• Strong experience with Apache-based streaming and distributed data processing technologies, including tools such as Apache Kafka, Apache Spark (Structured Streaming) or similar Real Time data processing frameworks.
• Experience building both batch and Real Time data processing solutions.
• Good understanding of data warehousing concepts, dimensional modelling and data governance.
• Experience working with relational databases such as PostgreSQL, MySQL or similar.
• Exposure to cloud-based data platforms and infrastructure-as-code practices.
• Experience using Git, CI/CD pipelines and containerisation technologies such as Docker or Kubernetes.
• Strong troubleshooting and performance optimisation skills across data platforms.
• Excellent communication skills with the ability to work collaboratively across engineering and business teams.

Desirable Experience

• Experience working with event-driven architectures and streaming data platforms.
• Exposure to technologies such as Apache Airflow, Dagster or other workflow orchestration tools.
• Experience with analytical databases such as ClickHouse or similar.
• Familiarity with Business Intelligence platforms and data visualisation tools.
• Experience working within large-scale, data-intensive or regulated environments.
• Knowledge of GraphQL, metadata management or data catalogue solutions.