Data Engineer

• Translating architectural designs into high-quality, low-level technical documentation.
• Partnering with cloud infrastructure and development teams to deliver robust solutions.
• Working within an established SDLC to ensure quality, consistency and control.
• Collaborating with analysts and system owners to define data extraction and transformation rules, including interface contracts.
• Supporting data modelling initiatives and maintaining transformation logic.
• Building ETL/ELT batch and micro-batch pipelines.
• Developing modelled data sources and products in Snowflake for end-users.
• Maintaining metadata, enforcing data quality and defining platform standards.
• Administering the cloud data platform.
• Designing and implementing Real Time streaming pipelines using AWS Kinesis, Firehose, and Kafka (MSK).

• Hands-on experience delivering ETL/ELT pipelines.
• Experience with transformation tooling such as dbt.
• Strong proficiency in SQL and Python.
• Deep understanding of Snowflake and modern data platform principles.
• Knowledge of cloud-based data architectures (lakes, Lakehouses, warehouses).
• Familiarity with AWS services
• Understanding of Lakehouse storage formats
• Working knowledge of data modelling methodologies
• Excellent communication skills and the ability to tailor messages for technical and non-technical audiences.
• Strong documentation skills, including LLDS and runbooks.

Desirable Experience

• Streaming technologies (Kinesis, Firehose, Kafka, Flink).
• Infrastructure-as-Code tools such as CloudFormation or Terraform.
• AWS Data Engineer certification.
• A relevant degree or equivalent experience.

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.