Junior Data Engineer
Role details
Job location
Tech stack
Job description
As part of the Backend Engineering function and reporting to the Data Engineering Tech Lead, the Junior Data Engineer will be working on engineering and maintaining clients' ETL processes and other data pipelines. As Smart's client base grows we will be delivering data pipelines for each client who requires it. This is an opportunity to be involved in the design, deployment and maintenance of data pipeline solutions across multiple clients.
As a Junior Data Engineer you'll get a kick out of interacting with data in all its forms. More importantly, you get excited by the prospect of using data to solve problems. If you can use your skills to solve a business problem, that's a great day's work for you. You will need to be able to talk to techies and non-techies alike and make suggestions about solutions to problems that can be understood and implemented. Smart strives to provide a comfortable, relaxed working environment and the Data Engineering team is no different. We take great pride in our work and strive to hit sometimes challenging deadlines but we like to make sure that people are enjoying their work as we do it. This is not an easy balance to strike but being open and honest with each other is an important step in the right direction.
The Data Engineering team is accountable for:
- Maintenance of the UK SPMT Data Warehouse and associated ETL routines
- Maintenance of the underlying data for BI reports and dashboards, used throughout the organisation
- Data engineering support when migrating large new clients onto Smart's Keystone platform
- Validating significant changes to system functionality, particularly in relation to those that might impact members' pension holdings
- Maintaining client data extracts which integrate with some of our clients' systems
- Implementing new and/or improved data pipelines which help expand core Keystone functionality, empowering users with more immediate and direct access to critical data
What you will do:
- Implementing new data pipelines for new or existing clients
- Maintaining existing data pipelines and handling errors as necessary
- Evaluating the existing data warehouse solution to recommend updates and integration requirements to improve our ways of working
- Impact assessing change requests, ensuring that changes don't break existing workflows
- Supporting the other Data Engineers in reviewing code changes, debugging errors and pair-coding to implement new client requirements
Requirements
Do you have experience in SQL?, The skills, experience and aptitudes we are looking for are listed below but please don't be discouraged from applying if you don't meet every single one of these criteria - having a 'can do' attitude is sometimes more important than being able to tick every box:
- 2+ years' experience in data engineering;
- Developing with Python (>= v3.9);
- Maintaining a dbt_core project;
- Working in an Apache Airflow environment;
- Database development experience, preferably in AWS Redshift but any database experience is good;
- Working knowledge of SQL.
Nice to have technical skills:
- Working with APIs to ingest data into databases;
- Experience working with AWS services.
Benefits & conditions
At Smart, one of the eight principles we work to is "We want happy and good people in our team". We created a list of benefits that helps us achieve this goal:
- 25 days' holiday per year, increasing with length of service.
- £500 annual training budget to spend on your professional development
- Extensive private healthcare, including dental, eyecare and EAP
- Enhanced sick leave (three months' pay per year)
- Enhanced maternity and paternity (maternity - 6 months fully paid/paternity - 3 weeks fully paid)
- Death in service insurance cover
- Fully-paid five-week sabbatical after five years of employment
- In office wellbeing, such as manicures, massages and barbers.
- Smart employees also enjoy a 50% discount on orders from our sister company Arena Flowers, Britain's most ethical florist. They offer unique hand-tied bouquets, luxury flowers, letterbox flowers, plants and gifts to spend on friends and loved ones or even for yourself.
At Smart, we are committed to creating an inclusive and equitable workplace where everyone feels valued, respected, and empowered to do their best work.