Senior Data Engineer
Role details
Job location
Tech stack
Job description
At the heart of our Data Team, Data Engineers play a pivotal role by creating pipelines and tables that power impactful dashboards, enable self-service analytics, and support innovative machine learning models and real-time data products.
As a Data Engineer, you will be involved in engineering pipelines that will drive key decisions and give data science powerful datasets to enable and drive new business insights.
Data Engineers work alongside Machine Learning Engineers, BI Developers and Data Scientists in cross-functional teams with key impacts and visions. As a department, we strive to give our Data Engineers have high levels of autonomy and freedom to innovate and continually refine their technical and soft skills with clear progression plans and training opportunities with Data Camp!, * Be key to making our data lake more accessible and insightful breaking down the barriers to access by working on new data marts and designing data models that even the most basic SQL users can use.
- Build data pipelines with Spark or DBT
- Lead on projects and initiatives
- Use SQL to transform data into meaningful insights
- Build and deploy infrastructure with Terraform
- Implement DDL, DML with Iceberg
- Do code reviews for your peers
- Mentor Mid/Junior Engineers
- Orchestrate your pipelines with DAGs on Airflow
- Participate in SCRUM ceremonies (standups, backlogs, demos, retros, planning)
- Secure data with IAM and AWS Lake formation
- Deploy your changes with Jenkins and GitHub actions
Requirements
- Proven experience as a Data Engineering using SQL and Python
- Excellent Data Modelling skills
- Experience leading initiatives within a team
- Previous experience with data lakes in AWS, Glue Catalog and Athena (or equivalent)
- Strong experience with DBT
- Capable of using popular data modelling tools to create a diagram of proposed tables to enable discussion
- Good communicator and comfortable with presenting ideas and outputs to technical and non-technical users
- Worked on Apache Airflow before to create DAGS
- Mentored other engineers
- Ability to work within Agile, considering minimum viable products, story pointing and sprints
Benefits & conditions
Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy, 2-for-1 share purchase plans, an EV Scheme to further reduce carbon emissions, extra festive time off, and excellent family-friendly benefits.
We prioritise career growth with clear career paths, transparent pay bands, personal learning budgets, and regular learning days. Jump on board and supercharge your career from day one!
We're operate a hybrid model to work and ask that Trainliners work from the office a minimum of 60% of their time over a 12-week period. We also have a 28-day Work from Abroad policy.
Our values represent the things that matter most to us and what we live and breathe everyday, in everything we do:
- Think Big - We're building the future of rail
- Own It - We focus on every customer, partner and journey
- Travel Together - We're one team
- Do Good - We make a positive impact
We know that having a diverse team makes us better and helps us succeed. And we mean all forms of diversity - gender, ethnicity, sexuality, disability, nationality and diversity of thought. That's why we're committed to creating inclusive places to work, where everyone belongs and differences are valued and celebrated.
