Data Engineering
SLR Consulting Limited
Charing Cross, United Kingdom
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 84KJob location
Charing Cross, United Kingdom
Tech stack
Agile Methodologies
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Code Review
Continuous Delivery
Continuous Integration
Information Engineering
Data Transformation
Relational Databases
Github
Python
PostgreSQL
Shell Script
Software Construction
SQL Databases
Snowflake
Information Technology
Production Code
Build Process
Software Coding
Software Version Control
Data Pipelines
Docker
Job description
This role will focus on enhancing and maintaining data pipelines to process financial and ESG data.
What this role will do:
- Design, build, and maintain robust data pipelines using tools like Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale. Ensure pipelines are efficient, reliable, and capable of handling terabytes of data.
- Collaborate with Climate Risk modeling team to integrate advanced economic models into production environments. Leverage automation tools like GitHub to streamline deployment and ensure rapid iteration.
- Uphold high technical standards by implementing best practices in coding, testing, and documentation. Regularly review and improve the existing codebase to incorporate innovation and new learnings.
- Work within an agile framework to prioritize tasks, manage time effectively, and align with team goals. Act as a proactive contributor to cross-functional collaboration with data scientists, analysts, and other stakeholders.
Requirements
- Degree in computer science, engineering, mathematics, quantitative methods or related field.
- Substantial experience in developing and maintaining production-level data pipelines.
- Strong command of Python, with a focus on writing clean, efficient, and production-ready code.
- Strong SQL expertise, with experience of relational databases such as PostgreSQL or Snowflake.
- Substantial experience with core AWS products such as EC2, ECS, Lambda and RDS.
- Familiarity with data orchestration technologies such as Dagster, or a strong desire to learn.
- Familiarity with DBT or similar tools for data transformation, or a strong desire to learn.
- Passion for automation, with experience in containerisation (e.g. Docker), shell scripting, and continuous integration/continuous deployment (CI/CD) pipelines.
- Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, peer code reviews, version control, build processes, testing, and deployment.
- Excellent written and verbal communication skills.
Commitment to create positive environmental value for our clients across sectors, helping them shape the future of their sustainability transition
About the company
SLR are global leaders in Sustainability Solutions, helping our clients achieve their sustainability goals. We are a consultancy with 4500+ employees across 6 regions in over 125 countries. Our 'one team' culture is at the heart of our business, providing a collaborative and supportive environment for professional development.