Data Engineer
Role details
Job location
Tech stack
Job description
We are looking for a talented and passionate Data Engineer to join the SwapClear Data Engineering team. This full stack development team is the SwapClear Technology function supporting the LCH SwapClear Clearing business. This team is responsible for the designing, building, and supporting our data warehouse, analytics and reporting solution to facilitate the SwapClear Clearing operations.
This Data Engineer role will focus on designing, building and maintaining various technologies associated with SwapClear's data management and utilisation. You will create technology that meet our performance, security and reliability needs. You will work across the full software lifecycle from design and coding to automated testing, release, deployment and ongoing support, to deliver usable, maintainable applications and platforms that create a good foundation for product delivery and improvement.
You will be assigned to a scrum team and work collaboratively within an Agile environment to ensure the smooth execution of the software development lifecycle, from planning and development to deployment and support. You will report to the SwapClear Data Engineering Team Lead while actively contributing to the delivery of high-quality solutions.
The successful candidate needs to be hands-on, with a strong and deep understanding of how we manage and transform data plus the knowledge of the front-end and cloud development, and a proactive approach in all aspects of development. You will also be expected to make contributions to testing, ensure the solutions meet high standards for quality and reliability.
WHAT YOU'LL BE DOING:
- Take ownership of the analysis, design, develop and delivery of software solutions
- Take responsibility for identification, estimation and reporting on progress of tasks, along with liaising across the business analyst, developer and continuous integration teams
- Contribute to unit testing, system integration testing, and participate in test case design and execution
- Support production systems, troubleshoot issues, provide timely fixes including participation in out-of-hours support rota
- Document technical specifications, workflow and system design
- Work within an Agile/Scrum team, actively participating in sprint planning, daily stand-ups and retrospectives
Requirements
- 10+ years of practical experience in system design, application development, testing, and operational stability using Python/Spark/ANSI SQL/DBT
- Expertise in Data Warehousing, Data Science & Analytics
- Expertise in Python Coding, Spark and distributed computing
- Can Demonstrate good working knowledge of relational databases including Oracle, Snowflake
- Experience with performance tuning and system optimization
- Experience with Test Driven Development
- Experience in working with GIT source control tool
- Exposure to agile methodologies such as CI/CD, Application Resiliency, and Security
- Adaptability to changing project requirements and technologies
Desirable skills
- Experience with the finance domain and knowledge of FpML
- Exposure to containerization and orchestration tools like Docker and Kubernetes
- Exposure to cloud technology