Data Engineer
Eden James Consulting Ltd
Reigate, United Kingdom
6 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Reigate, United Kingdom
Tech stack
Airflow
Amazon Web Services (AWS)
Continuous Integration
Data Integration
Python
Machine Learning
Cloud Services
Sql Optimization
Snowflake
Spark
Generative AI
GIT
Infrastructure Automation Frameworks
Real Time Data
Data Management
Terraform
Data Pipelines
Docker
Jenkins
Databricks
Job description
- Building and supporting data products within modern data platform.
- Designing and delivering solutions with engineers, scientists and product teams.
- Developing and optimising data pipelines across the analytics platform.
- Integrating data from varied sources with strong quality standards.
- Maintaining orchestration, monitoring and performance of data components.
- Improving engineering processes across the wider data community.
- Promoting high coding and data practice standards.
- Experimenting with emerging data, ML and AI technologies.
- Partnering with architects on data product designs.
- Working collaboratively in multi-functional agile squads.
- Supporting ML and GenAI infrastructure and workflows.
Requirements
- Passion for building scalable, resilient cloud data platforms.
- Strong experience with Databricks or Snowflake on AWS.
- Proven Python skills, including Spark and Airflow expertise.
- Advanced SQL skills and end-to-end data modelling experience.
- Experience building batch and real-time data integrations.
- Hands-on CICD skills with Git, Jenkins or similar.
- Ability to ingest, cleanse and structure large, diverse datasets.
- Knowledge of Terraform or similar IaC tools.
- Experience with Docker and Kubernetes is beneficial.
- Exposure to production Generative AI is an advantage.
- Strong collaboration skills and a proactive attitude.
About the company
We are recruiting for a Data Engineer on behalf of one of the UK's most recognised and celebrated personal lines insurers.
The successful candidate will join a collaborative team of data and AI engineers, scientists, developers, analysts, and architects. Together, they will design and build modern machine learning and AI services that support analytics and improve products across the business.
It's a chance to work on a very modern tech stack and learn from an incredible team.