Remote Data Software Engineer Python PySpark
Role details
Job location
Tech stack
Job description
- We will have you help shape the architecture of our data products.
- We will have you build reusable technology that enables teams to ingest, store, transform, and serve their own data products.
- We will have you take a lead in data transformation.
- We will have you set up best practices in data modelling, performance optimisation, and data governance.
- We will rely on you to help ensure the data used across our business is consistent, available, and reliable.
- We will support your continual learning and self-development, including testing open source tools, engaging in community-building activities, and keeping up to date with new technologies and methods.
Technologies:
- AWS
- Redshift
- Big Data
- CI/CD
- DevOps
- Support
- Kafka
- NoSQL
- PostgreSQL
- Python
- PySpark
- SQL
- Cloud
- Spark
Requirements
- We are looking for a degree-educated candidate in a relevant discipline such as Computer Science or Mathematics.
- We need a software engineering background with advanced Python and PySpark coding skills.
- We require experience in batch processing, distributed data processing, and near real-time streaming data pipelines with technologies such as Kafka.
- We are looking for experience integrating Big Data Analytics platforms with AWS.
- We need a strong understanding of RDBMS, data warehousing, data modelling, SQL, including Redshift and PostgreSQL, and NoSQL databases.
- We value a good appreciation of software engineering best practices, including DevOps, CI/CD, and IaC.
- We require excellent communication skills.
Benefits & conditions
We are a growing and hugely successful European car insurance tech company expanding our UK presence. Our platform enables an insurance quote to be made to the consumer within 60 seconds using just four clicks. You will join a friendly and supportive international team in a senior, hands-on Data Software Engineer role within our Claims team. We offer remote working from anywhere in the UK or a hybrid London office option, flexible working hours, and a competitive package including salary up to £95,000, holiday allowance, pension, private medical and dental insurance, life assurance, employee assistance programme, workplace nursery scheme, enhanced maternity package, wellbeing support, and a range of other perks.