Data Engineer | Learn Kafka & Databricks | Big Data Technologies | 10% Bonus

Opus Recruitment Solutions
Bradley Stoke, United Kingdom
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
£ 71K

Job location

Remote
Bradley Stoke, United Kingdom

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Big Data
Continuous Integration
Database Design
Python
Machine Learning
Standard Sql
SQL Databases
Data Streaming
PySpark
Information Technology
Real Time Data
Kafka
Video Streaming
Vertica
Data Pipelines
Databricks

Job description

Are you a Data Engineer with strong Python, SQL and PySpark skills who is looking for the opportunity to step up and accelerate your career?

We're partnering with a market-leading technology business that is investing heavily in its data platform and is at the forefront of innovation within the smart housing sector. Processing billions of sensor readings every month, they're looking for a talented Data Engineer to join their growing team and help build the next generation of scalable data solutions.

This opportunity is ideally suited to a mid-level Data Engineer who is ready to take on more responsibility, work on complex technical challenges, and gain exposure to cutting-edge technologies including Databricks, Kafka, Streaming, AI and Machine Learning.

The Opportunity You'll be joining a collaborative team of engineers and data specialists working on large-scale, real-time data platforms. This is a business that embraces new technologies and encourages engineers to learn, innovate and have a genuine impact on technical direction.

You'll have the opportunity to:

  • Build and optimise large-scale data pipelines
  • Work with billions of data points generated from IoT devices
  • Develop solutions using Python, SQL and PySpark
  • Gain exposure to Databricks, Kafka and streaming technologies
  • Contribute to Machine Learning and AI initiatives
  • Work alongside Data Scientists and Software Engineers
  • Influence architecture and engineering best practices
  • Play a key role in exciting greenfield projects

Requirements

  • Strong commercial experience as a Data Engineer
  • Advanced Python and SQL skills
  • Strong PySpark experience
  • Experience building and maintaining scalable data pipelines
  • Understanding of data modelling and database design principles
  • Strong analytical and problem-solving capabilities
  • Excellent communication and stakeholder engagement skills
  • Degree in Computer Science, Mathematics, Statistics or a related discipline would be advantageous

Desirable Skills Experience with any of the following would be beneficial but not essential:

  • Databricks
  • Apache Kafka
  • Real-time streaming technologies
  • AWS services
  • ClickHouse
  • Infrastructure as Code
  • CI/CD practices

Apply for this position