Data Platform Engineer

LinuxRecruit
Charing Cross, United Kingdom
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 75K

Job location

Charing Cross, United Kingdom

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Data Security
DevOps
Python
Software Engineering
SQL Databases
Data Processing
Spark

Job description

As a Data Platform Engineer, you will be at the forefront of designing and maintaining data processing pipelines that handle vast amounts of information. You will ensure data quality, integrity, and security while collaborating with cross-functional teams to tackle complex data challenges. Staying current with the latest trends and technologies, you will drive continuous improvement and innovation in their data processing domains.

Requirements

To be suitable, you are someone who is experienced in working within a heavy AWS environment, with strong capabilities in data security, management, DevOps, and software engineering. Your critical and statistical thinking skills and passion for solving complex problems will be invaluable. You are proficient in SQL and Python, with experience in AWS services such as Athena, S3, Glue, and Spark, and you are adept at handling big data technologies and orchestration tools.

About the company

This is your chance to join an exciting scale-up that has developed an AI-driven platform to help large enterprises, private firms, and VC companies find the top scientists, engineers, and researchers. With over one billion data points extracted from eight terabytes of data spanning a decade, you'll thrive in a fast-paced, agile environment with a robust engineering culture.

Apply for this position