Spark-Scala Developer

ETeam Inc

Charing Cross, United Kingdom

2 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Compensation

£ 114K

Job location

Charing Cross, United Kingdom

Tech stack

Big Data

Cloudera Impala

ETL

Data Structures

Data Warehousing

Database Theory

Distributed Data Store

Hadoop

Hadoop Distributed File System

Hive

Shell

NoSQL

SQL Databases

Sqoop

Spark

Spark Streaming

Job description

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you.

Requirements

Spark Streaming, Hadoop, -Hive, -SQL, -Sqoop,

Impala

Detailed Job Description: At least 8+ years of experience and strong knowledge in Scala programming language. Able to write clean, maintainable and efficient Scala code following best practices. Good knowledge on the fundamental Data Structures and their usage At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies. Having expertise in Spark Core, Spark SQL and Spark Streaming. Experience with Hadoop, HDFS, Hive and other BigData technologies. Familiarity with Data warehousing and ETL concepts and techniques Having expertise in Database concepts and SQL/NoSQL operations. UNIX Shell Scripting will be an added advantage in scheduling/running application jobs. At least 8 years of experience in Project development life cycle activities and maintenance/support projects.