WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Spark Developer

IBA InfoTech Inc.
San Jose, CA, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source
ibainfotech.com

Tech stack

Java (Programming Language) Business Analytics Applications Apache HTTP Server Big Data R (Programming Language) Apache Hadoop MapReduce Apache HBase Apache Hive Python (Programming Language) Apache Oozie Scala (Programming Language)
+5 more
Software Engineering Apache Spark Information Technology Apache Kafka Programming Languages

Requirements

  • At least 8 years of experience in developing cloud based multi user application with expertise in designing, building, testing and implementing IT application.
  • Must have a strong background in software engineering principles and techniques.
  • Senior Developer with 5 years of hands on experience in Spark and Hadoop
  • 10 years of overall IT experience
  • Proven experience in building in Data Driven applications using a combination of Java/Scala and the Spark framework
  • Hands on experience in Map Reduce
  • Ability to work independently and drive solutions end to end leveraging various technologies to solve data problems and develop innovative big data solutions.
  • Proven expertise w/leveraging big data components (not limited to…Hive, HBASE, Oozie, Kafka etc) to build large scale data processing systems.
  • Expertise in two or more of the programming languages (Java, Spark, Python, R)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on ibainfotech.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

1:41 min

Visualizing the complex developer journey for JVM ecosystems

Bobur Umurzokov · LIVE

4:01 min

Comparing distributed processing architectures for batch and streaming

Qiyang Duan · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

4:38 min

Architecting common use cases via serverless design

Oliver Arafat · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Alibaba Big Data and Machine Learning Technology thumbnail
43:57
LIVE • almost 6 years ago

Alibaba Big Data and Machine Learning Technology

Qiyang Duan

Serverless: Past, Present and Future thumbnail
1:01:02
LIVE • almost 6 years ago

Serverless: Past, Present and Future

Oliver Arafat

Why and when should we consider Stream Processing frameworks in our solutions thumbnail
30:51
WWC 2024 • almost 2 years ago

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Can This Elephant Dance? IBM Bob and the Future of AI-First Software Development thumbnail
29:52
WWC Europe 2026 • about 1 month ago

Can This Elephant Dance? IBM Bob and the Future of AI-First Software Development

Neel Sundaresan, Arvid Ottenberg

Let's Get Aggregated: Custom UDAFs in Spark thumbnail
19:58
WWC 2025 • 12 months ago

Let's Get Aggregated: Custom UDAFs in Spark

Nikolai Nikolaev

Related articles

See all