WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Hadoop Data Engineer

Neo Tech
Scottsdale, AZ, United States
3 months ago
Apply on careerjet.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Compensation
$137,280.0 - $147,680.0
Working hours
Regular working hours
Job source
careerjet.com

Tech stack

Big Data Serialization Distributed Systems Apache Hadoop Apache Hive Scala (Programming Language) SQL Databases Data Streaming Sql Optimization Apache Spark Apache Kafka Spark Streaming

Job description

Location: Phoenix, AZ Salary Range: $70/hr on W2 to $75/hr on W2 Introduction In this contingent resource assignment, you will consult on complex initiatives with broad impac…

  • 4 days ago

Requirements

  • Strong Experience in Scala, Spark, Hive SQl, Hadoop and Kafka
  • Proficiency in Hive and SQL optimization.
  • Understanding of distributed systems and big data architecture.
  • Knowledge of streaming frameworks (Spark Streaming, Kafka Streams).
  • Familiarity with data partitioning, compression, and serialization formats

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:04 min

Comparing offline data analytics with online stream processing

Artem Volk Artem Volk +1 · World Congress 2024

1:09 min

Evaluating mature stream processing frameworks for production systems

Soroosh Khodami Soroosh Khodami · World Congress 2024

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Alibaba Big Data and Machine Learning Technology thumbnail
43:57
LIVE • almost 6 years ago

Alibaba Big Data and Machine Learning Technology

Qiyang Duan

Why and when should we consider Stream Processing frameworks in our solutions thumbnail
30:51
World Congress 2024 • about 2 years ago

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Let's Get Aggregated: Custom UDAFs in Spark thumbnail
19:58
World Congress 2025 • about 1 year ago

Let's Get Aggregated: Custom UDAFs in Spark

Nikolai Nikolaev

Building the platform for providing ML predictions based on real-time player activity thumbnail
30:57
World Congress 2024 • about 2 years ago

Building the platform for providing ML predictions based on real-time player activity

Artem Volk, Fabian Zillgens

Modern Data Architectures need Software Engineering thumbnail
29:25
World Congress 2024 • about 2 years ago

Modern Data Architectures need Software Engineering

Matthias Niehoff

Related articles

See all