WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Hadoop and PySpark Data Engineer

Nityo Infotech Corporation
Charlotte, NC, United States
24 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
www.dice.com

Tech stack

Agile Methodology Airflow CA Workload Automation Ae Big Data Data Warehousing Relational Databases Apache Hadoop Apache Hive Python (Programming Language) Unix Shell Cloudera SQL Databases
+1 more
Apache Spark

Requirements

Experience in data warehousing architectural approaches. Sound understanding and experience with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting. Experience in orchestration tool like Autosys, Airflow. Sound knowledge of relational databases (SQL) and experience with large SQL based systems. Understanding of Agile methodologies and technologies

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

1:31 min

Selecting the ideal data stack for distinct workloads

Alan Mazankiewicz · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:19 min

Introduction to Apache Airflow for advanced orchestration

Alan Mazankiewicz · LIVE

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

1:11 min

Deploying and running Airflow in cloud environments

Alan Mazankiewicz · LIVE

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Fully Orchestrating Databricks from Airflow thumbnail
39:14
LIVE • almost 5 years ago

Fully Orchestrating Databricks from Airflow

Alan Mazankiewicz

Alibaba Big Data and Machine Learning Technology thumbnail
43:57
LIVE • almost 6 years ago

Alibaba Big Data and Machine Learning Technology

Qiyang Duan

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15
World Congress 2026 Europe • 3 months ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment thumbnail
25:41
World Congress 2024 • about 2 years ago

AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment

Joy

Why and when should we consider Stream Processing frameworks in our solutions thumbnail
30:51
World Congress 2024 • about 2 years ago

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Related articles

See all