WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer (Hadoop / Python)

Atria Group LLC
San Francisco, CA, United States
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source
jobs.smartrecruiters.com

Tech stack

Big Data Data Integration Extract Transform Load (ETL) Apache Hadoop Apache Hive Python (Programming Language) Unix Shell Performance Tuning Scripting Vertica

Requirements

  • At least 8 years of experience in end to end data integration/data warehousing implementations and at project experience with large data volumes.
  • Hands-on Hadoop / Hive implementation / data movement experience
  • Scripting in the following languages: Linux shell and Python
  • Strong SQL development experience to support data integration and analysis
  • Strong hands-on, high volume, performance tuning DW experience
  • Vertica experience a plus
  • Self-sufficient in extremely technical, high pace and exploratory environment
  • B.S. degree in CS / EE. Higher level degree is a plus

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.smartrecruiters.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:04 min

Introduction to Bitcoin script parsing tools

Steve Shadders · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:53 min

Evaluating traditional scripting languages for modern development tasks

Jens Knipper Jens Knipper · Europe 2026 Virtual

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all
Alibaba Big Data and Machine Learning Technology thumbnail
43:57
LIVE • almost 6 years ago

Alibaba Big Data and Machine Learning Technology

Qiyang Duan

Enjoying SQL data pipelines with dbt thumbnail
26:53
WWC 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

JavaScript? No. Java Scripts! - Scripting with Java thumbnail
46:19
Europe 2026 Virtual • about 1 month ago

JavaScript? No. Java Scripts! - Scripting with Java

Jens Knipper

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15
WWC Europe 2026 • about 1 month ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

Intermediate Bitcoin Script thumbnail
1:06:12
LIVE • about 6 years ago

Intermediate Bitcoin Script

Steve Shadders

Related articles

See all