Hadoop and PySpark Data Engineer
VDart, Inc.
New York, NY, United States
13 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.disabledperson.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Agile Methodology
Airflow
CA Workload Automation Ae
Big Data
Cloud Computing
Data Visualization
Data Warehousing
Relational Databases
Apache Hadoop
Apache Hive
Python (Programming Language)
Unix Shell
+6 more
Cloudera
SQL Databases
Tableau (Software)
Apache Spark
Containerization
Pyspark
Requirements
- Experience in data warehousing architectural approaches.
- Sound understanding and experience with Hadoop ecosystem (Cloudera).
- Experience in working with a Big Data implementation in production environment.
- Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting.
- Experience in orchestration tool like Autosys, Airflow.
- Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
- Understanding of Agile methodologies and technologies
Preferred Skill and Experience
- Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
- Knowledge and experience with Cloud and containerization technologies
- Experience with data visualization tools like Tableau”
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.disabledperson.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…