> Markdown version of [/jobs/ext/3410692-hadoop-and-pyspark-data-engineer](https://www.wearedevelopers.com/jobs/ext/3410692-hadoop-and-pyspark-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Hadoop and PySpark Data Engineer

- **Company:** Nityo Infotech Corporation
- **Location:** Charlotte, NC, United States
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Airflow, CA Workload Automation Ae, Big Data, Data Warehousing, Relational Databases, Apache Hadoop, Apache Hive, Python (Programming Language), Unix Shell, Cloudera, SQL Databases, Apache Spark
- **Published:** September 10, 2026
- **Apply:** https://www.dice.com/job-detail/5c56728e-e820-43e5-924d-59c10d756d46

## About the Role

Experience in data warehousing architectural approaches.
Sound understanding and experience with Hadoop ecosystem (Cloudera).
Experience in working with a Big Data implementation in production environment.
Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting.
Experience in orchestration tool like Autosys, Airflow.
Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
Understanding of Agile methodologies and technologies



## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)