> Markdown version of [/jobs/ext/525795-hadoop-developer](https://www.wearedevelopers.com/jobs/ext/525795-hadoop-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Hadoop Developer - **Company:** IBA InfoTech Inc. - **Location:** Charlotte, NC, United States - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Agile Methodology, Data Analysis, Apache HTTP Server, Big Data, Databases, Data as a Services, Extract Transform Load (ETL), Data Systems, Data Warehousing, DevOps, Apache Hadoop, Python (Programming Language), Standard Sql, Scala (Programming Language), Simple Data Format, Sqoop, Enterprise Data Management, Parquet, Data Ingestion, Apache Spark, Virtual Environment, Data Lakes, Apache Flume, Information Technology, Data Management, Data Pipelines - **Published:** June 14, 2026 - **Apply:** https://ibainfotech.com/hadoop-developer-2 ## About the Role * ETL (Extract, Transform, Load) Programming experience * Experience in Hadoop ecosystem tools for real-time batch data ingestion, processing, and provisioning such as Apache Flume, Apache Sqoop, Apache Spark * Java/Scala/Python experience * Agile experience * Good SQL knowledge * Design and development experience with columnar databases using Parquet or ORC file formats on Hadoop * Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs) Desired Qualifications * Excellent verbal, written, and interpersonal communication skills * Ability to work effectively in a virtual environment where key team members and partners are in various time zones and locations * Knowledge and understanding of project management methodologies: used in waterfall or Agile development projects * Knowledge and understanding of DevOps principles * Reporting experience, analytics experience or a combination of both * A BS/BA degree or higher in information technology ## Description As a Hadoop Developer, the ideal candidate for this developer role should be able to: * Build high performing data models on big-data architecture as data services. * Build a high performing and scalable data pipeline platform using Hadoop, Apache Spark. * Partner with Enterprise data teams such as Data Management & Insights and Enterprise Data Environment (Data Lake) and identify the best place to source the data * Work with business analysts, development teams and project managers for requirements and business rules. * Collaborate with the source system and approved provisioning point (APP) teams, Architects, Data Analysts and Modelers to build scalable and performant data solutions. * Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist * Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure. * Work with DBAs in Enterprise Database Management group to troubleshoot problems and optimize performance * Support ongoing data management efforts for Development, QA and Production environments * Utilizes a thorough understanding of available technology, tools, and existing designs. * Leverage knowledge of industry trends to build best in class technology to provide a competitive advantage. * Provide QA support & do Testing as needed. ## Related Videos - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [7 Important Tips That Every Software Developer Should Know](https://www.wearedevelopers.com/magazine/101-7-important-tips-that-every-software-developer-should-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)