> Markdown version of [/jobs/ext/2028011-hadoop-big-data-platform-engineer-sme](https://www.wearedevelopers.com/jobs/ext/2028011-hadoop-big-data-platform-engineer-sme). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Hadoop/Big Data Platform Engineer / SME - **Company:** BCforward - **Location:** Chicago, IL, United States - **Salary:** $153,234.0 - **Contract:** Temporary contract - **Skills:** Query Performance, Java (Programming Language), CA Workload Automation Ae, Bash Shell, Cloud Computing, Cloudera Impala, Encodings, Databases, Data Infrastructure, Data Warehousing, Software Debugging, Disaster Recovery, Perl (Programming Language), File System Permissions, Apache Hadoop, Hadoop Distributed File System, Apache HBase, Apache Hive, Job Scheduling, Python (Programming Language), Kerberos (Protocol), PostgreSQL, OpenShift, Oracle (Applications), Ansible, Cloudera, Simple Data Format, Apache Solr, SQL Databases, Subversion, Tableau (Software), Apache Zookeeper, Enterprise Data Management, Scripting, Enterprise Software Applications, Apache Yarn, DevOps Tools - Open-source, Apache Spark, Sybase, Jupyter, Containerization, Sentry, Apache Kafka, Bitbucket, Docker, Jenkins - **Published:** August 11, 2026 - **Apply:** https://www.dice.com/job-detail/9851b207-ee0b-4d0a-bcbc-99d2666d76de ## About the Role We are seeking a Hadoop Engineer (SME) to join our dynamic team. The ideal candidate will have strong experience in Big Data platform engineering and administration across Cloudera, Spark, Kafka, Hive, Impala, HBase, and containerized environments and a proven ability to operate and optimize enterprise data platforms, integrate solutions, and resolve complex production issues across environments., * Expertise in Cloudera Hadoop components: HDFS, YARN, Hive, Impala, HBase, Kafka, Sentry, Solr, Hue, Zookeeper, and Postgres. * Hands-on experience with Spark, Kafka, Hive, Impala, Ozone, and Hadoop ecosystem tooling. * Strong Hadoop architecture knowledge, HDFS operations, and cluster administration with AD/Kerberos integration. * Proficiency in Unix/Linux, SQL, and relational/data warehouse concepts across Sybase, Oracle, or similar databases. * Scripting and development skills in Java, Python, Perl, and Shell for automation and tooling. * Experience with monitoring, alerting, and job scheduling systems, including Autosys. * Comfort with frequent, incremental testing and deployment in agile environments. * Automation and DevOps tooling experience with Ansible, Jenkins, SVN, and Bitbucket. * Experience supporting enterprise users and platforms at L1, L2, and L3 levels. Preferred Skills: * Cloudera Administrator or Developer certification. * Certification or experience with Cloud, Docker, and OpenShift technologies. * Experience with Tableau, including dashboards connected to Hadoop/Hive tables. ## Description * Provide subject matter expertise for Cloudera Hadoop and Data Science platforms, including Jupyter, OpenShift, and Docker cluster administration. * Manage platform operations across environments, including upgrades, patches, deployments, monitoring, forecasting, and disaster recovery. * Own incident, problem, and capacity management for Hadoop and associated services. * Debug and troubleshoot YARN, Spark, and Impala jobs, including resource utilization and query performance tuning. * Address NameNode, HDFS space, file and folder permissions, and backup issues. * Integrate platform solutions with external applications and enterprise platforms. * Analyze Hadoop logs, compression, encoding, and file formats to resolve production issues and improve stability. * Collaborate with clients, development teams, vendors, and partners to deliver technical solutions that meet user needs. * Support L1, L2, and L3 operations and establish runbooks and automation for repeatable tasks. * Implement monitoring, alerting, and job scheduling using enterprise tools. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Doubt to Confidence: How Sentry Uses Verdaccio to Bulletproof SDK Releases](https://www.wearedevelopers.com/videos/739-from-doubt-to-confidence-how-sentry-uses-verdaccio-to-bulletproof-sdk-releases) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Debugging in the Dark](https://www.wearedevelopers.com/videos/1658-debugging-in-the-dark) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top 6 Hackathons for Developers in 2023](https://www.wearedevelopers.com/magazine/263-top-6-hackathons-for-developers-in-2023) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)