Hadoop Engineer

Everforth Apex
Chicago, IL, United States
23 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Query Performance Java (Programming Language) CA Workload Automation Ae Software Bug Management Cloud Computing Cloudera Impala Encodings Databases Data Warehousing Relational Databases Software Debugging DevOps
+32 more
Disaster Recovery Perl (Programming Language) Apache Hadoop Hadoop Distributed File System Apache HBase Apache Hive Job Scheduling Python (Programming Language) Kerberos (Protocol) PostgreSQL Log Files OpenShift Oracle (Applications) Ansible Cloudera Shell Script Simple Data Format Apache Solr SQL Databases Subversion Tableau (Software) Apache Zookeeper Jupyter Notebook Apache Yarn Apache Spark Sybase Code Testing Sentry Apache Kafka Bitbucket Docker Jenkins

Job description

  • Provide subject matter expertise in managing Hadoop and Data Science Platform operations, with a focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-Container Cluster Management and Administration.
  • Manage platform operations across all environments, including upgrades, bug fixes, deployments, metrics and monitoring, disaster recovery, and incident, problem, and capacity management.
  • Work on complex, major, or highly visible tasks in support of multiple projects that require multiple areas of expertise.
  • Integrate solutions with other applications and platforms outside the framework.
  • Serve as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs.
  • Perform L1, L2, and L3 level support for the Hadoop Platform.
  • Debug and troubleshoot Yarn, Spark, and Impala jobs.
  • Address issues related to Name node, HDFS space, and file/folder permission backups.

Requirements

  • Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster, and the Hadoop Administrator’s role.
  • Experience in query performance tuning and resource utilization tuning.
  • Intimate knowledge of fully integrated AD/Kerberos authentication.
  • Experience setting up optimum cluster configurations and debugging YARN.
  • Hands-on experience analyzing Hadoop log files, compression, encoding, and file formats.
  • Experience with monitoring, alerting, and job scheduling systems like Autosys.
  • Experience with frequent, incremental code testing and deployment.

Technical Skills:

  • Expert-level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, and Postgres.
  • Strong technical knowledge in Unix/Linux, Databases (Sybase/SQL/Oracle), Java, Python, Perl, and Shell scripting.
  • Proficiency with automation and DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket.
  • Technical knowledge of relational databases and data warehousing.

Preferred Qualifications

  • Cloudera Admin / Dev Certification.
  • Certification in Cloud, Docker-Container, or OpenShift Technologies.
  • Experience with BI tools like Tableau, particularly building dashboards connected to Hadoop-Hive Tables.

About the company

Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.

Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:22 min

Overview of the Sentry error and performance monitoring platform

Priscila Oliveira · World Congress 2023

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

3:21 min

Installing and configuring the Sentry JavaScript SDK for applications

Priscila Oliveira · World Congress 2023

Videos

See all

Related articles

See all