Hadoop Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+32 more
Job description
- Provide subject matter expertise in managing Hadoop and Data Science Platform operations, with a focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-Container Cluster Management and Administration.
- Manage platform operations across all environments, including upgrades, bug fixes, deployments, metrics and monitoring, disaster recovery, and incident, problem, and capacity management.
- Work on complex, major, or highly visible tasks in support of multiple projects that require multiple areas of expertise.
- Integrate solutions with other applications and platforms outside the framework.
- Serve as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs.
- Perform L1, L2, and L3 level support for the Hadoop Platform.
- Debug and troubleshoot Yarn, Spark, and Impala jobs.
- Address issues related to Name node, HDFS space, and file/folder permission backups.
Requirements
- Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster, and the Hadoop Administrator’s role.
- Experience in query performance tuning and resource utilization tuning.
- Intimate knowledge of fully integrated AD/Kerberos authentication.
- Experience setting up optimum cluster configurations and debugging YARN.
- Hands-on experience analyzing Hadoop log files, compression, encoding, and file formats.
- Experience with monitoring, alerting, and job scheduling systems like Autosys.
- Experience with frequent, incremental code testing and deployment.
Technical Skills:
- Expert-level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper, and Postgres.
- Strong technical knowledge in Unix/Linux, Databases (Sybase/SQL/Oracle), Java, Python, Perl, and Shell scripting.
- Proficiency with automation and DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket.
- Technical knowledge of relational databases and data warehousing.
Preferred Qualifications
- Cloudera Admin / Dev Certification.
- Certification in Cloud, Docker-Container, or OpenShift Technologies.
- Experience with BI tools like Tableau, particularly building dashboards connected to Hadoop-Hive Tables.
About the company
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
Making Data Warehouses Fast: A Developer’s Story
Highest Paying Tech Companies for Developers
Résumé-Driven Development: How IT trends affect the job market for software developers