Hadoop Administration & Scripting- Full-Time role

Smart Caliber Technology
Alpharetta, GA, United States
2 days ago
Apply on www.adzuna.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Apache Hadoop Hadoop Distributed File System Apache HBase Apache Hive Identity and Access Management Python (Programming Language) Performance Tuning Shell Script Enterprise Data Management Data Logging Scripting Cloud Platform System
+4 more
Apache Yarn Apache Spark Infrastructure Automation Frameworks Apache Kafka

Job description

  • Administer, monitor, and maintain Hadoop ecosystem components in production environments.
  • Manage Hadoop clusters, including performance tuning, troubleshooting, and capacity planning.
  • Develop and automate operational processes using Shell Scripting and Python.
  • Support Hadoop cluster deployments, upgrades, patching, and routine maintenance.
  • Monitor cluster health and ensure platform availability, stability, and reliability.
  • Troubleshoot and resolve production issues while meeting defined SLAs.
  • Work closely with development, infrastructure, and operations teams.
  • Drive automation initiatives to improve operational efficiency and reduce manual tasks.
  • Support monitoring, logging, and operational processes across the Hadoop ecosystem.

Requirements

  • Strong hands-on experience in Hadoop Administration.
  • Expertise in Shell Scripting and Python.
  • Experience managing Hadoop ecosystem components:
  • HDFS
  • YARN
  • Hive
  • HBase
  • Spark
  • Kafka
  • Strong knowledge of Linux administration and troubleshooting.
  • Experience with Hadoop cluster management, monitoring, and performance tuning.
  • Experience in production support and incident management.

Preferred Skills

  • Exposure to on-premises and cloud-based data platforms.
  • Experience with CI/CD pipelines and infrastructure automation tools.
  • Knowledge of security, access management, and cluster governance.
  • Experience with enterprise data platform operations and automation.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.com
Prepare application

Good distractions

Loading talks and stories from around this role…