Hadoop Administration ( Lead )

SonSoft Inc.
Austin, TX, United States
1 day ago
Apply on www.adzuna.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Systems Engineering CA Workload Automation Ae IBM Rational ClearCase Configuration Management Databases Linux Disaster Recovery File Systems Perl (Programming Language) Ganglia (Software) Github
+33 more
Apache Hadoop Hadoop Distributed File System MapReduce Apache HBase Apache Hive Tivoli Management Framework Python (Programming Language) Kerberos (Protocol) Lightweight Directory Access Protocols (LDAP) Log Files Nagios Apache Oozie Open Source Technology Performance Tuning Shell Script Software Engineering Subversion Management of Software Versions Cloudera Manager System Availability Apache Spark Information Technology Deployment Automation Apache Kafka Mahout Data Delivery Database Backup Puppet Splunk Software Version Control Ambari Servicenow Control M

Job description

Upgrades Hadoop Ecosystem and Clusters maintenance as well as creation and removal of nodes Perform administrative activities with Cloudera Manager/Ambari and tools like Ganglia, Nagios Setting up and maintaining Infrastructure and configuration for Hive, Pig and MapReduce Monitor Hadoop Cluster Availability, Connectivity and Security

  • Setting up Linux users, groups, Kerberos principals and keys
  • Aligning with the Systems engineering team in maintaining hardware and software environments required for Hadoop
  • Software installation, configuration, patches and upgrades
  • Working with data delivery teams to setup Hadoop application development environments
  • Performance tuning of Hadoop clusters and Hadoop MapReduce routines
  • Screen Hadoop cluster job performances
  • Data modelling, Database backup and recovery
  • Manage and review Hadoop log files
  • File system management, Disk space management and monitoring (Nagios, Splunk etc)
  • HDFS support and maintenance
  • Planning of Back-up, High Availability and Disaster Recovery Infrastructure
  • Diligently teaming with Infrastructure, Network, Database, Application and Business Intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to install operating system and Hadoop updates, patches and version upgrades
  • Ability to work in team in diverse/ multiple stakeholder environment
  • Experience to XXdomain
  • Experience and desire to work in a Global delivery environment

Requirements

  • At least 2 years of experience in Implementation and Administration of Hadoop infrastructure
  • At least 2 years of experience in Project life cycle activities on development and maintenance projects.
  • Operational expertise in troubleshooting , understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
  • Hadoop, MapReduce, HBase, Hive, Pig, Mahout
  • Hadoop Administration skills: Experience working in Cloudera Manager or Ambari, Ganglia, Nagios
  • Experience in using Hadoop Schedulers - FIFO, Fair Scheduler, Capacity Scheduler
  • Experience in Job Schedule Management - Oozie or Enterprise Schedulers like Control-M, Tivoli
  • Good knowledge of Linux
  • Exposure to setting up Ad/LDAP/Kerberos Authentication models
  • Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting, Autosys
  • Experience in Shell and Perl scripting and exposure to Python
  • Knowledge of Troubleshooting Core Java Applications is a plus
  • Exposure to Real-time Execution engines like Spark, Storm, Kafka
  • Version control Management tools : Subversion or Clearcase or CVS, Github
  • Experience in Service Management Ticketing tools - ServiceNow, Service Manager, Remedy, * Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • At least 4 years of overall IT experience Additional Information

** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.com
Prepare application

Good distractions

Loading talks and stories from around this role…