Hadoop Administration ( Lead )
SonSoft Inc.
Austin, TX, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.adzuna.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Systems Engineering
CA Workload Automation Ae
IBM Rational ClearCase
Configuration Management
Databases
Linux
Disaster Recovery
File Systems
Perl (Programming Language)
Ganglia (Software)
Github
+33 more
Apache Hadoop
Hadoop Distributed File System
MapReduce
Apache HBase
Apache Hive
Tivoli Management Framework
Python (Programming Language)
Kerberos (Protocol)
Lightweight Directory Access Protocols (LDAP)
Log Files
Nagios
Apache Oozie
Open Source Technology
Performance Tuning
Shell Script
Software Engineering
Subversion
Management of Software Versions
Cloudera Manager
System Availability
Apache Spark
Information Technology
Deployment Automation
Apache Kafka
Mahout
Data Delivery
Database Backup
Puppet
Splunk
Software Version Control
Ambari
Servicenow
Control M
Job description
Upgrades Hadoop Ecosystem and Clusters maintenance as well as creation and removal of nodes Perform administrative activities with Cloudera Manager/Ambari and tools like Ganglia, Nagios Setting up and maintaining Infrastructure and configuration for Hive, Pig and MapReduce Monitor Hadoop Cluster Availability, Connectivity and Security
- Setting up Linux users, groups, Kerberos principals and keys
- Aligning with the Systems engineering team in maintaining hardware and software environments required for Hadoop
- Software installation, configuration, patches and upgrades
- Working with data delivery teams to setup Hadoop application development environments
- Performance tuning of Hadoop clusters and Hadoop MapReduce routines
- Screen Hadoop cluster job performances
- Data modelling, Database backup and recovery
- Manage and review Hadoop log files
- File system management, Disk space management and monitoring (Nagios, Splunk etc)
- HDFS support and maintenance
- Planning of Back-up, High Availability and Disaster Recovery Infrastructure
- Diligently teaming with Infrastructure, Network, Database, Application and Business Intelligence teams to guarantee high data quality and availability
- Collaborating with application teams to install operating system and Hadoop updates, patches and version upgrades
- Ability to work in team in diverse/ multiple stakeholder environment
- Experience to XXdomain
- Experience and desire to work in a Global delivery environment
Requirements
- At least 2 years of experience in Implementation and Administration of Hadoop infrastructure
- At least 2 years of experience in Project life cycle activities on development and maintenance projects.
- Operational expertise in troubleshooting , understanding of systemβs capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
- Hadoop, MapReduce, HBase, Hive, Pig, Mahout
- Hadoop Administration skills: Experience working in Cloudera Manager or Ambari, Ganglia, Nagios
- Experience in using Hadoop Schedulers - FIFO, Fair Scheduler, Capacity Scheduler
- Experience in Job Schedule Management - Oozie or Enterprise Schedulers like Control-M, Tivoli
- Good knowledge of Linux
- Exposure to setting up Ad/LDAP/Kerberos Authentication models
- Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting, Autosys
- Experience in Shell and Perl scripting and exposure to Python
- Knowledge of Troubleshooting Core Java Applications is a plus
- Exposure to Real-time Execution engines like Spark, Storm, Kafka
- Version control Management tools : Subversion or Clearcase or CVS, Github
- Experience in Service Management Ticketing tools - ServiceNow, Service Manager, Remedy, * Bachelorβs degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 4 years of overall IT experience Additional Information
** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦