Hadoop Administrator

IBA InfoTech Inc.
Fort Myers, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Fort Myers, United States of America

Tech stack

Java
API
Applications Architecture
Big Data
System Configuration
ETL
Software Debugging
Linux
Hadoop
HBase
Hive
Python
MapR (Big Data)
Network Connections
Open Source Technology
Performance Tuning
Powershell
Simple Data Format
Smoke Testing
Software Deployment
Scripting (Bash/Python/Go/Ruby)
Spark
Information Technology

Job description

  • Responsible for understanding the data use cases.
  • Design, develop and implement data loading solutions into Hadoop utilizing various native and custom API connectors.
  • Manage Hadoop and Spark cluster environments - Cluster sizing, cluster configuration, smoke testing, service allocation, security setup, performance tuning and ongoing monitoring.
  • Contribute to planning and implementation of hardware and software upgrades.
  • Work with Operations on monitoring and troubleshooting of incidents to maintain service levels.
  • Develop and deliver data connectivity and storage solutions.
  • Architect, develop and debug Hadoop applications using Java and other Hadoop eco system components like HBase, Pig and Hive.
  • Research and recommend methods and technologies to improve cluster operation and user experience.
  • Mentor and train other associates.

Requirements

  • Bachelor's Degree in Information Technology or equivalent combination of course work and job experience
  • 5+ years of experience in architecting, configuring, installation and maintenance of Open Source Big-data applications, with focused experience on MapR distribution.
  • Scripting experience using Shell, Python or PowerShell.
  • Experience in installing and deploying applications on Linux Platform.
  • Experience in upgrading Linux / MapR
  • Hands on experience with distributed application architecture and implementation using Map
  • Hands on experience with distributed application architecture and implementation using MapR
  • Experience handling different file formats in Hadoop.
  • Core experience in Java/Python for data processing and other scripting languages optional.
  • Experience with big data workflows and Lambda architecture
  • Experience with Linux OS and Installation/Configuration and Maintenance of MapR Distribution.

Apply for this position