Software Engineer 3
Role details
Job location
Tech stack
Job description
- Design, configure, and maintain Hadoop clusters to ensure scalability, reliability, and performance.
- Implement resource management strategies (YARN, MapReduce) to optimize workloads.
- Monitor cluster health, troubleshoot issues, and fine-tune configurations for efficiency.
- Collaborate with data engineering teams to support ingestion pipelines and distributed processing.
- Plan and execute tenant migrations from legacy systems or older Hadoop distributions to newer versions or alternative platforms.
- Schedule and apply regular updates to keep the Hadoop ecosystem secure and stable.
- Perform proactive maintenance activities such as log rotation, disk cleanup, and service restarts.
- Validate patch compatibility with existing workloads before deployment.
- Maintain rollback strategies in case of patch failures.
- Assess Red Hat Enterprise Linux (RHEL) patches for relevance to the Hadoop environment.
- Evaluate MapR distribution patches for bug fixes, performance improvements, and security updates.
- Continuously monitor for CVEs (Common Vulnerabilities and Exposures) affecting Hadoop, Red Hat, or MapR.
- Provide Tier-2/Tier-3 support for Hadoop-related incidents.
Requirements
-
Experience in Hadoop administration
-
Large enterprise experience
-
Experience with migrations
-
Exposure to enterprise tools/processes
-
Linux/Red Hat background
-
Patching and infrastructure support experience
Tools & Technologies : Nice-to-have or preferred:
- Ansible
- ServiceNow
- JIRA
- Enterprise change management processes
- GCP / cloud exposure (bonus)
Benefits & conditions
Pay Range: $50/hr to $55/hr *Pay range offered to a successful candidate will be based on several factors, including the candidate's education, work experience, work location, specific job duties, certifications, etc.
Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre-paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP)., $149,000.00 - $248,300.00 per year