Hadoop Platform Support Engineer

InfiCare Technologies
Charlotte, United States of America
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Charlotte, United States of America

Tech stack

System Configuration
Data as a Services
Information Engineering
Data Integrity
Hadoop
Hadoop Distributed File System
Performance Tuning
Data Streaming
Google Cloud Platform
Data Ingestion
System Availability
Data Pipelines

Job description

Our client is seeking a skilled Data Engineer with a strong focus on Hadoop Distributed File System (HDFS) to join their team in Charlotte, NC. The ideal candidate will be responsible for the support and maintenance of the Hadoop platform, ensuring optimal performance and reliability. This is an L3 platform support role - candidates from a platform operations/support background are strongly preferred over development or build profiles., * Provide L3 support for the Hadoop platform, troubleshooting and resolving issues to ensure high availability and performance

  • Manage and maintain HDFS, ensuring data integrity and security
  • Collaborate with data scientists and analysts to understand data requirements and optimize data pipelines
  • Implement and monitor data ingestion processes for efficient data flow into the Hadoop ecosystem
  • Integrate Google Cloud Platform cloud-based solutions with on-premises Hadoop infrastructure
  • Develop and maintain documentation for data engineering processes, data models, workflows, and system configurations
  • Participate in capacity planning and performance tuning of the Hadoop environment

Requirements

  • Strong knowledge of Hadoop Distributed File System (HDFS) and its architecture
  • Hands-on experience with L3 support and maintenance of Hadoop platforms
  • Proficiency in managing and optimizing data workflows within the Hadoop ecosystem
  • Familiarity with Google Cloud Platform (Google Cloud Platform) and its data services
  • Experience with data ingestion tools and techniques

Apply for this position