Hadoop Platform Support Engineer
InfiCare Technologies
Charlotte, United States of America
yesterday
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
EnglishJob location
Charlotte, United States of America
Tech stack
System Configuration
Data as a Services
Information Engineering
Data Integrity
Hadoop
Hadoop Distributed File System
Performance Tuning
Data Streaming
Google Cloud Platform
Data Ingestion
System Availability
Data Pipelines
Job description
Our client is seeking a skilled Data Engineer with a strong focus on Hadoop Distributed File System (HDFS) to join their team in Charlotte, NC. The ideal candidate will be responsible for the support and maintenance of the Hadoop platform, ensuring optimal performance and reliability. This is an L3 platform support role - candidates from a platform operations/support background are strongly preferred over development or build profiles., * Provide L3 support for the Hadoop platform, troubleshooting and resolving issues to ensure high availability and performance
- Manage and maintain HDFS, ensuring data integrity and security
- Collaborate with data scientists and analysts to understand data requirements and optimize data pipelines
- Implement and monitor data ingestion processes for efficient data flow into the Hadoop ecosystem
- Integrate Google Cloud Platform cloud-based solutions with on-premises Hadoop infrastructure
- Develop and maintain documentation for data engineering processes, data models, workflows, and system configurations
- Participate in capacity planning and performance tuning of the Hadoop environment
Requirements
- Strong knowledge of Hadoop Distributed File System (HDFS) and its architecture
- Hands-on experience with L3 support and maintenance of Hadoop platforms
- Proficiency in managing and optimizing data workflows within the Hadoop ecosystem
- Familiarity with Google Cloud Platform (Google Cloud Platform) and its data services
- Experience with data ingestion tools and techniques