Hadoop Engineer

Collabera

Plano, TX, United States

6 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

6 years minimum

Compensation

$135,200.0 - $145,600.0

Working hours

Regular working hours

Job source

collabera.com

Tech stack

Java (Programming Language) Artificial Intelligence User Authentication Big Data Cloud Computing Cloudera Impala Apache Hadoop Hadoop Distributed File System Apache HBase Apache Hive Job Scheduling Python (Programming Language)

+20 more

Kerberos (Protocol) Machine Learning OpenShift Oracle (Applications) Performance Tuning Ansible Cloudera Azure Machine Learning Shell Script SQL Databases Talend Apache Yarn Snowflake Apache Spark Jupyter Kubernetes Apache Kafka Docker Jenkins Databricks

Job description

We are Seeking a Hadoop Engineer (SME) to support enterprise Big Data platforms, focusing on Cloudera Hadoop, Spark, Kafka, OpenShift, Docker, and AI/ML technologies. This role is responsible for platform administration, cluster management, automation, monitoring, and production support while partnering with development, infrastructure, and vendor teams. Day-to-Day o Administer and support Hadoop platforms (Cloudera, Spark, Kafka, Hive, Impala, HBase, YARN). o Manage upgrades, deployments, monitoring, performance tuning, and capacity planning. o Troubleshoot Hadoop clusters, HDFS, Kerberos authentication, and production issues. o Support OpenShift, Docker, and Data Science platforms (Jupyter). o Automate operational tasks using Ansible, Jenkins, Python, and Shell scripting.

Requirements

o Six plus years of relevant work experience. Strong Cloudera Hadoop administration experience. o Expertise with Hadoop ecosystem (HDFS, Spark, Kafka, Hive, Impala, HBase, YARN). o Linux/Unix administration and Python/Shell scripting. o Experience with Kerberos/AD authentication. o Monitoring, job scheduling, and automation (Ansible/Jenkins). o Experience supporting enterprise Big Data production environments. Plusses o Databricks, Snowflake, Talend, ELK, or AI/ML platforms. o OpenShift, Docker, or Kubernetes experience. o Java and SQL/Oracle experience. o Cloudera or Cloud certifications.

Benefits & conditions

The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)

About the company

At Collabera, we don’t just offer jobs-we build careers. As a global leader in talent solutions, we provide opportunities to work with top organizations, cutting-edge technologies, and dynamic teams. Our culture thrives on innovation, collaboration, and a commitment to excellence. With continuous learning, career growth, and a people-first approach, we empower you to achieve your full potential. Join us and be part of a company that values passion, integrity, and making an impact.

Job Requirement o Hadoop o CLoudera o Big Data platforms