Hadoop developer
Role details
Job location
Tech stack
Job description
Seeking a Hadoop Engineer (SME) to support enterprise Big Data platforms, focusing on Cloudera Hadoop, Spark, Kafka, OpenShift, Docker, and AI/ML technologies. This role is responsible for platform administration, cluster management, automation, monitoring, and production support while partnering with development, infrastructure, and vendor teams. Day-to-Day o Administer and support Hadoop platforms (Cloudera, Spark, Kafka, Hive, Impala, HBase, YARN). o Manage upgrades, deployments, monitoring, performance tuning, and capacity planning. o Troubleshoot Hadoop clusters, HDFS, Kerberos authentication, and production issues. o Support OpenShift, Docker, and Data Science platforms (Jupyter). o Automate operational tasks using Ansible, Jenkins, Python, and Shell scripting.
Requirements
o Six plus years of relevant work experience. Strong Cloudera Hadoop administration experience. o Expertise with Hadoop ecosystem (HDFS, Spark, Kafka, Hive, Impala, HBase, YARN). o Linux/Unix administration and Python/Shell scripting. o Experience with Kerberos/AD authentication. o Monitoring, job scheduling, and automation (Ansible/Jenkins). o Experience supporting enterprise Big Data production environments. Plusses o Databricks, Snowflake, Talend, ELK, or AI/ML platforms. o OpenShift, Docker, or Kubernetes experience. o Java and SQL/Oracle experience. o Cloudera or Cloud certifications.
Benefits & conditions
The Company offers the following benefits for this position, subject to applicable eligibility requirements: medical insurance, dental insurance, vision insurance, 401(k) retirement plan, life insurance, long-term disability insurance, short-term disability insurance, paid parking/public transportation, (paid time, paid sick and safe time, hours of paid vacation time, weeks of paid parental leave, paid holidays annually - AS Applicable)