Hadoop/Big Data Platform Engineer / SME

BCforward
Chicago, IL, United States
1 day ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
$153,234.0
Working hours
Shift work
Job source

Tech stack

Query Performance Java (Programming Language) CA Workload Automation Ae Bash Shell Cloud Computing Cloudera Impala Encodings Databases Data Infrastructure Data Warehousing Software Debugging Disaster Recovery
+34 more
Perl (Programming Language) File System Permissions Apache Hadoop Hadoop Distributed File System Apache HBase Apache Hive Job Scheduling Python (Programming Language) Kerberos (Protocol) PostgreSQL OpenShift Oracle (Applications) Ansible Cloudera Simple Data Format Apache Solr SQL Databases Subversion Tableau (Software) Apache Zookeeper Enterprise Data Management Scripting Enterprise Software Applications Apache Yarn DevOps Tools - Open-source Apache Spark Sybase Jupyter Containerization Sentry Apache Kafka Bitbucket Docker Jenkins

Job description

  • Provide subject matter expertise for Cloudera Hadoop and Data Science platforms, including Jupyter, OpenShift, and Docker cluster administration.
  • Manage platform operations across environments, including upgrades, patches, deployments, monitoring, forecasting, and disaster recovery.
  • Own incident, problem, and capacity management for Hadoop and associated services.
  • Debug and troubleshoot YARN, Spark, and Impala jobs, including resource utilization and query performance tuning.
  • Address NameNode, HDFS space, file and folder permissions, and backup issues.
  • Integrate platform solutions with external applications and enterprise platforms.
  • Analyze Hadoop logs, compression, encoding, and file formats to resolve production issues and improve stability.
  • Collaborate with clients, development teams, vendors, and partners to deliver technical solutions that meet user needs.
  • Support L1, L2, and L3 operations and establish runbooks and automation for repeatable tasks.
  • Implement monitoring, alerting, and job scheduling using enterprise tools.

Requirements

We are seeking a Hadoop Engineer (SME) to join our dynamic team. The ideal candidate will have strong experience in Big Data platform engineering and administration across Cloudera, Spark, Kafka, Hive, Impala, HBase, and containerized environments and a proven ability to operate and optimize enterprise data platforms, integrate solutions, and resolve complex production issues across environments., * Expertise in Cloudera Hadoop components: HDFS, YARN, Hive, Impala, HBase, Kafka, Sentry, Solr, Hue, Zookeeper, and Postgres.

  • Hands-on experience with Spark, Kafka, Hive, Impala, Ozone, and Hadoop ecosystem tooling.
  • Strong Hadoop architecture knowledge, HDFS operations, and cluster administration with AD/Kerberos integration.
  • Proficiency in Unix/Linux, SQL, and relational/data warehouse concepts across Sybase, Oracle, or similar databases.
  • Scripting and development skills in Java, Python, Perl, and Shell for automation and tooling.
  • Experience with monitoring, alerting, and job scheduling systems, including Autosys.
  • Comfort with frequent, incremental testing and deployment in agile environments.
  • Automation and DevOps tooling experience with Ansible, Jenkins, SVN, and Bitbucket.
  • Experience supporting enterprise users and platforms at L1, L2, and L3 levels.

Preferred Skills:

  • Cloudera Administrator or Developer certification.
  • Certification or experience with Cloud, Docker, and OpenShift technologies.
  • Experience with Tableau, including dashboards connected to Hadoop/Hive tables.

Benefits & conditions

  • Competitive compensation and benefits.
  • Opportunities for growth with global clients.
  • A supportive, inclusive culture that values innovation and people.
  • Exposure to cutting-edge technologies and projects.

Role Logistics

  • Shift options: 8:00 AM - 5:00 PM ET or 12:30 PM - 9:30 PM ET.
  • Hours per day: 8. Labor type: Technical.

About the company

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:22 min

Overview of the Sentry error and performance monitoring platform

Priscila Oliveira · World Congress 2023

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

1:28 min

Building shared Java modules and analyst targeting platforms

Chris Heilmann +2 · LIVE

3:21 min

Installing and configuring the Sentry JavaScript SDK for applications

Priscila Oliveira · World Congress 2023

Videos

See all

Related articles

See all