Hadoop Architect + Data Engineer + Capacity Analytics Architect

BCforward
United States
5 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$153,234.0
Working hours
Regular working hours
Job source

Tech stack

Adaptable Database Systems Application Programming Interfaces (APIs) Amazon S3 Business Analytics Applications CA Workload Automation Ae Cloud Storage Cloudera Impala Data as a Services Extract Transform Load (ETL) Data Systems Data Warehousing Relational Databases
+26 more
Database Queries Apache Hadoop Hadoop Distributed File System Apache HBase Apache Hive Python (Programming Language) CURL PostgreSQL Windows PowerShell Power BI Prometheus Cloudera Shell Script Tableau (Software) Teradata SQL Enterprise Data Management Scripting Apache Yarn Cloudera Manager Grafana Advanced Reports Powerquery Pyspark Vba Programming Language Data Analytics Api Design

Job description

  • Build analytics solutions within the Enterprise Data Warehouse and enterprise data lake to deliver capacity and resource insights.
  • Develop a single source of truth for capacity, storage, compute, onboarding demand, and platform hygiene data.
  • Design scalable data models and analytical datasets across Hadoop and cloud platforms.
  • Automate reporting and dashboards to support leadership decision-making.
  • Analyze CPU, memory, and workload utilization using YARN, Hive, and Impala metrics for resource reporting.
  • Leverage HDFS CLI and FSImage analysis to assess storage and compute utilization, including Ozone and object storage platforms.
  • Develop API-driven ETL pipelines using cURL, PySpark, and shell scripting with Autosys scheduling and monitoring.
  • Use Cloudera Manager, Pepperdata, and/or Acceldata Pulse for platform monitoring and operational insights.
  • Translate complex data into actionable insights and executive-ready narratives.
  • Lead POCs for emerging technologies and recommend scalable implementation strategies.

Requirements

We are seeking a Senior Data Solutions Architect to join our dynamic Enterprise Data Platforms Advanced Analytics team. The ideal candidate will have strong experience in Hadoop architecture, enterprise data lakes, capacity and resource analytics, and API-driven ETL and a proven ability to design and deliver scalable analytics solutions that drive platform insights, automate reporting, and enable data-driven decisions., * Deep Hadoop architecture expertise, including HDFS, HBase, Ozone, MinIO, Hive, Impala, YARN, and Hadoop CLI.

  • Proficiency with FSImage analysis and storage compute utilization assessment.
  • Hands-on API programming and ETL using cURL, PySpark, Python, shell scripting, and PowerShell.
  • Experience with Autosys for scheduling, monitoring, and error resolution.
  • Strong data modeling, advanced query writing, and analytical dataset development skills.
  • Experience with Cloudera data services, Cloudera Manager, Pepperdata, and/or Acceldata Pulse.
  • Familiarity with object storage and S3-compatible platforms, bucket-based storage models, and cloud storage concepts.
  • Proficiency in Excel automation using VBA, Power Query, and scripting; familiarity with Tableau and Power BI.
  • RDBMS experience, including Teradata and PostgreSQL.
  • Demonstrated ability to operate independently with ownership, attention to detail, and a continuous improvement mindset.

Preferred Skills:

  • Experience with Prometheus and Grafana for advanced platform visibility and trend analysis.
  • Experience in cloud or hybrid data ecosystems and compute analytics.

Benefits & conditions

  • Competitive compensation and benefits.
  • Opportunities for growth with global clients.
  • A supportive, inclusive culture that values innovation and people.
  • Exposure to cutting-edge technologies and projects.

About the company

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:28 min

Building shared Java modules and analyst targeting platforms

Chris Heilmann +2 · LIVE

1:45 min

The ubiquity of the curl library in connected devices

Daniel Stenberg · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

5:08 min

Interacting with payloads and content types using curl

Micah Silverman · World Congress 2022

Videos

See all

Related articles

See all