Hadoop Architect + Data Engineer + Capacity Analytics Architect
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+26 more
Job description
- Build analytics solutions within the Enterprise Data Warehouse and enterprise data lake to deliver capacity and resource insights.
- Develop a single source of truth for capacity, storage, compute, onboarding demand, and platform hygiene data.
- Design scalable data models and analytical datasets across Hadoop and cloud platforms.
- Automate reporting and dashboards to support leadership decision-making.
- Analyze CPU, memory, and workload utilization using YARN, Hive, and Impala metrics for resource reporting.
- Leverage HDFS CLI and FSImage analysis to assess storage and compute utilization, including Ozone and object storage platforms.
- Develop API-driven ETL pipelines using cURL, PySpark, and shell scripting with Autosys scheduling and monitoring.
- Use Cloudera Manager, Pepperdata, and/or Acceldata Pulse for platform monitoring and operational insights.
- Translate complex data into actionable insights and executive-ready narratives.
- Lead POCs for emerging technologies and recommend scalable implementation strategies.
Requirements
We are seeking a Senior Data Solutions Architect to join our dynamic Enterprise Data Platforms Advanced Analytics team. The ideal candidate will have strong experience in Hadoop architecture, enterprise data lakes, capacity and resource analytics, and API-driven ETL and a proven ability to design and deliver scalable analytics solutions that drive platform insights, automate reporting, and enable data-driven decisions., * Deep Hadoop architecture expertise, including HDFS, HBase, Ozone, MinIO, Hive, Impala, YARN, and Hadoop CLI.
- Proficiency with FSImage analysis and storage compute utilization assessment.
- Hands-on API programming and ETL using cURL, PySpark, Python, shell scripting, and PowerShell.
- Experience with Autosys for scheduling, monitoring, and error resolution.
- Strong data modeling, advanced query writing, and analytical dataset development skills.
- Experience with Cloudera data services, Cloudera Manager, Pepperdata, and/or Acceldata Pulse.
- Familiarity with object storage and S3-compatible platforms, bucket-based storage models, and cloud storage concepts.
- Proficiency in Excel automation using VBA, Power Query, and scripting; familiarity with Tableau and Power BI.
- RDBMS experience, including Teradata and PostgreSQL.
- Demonstrated ability to operate independently with ownership, attention to detail, and a continuous improvement mindset.
Preferred Skills:
- Experience with Prometheus and Grafana for advanced platform visibility and trend analysis.
- Experience in cloud or hybrid data ecosystems and compute analytics.
Benefits & conditions
- Competitive compensation and benefits.
- Opportunities for growth with global clients.
- A supportive, inclusive culture that values innovation and people.
- Exposure to cutting-edge technologies and projects.
About the company
BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developer’s Story
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again