> Markdown version of [/jobs/ext/658782-big-data-senior-developer](https://www.wearedevelopers.com/jobs/ext/658782-big-data-senior-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Big Data Senior Developer

- **Company:** Pyramid Consulting Inc.
- **Location:** Sunnyvale, CA, United States
- **Experience:** Expert
- **Salary:** $97,700.0 - $144,400.0
- **Contract:** Temporary contract
- **Skills:** Java (Programming Language), Data Analysis, Software Applications, Big Data, Software Debugging, Software Design Documents, Distributed Systems, Apache Hadoop, MapReduce, Apache HBase, Apache Hive, Python (Programming Language), SQL Databases, Java Application Server, Apache Yarn, Beeline, Apache Spark, Ansi Sql, Apache Kafka, Puppet, Pyramid, Spring Batch
- **Published:** June 26, 2026
- **Apply:** https://www.jofdav.com/jobs/58567284-big-data-senior-developer

## About the Role

* Loading and processing from disparate data sets using appropriate technologies including but not limited to, Hive, Pig, MapReduce, HBase, Spark, Storm and Kafka.
 * Requires a bachelor's degree in area of specialty and 3 - 5 years of experience in the field or in a related area.
 * Familiar with standard concepts, practices, and procedures within a particular field.
 * 3 to 5 years of Java experience.
 * Strong communication skills.
 * Experience with Hbase, kafka and spark
 * Expert in HIVE SQL and ANSI SQL - Great hands on in Data Analysis using SQL.
 * Ability to write simple to complicated SQL in addition to having ability to comprehend and support data questions/analysis using already written existing complicated queries.
 * Familiarity in Dev/Ops (Puppet, Chef, Python).
 * Understanding of Big Data concepts and common components including YARN, Queues, Hive, Beeline, AtScale, Datameer, Kafka, and HDF.

## Description

* Designs, develops, and implements web-based Java applications to support business requirements.
 * Follows approved life cycle methodologies, creates design documents, and performs program coding and testing.
 * Resolves technical issues through debugging, research, and investigation. Relies on experience and judgment to plan and accomplish goals.
 * Performs a variety of tasks.
 * A degree of creativity and latitude is required.
 * Typically reports to a - or manager.
 * Codes software applications to adhere to designs supporting internal business requirements or external customers.
 * Standardizes the quality assurance procedure for software.
 * Oversees testing and develops fixes.
 * Contribute to the Design and develop high quality software for large scale Java/Spring Batch/Hadoop distributed systems.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [SMART Test Automation - the experience of legacy transformation](https://www.wearedevelopers.com/videos/100215-smart-test-automation-the-experience-of-legacy-transformation)
- [Automate everything via NodeJS and Puppeteer](https://www.wearedevelopers.com/videos/322-automate-everything-via-nodejs-and-puppeteer)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Testing AI Agents: Automated Evaluation for Chatbots & RAG Systems](https://www.wearedevelopers.com/videos/100300-testing-ai-agents-automated-evaluation-for-chatbots-rag-systems)
- [The Memory Leak That Ate Our Cluster: A Postmortem](https://www.wearedevelopers.com/videos/2057-the-memory-leak-that-ate-our-cluster-a-postmortem)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [93 Java Interview Questions You Should Prepare For](https://www.wearedevelopers.com/magazine/14-93-java-interview-questions-you-should-prepare-for)