> Markdown version of [/jobs/ext/2718044-software-engineer-big-data](https://www.wearedevelopers.com/jobs/ext/2718044-software-engineer-big-data). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer - Big Data - **Company:** IBM INDIA PRIVATE LTD - **Location:** San Francisco, CA, United States (Remote available) - **Experience:** Expert - **Salary:** $130,000.0 - $196,500.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Amazon Web Services, Microsoft Azure, Batch Processing, Big Data, BigTable, BigQuery, Programming Tools, Gradle, Apache Hadoop, Apache Hive, Cloudera, Software Engineering, SQL Databases, Data Processing, Google Cloud, Cloud Platform System, Apache Spark, Kubernetes, Information Technology, Apache Kafka, Restful APIs, Terraform, Apache Beam, Docker - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/senior-software-engineer-big-data-c0013-liveramp-india-private-8463921 ## About the Role * 6+ years of professional software development experience, primarily focused on big data technologies. * 3+ years of experience writing and optimizing large-scale batch processing using Spark/Hadoop or similar * 3+ years of Java , SQL programming skills * 2+ years of experience using cloud based platforms such as GCP, AWS, Azure or similar technologies. * Experience with technologies like Docker, Terraform and/or Kubernetes * Startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive. * Bachelor's degree in a quantitative field such as Statistics, Mathematics, Computer Science, Engineering, Economics, or a related discipline. Nice to have: * Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Kafka, Hive, or Apache Beam * Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle * Experience with designing and implementing interfaces and infrastructure for large scale systems and RESTful APIs ## Description JobPosting MonetaryAmount USD QuantitativeValue 196500 130000 YEAR 2026-06-02T00:00:00Z LiveRamp is the data collaboration platform of choice for the world's most innovative companies. A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is setting the new standard for building a connected customer view with unmatched clarity and context while protecting precious brand and consumer trust. LiveRamp offers complete flexibility to collaborate wherever data lives to support the widest range of data collaboration use cases-within organizations, between brands, and across its premier global network of top-quality partners. Hundreds of global innovators, from iconic consumer brands and tech giants to banks, retailers, and healthcare leaders turn to LiveRamp to build enduring brand and business value by deepening customer engagement and loyalty, activating new partnerships, and maximizing the value of their first-party data while staying on the forefront of rapidly evolving compliance and privacy requirements. We on the Identity Engineering team maintain the graph processing engine that connects the trillions of different identifiers for consumers and the devices they use online. Help us process this trillion edge graph as quickly and efficiently as possible. We handle product requests and enhancements, focusing on scalability, modernization, performance, cost, security, legal compliance, reliability, and quality. Projects include architectural refreshes like POCs for batch data processing, developing new REST APIs, and migrating applications to Spark and SingleStore. These initiatives aim to improve processing speed, scalability, maintainability, and cost-effectiveness. You will: * Lead complex problems, by breaking into their essential components, design and implement elegant solutions focussing on value delivered. * Deliver on the problems problems by collaborating with the team and cross functional teams * Modernize our applications to be modular, scalable by leveraging the latest stack * Collaborate closely with product managers, and other engineers to deliver high-quality software * Design with privacy and security-first principles and err on the side of shipping fast and iterating. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Modular Secrets to Lightning-Fast Android Builds](https://www.wearedevelopers.com/videos/1428-modular-secrets-to-lightning-fast-android-builds) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Best Countries for Software Engineers](https://www.wearedevelopers.com/magazine/267-best-countries-for-software-engineers)