> Markdown version of [/jobs/ext/3955754-software-engineer-batch-processing-platform](https://www.wearedevelopers.com/jobs/ext/3955754-software-engineer-batch-processing-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer - Batch Processing Platform

- **Company:** Spectraforce
- **Location:** San Francisco, CA, United States
- **Experience:** Experienced
- **Contract:** Temporary contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, Batch Processing, Big Data, Computer Programming, Data Infrastructure, Extract Transform Load (ETL), Data Warehousing, Apache Hadoop, Python (Programming Language), Data Processing, Data Ingestion, Apache Spark, Information Technology, Presto, Stream Processing, Data Pipelines, Programming Languages
- **Published:** October 27, 2026
- **Apply:** http://leoforce.us/Careers/Spectraforce/JobDetails.html?jobid=bb50e031-a34f-4e2b-afb1-b1916f43f39b&OrgId=1&UserId=4939

## About the Role

* Industry Experience: 2+ years of experience in big data infrastructure or data warehouse engineering.
 * Programming Skills: Strong experience in at least one programming language, such as Java, Scala, or Python.
 * Big Data Technologies: Hands-on experience with big data infrastructure and processing technologies, such as Hadoop, Spark, Airflow, Presto, or Trino.
 * Data Processing: Experience using big data technologies for large-scale data processing and ETL pipelines.
 * Communication Skills: Good verbal and written communication skills.
 * Data at Scale: A passion for working with data at hundreds of petabytes scale.
 * AI Tools: Understanding of how to use AI tools effectively.
 * Research and Publications: Publications at technical conferences are a plus.

Education

 * Bachelor's degree in Computer Science or a related field, or equivalent practical experience.

## Description

* The Batch Processing Platform team is responsible for building and maintaining end-to-end big data infrastructure, data warehousing, and business intelligence solutions that power the company's business operations.
 * The team manages critical data infrastructure, including log ingestion, batch and stream processing, big data query engines, and workflow systems. It also develops and maintains data processing and ETL pipelines that support data warehousing and business intelligence.

What You'll Do

 * Build and maintain infrastructure platforms and data processing pipelines that support critical business needs.
 * Work with cutting-edge big data technologies, including Hadoop, Spark, Airflow, Presto, and Trino.
 * Contribute to large-scale data processing and infrastructure solutions capable of handling hundreds of petabytes of data.
 * Support data warehousing, business intelligence, and other data-driven business initiatives.