> Markdown version of [/jobs/ext/2733832-software-engineer-data-acquisition](https://www.wearedevelopers.com/jobs/ext/2733832-software-engineer-data-acquisition). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, Data Acquisition

- **Company:** OpenAI Inc.
- **Location:** San Francisco, CA, United States
- **Experience:** Experienced
- **Salary:** $293,000.0
- **Contract:** Permanent contract
- **Skills:** Databases, Distributed Systems, Search Technologies, Software Engineering, Data Streaming, Web Crawlers, Data Processing, Data Storage Technologies, Data Ingestion, Backend, Kubernetes, Information Technology
- **Published:** September 5, 2026
- **Apply:** https://jobs.localjobnetwork.com/apply/add/82496315/1

## About the Role

* BS/MS/PhD in Computer Science or a related field.
 * 4+ years of industry experience in software development.
 * Experience with large web crawlers a plus
 * Strong expertise in large stateful distributed systems and data processing.
 * Proficiency in Kubernetes, and Infrastructure-as-Code concepts.
 * Willingness and enthusiasm for trying new approaches and technologies.
 * Ability to handle multiple tasks and adapt to changing priorities.
 * Strong communication skills, both written and verbal.

## Description

The Data Acquisition team within the Foundations organization at OpenAI is responsible for all aspects of data collection to support our model training operations. Our team manages web crawling and GPTBot services and works closely with Data Processing, Architecture, and Scaling teams. We are looking for a skilled Software Engineer to join our Data Acquisition team., * Own and lead engineering projects in the area of data acquisition including web crawling, data ingestion, and search.

 * Collaborate with other sub-teams, such as Data Processing, Architecture, and Scaling, to ensure smooth data flow and system operability.
 * Work closely with the legal team to handle any compliance or data privacy-related matters.
 * Develop and deploy highly scalable distributed systems capable of handling petabytes of data.
 * Architect and implement algorithms for data indexing and search capabilities.
 * Build and maintain backend services for data storage, including work with key-value databases and synchronization.
 * Deploy solutions in a Kubernetes Infrastructure-as-Code environment and perform routine system checks.
 * Conduct and analyze experiments on data to provide insights into system performance.


## Related Videos

- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases)
- [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean)
- [The Data Phoenix: The future of the Internet and the Open Web](https://www.wearedevelopers.com/videos/1116-the-data-phoenix-the-future-of-the-internet-and-the-open-web)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)