> Markdown version of [/jobs/ext/2693727-software-engineer-platform-inference-organization](https://www.wearedevelopers.com/jobs/ext/2693727-software-engineer-platform-inference-organization). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, Platform & Inference Organization

- **Company:** Chai Discovery, Inc.
- **Location:** San Francisco, CA, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Cloud Computing, Distributed Systems, Software Engineering, Graphics Processing Unit (GPU), Autoscaling, Caching, Machine Learning Operations
- **Published:** September 3, 2026
- **Apply:** https://www.careerbuilder.com/job-details/software-engineer-platform-inference-san-francisco-ca--b2d6bc2c-0bdb-4778-9717-8bea29ba6c35

## About the Role

We index on systems judgment, ownership, and the scars that come from having run production infrastructure before. We're looking for engineers who get obsessed with hard problems and don't give up easily. We look for:

 * 4+ years building production systems, with real depth in performance, distributed systems, or ML serving
 * Experience optimizing model inference: GPU utilization, batching, quantization, caching, or kernel-level work
 * A platform mindset: you like building the tools and abstractions that make other engineers and researchers faster
 * End-to-end ownership of 24/7 systems, including observability, alerting, and incident response
 * Experience across both 0-to-1 buildouts and 1-to-n scale-ups, with an always-evolving playbook you bring wherever you go
 * The instinct to treat cost and efficiency as first-class constraints, not afterthoughts

A background in biology is not required. What makes the difference is technical excellence, curiosity about the domain, and grit.
We offer

The opportunity to work at the vanguard of AI research and frontier biology, with world-class people, on a mission that matters. We protect & promote a culture of high velocity and ownership. We compensate our team accordingly.

Skills:
Artificial Intelligence (AI), Autoscaling, Biochemistry, Biology, Biotech and Pharmaceutical, Cloud Computing, Distributed Computing, Drug Discovery, GPU (Graphics Processing Unit), Incident Response, Infrastructure Software, Machine Tool, Product Engineering, Production Systems, Research Skills, Software Engineering, Training/Teaching, Vehicle Fleets

## Description

Platform engineers make Chai's models fast, cheap, and reliable at scale, and enable the outer loop that accelerates research: the infrastructure and software abstractions used to train, eval, and understand models.

You'll own the serving stack that turns our frontier models into a product scientists depend on: latency, throughput, GPU efficiency, batching, and autoscaling across a large multi-cloud GPU fleet. You'll also contribute to the work that enables turning raw models into product-ready pipelines, and the experiment and observability tooling that lets a researcher ship faster.

You've built high-performance services that developers love, moved ML systems into production at scale, and can see around corners before they become outages.

You'll work closely with the researchers who train the models, the product engineers who build on them, and the commercial team deploying them to the world's largest pharma companies.


## Related Videos

- [HTTP headers that make your website go faster](https://www.wearedevelopers.com/videos/1676-http-headers-that-make-your-website-go-faster)
- [Fifty Shades of Kubernetes Autoscaling](https://www.wearedevelopers.com/videos/813-fifty-shades-of-kubernetes-autoscaling)
- [Green Cloud Computing](https://www.wearedevelopers.com/videos/592-green-cloud-computing)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [Event based cache invalidation in GraphQL](https://www.wearedevelopers.com/videos/433-event-based-cache-invalidation-in-graphql)
- [Geometric deep learning for drug discovery](https://www.wearedevelopers.com/videos/264-geometric-deep-learning-for-drug-discovery)

## Related Articles

- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)