> Markdown version of [/jobs/ext/1323686-senior-software-engineer-foundation-model-api](https://www.wearedevelopers.com/jobs/ext/1323686-senior-software-engineer-foundation-model-api). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer, Foundation Model API

- **Company:** Databricks
- **Location:** San Francisco, CA, United States
- **Experience:** Expert
- **Salary:** $160,000.0 - $225,000.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Computer Programming, Distributed Systems, Monitoring of Systems, Python (Programming Language), Service-Oriented Architecture, Cloud Platform System, Delivery Pipeline, Large Language Models, Backend, Low Latency, Machine Learning Operations, Restful APIs, GPT, Databricks
- **Published:** July 17, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=83f56cb7ad0d6179

## About the Role

* 8+ years of experience in backend or infrastructure engineering
 * Experience with distributed systems, scalable APIs, or cloud-native infrastructure
 * Strong product and ownership mindset, with a focus on shipping user-facing value
 * Experience with real-time serving, ML infrastructure, or GPU orchestration
 * Familiarity with service-oriented architecture, deployment pipelines, and system observability
 * Strong programming skills in Scala, Go, or Python

## Description

* Build LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama)
 * Shape the direction of the FMAPI product - from roadmap to execution - by leveraging deep customer empathy and direct engagement with enterprise users and model providers
 * Improve reliability, latency, and efficiency of distributed AI workloads
 * Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
 * Shape how developers and data scientists build and interact with AI on Databricks


## Related Videos

- [Developer Experience, Platform Engineering and AI powered Apps](https://www.wearedevelopers.com/videos/990-developer-experience-platform-engineering-and-ai-powered-apps)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)
- [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [The Best X (Twitter) Accounts for Developers](https://www.wearedevelopers.com/magazine/294-the-best-x-twitter-accounts-for-developers)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)