> Markdown version of [/jobs/ext/4713808-staff-software-engineer-ai-gateway](https://www.wearedevelopers.com/jobs/ext/4713808-staff-software-engineer-ai-gateway). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Staff Software Engineer - AI Gateway - **Company:** Databricks - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $190,000 - $261,250 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Computer Programming, Distributed Systems, Monitoring of Systems, Azure Machine Learning, Service-Oriented Architecture, AI Infrastructure, Cloud Platform System, Delivery Pipeline, Backend, Low Latency, Automation Anywhere, Databricks - **Published:** November 14, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=5e8441703a1a7380 ## About the Role * 8+ years of experience in backend or infrastructure engineering * Strong programming skills in Scala, or Go * Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure * Familiarity with service-oriented architecture, deployment pipelines, and system observability * Strong product and ownership mindset. You care about building the right solution, not just any solution, * Experience with real-time serving, AI infrastructure, or GPU orchestration * Exposure to platforms like Bedrock, Vertex AI, or Azure ML * Experience building developer platforms or internal tools supporting AI workflows Pay Range Transparency ## Description * Build the routing layer that picks the right model for each request across quality, cost, latency, availability, and remaining budget * Improve reliability, latency, and efficiency of distributed AI workloads * Collaborate with research, platform, infra, and AI/ML teams to deliver seamless end-to-end experiences * Shape how developers and data scientists build and interact with AI on Databricks