Software Engineering SMTS
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+24 more
Job description
Build the inference platform behind Salesforceβs AI agents.
Behind every Salesforce AI agent is a model, and behind every model is infrastructure that has to be fast, cheap, and secure. Weβre building the Kubernetes-based platform that serves those models: a large and fast-growing fleet of custom models handling massive volumes of LLM traffic across multiple public clouds. Youβll join the Hyperforce Container Platform (HCP) team and build the layer beneath the models: GPU scheduling, distributed inference, and model serving.
This role is for engineers who want their code in the serving path of nearly every agentic request. Youβll work in the open-source ecosystem that the AI industry runs on, and make it production-grade for enterprise requirements: reliability, security, and strict tenant isolation., * Build the inference platform. Design and build core capabilities on Kubernetes: GPU scheduling, distributed model serving, and intelligent request routing.
- Scale the LLM runtime. Support both inference and training with high-throughput serving and distributed multi-GPU execution.
- Make shared GPUs a multi-tenant service. Drive inference performance and cost efficiency at fleet scale, with strong tenant isolation.
- Treat AI as a first-class workload. Secure and operate it on the same service mesh, workload identity, and caching layer as every other Salesforce service.
- Build the agentic runtime layer. Work on multi-agent orchestration, retrieval-augmented generation (RAG), knowledge graphs, and evaluation for accuracy and safety.
- Isolate untrusted workloads. Build sandboxing for AI agents and the code they generate, keeping production workloads separated from each other.
- Own reliability end to end. Run services to a 99.99% availability SLA, and make the platform observable and self-healing at fleet scale.
- Shape the open-source foundations. Contribute upstream to vLLM, llm-d, Ray, and Kueue, Agent Substrate, and influence their direction and roadmaps., * Have used inference and orchestration stacks such as vLLM, llm-d, Ray, or Kueue
- Have hands-on experience with GPU scheduling, CUDA, or inference performance tuning
- Know networking fundamentals: TCP/IP, DNS, and TLS termination
- Have used Terraform and Argo, and observability tools such as Prometheus, Grafana, Splunk, or Elasticsearch
- Have built multi-agent or RAG systems, or worked with knowledge graphs and LLM-as-judge evaluation
- Have contributed to open-source projects upstream
Requirements
- Have strong software engineering experience, with hands-on depth in distributed systems and production service ownership
- Have proven experience developing with AI coding agents (such as Claude Code, Cursor, or Copilot): you know how to direct them, review their output critically, and ship reliable code with them in your daily workflow
- Know Kubernetes well and have built controllers or operators using Go. Istio/Envoy mesh experience is a plus.
- Have built or operated services on a major public cloud (AWS or GCP)
- Have worked with managed AI platforms for training and inference, such as AWS SageMaker or Google Vertex AI
- Write Go fluently
- Have worked on AI/ML model serving, model training or agentic systems, and can reason about the architecture, cost, and quality of what you build
- Treat reliability as a design principle: observability, SLOs, and self-healing are built in from the start
- Hold a degree in a related technical field
Benefits & conditions
benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.
In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com.
At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions.
The typical base salary range for this position is $148,500 - $223,900 annually.
The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable.
About the company
Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isnβt a buzzword - itβs a way of life. The world of work as we know it is changing and weβre looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforceβs core values at the heart of it all.
Ready to level-up your career at the company leading workforce transformation in the agentic era? Youβre in the right place! Agentforce is the future of AI, and you are the future of Salesforce., Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace thatβs inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications - without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦