Software Engineering SMTS

Salesforce Inc.
Bellevue, WA, United States
2 days ago
Apply on salesforce.wd12.myworkdayjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$148,500 - $223,900
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Nvidia CUDA Cursor Distributed Systems Domain Name System (DNS) Elasticsearch Graph Database Machine Learning Networking Basics Open Source Technology Performance Tuning
+24 more
Prometheus Microsoft Copilot Salesforce.Com Software Engineering TCP/IP Graphics Processing Unit (GPU) Transport Layer Security Istio Retrieval-Augmented Generation Large Language Models Claude Code Grafana Multi-Agent Systems Google Vertex AI Generative AI AI Coding Agents Agentic-AI Build Management AI Platforms Kubernetes Machine Learning Operations Virtual Agents Terraform Splunk

Job description

Build the inference platform behind Salesforce’s AI agents.

Behind every Salesforce AI agent is a model, and behind every model is infrastructure that has to be fast, cheap, and secure. We’re building the Kubernetes-based platform that serves those models: a large and fast-growing fleet of custom models handling massive volumes of LLM traffic across multiple public clouds. You’ll join the Hyperforce Container Platform (HCP) team and build the layer beneath the models: GPU scheduling, distributed inference, and model serving.

This role is for engineers who want their code in the serving path of nearly every agentic request. You’ll work in the open-source ecosystem that the AI industry runs on, and make it production-grade for enterprise requirements: reliability, security, and strict tenant isolation., * Build the inference platform. Design and build core capabilities on Kubernetes: GPU scheduling, distributed model serving, and intelligent request routing.

  • Scale the LLM runtime. Support both inference and training with high-throughput serving and distributed multi-GPU execution.
  • Make shared GPUs a multi-tenant service. Drive inference performance and cost efficiency at fleet scale, with strong tenant isolation.
  • Treat AI as a first-class workload. Secure and operate it on the same service mesh, workload identity, and caching layer as every other Salesforce service.
  • Build the agentic runtime layer. Work on multi-agent orchestration, retrieval-augmented generation (RAG), knowledge graphs, and evaluation for accuracy and safety.
  • Isolate untrusted workloads. Build sandboxing for AI agents and the code they generate, keeping production workloads separated from each other.
  • Own reliability end to end. Run services to a 99.99% availability SLA, and make the platform observable and self-healing at fleet scale.
  • Shape the open-source foundations. Contribute upstream to vLLM, llm-d, Ray, and Kueue, Agent Substrate, and influence their direction and roadmaps., * Have used inference and orchestration stacks such as vLLM, llm-d, Ray, or Kueue
  • Have hands-on experience with GPU scheduling, CUDA, or inference performance tuning
  • Know networking fundamentals: TCP/IP, DNS, and TLS termination
  • Have used Terraform and Argo, and observability tools such as Prometheus, Grafana, Splunk, or Elasticsearch
  • Have built multi-agent or RAG systems, or worked with knowledge graphs and LLM-as-judge evaluation
  • Have contributed to open-source projects upstream

Requirements

  • Have strong software engineering experience, with hands-on depth in distributed systems and production service ownership
  • Have proven experience developing with AI coding agents (such as Claude Code, Cursor, or Copilot): you know how to direct them, review their output critically, and ship reliable code with them in your daily workflow
  • Know Kubernetes well and have built controllers or operators using Go. Istio/Envoy mesh experience is a plus.
  • Have built or operated services on a major public cloud (AWS or GCP)
  • Have worked with managed AI platforms for training and inference, such as AWS SageMaker or Google Vertex AI
  • Write Go fluently
  • Have worked on AI/ML model serving, model training or agentic systems, and can reason about the architecture, cost, and quality of what you build
  • Treat reliability as a design principle: observability, SLOs, and self-healing are built in from the start
  • Hold a degree in a related technical field

Benefits & conditions

benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.

In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com.

At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions.

The typical base salary range for this position is $148,500 - $223,900 annually.

The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable.

About the company

Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword - it’s a way of life. The world of work as we know it is changing and we’re looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce’s core values at the heart of it all.

Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce., Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications - without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on salesforce.wd12.myworkdayjobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…