> Markdown version of [/jobs/ext/4629499-platform-engineer-inference](https://www.wearedevelopers.com/jobs/ext/4629499-platform-engineer-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Platform Engineer - Inference

- **Company:** SUBCONSCIOUS SYSTEMS LLC
- **Location:** Boston, MA, United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Microsoft Azure, Continuous Integration, Software Design Documents, Open Source Technology, Systems Development Life Cycle, Prometheus, Datadog, Load Balancing, Grafana, Kubernetes, SGLang, VLLM, Terraform
- **Published:** November 7, 2026
- **Apply:** https://www.juju.com/job/28_25197_b3e9f41767cc9b0fce4f31c96e46ada6

## About the Role

* 5+ years in Platform, Infrastructure, or Inference engineering roles
 * Experience running Kubernetes at scale
 * Experience running AWS at scale
 * Deep observability experience - including Datadog (Prometheus and Grafana are a plus)
 * Expert in deployment jujitsu - zero downtime, rollbacks, blue/green, canary, etc. - we want someone with battle scars
 * Proficient in Terraform, CI/CD pipelines, and GitOps workflows
 * Experience with SDLC security and compliance processes
 * Staff-level judgment - you can define ambiguous problems, make pragmatic tradeoffs, influence without authority, and leave both systems and teams better than you found them. You can tell a good story with data.
 * Product sense - you solve problems by working backwards from the end-user and business requirements.
 * You have character, a sense of humor, and compassion. You are someone we are excited to introduce to our partner., * You have worked in startups before
 * You have worked on AI systems that serve trillions of tokens per day
 * Experience with vLLM, SGLang, or NVIDIA Dynamo
 * Experience with BYOC (bring your own cloud) implementations
 * Experience with SOC 2 - ideally having contributed to achieving compliance
 * Experience with GCP or Azure
 * Experience with agent-driven software delivery at scale

## Description

You will provide the battle-tested infrastructure experience needed to scale our platform to hundreds of thousands of users. Today, we serve billions of tokens per day. With your contributions, we'll serve trillions., * Own the reliability, performance, observability, uptime, load balancing, and security of inference workloads.

 * Work closely with our research team to make new inference optimizations and open source model support broadly available to customers.
 * Contribute to the technical direction of our inference platform including major architecture and build vs. buy decisions.
 * Help build the product factory that makes our team ship code like a team 10x our size - including human-driven process, CI/CD, and agent guardrails.
 * Establish durable engineering culture through design docs, architecture reviews, mentorship, and hands-on implementation.

You will work across our inference stack, from the user-facing platform to GPU cache optimization.