Platform Engineer - Inference

SUBCONSCIOUS SYSTEMS LLC
Boston, MA, United States
1 day ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Microsoft Azure Continuous Integration Software Design Documents Open Source Technology Systems Development Life Cycle Prometheus Datadog Load Balancing Grafana Kubernetes SGLang
+2 more
VLLM Terraform

Job description

You will provide the battle-tested infrastructure experience needed to scale our platform to hundreds of thousands of users. Today, we serve billions of tokens per day. With your contributions, we’ll serve trillions., * Own the reliability, performance, observability, uptime, load balancing, and security of inference workloads.

  • Work closely with our research team to make new inference optimizations and open source model support broadly available to customers.
  • Contribute to the technical direction of our inference platform including major architecture and build vs. buy decisions.
  • Help build the product factory that makes our team ship code like a team 10x our size - including human-driven process, CI/CD, and agent guardrails.
  • Establish durable engineering culture through design docs, architecture reviews, mentorship, and hands-on implementation.

You will work across our inference stack, from the user-facing platform to GPU cache optimization.

Requirements

  • 5+ years in Platform, Infrastructure, or Inference engineering roles
  • Experience running Kubernetes at scale
  • Experience running AWS at scale
  • Deep observability experience - including Datadog (Prometheus and Grafana are a plus)
  • Expert in deployment jujitsu - zero downtime, rollbacks, blue/green, canary, etc. - we want someone with battle scars
  • Proficient in Terraform, CI/CD pipelines, and GitOps workflows
  • Experience with SDLC security and compliance processes
  • Staff-level judgment - you can define ambiguous problems, make pragmatic tradeoffs, influence without authority, and leave both systems and teams better than you found them. You can tell a good story with data.
  • Product sense - you solve problems by working backwards from the end-user and business requirements.
  • You have character, a sense of humor, and compassion. You are someone we are excited to introduce to our partner., * You have worked in startups before
  • You have worked on AI systems that serve trillions of tokens per day
  • Experience with vLLM, SGLang, or NVIDIA Dynamo
  • Experience with BYOC (bring your own cloud) implementations
  • Experience with SOC 2 - ideally having contributed to achieving compliance
  • Experience with GCP or Azure
  • Experience with agent-driven software delivery at scale

Benefits & conditions

We can’t build this company without you, and we want you to be a meaningful owner alongside us. Your equity will reflect that.

Salary will be between $180k-$230k with significant equity ownership.

We offer full medical, dental, and vision coverage, plus unlimited PTO. We order Shy Bird on Wednesdays in the office. #J-18808-Ljbffr

About the company

Agents are eating the economy, but it’s still the early days. Token useage is increasing 2,500% year over year, agents token consumption is growing 7x faster than humans, and adoption of agentic systems is on the rise across professions. All signs point to these trends continuing, as agentic workloads become irreplacable across software, cybersecurity, legal, finance, HR, sales, and science tasks. We are building the foundation.

Subconscious is an inference platform specifically designed to power long-running agents. For tasks that consume 200k+ tokens, our inference system delivers unparalleled speed, accuracy, and cost efficiency. As agents proliferate, Subconscious will be a provider in every agent stack.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…