Member of Technical Staff, Developer Infrastructure & Agent Automation

INCO AI INC.
Palo Alto, CA, United States
2 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$200,000 - $350,000
Working hours
Regular working hours
Job source

Tech stack

Bash Shell Code Review Nvidia CUDA Continuous Integration Cursor Software Debugging Linux Github General-Purpose Computing on Graphics Processing Units InfiniBand Python (Programming Language) Open Source Technology
+22 more
Remote Direct Memory Access Software Engineering Systems Integration Data Logging Pytorch Large Language Models Claude Code Grafana Caching AI Coding Agents Discretization Gitlab-ci Kubernetes SGLang Build Tools Slurm Observability for Autonomous Agents VLLM Model Inference Software Version Control Docker Jenkins

Job description

We are looking for a founding member to define how Inco builds software. You will own the internal developer platform (CI/CD, build systems, test infrastructure, and source control) while helping lead the shift to agent-driven engineering.

Your work will span developer tooling, automated research and experimentation, and production failure triage and remediation. You will work closely with other team members to understand their most demanding workflows, then turn those workflows into reliable automation and agent systems that reproduce results and expand what the team can accomplish. Just as importantly, you will earn trust across the organization and help teams adopt new ways of working.

You will set technical direction, make foundational decisions, and stay hands-on: prototyping agent harnesses and shipping the tooling yourself. The goal is a trusted agent-enabled environment that expands the team’s capacity and speed without sacrificing quality or reliability. Our organization is flat, and you will work directly with research, engineering, and production teams to carry ideas from inception through deployment.

Requirements

  • You are an effective change leader: you earn trust with technical peers, influence how teams work, and turn new tools and practices into durable habits
  • You are eager to invent new ways of working with LLMs and agents, pushing beyond the status quo to discover what agentic engineering can make possible
  • You have built internal developer platforms or dev-productivity infrastructure at scale, and you have integrated LLMs or coding agents into real engineering workflows, not just prototyped them
  • You reason across the full software development lifecycle: local dev, CI, testing, debugging, deployment
  • You treat internal tooling as a product and have real empathy for developer pain
  • You are drawn to the risk and upside of an early-stage startup
  • You embrace ambiguity and have a strong bias for action
  • You operate with a tech-lead mentality regardless of title or years of experience, * Strong generalist engineering ability across the full stack: Linux, Docker, GPU computing, Python, Bash, and CI/CD at scale
  • Experience with monorepos, build systems and caching, test infrastructure, and CI/CD platforms such as GitHub Actions, Buildkite, Jenkins, or GitLab CI
  • Fluency with coding agents, agent harnesses, and orchestration systems such as Claude Code, Cursor, Codex, MCP servers, and Humanize, including sandboxed execution environments, agent observability, and cost and quality controls.
  • Experience integrating LLMs into engineering workflows, including agentic code review, test and documentation generation, and migrations with appropriate supervision checkpoints, rollback strategies, and evaluations
  • Hands-on experience with cluster management systems such as Kubernetes, SkyPilot, Slurm, or comparable platforms, * Familiarity with LLM inference workloads and serving stacks, including model architectures, KV-cache management, and quantization; PyTorch, vLLM, and SGLang
  • Familiarity with GPU environments, including NVIDIA drivers, CUDA, NCCL, and InfiniBand/RDMA
  • Experience supporting CI for large open-source projects with 100+ contributors
  • Experience building observable, self-healing platforms with Grafana dashboards, structured logging, actionable alerting, and agent-driven incident triage and remediation
  • Experience improving operational reliability through stress testing, resilient CI/CD, and systematic reduction of flaky tests

Benefits & conditions

  • Highly competitive salary and equity
  • Comprehensive health coverage for you and your dependents
  • Strong 401(k) match
  • Meals and snacks on us + discretionary productivity budget

Strong preference for in-person in Palo Alto or Brooklyn.

About the company

Inco AI (inco.ai) builds the agent-native inference platform for tomorrow’s token economics. Through hardware-model co-design, it turns any GPU fleet into efficient token production, trains inference-aware models on each customer’s real traffic, and deploys portably across heterogeneous compute.

We’ve raised $20M+ and are already building for customers: bare-metal neoclouds and alternative hardware providers looking to differentiate their compute as inference infrastructure, and agentic software companies for whom inference cost is the line between viable and broken margins.

We’re the team behind industry-defined techniques such as AWQ, DFlash, and TensorRT-LLM, with combined decades in AI efficiency leadership and prior successful exits. Our researchers and engineers work where frontier research meets production.

We operate on five principles:

  • Operate at the frontier. The field moves every day, and so do we. We reinvent ourselves constantly and push the frontier forward with our research. We keep process light and decisions fast, so a good idea reaches production in days, not quarters. Legacy doesn’t slow us down.
  • Mission over individuals. We are obsessed with our customers and humble in pursuit of the goal. We share credit, name mistakes early, and change our minds when the evidence says so. The question is always what moves the mission forward, never who was right.
  • Amplify with agents. Code is free now; architecture and process aren’t. We hand agents everything they can own, from code to operations, and spend our own time on design, judgment, and the problems only people can solve.
  • Protect the maker’s time. Focus is our scarcest resource. We keep meetings few and protect long, uninterrupted stretches of work. We automate overhead, cover meals, and handle logistics, so our hours go to research and product.
  • Be a team player. We win as one team. We share context generously, step in wherever we’re needed, and hold each other to a high bar, because exceptional work comes from exceptional peers.

Inco is already seeing strong early demand. The company is already serving more than 1T tokens a day, has inbound interest from hardware and accelerator companies, and has two enterprise engagements underway, including one focused on building data, fine-tuning, and inference-serving flywheel for an industrial vision use case.

Compensation Range: $200K - $350K

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…