Foundations Engineer (Deep Infra)

ROX, INC.
San Francisco, CA, United States
about 2 months ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Big Data Software Debugging Distributed Data Store Distributed Systems Fault Tolerance Backend Build Management Low Latency Real Time Data

Job description

We are hiring a Foundations Engineer (Deep Infra) to design and operate the systems that power Rox’s agent runtime.

This role sits at the intersection of:

  • distributed systems
  • real-time data infrastructure
  • agent orchestration
  • decisioning systems

You will work on infrastructure similar to what powers large-scale data platforms - but optimized for continuous AI decision loops rather than batch analytics.

Many of the systems we are building resemble components from:

  • streaming compute systems
  • distributed query engines
  • large-scale event processing pipelines
  • matching and routing infrastructure

But with a new constraint: AI agents must operate continuously and reliably in production environments.

What You’ll Do

Design and build core distributed systems powering Rox agents.

Build infrastructure for real-time context ingestion and retrieval.

Develop systems that enable low-latency agent decisioning at scale.

Improve reliability, observability, and fault tolerance across agent infrastructure.

Build execution frameworks that support long-running agent workflows.

Collaborate closely with product engineers and forward deployed engineers to translate infrastructure capabilities into customer impact.

Ship production systems quickly and evolve them based on real-world usage.

Requirements

  • distributed data platforms
  • streaming compute systems
  • real-time analytics infrastructure
  • distributed query engines
  • high-scale backend services

Strong intuition for latency, reliability, and scalability tradeoffs.

Experience operating systems where real-world traffic exposes edge cases quickly.

Comfort debugging complex distributed systems in production.

A bias toward shipping systems, learning from production, and improving them continuously.

Benefits & conditions

Most enterprise software was built for humans operating dashboards. Rox is built for agents operating systems.

Instead of static workflows, Rox runs continuous decision loops powered by real-time context from across the enterprise.

Agents analyze signals, reason about them, and take action - automatically.

To make that possible, we are building infrastructure that combines elements of:

  • distributed data platforms
  • real-time decision systems
  • agent execution frameworks
  • low-latency context retrieval

We’re backed by Sequoia, GV, and General Catalyst and building a small team of engineers who want to work on deep technical systems problems with real-world impact.

About the Foundations Team

The Foundations team builds the core infrastructure behind Rox agents.

We work on the systems responsible for:

  • real-time context ingestion
  • agent execution and orchestration
  • reliability for long-horizon AI tasks
  • low-latency decisioning across distributed systems

If you’ve worked on systems like:

  • streaming compute platforms
  • distributed query engines
  • real-time OLAP systems
  • matching engines
  • large-scale data infrastructure

many of the problems here will feel familiar - but applied to a new category of software.

At Rox, agents are constantly:

  • retrieving context
  • making decisions
  • triggering actions
  • updating state

The Foundations team builds the infrastructure that makes those loops reliable, fast, and observable.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

5:48 min

Balancing delivery latency with stream reliability and scale

Phil Cluff · LIVE

1:24 min

Comprehensive AI infrastructure stacks at the Linux Foundation

Matt White Matt White · World Congress 2025

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · World Congress 2024

Videos

See all

Related articles

See all