> Markdown version of [/jobs/ext/582308-senior-software-engineer-engine-distributed-systems](https://www.wearedevelopers.com/jobs/ext/582308-senior-software-engineer-engine-distributed-systems). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Engineer, Engine & Distributed Systems - **Company:** STACK.AI, LLC - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $220,000.0 - $240,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Databases, Distributed Systems, Fault Tolerance, Python (Programming Language), PostgreSQL, Queueing Systems, State Machines, Backend, Fastapi, Event Driven Architecture - **Published:** June 21, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=4e436b1b9a9a08ff ## About the Role Do you have experience in Python?, * 5+ years building backend systems in production, with real depth in distributed systems. * Hands-on experience with durable execution or workflow orchestration (Temporal, Cadence, Airflow, or equivalent), with a way of thinking rooted in idempotency, state machines, and failure recovery. * Strong command of concurrency, queueing, retries, and fault tolerance under load. * Strong in Python and modern backend frameworks (FastAPI or similar), with sound database fundamentals (Postgres or similar). * You're drawn to the correctness problems that everything else quietly depends on. Distributed systems is broad. If you're strong on most of this and excited to grow into the rest, we'd like to hear from you, even if you don't check every box. Bonus points * Operating Temporal at scale. * Event-driven architectures and message queues. * Experience with PydanticAI, LangGraph, or similar. * AI or agent runtimes: tool-calling, sub-agent orchestration, streaming. * Performance and cost optimization of high-throughput backends. * Startup or growth-stage experience. ## Description Enterprises run real work on AI agents, and at Stack AI that work runs on a single engine. Some agents finish in a second. Others run for days, fan out into dozens of sub-agents, pause, resume, and recover from failures without losing a step. We're hiring a Senior Software Engineer, Engine & Distributed Systems to own that engine: the durable runtime at the core of the platform that has to be correct every time, at any scale. This is deep systems work at the heart of the product. When the engine is solid, agents simply run - and getting it there is one of the more interesting distributed-systems problems in AI today. You'll own it end to end, from the execution model to how it behaves in production. What you'll do * Own the execution engine. The runtime, scheduling, and sub-agent parallelization that run every agent on the platform. * Make long-running work durable. Build checkpointing, resumption, and recovery so agents survive failures and restarts and pick up exactly where they left off. * Shape the execution model. Decide how work is scheduled, queued, and moved from synchronous to asynchronous, so the platform stays correct and responsive as load grows. * Engineer for scale and reliability. Hold the engine to strict health targets for worker freshness, deploy safety, and drain time, and keep latency and throughput strong as volume grows. * Keep the engine open to the ecosystem. Make it straightforward to bring new agent harnesses, orchestration frameworks, and model capabilities into the runtime. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Postgres in the Age of AI (and Devin)](https://www.wearedevelopers.com/videos/1042-postgres-in-the-age-of-ai-and-devin) - [Building and Deploying Multi-Agent Systems with ADK and Vertex AI](https://www.wearedevelopers.com/videos/1918-building-and-deploying-multi-agent-systems-with-adk-and-vertex-ai) ## Related Articles - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)