> Markdown version of [/jobs/ext/2706244-software-engineer-systems](https://www.wearedevelopers.com/jobs/ext/2706244-software-engineer-systems). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer - Systems - **Company:** Boson AI USA Inc. - **Location:** Santa Clara, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Airflow, Amazon Web Services, C++ (Programming Language), Cloud Computing, Continuous Integration, Extract Transform Load (ETL), Distributed Systems, Fault Tolerance, Python (Programming Language), Routing, Rust (Programming Language), Data Logging, ReactJS, Large Language Models, Apache Spark, Caching, Backend, Rate Limiting, Containerization, Core Data, Kubernetes, Low Latency, Apache Flink, Apache Kafka, Machine Learning Operations, Video Streaming, Data Pipelines, Api Management - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/senior-software-engineer-systems-boson-ai-8724171 ## About the Role * 3+ years building and operating backend systems at scale - you've owned services that other teams depend on in production. * Strong distributed systems fundamentals: concurrency, fault tolerance, consistency tradeoffs, capacity planning. * Hands-on experience with data pipeline infrastructure (Kafka/Kinesis, Spark/Flink, Airflow, or similar) for log processing, analytics, or ETL workloads. * Track record of designing APIs and frameworks adopted by other engineering teams - you care about developer experience and long-term maintainability. * Proficiency in at least one systems language (Go, Rust, Java, C++) or Python in a performance-sensitive context. * Comfortable working across the stack: cloud infrastructure (AWS/GCP), containerized deployments (K8s), CI/CD, and production oncall., * Experience with LLM serving, agentic orchestration patterns (ReAct, planner-executor), or RAG pipelines. * Familiarity with emerging agent integration protocols (MCP, A2A) or orchestration frameworks (LangChain, LlamaIndex). * Background in real-time media systems (audio/video streaming, low-latency signaling). * Experience building high-stakes platform services (payments, identity, core data) where correctness and auditability are non-negotiable. ## Description About the Role: Build and operate the core platform behind Boson's model APIs and agentic products. You'll own the infrastructure that every Boson agent runs on - API serving, state management, data pipelines, context retrieval, and execution runtime - and make it fast, reliable, and easy for product teams to build on., * Own and evolve the core platform infrastructure: API serving layer, state management, policy enforcement engine, and execution runtime for agentic workflows. * Design and operate high-throughput, low-latency distributed services that back our model API products - including request routing, load management, rate limiting, and multi-tenant isolation. * Build and maintain downstream data pipelines (ETL/ELT) for API logs, usage analytics, and billing - ensuring data correctness, freshness, and queryability at scale. * Develop production-grade internal SDKs and libraries with clean APIs, strong type safety, and clear contracts that product teams can build on confidently. * Architect context and memory systems for conversational workloads - low-latency retrieval, caching, and integration with vector stores and retrieval pipelines. * Instrument end-to-end observability: define SLIs/SLOs, build structured logging and tracing, and drive reliability improvements across the platform. * Collaborate closely with ML and product teams to integrate model serving, voice runtime, and tooling infrastructure under tight latency and quality constraints. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Inside Bitpanda's Tech Stack: Scaling a European Fintech Leader - Markus Dorner](https://www.wearedevelopers.com/videos/1979-inside-bitpanda-s-tech-stack-scaling-a-european-fintech-leader-markus-dorner) - [HTTP headers that make your website go faster](https://www.wearedevelopers.com/videos/1676-http-headers-that-make-your-website-go-faster) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Event based cache invalidation in GraphQL](https://www.wearedevelopers.com/videos/433-event-based-cache-invalidation-in-graphql) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [How Much FAANG Companies Actually Pay Software Engineers in 2025](https://www.wearedevelopers.com/magazine/230-how-much-faang-companies-actually-pay-software-engineers-in-2025) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)