AI Backend Engineers

Next Step Systems
San Francisco, CA, United States
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Business Logic Computer Programming Software Debugging Distributed Systems Python (Programming Language) Node.Js NoSQL Open Source Technology SQL Databases Data Streaming
+15 more
Data Logging System Availability Delivery Pipeline Large Language Models Grafana Multi-Agent Systems Reliability of Systems Backend AI Platforms Kubernetes Low Latency Build Tools Front End Software Development Automation Anywhere Docker

Job description

We are looking for talented AI Backend Engineers to build systems that power AI-driven decisioning, automation, and orchestration across our platform. This role sits at the core of our AI stack, between models, backend systems, and real users, where latency, correctness, reliability, and cost directly impact production experience. This is a fully remote position where you will be part of a global engineering team working across multiple countries to build reliable, scalable AI systems. We have multiple openings for this position. This position is 100% Remote.

AI Backend Engineer Responsibilities:

  • Build and operate backend systems that serve AI-powered insurance workflows in production.

  • Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic.

  • Build inference pipelines for LLM-based and AI-assisted automation systems.

  • Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing).

  • Design stable service boundaries between backend systems, ML components, and product APIs.

  • Implement observability: logging, metrics, tracing, alerting, and incident response workflows.

  • Debug production issues across distributed AI systems and resolve root causes.

  • Collaborate closely with frontend, product, operations, and ML teams to ship end-to-end features.

  • Continuously improve system reliability, scalability, and performance.

AI Backend Engineer Outcomes:

  • AI backend systems run reliably at scale with low latency and high availability.

  • AI workflows are stable, observable, and production-ready across multiple products.

  • System performance improves continuously through real-world feedback and optimization.

  • Production incidents are quickly detected, diagnosed, and resolved.

  • AI capabilities are seamlessly integrated into global customer and internal workflows., Looking to hire an AI Backend Engineer in San Francisco, CA or in other cities? Our IT recruiting agencies and staffing companies can help.

Requirements

Strong backend engineering experience in production systems.

  • Artificial Intelligence (AI) experience required.

  • Experience building or operating high-throughput, low-latency services.

  • Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows).

  • Experience with distributed systems and production debugging.

  • Strong understanding of APIs, data flows, and system design principles.

  • Experience with observability tools (logging, monitoring, tracing).

  • Strong ownership mindset and bias toward shipping.

  • Comfortable working in fast-paced, globally distributed teams.

  • Tech Stack: Anthropic, Artificial Intelligence (AI), Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL.

Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.

Keywords: San Francisco CA Jobs, AI Backend Engineer, AI, Anthropic, Artificial Intelligence, Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Low Latency, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL, Software Engineer, Software Developer, Programming, Programmer Analyst, Work From Home, Remote, California Recruiters, IT Jobs, California Recruiting

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

45 sec

Working securely with Node.js path application programming interfaces

Sonya Moisset · WWC 2023

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · WWC Europe 2026

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

Videos

See all

Related articles

See all