Backend Engineer, AI job

Artemis Consultants
United States
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Software Debugging Distributed Systems Python (Programming Language) Node.Js NoSQL Open Source Technology SQL Databases Data Logging Pytorch Large Language Models
+6 more
Backend Kubernetes Low Latency Machine Learning Operations Front End Software Development Docker

Job description

As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience., * Build and operate backend systems that serve AI-powered features in production.

  • Design inference pipelines, orchestration layers, and service boundaries around models.
  • Own production concerns: monitoring, logging, alerting, and incident response.
  • Optimize latency and throughput across inference, caching, batching, and streaming.

Requirements

  • Strong backend engineering fundamentals in production environments.
  • Experience running high-throughput, low-latency services.
  • Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
  • Comfortable debugging distributed systems under load.
  • Bias toward shipping and learning from production behavior.

TECH STACK:

  • Python
  • NodeJs
  • Pytorch
  • OpenAI / Anthropic / open-source LLMs
  • SQl & noSQL
  • Kubernetes
  • Docker, * Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.
  • APIs are stable, clear, and support seamless integration with frontend and ML systems.
  • Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.
  • Iterative improvements based on real usage continuously increase system performance and reliability.

Benefits & conditions

Artemis Referral Bonus - $500! If you know someone for this job, please join our Referral Bonus Program .

About the company

There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. This company’s mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organizing and workflows, with minimal prompting.

Their product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. The objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.

The best products today in the world were built by small, world class teams. This is a high talent density and hands-on team. They make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining the team requires the ability to bring structure, exercise judgment, and execute independently. The goal is to put in hands of users a truly magical product.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.diversity.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:24 min

Comprehensive AI infrastructure stacks at the Linux Foundation

Matt White Matt White · WWC 2025

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

1:38 min

Transitioning into backend engineering from web development

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all