Senior Backend Engineer, AI Platform

TMTG Group LLC
Sarasota, FL, United States
1 day ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence C Sharp (Programming Language) Data Centers Failover Python (Programming Language) PostgreSQL RabbitMQ Ruby on Rails Redis Search Technologies TypeScript
+10 more
Qdrant ReactJS Large Language Models Backend Kotlin Pgvector AI Platforms LiteLLM Api Design Golang

Job description

You’ll work directly with the platform architect and other developers to bring deep, hands-on LLM-stack expertise: you’ve built these systems before, you know where they break, and you know what “good” looks like in production.

The work is greenfield. You won’t be maintaining someone else’s pipeline - you’ll be standing up the core AI infrastructure for a platform with millions of active users, and shaping the engineering practices around it as the team grows.

Requirements

  • 5+ years of backend engineering experience in a statically typed language (Go, Java, Kotlin, C#)
  • You’ve shipped production LLM-backed features - retrieval-augmented generation, streaming responses, tool use - and lived with them after launch
  • Hands-on experience with the LLM serving stack: routing across multiple model providers, failover, token streaming, and cost/usage metering
  • Experience building retrieval systems: vector search, embedding pipelines, context assembly, and citation-backed answers
  • You think in failure modes: hallucination, retrieval misses, provider outages, cost blowouts - and you build the instrumentation to catch them
  • Pragmatic about evaluation - you know how to measure whether AI answers are actually good (relevance, safety, source quality) with simple, repeatable tests, not just academic benchmarks
  • Strong API design instincts; comfortable owning a service end to end, from schema to deploy to on-call
  • US-based and authorized to work in the United States

Nice to Have

  • Go (strongly preferred)
  • Python
  • Experience with LLM gateways or serving infrastructure (LiteLLM, vLLM, TGI, or similar)
  • Vector databases (Qdrant, pgvector) and embedding pipelines
  • Fine-tuning open-weight models (LoRA or full fine-tunes) and the eval discipline that goes with it
  • Content moderation or safety tooling experience
  • Familiarity with Ruby on Rails or React/TypeScript (you’ll integrate with both)

Our Stack

Go, Ruby on Rails, Python, React/TypeScript, PostgreSQL, Redis, RabbitMQ. Services deployed across multiple data centers.

About the company

Are you passionate about building AI products people actually use, serving millions of users? Do you want to help lead the AI engineering effort at this country’s fastest-growing social media company that champions free speech? You’ll be building AI-based features into a platform serving millions of users.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…