Senior Software Engineer (Backend/LLM Infrastructure)

Routine Labs
Berlin, Germany
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Regular working hours
Job source

Tech stack

Continuous Integration Python (Programming Language) OpenID Role-Based Access Control Redis Security Assertion Markup Language (SAML) SQL Databases SQLAlchemy Large Language Models Backend Fastapi Playwright
+2 more
Apache Kafka Celery

Job description

  • Build and maintain Python/FastAPI services, SQLAlchemy/Alembic models, Redis caching, and background jobs (Celery/RQ).
  • Implement and optimize LLM orchestration pipelines: RAG flows, agent workflows, evaluation, tracing, retries, and feature flags.
  • Own CI/CD pipelines, environment promotion, schema migrations, canary/blue-green deployments, and operational reliability.
  • Add observability: structured logs, OpenTelemetry tracing, and RAG quality dashboards.
  • Integrate secure multi-tenant access with SSO (OIDC/SAML) and RBAC.
  • Participate in on-call rotations, incident response, and continuous improvement of production systems.

Requirements

  • 4-6+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production.
  • Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization.
  • Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks. Solid SQL, Redis, and background job experience.

  • Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC.
  • Nice addition: Playwright/Stagehands/pywinauto, Temporal/Kafka, feature flags (langfuse/Unleash), HIPAA/SOC2 exposure.

Benefits & conditions

  • Direct collaboration with the CTO, CPO and founding team
  • Competitive compensation package including Virtual Share Options (VSOPs)
  • True ownership and a green field to shape the technical foundation of the product
  • Perks such as Urban Sports Club, Workations, Offsites, Deutschland Ticket

Join the team shaping the technical foundation of a company redefining how legacy software gets automated.

We value diverse perspectives and welcome candidates of all genders, identities and backgrounds.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.de

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

4:35 min

Setting up passwordless federated identity configuring OpenID Connect patterns

Marcel Lupo · LIVE

1:37 min

Core concepts of Celery and message broker integration

Jan Giacomelli · LIVE

2:08 min

Applying large language models to infrastructure tasks

Alfonso Sandoval Rosas Alfonso Sandoval Rosas · Europe 2026 Virtual

3:42 min

Comparing in-memory and Redis storage for cache scalability

Simone Sanfratello · World Congress 2022

4:18 min

Prioritizing communication and structural awareness over strict tool mastery

Liam Hurrel +1 · World Congress 2021

Videos

See all

Related articles

See all