Senior Software Engineer (Backend/LLM Infrastructure)
Routine Labs
Berlin, Germany
25 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Regular working hours
Job source
Tech stack
Continuous Integration
Python (Programming Language)
OpenID
Role-Based Access Control
Redis
Security Assertion Markup Language (SAML)
SQL Databases
SQLAlchemy
Large Language Models
Backend
Fastapi
Playwright
+2 more
Apache Kafka
Celery
Job description
- Build and maintain Python/FastAPI services, SQLAlchemy/Alembic models, Redis caching, and background jobs (Celery/RQ).
- Implement and optimize LLM orchestration pipelines: RAG flows, agent workflows, evaluation, tracing, retries, and feature flags.
- Own CI/CD pipelines, environment promotion, schema migrations, canary/blue-green deployments, and operational reliability.
- Add observability: structured logs, OpenTelemetry tracing, and RAG quality dashboards.
- Integrate secure multi-tenant access with SSO (OIDC/SAML) and RBAC.
- Participate in on-call rotations, incident response, and continuous improvement of production systems.
Requirements
- 4-6+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production.
- Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization.
-
Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks. Solid SQL, Redis, and background job experience.
- Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC.
- Nice addition: Playwright/Stagehands/pywinauto, Temporal/Kafka, feature flags (langfuse/Unleash), HIPAA/SOC2 exposure.
Benefits & conditions
- Direct collaboration with the CTO, CPO and founding team
- Competitive compensation package including Virtual Share Options (VSOPs)
- True ownership and a green field to shape the technical foundation of the product
- Perks such as Urban Sports Club, Workations, Offsites, Deutschland Ticket
Join the team shaping the technical foundation of a company redefining how legacy software gets automated.
We value diverse perspectives and welcome candidates of all genders, identities and backgrounds.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.deGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
CH
Chris Heilmann
about 2 years ago
LM
Luis Minvielle
The 7 Most Popular Backend Frameworks for Developers
over 2 years ago
LM
Luis Minvielle
What Are Large Language Models?
almost 3 years ago
IK
Igor Khokhriakov
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
about 9 hours ago
CH
Chris Heilmann
Dev Digest 120 - Apple and peers
about 2 years ago
LM
Luis Minvielle
Fully Remote Software Engineer Jobs
about 2 years ago