> Markdown version of [/jobs/ext/1654138-senior-software-engineer-backend-llm-infrastructure](https://www.wearedevelopers.com/jobs/ext/1654138-senior-software-engineer-backend-llm-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer (Backend/LLM Infrastructure)

- **Company:** Routine Labs
- **Location:** Berlin, Germany
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Continuous Integration, Python (Programming Language), OpenID, Role-Based Access Control, Redis, Security Assertion Markup Language (SAML), SQL Databases, SQLAlchemy, Large Language Models, Backend, Fastapi, Playwright, Apache Kafka, Celery
- **Published:** July 19, 2026
- **Apply:** https://www.adzuna.de/details/5804554856

## About the Role

* 4-6+ years of backend or full-stack engineering experience with Python/FastAPI/LangGraph in production.
 * Hands-on experience with LLM systems, embeddings, vector stores, and performance/cost optimization.
 * Strong CI/CD and operations mindset: SLOs, monitoring, incidents, and rollbacks.
Solid SQL, Redis, and background job experience.

 * Experience integrating SSO (OIDC/SAML) and multi-tenant RBAC.
 * Nice addition: Playwright/Stagehands/pywinauto, Temporal/Kafka, feature flags (langfuse/Unleash), HIPAA/SOC2 exposure.

## Description

* Build and maintain Python/FastAPI services, SQLAlchemy/Alembic models, Redis caching, and background jobs (Celery/RQ).
 * Implement and optimize LLM orchestration pipelines: RAG flows, agent workflows, evaluation, tracing, retries, and feature flags.
 * Own CI/CD pipelines, environment promotion, schema migrations, canary/blue-green deployments, and operational reliability.
 * Add observability: structured logs, OpenTelemetry tracing, and RAG quality dashboards.
 * Integrate secure multi-tenant access with SSO (OIDC/SAML) and RBAC.
 * Participate in on-call rotations, incident response, and continuous improvement of production systems.


## Related Videos

- [Celery on AWS ECS - the art of background tasks & continuous deployment](https://www.wearedevelopers.com/videos/561-celery-on-aws-ecs-the-art-of-background-tasks-continuous-deployment)
- [LLMs in the wild: Building an AI agent that survives production](https://www.wearedevelopers.com/videos/100319-llms-in-the-wild-building-an-ai-agent-that-survives-production)
- [Keeping applications secure by evolving OAuth 2.0 and OpenID Connect](https://www.wearedevelopers.com/videos/100152-keeping-applications-secure-by-evolving-oauth-2-0-and-openid-connect)
- [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis)
- [Unveiling the Magic: Scaling Large Language Models to Serve Millions](https://www.wearedevelopers.com/videos/1619-unveiling-the-magic-scaling-large-language-models-to-serve-millions)
- [Walking into the era of Supply Chain Risks](https://www.wearedevelopers.com/videos/376-walking-into-the-era-of-supply-chain-risks)

## Related Articles

- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [The 7 Most Popular Backend Frameworks for Developers](https://www.wearedevelopers.com/magazine/403-the-7-most-popular-backend-frameworks-for-developers)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)