> Markdown version of [/jobs/ext/363614-ai-devops-engineer-all-genders](https://www.wearedevelopers.com/jobs/ext/363614-ai-devops-engineer-all-genders). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI DevOps Engineer (all genders)

- **Company:** AEB SE
- **Location:** Mainz, Germany
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Computer Programming, Continuous Integration, DevOps, Webui, Gitlab-ci, Nintex, Machine Learning Operations
- **Published:** June 1, 2026
- **Apply:** https://de.indeed.com/viewjob?jk=483313c4727e49de

## About the Role

* IT, KI und skalierbare technische Lösungen begeistern dich - besonders dann, wenn sie echten Mehrwert schaffen
 * Du hast Erfahrung mit AI-Plattformen und -Tools wie AI Foundry, LiteLLM, Open WebUI oder n8n
 * IaC-Praxis (idealerweise modulare, wiederverwendbare Bausteine)
 * Erfahrung im Betrieb containerisierter Plattformen (Kubernetes) und im Aufbau von CI/CD
 * LLMOps-Erfahrung, z. B. mit RAG-Systemen, Inference-Workloads, Drift-/Qualitätsmonitoring, Guardrails/Policies und Kostenmetriken

## Description

* Du betreibst unser self-hosted LiteLLM Gateway als zentralen Zugang zu LLMs (inkl. Key-, Budget- und Policy-Mechanismen) und entwickelst es gemeinsam mit uns weiter.
 * Du integrierst die Azure AI Foundry in unser Plattformkonzept (Zugriffe, Observability, Governance), sodass Teams Agents und Modelle sauber in den Produktbetrieb bringen können.
 * Du automatisierst und betreibst Anwendungen mit Hilfe von CI/CD-Praktiken und Infrastructure as Code (z. B. GitLab CI, Helm/ArgoCD), damit Änderungen reproduzierbar, auditierbar und schnell ausrollbar sind.
 * Du etablierst Observability (Metrics/Logs/Tracing), SLOs und Incident-Prozesse für unsere KI-Services.
 * Du unterstützt interne Nutzer*innen durch Templates, Runbooks und Self-Service, damit die Plattform einfach und sicher eingesetzt werden kann.
 * Du entwickelst unsere AI Platform weiter, beispielsweise rund um MCP Server, Coding Tools und Agent Registry.


## Related Videos

- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment)
- [The AI-Ready Stack: Rethinking the Engineering Org of the Future](https://www.wearedevelopers.com/videos/1706-the-ai-ready-stack-rethinking-the-engineering-org-of-the-future)
- [Navigating the AI Wave in DevOps](https://www.wearedevelopers.com/videos/853-navigating-the-ai-wave-in-devops)
- [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey)

## Related Articles

- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Finding IT & Technology English-speaking Jobs in Germany ](https://www.wearedevelopers.com/magazine/446-finding-it-technology-english-speaking-jobs-in-germany)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)