> Markdown version of [/jobs/ext/3358525-ai-platform-engineer-embedded](https://www.wearedevelopers.com/jobs/ext/3358525-ai-platform-engineer-embedded). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Platform Engineer embedded

- **Company:** Scalable GmbH
- **Location:** Munchen, Germany
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Cloud Computing, Cloud Engineering, DevOps, Python (Programming Language), Reliability Engineering, Software Engineering, Datadog, Data Logging, Large Language Models, Rate Limiting, Containerization, Information Technology, Terraform, Network Server, Docker
- **Published:** September 5, 2026
- **Apply:** https://startup.jobs/ai-platform-engineer-m-f-x-scalable-gmbh-8806268

## About the Role

* Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
 * Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
 * Strong experience and confidence working with cloud infrastructure (AWS preferred) and Infrastructure as Code (Terraform).
 * Proficiency in at least one programming language (e.g., Python, Go) and experience with CI/CD pipelines and containerization (e.g., Docker).
 * Solid understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
 * Experience with, or a strong willingness to learn, LLM gateways, observability platforms, and telemetry (e.g., LiteLLM, Langfuse, Datadog).
 * Strong problem-solving skills, a sense of humor, and the ability to thrive in an ego-free environment as an embedded platform expert within a cross-functional Data Science and AI team.

## Description

* Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e.g., via LiteLLM).
 * Implement comprehensive LLM observability, logging, and alerting systems using tools like Datadog and Langfuse.
 * Enforce model governance, ensuring security, data privacy, rate limiting, and strict LLM API cost management.
 * Collaborate closely with embedded AI Software Engineers to support cloud-native architectures and agentic workflow integrations.
 * Build and maintain infrastructure for monitoring the reliability and performance of production AI systems.


## Related Videos

- [The Memory Leak That Ate Our Cluster: A Postmortem](https://www.wearedevelopers.com/videos/2057-the-memory-leak-that-ate-our-cluster-a-postmortem)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Inside Bitpanda's Tech Stack: Scaling a European Fintech Leader - Markus Dorner](https://www.wearedevelopers.com/videos/1979-inside-bitpanda-s-tech-stack-scaling-a-european-fintech-leader-markus-dorner)
- [Debugging in the Dark](https://www.wearedevelopers.com/videos/1658-debugging-in-the-dark)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)