AI Platform Engineer embedded

Scalable GmbH

Munchen, Germany

28 days ago

Apply on startup.jobs

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

startup.jobs

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Cloud Computing Cloud Engineering DevOps Python (Programming Language) Reliability Engineering Software Engineering Datadog Data Logging Large Language Models

+6 more

Rate Limiting Containerization Information Technology Terraform Network Server Docker

Job description

Develop and maintain an internal AI provisioning platform to streamline access to various LLMs & MCP Servers (e.g., via LiteLLM).
Implement comprehensive LLM observability, logging, and alerting systems using tools like Datadog and Langfuse.
Enforce model governance, ensuring security, data privacy, rate limiting, and strict LLM API cost management.
Collaborate closely with embedded AI Software Engineers to support cloud-native architectures and agentic workflow integrations.
Build and maintain infrastructure for monitoring the reliability and performance of production AI systems.

Requirements

Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
Strong experience and confidence working with cloud infrastructure (AWS preferred) and Infrastructure as Code (Terraform).
Proficiency in at least one programming language (e.g., Python, Go) and experience with CI/CD pipelines and containerization (e.g., Docker).
Solid understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
Experience with, or a strong willingness to learn, LLM gateways, observability platforms, and telemetry (e.g., LiteLLM, Langfuse, Datadog).
Strong problem-solving skills, a sense of humor, and the ability to thrive in an ego-free environment as an embedded platform expert within a cross-functional Data Science and AI team.

Benefits & conditions

Be part of one of the fastest-growing and most visible Fintech startups in Europe, creating innovative services that have a substantial impact on the lives of our customers
Work with an international, diverse, inclusive, and ever-growing team that loves creating the best products for our clients
Be productive with the latest hardware and tools
Learn and grow by joining our in-house knowledge sharing or career development sessions and spending your individual Education Budget
Learn and experience German culture first hand by joining our free German language classes
International relocation support is provided if required
Opportunity to work from abroad
Benefit from an attractive compensation package and from the company pension scheme
Monthly contribution of 50% for the ‘Deutschland Jobticket’
Say goodbye to order commissions and say hello to your complimentary subscription of Scalable Capital’s PRIME+ Broker
Enjoy flexible and discounted sports activities with Urban Sports Club