WeAreDevelopers LIVE • Oct 2, 2024

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow

Aarno Aukia

Are silent API updates secretly breaking your production AI? Regain control by self-hosting and autoscaling LLMs natively with Kubernetes, KServe, and proven DevOps principles.

Starting at 24:00 · Watch from the beginning

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

4:15 min

Introduction to artificial intelligence driven development

Natalie Pistunovich · LIVE

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

5:28 min

Defining MLOps and its role in production systems

Hauke Brammer · World Congress 2023

2:14 min

Differences between traditional MLOps and GenAIOps

Maxim Salnikov Maxim Salnikov · World Congress 2025

7:28 min

Accelerating product features using generative large language models

David Singleton +1 · Coffee With Developers

2:00 min

Shifting from single models to specialized AI infrastructure

Emmanuel Acheampong Emmanuel Acheampong · World Congress 2026 North America

Upcoming sessions on this topic

Starts in 9 days

Conference India 2026

November 25–26, 2026

Bengaluru, India