WeAreDevelopers LIVE • Oct 2, 2024

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow

Aarno Aukia

Are silent API updates secretly breaking your production AI? Regain control by self-hosting and autoscaling LLMs natively with Kubernetes, KServe, and proven DevOps principles.

Starting at 15:14 · Watch from the beginning

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

4:15 min

Introduction to artificial intelligence driven development

Natalie Pistunovich · LIVE

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski

Mary Grygleski · LIVE

5:28 min

Defining MLOps and its role in production systems

Hauke Brammer · World Congress 2023

2:14 min

Differences between traditional MLOps and GenAIOps

Maxim Salnikov

Maxim Salnikov · World Congress 2025

7:28 min

Accelerating product features using generative large language models

David Singleton

David Singleton +1 · Coffee With Developers

2:00 min

Shifting from single models to specialized AI infrastructure

Emmanuel Acheampong

Emmanuel Acheampong · World Congress 2026 North America

More from WeAreDevelopers LIVE

Humans in the Loop: Storytelling in Tech thumbnail

Humans in the Loop: Storytelling in Tech

Christian Heilmann +2

4 days ago

WeAreDevelopers LIVE: Your Brain Is Lying to You: Cognitive Biases in Development thumbnail

Your Brain Is Lying to You: Cognitive Biases in Development

Last week

Like Peas in a Pod - What Happens When People Clone Your App? thumbnail

Like Peas in a Pod - What Happens When People Clone Your App?

Ivan Kutskir +2

2 weeks ago

WeAreDevelopers LIVE - Read more, Prompt Less thumbnail

Read more, Prompt Less

Christian Heilmann +2

3 weeks ago

WeAreDevelopers LIVE - Tech Education in Two Languages thumbnail

Tech Education in Two Languages

Daniel Cranney +1

Oct 2026

WeAreDevelopers LIVE - Playing in Production thumbnail

Playing in Production

Andrew MacLean +2

Sep 2026

Upcoming sessions on this topic

Engineering AI Strategy: Beyond the Hype

Omkar Srivastava

ADSK

Engineering Leader

Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)

Sagar Utekar

CrowdStrike

SRE

Your AI Agents Are Bleeding Tokens: Building a Runtime Cost Control Plane for LLMs

Aakriti Aggarwal

IBM Research

Research Engineer
Bhavishya Pandit

66degrees

Leading AI Innovation

Decision models for developers who use LLMs

Anurag Bhandari

antelligent

CTO

Build Otto: Ship an AI Agent Without Redeploying

Abhishek Hiremath

LaunchDarkly

Senior Solutions Engineers

Enterprise AI Memory at Scale

Aditya Joshi

Walmart

Senior Software Engineer

Related videos

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices thumbnail

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices

Anshul Jindal · NVIDIA

World Congress · 2025

AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment thumbnail

AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment

Joy · DCMN GmbH

World Congress · 2024

From Traction to Production: Maturing your LLMOps step by step thumbnail

From Traction to Production: Maturing your LLMOps step by step

LIVE · Nov 2024

Self-Hosted LLMs: From Zero to Inference thumbnail

Self-Hosted LLMs: From Zero to Inference

Cedric Clyburn +1

World Congress · 2025

Supercharge your cloud-native applications with Generative AI thumbnail

Supercharge your cloud-native applications with Generative AI

Cedric Clyburn · Red Hat

World Congress · 2024

MLOps and AI Driven Development thumbnail

MLOps and AI Driven Development

Natalie Pistunovich

LIVE · Feb 2022

Related articles

BB

Benedikt Bischof

MLOps – What’s the deal behind it?

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Nico Axtmann who introduced us to MLOpsAbout the speaker:Nico Axtmann is a seasoned machine...

about 4 years ago

MLOps – What’s the deal behind it?

BB

Benedikt Bischof

MLOps And AI Driven Development

Welcome to this issue of the WeAreDevelopers Dev Talk Recap series. This article recaps an interesting talk by Natalie Pistunovic who spoke about the development of AI and MLOps. What you will lear...

over 4 years ago

MLOps And AI Driven Development

BB

Benedikt Bischof

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Bas Geerdink who gave advice on MLOps.‍About the speaker:‍Bas is a programmer, scientist, a...

about 4 years ago

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

LM

Luis Minvielle

What Are Large Language Models?

Developers and writers can finally agree on one thing: Large Language Models, the subset of AIs that drive ChatGPT and its competitors, are stunning tech creations. Developers enjoying the likes of...

about 3 years ago

What Are Large Language Models?

From learning to earning

Jobs that call for the skills explored in this talk.

about 1 month ago

Machine Learning Engineer

Valladolid, Spain

Remote Twilio AutoGen Pytorch

about 1 month ago • Verified

AI Software Engineer (Germany)

Berlin, Germany

Expert €70k–100k Remote REST TypeScript AI Frameworks

about 1 month ago

Engineering Manager, Google Cloud AI/ML

Kansas City, MO, United States

Expert $99k–232k LangChain Google Cloud Generative AI

about 1 month ago

Engineering Manager, Google Cloud AI/ML

Portland, OR, United States

Expert $99k–232k LangChain Google Cloud Generative AI

Machine Learning Engineer

Valencia, Spain

Remote Twilio AutoGen Pytorch

about 1 month ago

Engineering Manager, Google Cloud AI/ML

Des Moines, IA, United States

Expert $99k–232k LangChain Google Cloud Generative AI