World Congress 2025 • Aug 20, 2025 • Session details

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices

Struggling to move generative AI from experimental notebooks to scalable production? Discover how NVIDIA NIM and NeMo Microservices unify fine-tuning, evaluation, and inference into an automated LLMOps pipeline.

Pause

Mute

Enter Fullscreen

#1 about 5 min

The generative AI application lifecycle

How building data curation and model training tasks into loops enables continuous generative AI application updates.

#2 about 4 min

Solving application deployment complexities using LLMOps pipelines

Overcoming disconnected deployment stages involves operationalizing the machine learning pipeline from proof-of-concept to production.

#3 about 2 min

Mapping the developer pipeline with NVIDIA microservices

Integrating specialized microservice containers directly addresses the complexity of application customization and evaluation tasks.

#4 about 3 min

Integrating infrastructure enablers for LLMOps operations ecosystems

Combining data storage and operational workflow tools establishes a resilient automation foundation for language models.

#5 about 5 min

Executing fine-tuning and LLM evaluation API workflows

Pulling foundation models and datasets via API requests enables automated container training and adapter benchmarking.

#6 about 4 min

Scaling customized inference models with NVIDIA NIM

Using specialized Kubernetes operators to deploy optimized containers scales customized adapter loading into hardware cache.

#7 about 3 min

Automating discrete component pipelines using Argo Workflows

Writing deterministic component templates stitches discrete deployment operations into reproducible pre-production software workflows.

#8 about 4 min

Managing cluster platform infrastructure via GitOps principles

Establishing version control as the core infrastructure truth aligns application development with Kubernetes cluster operations.

#9 about 3 min

Demonstrating an integrated LLMOps cluster deployment environment

Orchestrating cluster synchronization automatically triggers pipeline sequences and centralizes model training metric visualization.

Matching moments

1:27 min

Automating model lifecycle management with the NIM operator

Kevin Klues

Kevin Klues

5:28 min

Defining MLOps and its role in production systems

Hauke Brammer · WWC 2023

2:14 min

Building and fine-tuning models with the NeMo framework

Anshul Jindal

Anshul Jindal +1 · WWC Europe 2026

4:19 min

Introduction to DevOps for AI and MLOps

Aarno Aukia · LIVE

4:57 min

Centralizing LLMOps workflows within Azure AI Foundry

Maxim Salnikov

Maxim Salnikov · LIVE

2:04 min

Optimizing and deploying containerized AI inference workloads

Ankit Patel

Ankit Patel · WWC 2024

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Upcoming sessions on this topic

World Congress 2026 North America

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong

World Congress 2026 North America

It’s Alive! Taming the MLOps Franken-Stack: Write, Run, and Serve with Michelangelo

Eric Wang, Paul Zimmerman

Eric Wang

Paul Zimmerman

World Congress 2026 North America

Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs

Duan Lightfoot

Sr. AI Engineer, Akamai

Duan Lightfoot

World Congress 2026 North America

Trust, But Verify: Continuous GPU Validation at Scale

Kyle Bell

VP of AI @ TensorWave

Kyle Bell

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan

World Congress 2026 North America

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization

Cedric Clyburn, Legare Kerrison

Cedric Clyburn

Legare Kerrison

Related videos

Efficient deployment and inference of GPU-accelerated LLMs thumbnail

WWC 2024 • almost 2 years ago

Efficient deployment and inference of GPU-accelerated LLMs

Adolf Hohl

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow thumbnail

LIVE • almost 2 years ago

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow

Aarno Aukia

MLOps - What’s the deal behind it? thumbnail

WWC 2022 • about 4 years ago

MLOps - What’s the deal behind it?

Nico Axtmann

AI That Fits Your Business, Not the Other Way Around thumbnail

WWC Europe 2026 • about 1 month ago

AI That Fits Your Business, Not the Other Way Around

Anshul Jindal, Cansu Kavili Örnek

From Traction to Production: Maturing your LLMOps step by step thumbnail

LIVE • over 1 year ago

From Traction to Production: Maturing your LLMOps step by step

Maxim Salnikov

The state of MLOps - machine learning in production at enterprise scale thumbnail

LIVE • over 4 years ago

The state of MLOps - machine learning in production at enterprise scale

Bas Geerdink

Related articles

BB

Benedikt Bischof

MLOps – What’s the deal behind it?

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Nico Axtmann who introduced us to MLOpsAbout the speaker:Nico Axtmann is a seasoned machine...

almost 4 years ago

MLOps – What’s the deal behind it?

BB

Benedikt Bischof

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Bas Geerdink who gave advice on MLOps.‍About the speaker:‍Bas is a programmer, scientist, a...

almost 4 years ago

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

BB

Benedikt Bischof

MLOps And AI Driven Development

Welcome to this issue of the WeAreDevelopers Dev Talk Recap series. This article recaps an interesting talk by Natalie Pistunovic who spoke about the development of AI and MLOps. What you will lear...

over 4 years ago

MLOps And AI Driven Development

DC

Daniel Cranney

Stephan Gillich - Bringing AI Everywhere

In the ever-evolving world of technology, AI continues to be the frontier for innovation and transformation. Stephan Gillich, from the AI Center of Excellence at Intel, dove into the subject in a r...

almost 2 years ago

Stephan Gillich - Bringing AI Everywhere

From learning to earning

Jobs that call for the skills explored in this talk.

15 days ago • Verified

AI Software Engineer (Germany)

Berlin, Germany

Expert €70k–100k Remote REST TypeScript AI Frameworks

Staff Software Engineer, Copilot Experiences

Remote Ruby Docker Sentry

about 2 months ago

Machine Learning Engineer

Experienced Remote Spacy Pytorch Chatbots

Machine Learning Engineer

Oberkochen, Germany

Git Bicep Github

Principal Software Engineer, Enterprise AI Platform

Expert Remote Ruby Golang Github

Machine Learning Engineer

Barcelona, Spain

€25k–60k Remote Spacy Twilio Pytorch