WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices

Anshul Jindal

Struggling to move generative AI from experimental notebooks to scalable production? Discover how NVIDIA NIM and NeMo Microservices unify fine-tuning, evaluation, and inference into an automated LLMOps pipeline.

Starting at 4:42 · Watch from the beginning

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:27 min

Automating model lifecycle management with the NIM operator

Kevin Klues Kevin Klues

5:28 min

Defining MLOps and its role in production systems

Hauke Brammer · World Congress 2023

2:14 min

Building and fine-tuning models with the NeMo framework

Anshul Jindal Anshul Jindal +1 · World Congress 2026 Europe

4:19 min

Introduction to DevOps for AI and MLOps

Aarno Aukia · LIVE

4:57 min

Centralizing LLMOps workflows within Azure AI Foundry

Maxim Salnikov Maxim Salnikov · LIVE

2:04 min

Optimizing and deploying containerized AI inference workloads

Ankit Patel Ankit Patel · World Congress 2024

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing · AWS

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel +2

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe +3

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler +3

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher +3

AI Sovereignty: What Does It Take? thumbnail
29:13

AI Sovereignty: What Does It Take?

Boris Hecker +3

Upcoming sessions on this topic

Open session

Engineering AI Strategy: Beyond the Hype

  • Omkar Srivastava

    ADSK

    Engineering Leader

Open session

Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)

  • Sagar Utekar

    CrowdStrike

    SRE

Open session

The Dream Team You Didn't Know You Had - Multi-Model, Multi-Agent, One Software Lifecycle

  • Aditya Dua

    GitHub

    Senior Manager, Field Services, SAARC

Open session

How 8 GPUs Became 16: Rethinking LLM Inference Through Parallelism, Memory, and Runtime Design

  • Purnima Kumari

    DigitalOCean

    Sr. Solutions Architect II

Open session

Build Otto: Ship an AI Agent Without Redeploying

  • Abhishek Hiremath

    LaunchDarkly

    Senior Solutions Engineers

Open session

Your AI Agents Are Bleeding Tokens: Building a Runtime Cost Control Plane for LLMs

  • Aakriti Aggarwal

    IBM Research

    Research Engineer

  • Bhavishya Pandit

    66degrees

    Leading AI Innovation

Related videos

Efficient deployment and inference of GPU-accelerated LLMs​ thumbnail
23:01

Efficient deployment and inference of GPU-accelerated LLMs​

Adolf Hohl

World Congress · 2024

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow thumbnail
34:21

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow

Aarno Aukia

LIVE · Oct 2024

MLOps - What’s the deal behind it? thumbnail
29:24

MLOps - What’s the deal behind it?

Nico Axtmann

World Congress · 2022

AI That Fits Your Business, Not the Other Way Around thumbnail
25:56

AI That Fits Your Business, Not the Other Way Around

Anshul Jindal +1

World Congress Europe · 2026

From Traction to Production: Maturing your LLMOps step by step thumbnail
41:45

From Traction to Production: Maturing your LLMOps step by step

Maxim Salnikov

LIVE · Nov 2024

The state of MLOps - machine learning in production at enterprise scale thumbnail
47:19

The state of MLOps - machine learning in production at enterprise scale

Bas Geerdink

LIVE · Mar 2022

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.