> Markdown version of [/events/world-congress-2025/sessions/862-llmops-driven-fine](https://www.wearedevelopers.com/events/world-congress-2025/sessions/862-llmops-driven-fine). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices


- **Date:** Friday, Jul 11, 2025
- **Time:** 14:20–14:50 (30 min)
- **Room:** Stage 5
- **Event:** World Congress 2025

## Recording

[Watch recording](https://www.wearedevelopers.com/videos/1582-llmops-driven-fine-tuning-evaluation-and-inference-with-nvidia-nim-nemo-microservices)

## Description

As the adoption of LLMs continues to grow, the complexity of fine-tuning, and deploying these models has become a significant bottleneck. Manual processes and fragmented workflows can lead to errors, inconsistencies, and delays that hinder innovation and progress. This hands-on workshop introduces LLMOps, an approach to automating the entire LLM evaluation, and inference lifecycle using a GitOps-based methodology.

Participants will learn how to build an end-to-end automated pipeline leveraging NVIDIA NIMs and Nemo Microservices for fine-tuning, evaluation, and deployment of LLMs. Through practical demonstrations, we will explore how to ensure seamless integration, validation, and deployment of updates, leading to faster development cycles, improved accuracy, and increased reliability.

Key Topics: 
- Kubernetes-based LLM Pipelines 
- Argo CD for Continuous Delivery 
- Argo Workflows for LLM Workflow Automation 
- Cloud-Agnostic Deployment 

## Speaker

### [Anshul Jindal](https://www.wearedevelopers.com/@anshul-jindal)

Sr. Solution Architect at NVIDIA


## Related talks at this congress

- [ Model Compression Techniques for Efficient LLM Deployment](https://www.wearedevelopers.com/events/world-congress-2025/sessions/811-model-compression) — Harshita Seth, Lavinia Ghita, Sergio Perez, Ziv Ilan
- [The State of GenAI & Machine Learning in 2025](https://www.wearedevelopers.com/events/world-congress-2025/sessions/492-the-state-of-genai) — Alejandro Saucedo
- [MLOps & LLMOps in Banking IT: Automation, Infrastructure & Real-World Challenges](https://www.wearedevelopers.com/events/world-congress-2025/sessions/816-mlops-llmops-in) — Daniel Evenschor, Lars Langerbein, Matthias Kordt, Sebastian Klenke
- [Scaling LLM Applications on Arm: Optimize for Performance and Cost in the Cloud](https://www.wearedevelopers.com/events/world-congress-2025/sessions/508-scaling-llm) — Avin Zarlez