World Congress 2024

Efficient Large Language Model Customization with NVIDIA NeMo Framework.

July 18, 2024 14:50 – 15:20 · 30 min Virtual Stage 1

What this session covers

In the rapidly evolving field of artificial intelligence, efficiently customizing large language models (LLMs) is essential for high performance across diverse applications. This talk will cover advanced techniques for parameter-efficient fine-tuning (PEFT) of LLMs, including p-tuning, prompt-tuning, adapters, supervised fine-tuning, and retrieval-augmented generation (RAG). Attendees will learn how to fine-tune LLMs with minimal computational resources while maintaining or enhancing performance, with practical demonstrations using the NVIDIA NeMo Framework. By the end, participants will be equipped to efficiently customize LLMs for specific tasks and challenges. This talk is valuable for researchers, developers, and AI enthusiasts interested in optimizing and personalizing LLMs.

World Congress 2024

Related talks

Open session

Unlocking the Power of AI: Accessible Language Model Tuning for All

  • Cedric Clyburn

    Cedric Clyburn is Developer Advocate at Red Hat

  • @technicallylegare

    Technical Product Marketing Intern, Red Hat

Open session

Efficient deployment and inference of GPU-accelerated LLMs​

  • Adolf Hohl

    Sr. Mgr. Solution Architects AUTO Enterprise

Open session

Intro to LLMs and recent developments

  • Christian Winkler

    CEO of datanizing, research professor at TH Nürnberg

Open session

Leveraging Large Language Models for Legacy Code Translation: Challenges and Solutions

  • Michael Niebisch

    Software Developer Algorithms ZEISS

All sessions at this congress