World Congress 2025

Adding knowledge to open-source LLMs

July 11, 2025 09:40 – 10:10 · 30 min Stage 2

What this session covers

While Large Language Models are remarkably powerful, their knowledge is typically limited to the data available during training. This makes their applications challenging when business contexts, or cultural nuances change or are not well represented in their original training data. In many cases, in-context learning techniques such as retrieval-augmented generation (RAG) can help to bridge this gap by providing models with relevant information at runtime. However, when a model lacks foundational understanding of domain-specific knowledge, use case, or local cultural context, even advanced retrieval methods may fail. In this session, NVIDIA experts will explain how to enrich language models with new knowledge, expanding their capabilities in specialized business, engineering, or scientific domains, and adjusting adaptation to new languages, cultures, and values.

World Congress 2025

Related talks

Open session

Model Compression Techniques for Efficient LLM Deployment

  • Harshita Seth

    NVIDIA

    Senior Solution Architect

  • Lavinia Ghita

    NVIDIA

    Solution Architect

  • Sergio Perez

    NVIDIA

    Solution Architect

  • Ziv Ilan

    NVIDIA

    Solution Architect GenAI

Open session

Breaking Language Barriers: GPU-Accelerated Corpus Curation for LLM Training/Customization

  • Miguel Martínez

    NVIDIA

    Sr. Deep Learning Data Scientist

  • Roman

    NVIDIA

    Solutions Architect

Open session

Self-Hosted LLMs: From Zero to Inference

  • Cedric Clyburn

    Red Hat

    Senior Developer Advocate

  • Roberto Carratalá

    Red Hat

    Principal AI Architect

Open session

Inside the Mind of an LLM

  • Emanuele Fabbiani

    xtream

    Head of AI

All sessions at this congress