WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

Adding knowledge to open-source LLMs

Harshita Seth , Sergio Perez

How do you inject proprietary knowledge into open-source LLMs? Master the pipeline of continued pre-training, supervised fine-tuning, and modern preference alignment to build tailored, domain-specific AI.

Pause
Mute Enter Fullscreen
#1 about 2 min

The core stages of large language model training

Understanding the pre-training and alignment stages establishes a foundation for how language models process and refine information.

#2 about 2 min

Why open-source language models need continuous knowledge updates

Updating models with current affairs and domain-specific knowledge prevents information degradation and improves task relevance.

#3 about 5 min

Using continued pre-training for domain-specific model adaptation

Applying self-supervised learning during continued pre-training ensures foundational models adapt accurately to highly specialized industry domains.

#4 about 7 min

Adding reasoning capabilities through supervised fine-tuning tasks

Structuring instruction datasets with chain-of-thought traces teaches neural networks to formulate explainable reasoning steps before answering.

#5 about 9 min

Aligning behavior and human preferences with reinforcement learning

Implementing comparative reward models and direct preference optimization aligns generative textual outputs with human behavioral expectations.

#6 about 2 min

Orchestrating model alignment with the NeMo RL framework

Adopting specialized automation frameworks simplifies the integration of complex reinforcement learning loops without engineering custom training layouts.

Matching moments

5:01 min

Leveraging large language models for code optimization and development

Stephan Gillich Stephan Gillich +3 · World Congress 2024

2:37 min

Understanding core parameters and mechanics of large language models

Julián Duque Julián Duque · World Congress 2025

2:08 min

Applying large language models to infrastructure tasks

Alfonso Sandoval Rosas Alfonso Sandoval Rosas · Europe 2026 Virtual

2:05 min

Enhancing language models with retrieval-augmented generation

Mary Grygleski Mary Grygleski · LIVE

1:37 min

Extending large language models without expensive retraining

Damir Damir · World Congress 2025

1:16 min

Maturing through the machine learning development lifecycle

Xavier Portilla Edo · LIVE

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
11 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
about 1 year ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
about 1 year ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
about 1 year ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
about 1 year ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
about 1 year ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Related videos

Inside the Mind of an LLM thumbnail
27:11
World Congress 2025 • about 1 year ago

Inside the Mind of an LLM

Emanuele Fabbiani

Unlocking the Power of AI: Accessible Language Model Tuning for All thumbnail
31:50
World Congress 2024 • about 2 years ago

Unlocking the Power of AI: Accessible Language Model Tuning for All

Cedric Clyburn, @technicallylegare

How AI Models Get Smarter thumbnail
35:16
World Congress 2025 • about 1 year ago

How AI Models Get Smarter

Ankit Patel

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated thumbnail
30:40
World Congress 2026 Europe • 3 months ago

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated

Christin Pohl

Fine-Tuning Small Language Models for Agentic AI thumbnail
29:18
World Congress 2026 Europe • 3 months ago

Fine-Tuning Small Language Models for Agentic AI

Björn Buchhold

You are not my model anymore - understanding LLM model behavior thumbnail
24:11
World Congress 2025 • about 1 year ago

You are not my model anymore - understanding LLM model behavior

Andreas Erben

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.