> Markdown version of [/videos/1522-adding-knowledge-to-open-source-llms?t=123](https://www.wearedevelopers.com/videos/1522-adding-knowledge-to-open-source-llms?t=123). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Adding knowledge to open-source LLMs

How do you inject proprietary knowledge into open-source LLMs? Master the pipeline of continued pre-training, supervised fine-tuning, and modern preference alignment to build tailored, domain-specific AI.

- **Speakers:** [Harshita Seth](https://www.wearedevelopers.com/@harshita-seth), [Sergio Perez](https://www.wearedevelopers.com/@sergio-perez)
- **Event:** World Congress 2025
- **Published:** August 20, 2025
- **Duration:** 25:35
- **URL:** https://www.wearedevelopers.com/videos/1522-adding-knowledge-to-open-source-llms
- **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/44acde791e72d38389c126ce580e88bd/thumbnails/thumbnail.jpg?time=125485ms

## Access

Playback and chapters for this video are available with a Free account.

## Related Moments

- [Understanding the unique architecture of LLM applications](https://www.wearedevelopers.com/videos/100407-red-teaming-your-llm-app-a-hands-on-threat-model-you-can-reuse) (from "Red Teaming Your LLM App -- A Hands-On Threat Model You Can Reuse")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/11a820ca699b9e4474ed6156b27f8ec6/thumbnails/thumbnail.jpg?time=160868ms
- [Leveraging large language models for code optimization and development](https://www.wearedevelopers.com/videos/1106-the-future-of-computing-ai-technologies-in-the-exascale-era) (from "The Future of Computing: AI Technologies in the Exascale Era")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/852fc4aca18bd3af3d48ec5d5b629889/thumbnails/thumbnail.jpg?time=193385ms
- [Understanding core parameters and mechanics of large language models](https://www.wearedevelopers.com/videos/1512-building-ai-applications-with-langchain-and-node-js) (from "Building AI Applications with LangChain and Node.js")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/7f71af512c5d50d581e626e3361b8deb/thumbnails/thumbnail.jpg?time=57865ms
- [Applying large language models to infrastructure tasks](https://www.wearedevelopers.com/videos/2084-your-infrastructure-is-not-a-playground-ai-agents-for-infra-done-right) (from "Your Infrastructure Is Not a Playground: AI Agents for Infra Done Right")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/e501980dcd6567de4bf068c84d0b760c/thumbnails/thumbnail.jpg?time=189440ms
- [Optimizing large language models for autonomous software engineering](https://www.wearedevelopers.com/videos/100370-acquired-live-interview-amjad-masad-co-founder-ceo-replit) (from "Acquired Live Interview: Amjad Masad (Co-founder & CEO, Replit)")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/1fc1d17a79c17332d7a4257a5b899912/thumbnails/thumbnail.jpg?time=185043ms
- [Enhancing language models with retrieval-augmented generation](https://www.wearedevelopers.com/videos/844-enter-the-brave-new-world-of-genai-with-vector-search) (from "Enter the Brave New World of GenAI with Vector Search")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/9603ab4cad02218daecd3265703f19a3/thumbnails/thumbnail.jpg?time=184865ms

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)

## Related Jobs

- [Machine Learning Engineer](https://www.wearedevelopers.com/jobs/ext/3652934-machine-learning-engineer) at **TWILIO**
- [Machine Learning Engineer](https://www.wearedevelopers.com/jobs/ext/4215706-machine-learning-engineer) at **TWILIO**
- [Machine Learning Scientist III - Personalization](https://www.wearedevelopers.com/jobs/48533-machine-learning-scientist-iii-personalization) at **Expedia**
- [Senior AI Engineer](https://www.wearedevelopers.com/jobs/ext/4256728-senior-ai-engineer) at **ARM**
- [Principal Software Engineer, AI Inference Runtime](https://www.wearedevelopers.com/jobs/ext/3922544-principal-software-engineer-ai-inference-runtime) at **ARM**
- [Staff Machine Learning Engineer](https://www.wearedevelopers.com/jobs/48478-staff-machine-learning-engineer) at **Arm**