WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 9, 2026 • Session details

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated

Christin Pohl

Maximizing open-source LLM throughput requires aggressively balancing compute and memory bottlenecks. Master the complete GPU optimization stack, from simple model quantization to sophisticated speculative decoding.

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:24 min

Exploring open source inference tools for language model serving

Legare Kerrison Legare Kerrison +1 · World Congress 2026 North America

50 sec

Key takeaways for optimizing open source inference engine deployments

Legare Kerrison Legare Kerrison +1 · World Congress 2026 North America

2:39 min

Open source tools for running and scaling models

Cedric Clyburn Cedric Clyburn +1 · World Congress 2025

5:58 min

Architecting inference layers and meta harnesses to manage token costs

Hari Lingamagunta Hari Lingamagunta +3 · World Congress 2026 North America

3:30 min

Optimizing performance using dedicated open source inference engines

Patrick Koss Patrick Koss · World Congress 2025

1:47 min

Managing compute costs and AI model routing

Deivids Vilkinsons Deivids Vilkinsons +3 · World Congress 2026 Europe

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan +1

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann · WeAreDevelopers

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen · NetApp

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic · adjoe

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray · Stack8s

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert +1

Upcoming sessions on this topic

Open session

How 8 GPUs Became 16: Rethinking LLM Inference Through Parallelism, Memory, and Runtime Design

  • Purnima Kumari

    DigitalOCean

    Sr. Solutions Architect II

Open session

Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)

  • Sagar Utekar

    CrowdStrike

    SRE

Open session

Decision models for developers who use LLMs

  • Anurag Bhandari

    antelligent

    CTO

Open session

Engineering AI Strategy: Beyond the Hype

  • Omkar Srivastava

    ADSK

    Engineering Leader

Open session

Your AI Agents Are Bleeding Tokens: Building a Runtime Cost Control Plane for LLMs

  • Aakriti Aggarwal

    IBM Research

    Research Engineer

  • Bhavishya Pandit

    66degrees

    Leading AI Innovation

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Related videos

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization thumbnail
26:27

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization

Legare Kerrison +1

World Congress North America · 2026

Efficient deployment and inference of GPU-accelerated LLMs​ thumbnail
23:01

Efficient deployment and inference of GPU-accelerated LLMs​

Adolf Hohl

World Congress · 2024

Anatomy of an AI Request: Where Latency and Cost Are Really Born thumbnail
28:01

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu · Together AI

World Congress North America · 2026

Unveiling the Magic: Scaling Large Language Models to Serve Millions thumbnail
31:25

Unveiling the Magic: Scaling Large Language Models to Serve Millions

Patrick Koss · STACKIT

World Congress · 2025

Self-Hosted LLMs: From Zero to Inference thumbnail
30:04

Self-Hosted LLMs: From Zero to Inference

Cedric Clyburn +1

World Congress · 2025

A Hands-On Developer Guide to Inference Engineering thumbnail
30:18

A Hands-On Developer Guide to Inference Engineering

Ankit Patel +1

World Congress North America · 2026

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.