WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 20, 2024 • Session details

Efficient deployment and inference of GPU-accelerated LLMs​

Adolf Hohl

Stop choosing between strict data privacy and deployment speed. Deploy optimized, GPU-accelerated LLMs securely to your infrastructure using NVIDIA NIM and LoRA adapters.

Starting at 0:53 · Watch from the beginning

Efficient deployment and inference of GPU-accelerated LLMs​ thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

2:04 min

Optimizing and deploying containerized AI inference workloads

Ankit Patel Ankit Patel · World Congress 2024

3:10 min

Scaling customized inference models with NVIDIA NIM

Anshul Jindal Anshul Jindal · World Congress 2025

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

5:58 min

Architecting inference layers and meta harnesses to manage token costs

Hari Lingamagunta Hari Lingamagunta +3 · World Congress 2026 North America

2:39 min

Open source tools for running and scaling models

Cedric Clyburn Cedric Clyburn +1 · World Congress 2025

1:12 min

Using vLLM recipes for optimal local hardware configuration

Legare Kerrison Legare Kerrison +1 · World Congress 2026 North America

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher +3

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre · Osedea

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim · Neo4j

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush · Dynatrace

Livecoding with AI thumbnail
31:39

Livecoding with AI

Rainer Stropek · software architects

Dapr in Practice thumbnail
24:08

Dapr in Practice

marcklefter · AxonIQ

Upcoming sessions on this topic

Open session

How 8 GPUs Became 16: Rethinking LLM Inference Through Parallelism, Memory, and Runtime Design

  • Purnima Kumari

    DigitalOCean

    Sr. Solutions Architect II

Open session

Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)

  • Sagar Utekar

    CrowdStrike

    SRE

Open session

Your AI Agents Are Bleeding Tokens: Building a Runtime Cost Control Plane for LLMs

  • Aakriti Aggarwal

    IBM Research

    Research Engineer

  • Bhavishya Pandit

    66degrees

    Leading AI Innovation

Open session

Engineering AI Strategy: Beyond the Hype

  • Omkar Srivastava

    ADSK

    Engineering Leader

Open session

Enterprise AI Memory at Scale

  • Aditya Joshi

    Walmart

    Senior Software Engineer

Open session

Decision models for developers who use LLMs

  • Anurag Bhandari

    antelligent

    CTO

Related videos

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated thumbnail
30:40

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated

Christin Pohl · Microsoft

World Congress Europe · 2026

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization thumbnail
26:27

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization

Legare Kerrison +1

World Congress North America · 2026

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices thumbnail
29:20

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices

Anshul Jindal · NVIDIA

World Congress · 2025

Self-Hosted LLMs: From Zero to Inference thumbnail
30:04

Self-Hosted LLMs: From Zero to Inference

Cedric Clyburn +1

World Congress · 2025

A Hands-On Developer Guide to Inference Engineering thumbnail
30:18

A Hands-On Developer Guide to Inference Engineering

Ankit Patel +1

World Congress North America · 2026

Anatomy of an AI Request: Where Latency and Cost Are Really Born thumbnail
28:01

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu · Together AI

World Congress North America · 2026

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.