WeAreDevelopers LIVE • May 26, 2021

Serverless deployment of (large) NLP models

Marek Suppa

Can you run massive NLP models within AWS Lambda's strict 250MB limit? Discover how Slido used knowledge distillation and ONNX to achieve sub-100ms serverless inference.

Starting at 8:53 · Watch from the beginning

Serverless deployment of (large) NLP models  thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:33 min

Scaling model inference leveraging serverless edge functions

Jeremy Murray Jeremy Murray · World Congress 2026 Europe

1:20 min

Reducing infrastructure capacity requirements by deploying small language models

Alexander Wallner Alexander Wallner +3 · World Congress 2024

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

1:45 min

Introduction to serving large language models locally

Patrick Koss Patrick Koss · World Congress 2025

2:44 min

Running lightweight large language models on local hardware

Ekaterina Sirazitdinova · LIVE

5:05 min

Exploring hybrid models, monoliths, and serverless computing

Michael Eisenbart · LIVE

Upcoming sessions on this topic

Starts in 5 days

Conference India 2026

November 25–26, 2026

Bengaluru, India