WeAreDevelopers LIVE • May 26, 2021

Serverless deployment of (large) NLP models

Marek Suppa

Can you run massive NLP models within AWS Lambda's strict 250MB limit? Discover how Slido used knowledge distillation and ONNX to achieve sub-100ms serverless inference.

Serverless deployment of (large) NLP models thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:33 min

Scaling model inference leveraging serverless edge functions

Jeremy Murray

Jeremy Murray · World Congress 2026 Europe

1:20 min

Reducing infrastructure capacity requirements by deploying small language models

Alexander Wallner

Alexander Wallner +3 · World Congress 2024

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan

Viktoria Semaan · World Congress 2026 Europe

1:45 min

Introduction to serving large language models locally

Patrick Koss

Patrick Koss · World Congress 2025

2:44 min

Running lightweight large language models on local hardware

Ekaterina Sirazitdinova · LIVE

5:05 min

Exploring hybrid models, monoliths, and serverless computing

Michael Eisenbart · LIVE

More from WeAreDevelopers LIVE

Humans in the Loop: Storytelling in Tech thumbnail

Humans in the Loop: Storytelling in Tech

Christian Heilmann +2

4 days ago

WeAreDevelopers LIVE: Your Brain Is Lying to You: Cognitive Biases in Development thumbnail

Your Brain Is Lying to You: Cognitive Biases in Development

Last week

Like Peas in a Pod - What Happens When People Clone Your App? thumbnail

Like Peas in a Pod - What Happens When People Clone Your App?

Ivan Kutskir +2

2 weeks ago

WeAreDevelopers LIVE - Read more, Prompt Less thumbnail

Read more, Prompt Less

Christian Heilmann +2

3 weeks ago

WeAreDevelopers LIVE - Tech Education in Two Languages thumbnail

Tech Education in Two Languages

Daniel Cranney +1

Oct 2026

WeAreDevelopers LIVE - Playing in Production thumbnail

Playing in Production

Andrew MacLean +2

Sep 2026

Upcoming sessions on this topic

Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)

Sagar Utekar

CrowdStrike

SRE

Decision models for developers who use LLMs

Anurag Bhandari

antelligent

CTO

Build a Zero-Cost AI Agent in Your Browser

Aishwarya Mathuria

Adobe

Computer Scientist
Nishant Thakur

Adobe

Senior Computer Scientist

Your Server-Rendered App Doesn't Know Who It's Talking To

Anshul Bansal

OLX India

Principal Architect

Build Otto: Ship an AI Agent Without Redeploying

Abhishek Hiremath

LaunchDarkly

Senior Solutions Engineers

Recursive Language Models: Scaling infinitely beyond the Context Window

Jayita Bhattacharyya

Domyn

Member of Technical Staff

Related videos

Unveiling the Magic: Scaling Large Language Models to Serve Millions thumbnail

Unveiling the Magic: Scaling Large Language Models to Serve Millions

Patrick Koss · STACKIT

World Congress · 2025

Leverage Cloud Computing Benefits with Serverless Multi-Cloud ML thumbnail

Leverage Cloud Computing Benefits with Serverless Multi-Cloud ML

Linda Mohamed

LIVE · Nov 2020

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization thumbnail

Fast, Cheap, and Accurate: Optimizing LLM Inference with vLLM and Quantization

Legare Kerrison +1

World Congress North America · 2026

Serverless: Past, Present and Future thumbnail

Serverless: Past, Present and Future

Oliver Arafat

LIVE · Sep 2020

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated thumbnail

Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated

Christin Pohl · Microsoft

World Congress Europe · 2026

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow thumbnail

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow

Aarno Aukia

LIVE · Oct 2024

Related articles

BB

Benedikt Bischof

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Bas Geerdink who gave advice on MLOps.‍About the speaker:‍Bas is a programmer, scientist, a...

about 4 years ago

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

BB

Benedikt Bischof

MLOps And AI Driven Development

Welcome to this issue of the WeAreDevelopers Dev Talk Recap series. This article recaps an interesting talk by Natalie Pistunovic who spoke about the development of AI and MLOps. What you will lear...

over 4 years ago

MLOps And AI Driven Development

LM

Luis Minvielle

What Are Large Language Models?

Developers and writers can finally agree on one thing: Large Language Models, the subset of AIs that drive ChatGPT and its competitors, are stunning tech creations. Developers enjoying the likes of...

about 3 years ago

What Are Large Language Models?

BB

Benedikt Bischof

MLOps – What’s the deal behind it?

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Nico Axtmann who introduced us to MLOpsAbout the speaker:Nico Axtmann is a seasoned machine...

about 4 years ago

MLOps – What’s the deal behind it?

From learning to earning

Jobs that call for the skills explored in this talk.

Machine Learning Engineer

Cantabria, Spain

Remote Twilio Chatbots Tensorflow

about 1 month ago

Machine Learning Engineer

Valladolid, Spain

Remote Twilio AutoGen Pytorch

Machine Learning Engineer

Valencia, Spain

Remote Twilio AutoGen Pytorch

Machine Learning Engineer

Remote Spacy Twilio CrewAI

Machine Learning Engineer

Leganés, Spain

Twilio Pytorch Tensorflow

about 2 months ago

Machine Learning Engineer

Twilio Pytorch Tensorflow