World Congress 2025

Scaling LLM Applications on Arm: Optimize for Performance and Cost in the Cloud

July 10, 2025 10:30 – 12:30 Β· 120 min M3 (45 Seats)

What this session covers

Running cloud workloads and containerized LLM-based applications on Arm delivers better price-performance, improves energy efficiency, and meets growing demands for scale and sustainability. In this hands-on workshop, get a walkthrough of the end-to-end process of containerizing a PyTorch application, building multi-architecture Docker images, deploying Azure Kubernetes Service (AKS) using Terraform, and running your application across scalable cloud workloads. If you’re running applications in the cloud, this session shows you how to do it better, faster, and more cost-effectively.

All workshop attendees are required to bring their own laptop

Related talks at this congress

Open session

World Congress 2025

July 11, 2025 Β· 14:45–16:45

M3 (45 Seats)

AI at the Edge: Build a Smarter IoT on Arm

Annie Tallund

Solutions Engineer at Arm

Annie Tallund
Open session

World Congress 2025

July 10, 2025 Β· 13:00–15:00

M3 (45 Seats)

Mobile AI on Arm: AI Text and Audio Generation Entirely on Device

Michael Hall

Developer Evangelist

Michael Hall
Open session

World Congress 2025

July 11, 2025 Β· 14:20–14:50

Stage 5

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices

Anshul Jindal

Sr. Solution Architect at NVIDIA

Anshul Jindal
Open session

World Congress 2025

July 10, 2025 Β· 10:45–12:45

M2 (40 Seats)

Building Agentic Apps with Docker

Michael Irwin

Principal Software Engineer, Developer Success at Docker

Michael Irwin
All sessions at this congress