World Congress 2025

Scaling LLM Applications on Arm: Optimize for Performance and Cost in the Cloud

July 10, 2025 10:30 – 12:30 Β· 120 min M3 (45 Seats)

What this session covers

Running cloud workloads and containerized LLM-based applications on Arm delivers better price-performance, improves energy efficiency, and meets growing demands for scale and sustainability. In this hands-on workshop, get a walkthrough of the end-to-end process of containerizing a PyTorch application, building multi-architecture Docker images, deploying Azure Kubernetes Service (AKS) using Terraform, and running your application across scalable cloud workloads. If you’re running applications in the cloud, this session shows you how to do it better, faster, and more cost-effectively.

All workshop attendees are required to bring their own laptop

World Congress 2025

Related talks

Open session

AI at the Edge: Build a Smarter IoT on Arm

  • Annie Tallund

    Arm

    Solutions Engineer

Open session

Mobile AI on Arm: AI Text and Audio Generation Entirely on Device

  • Michael Hall

    Arm

    Developer Evangelist

Open session

LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices

  • Anshul Jindal

    NVIDIA

    Sr. Solution Architect

Open session

Building Agentic Apps with Docker

  • Michael Irwin

    Principal Software Engineer, Developer Success at Docker

All sessions at this congress