World Congress 2025
July 10, 2025 · 14:50–15:20
Stage 6 - Red Hat
Self-Hosted LLMs: From Zero to Inference
Cedric Clyburn, Roberto Carratalá
World Congress 2025
Microsoft and Red Hat recently simplified the ability to run Red Hat Enterprise Linux (RHEL) on Microsoft Windows systems using Windows Services for Linux version 2 (WSL2). In this demo-filled session, we’ll show you how to install RHEL on WSL2 and use it to develop a Linux-based Python application. We’ll also have a look at the capabilities of RHEL image builder and demonstrate how you can build a WSL2-ready developer image that runs in WSL2 and lets you use a suite of your favorite Linux and Windows tools in the development process.. This way of working has been getting harder as systems become more and more distributed. Now, with the advent of AI-driven development, it has become even more challenging than ever before. Many of us use remote generative AI services to help us with scaffolding, writing and testing code, and with many other tasks.
Wouldn’t it be great if we could still run everything on our local machine? That’s what this session is all about!
In this session we’ll take a look at various solutions to continue to do local, network-optional development: Run AI models locally using different tools such as Ollama, Podman AI Lab, RamaLama, Docker, etc. Evaluate different code assistants that can work with these locally running models Explore how to infuse AI capabilities from local models into our code Compare models from different vendors; and with different sizes to find the right balance between performance and accuracy Weigh pros and cons of using local vs remote models
Come to this session to learn more about local development while leveraging AI to optimize our development flow, code and our functionality itself!
World Congress 2025
July 10, 2025 · 14:50–15:20
Stage 6 - Red Hat
Cedric Clyburn, Roberto Carratalá
World Congress 2025
July 11, 2025 · 09:40–10:10
Stage 3 - Microsoft
Oliver Will
Head of AI at Obungi
World Congress 2025
July 11, 2025 · 09:00–09:30
Stage 6 - Red Hat
Roberto Carratalá
Principal AI Architect at Red Hat
World Congress 2025
July 10, 2025 · 10:10–10:40
Stage 2
Damir
daenet GmbH - ACP Digital, Microsoft Regional Director, Most Valuable Professional - AI