> Markdown version of [/videos/1133-containers-and-kubernetes-made-easy-deep-dive-into-podman-desktop-and-new-ai-capabilities](https://www.wearedevelopers.com/videos/1133-containers-and-kubernetes-made-easy-deep-dive-into-podman-desktop-and-new-ai-capabilities). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Containers and Kubernetes made easy: Deep dive into Podman Desktop and new AI capabilities

Eliminate local-to-production Kubernetes friction using Podman Desktop. Learn to build multi-container pods and securely prototype large language models locally without compromising data privacy.

- **Speakers:** [Stevan Le Meur](https://www.wearedevelopers.com/@stevan-le-meur)
- **Event:** World Congress 2024
- **Published:** August 20, 2024
- **Duration:** 32:19
- **URL:** https://www.wearedevelopers.com/videos/1133-containers-and-kubernetes-made-easy-deep-dive-into-podman-desktop-and-new-ai-capabilities

## Summary

Developers often face friction when translating local container environments into production-ready Kubernetes setups. Podman Desktop bridges this gap by providing an open-source graphical interface powered by the daemonless, rootless Podman engine. By shifting away from monolithic background processes, development teams can securely construct applications, natively group them into multi-container pods, and effortlessly deploy them to local or remote Kubernetes clusters using integrated tooling like Minikube and Kind. This workflow directly targets the widespread discrepancies that normally cause friction between local testing and operations team expectations.

Creating reliable local environments is heavily streamlined through intuitive image handling, immediate container logs, and automated port-mapping capabilities. When building composite architectures—such as a Python frontend connected to a Redis backend—developers can bypass complex local networking configurations by grouping the application's services into an interconnected pod. This allows components to communicate locally exactly as they would inside a Kubernetes environment, dramatically reducing the cognitive load necessary to go cloud-native.

The newly introduced Podman AI Lab extension pushes this containerized methodology directly into the generative AI space. Rather than relying on costly third-party cloud APIs that pose sensitive data privacy risks, developers can evaluate, prototype, and run robust large language models locally. By wrapping quantized GGUF format models and inference engines securely inside containers, engineers maintain total data ownership while exploring patterns like Retrieval-Augmented Generation (RAG). This allows teams to safely ingest real-time data into a vector database to contextualize models locally, serving AI-infused applications over standard APIs while leveraging emerging hardware efficiencies like Mac GPU acceleration.

**Keywords:** podman desktop gui, daemonless container architecture, rootless container security, local kubernetes deployment, multi-container pod creation, podman ai lab extension, local generative ai development, quantized gguf models, containerized retrieval-augmented generation, local llm inference containerization, minikube extension integration, open-source container engine, python flask containerization, local model serving endpoints, mac gpu acceleration containers, cloud-native local environments

## Chapters

1. **Podman Desktop adoption and project milestones** (00:10) — How community feedback and open-source contributions established continuous container development milestones during the project's first year.
1. **Architecture and security benefits of the Podman engine** (01:56) — How a daemonless system architecture enables rootless containers and secures non-root enterprise environments.
1. **Addressing local development challenges with Podman Desktop** (06:16) — Overcoming discrepancies between local developer setups and live Kubernetes environments with intuitive container management.
1. **Building and running multi-container applications locally** (10:48) — Building multi-stage Python and Redis containers via the desktop user interface without complex command line operations.
1. **Networking containers together using Kubernetes pods** (18:28) — Combining individual containers into a pod to share localhost networking and mirror actual Kubernetes environments.
1. **Deploying local container pods to Kubernetes clusters** (19:10) — Setting up a local control plane via Kind or Minikube to transition pods straight into Kubernetes deployments.
1. **Simplifying generative AI adoption with Podman AI Lab** (20:26) — Providing local sandbox environments to test and run generative AI models securely without cloud provider lock-in.
1. **Running local AI models with containers and endpoints** (23:42) — Setting up a quantized GGUF model via a local endpoint to safely test chat interactions and integrate language models.
1. **Building retrieval-augmented generation applications with vector databases** (26:58) — Utilizing a distributed vector database and an inference server to enrich foundation models with external documents.
1. **Enabling experimental GPU acceleration for local containers** (29:00) — Applying hardware acceleration passthrough for container environments to optimize model inference processing speeds.
1. **Future roadmap for the AI recipes catalog and extensions** (30:24) — Upcoming features for local model fine-tuning along with specific container extensions for platform compatibility.

## Related Moments

- [Building local containerized models with Podman AI Lab](https://www.wearedevelopers.com/videos/950-supercharge-your-cloud-native-applications-with-generative-ai) (from "Supercharge your cloud-native applications with Generative AI")
- [Running an AI model locally using Podman AI Lab](https://www.wearedevelopers.com/videos/1597-self-hosted-llms-from-zero-to-inference) (from "Self-Hosted LLMs: From Zero to Inference")
- [Managing containerized infrastructure with Podman Desktop](https://www.wearedevelopers.com/videos/1593-bootable-ai-containers-with-podman-desktop) (from "Bootable AI Containers with Podman Desktop")
- [Developing a containerized AI code assistant locally](https://www.wearedevelopers.com/videos/1593-bootable-ai-containers-with-podman-desktop) (from "Bootable AI Containers with Podman Desktop")
- [Practical learnings from deploying containerized AI solutions](https://www.wearedevelopers.com/videos/1127-using-containers-to-deploy-ai-models-across-our-microscopy-platform) (from "Using Containers to deploy AI Models across our microscopy platform")
- [Integrating generative AI into cloud-native applications](https://www.wearedevelopers.com/videos/950-supercharge-your-cloud-native-applications-with-generative-ai) (from "Supercharge your cloud-native applications with Generative AI")

## Related Articles

- [Building AI Solutions with Rust and Docker](https://www.wearedevelopers.com/magazine/494-building-ai-solutions-with-rust-and-docker)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [How we Build The Software of Tomorrow](https://www.wearedevelopers.com/magazine/120-how-we-build-the-software-of-tomorrow)

## Related Jobs

- [Data Scientist](https://www.wearedevelopers.com/jobs/ext/1351648-data-scientist) at **Almedia**
- [AI Software Engineer (Germany)](https://www.wearedevelopers.com/jobs/48317-ai-software-engineer-germany) at **Sunhat**
- [DevOps Engineer (m/f/d)](https://www.wearedevelopers.com/jobs/48303-devops-engineer-m-f-d) at **basebox GmbH**
- [Devops Engineer](https://www.wearedevelopers.com/jobs/ext/1940926-devops-engineer) at **Bitpanda**
- [Principal Software Engineer, Enterprise AI Platform](https://www.wearedevelopers.com/jobs/ext/1467292-principal-software-engineer-enterprise-ai-platform) at **GitHub**
- [Staff Software Engineer, Copilot Experiences](https://www.wearedevelopers.com/jobs/ext/164361-staff-software-engineer-copilot-experiences) at **GitHub**