> Markdown version of [/videos/1627-pioneering-ai-assistants-in-banking?t=86](https://www.wearedevelopers.com/videos/1627-pioneering-ai-assistants-in-banking?t=86). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Pioneering AI Assistants in Banking

Can highly regulated banks securely scale generative AI without sacrificing data control? Discover how Finance Informatic and NVIDIA deployed an on-premise AI factory for 200,000 employees.

- **Speakers:** [Markus Hacker](https://www.wearedevelopers.com/@markus-hacker), [Tabitha Kleine](https://www.wearedevelopers.com/@tabitha-kleine)
- **Event:** World Congress 2025
- **Published:** August 20, 2025
- **Duration:** 26:34
- **URL:** https://www.wearedevelopers.com/videos/1627-pioneering-ai-assistants-in-banking

## Summary

Finance Informatic, the technology provider for Germany's Sparkassen, partners with NVIDIA to tackle the challenge of securely scaling agentic AI in a highly regulated banking environment. Serving 200,000 employees and 50 million customers, their "SAI pilot" demonstrates how to move beyond AI experimentation into sovereign, enterprise-wide deployment. By connecting domain-specific, localized on-premise data to specialist AI agents, the platform streamlines heavy operational workflows, such as auditing investment compliance calls, completing process documentation, and facilitating employee onboarding.

The technical architecture relies on a modular framework of specialized agents running on a sovereign data layer to ensure strict data privacy and security. To achieve this performant on-premise infrastructure, the deployment utilizes NVIDIA NIM (inference microservices) to easily package and optimize generative open-source models, paired with NeMo Guardrails to enforce strict domain boundaries and actively prevent model hallucinations. This full-stack approach proves that highly regulated industries can operationalize customized, responsive AI without sacrificing data control or containerized agility.

Beyond technical infrastructure—which itself benefits from a 100,000x energy efficiency gain natively achieved from Kepler to Blackwell GPU architectures—successful implementation heavily relies on workforce culture. Building an internal "AI factory" use-case pipeline requires organizational openness, an entrepreneurial tolerance for mistakes, and pioneers to lead behavioral change. Ultimately, deploying artificial intelligence in financial institutions operates as a fundamentally human-centered project, acting as a productivity multiplier that enhances daily workflows rather than replacing the human workforce.

**Keywords:** banking AI assistants, on-premise AI deployment, data sovereignty frameworks, agentic AI architectures, nvidia NIM inferencing, nemo guardrails, hallucination prevention, domain-specific AI knowledge, financial compliance automation, AI-driven workflow efficiency, human-centered AI design, modular agent frameworks, enterprise AI scaling, cultural AI adoption, GPU compute efficiency

## Chapters

1. **Developing AI solutions for large banking scales** (01:26) — Deploying models requires supporting millions of customers and thousands of employees across diverse business channels.
1. **Implementing AI assistants for workplace productivity** (02:52) — An internal pilot agent helps teams process domain-specific data and automate complex manual validation steps.
1. **Designing modular AI architectures for data sovereignty** (07:22) — A human-centered application layer connects specialist models while maintaining strictly on-premises data processing protocols.
1. **Driving AI implementation for scalable customer support** (08:56) — Deploying intentional technology paradigms at scale empowers banking staff to assist consumers without disruptive overhauls.
1. **Tracing the evolution of artificial intelligence models** (11:06) — Advancements have shifted capabilities from basic environmental perception to generative, agentic, and eventually physical paradigms.
1. **Empowering developers with comprehensive AI software stacks** (14:59) — Microservices and safety guardrails enable engineering teams to deploy specialized, domain-specific inference architectures efficiently.
1. **Balancing AI competitiveness with compute efficiency demands** (19:12) — Scaling digital ecosystems requires massive data center infrastructure paired with exponentially optimized silicon hardware.
1. **Highlighting innovative artificial intelligence organizations and ecosystems** (21:48) — A robust national technology market features powerful translation platforms and specialized robotics research labs.
1. **Navigating artificial intelligence adoption as a cultural transformation** (23:14) — Discovering high-value automation pipelines requires employee curiosity, operational flexibility, and a willingness to explore failures.

## Related Moments

- [Deploying AI assistance for banking employees](https://www.wearedevelopers.com/videos/100070-from-ai-assistance-to-agentic-systems-scaling-sovereign-ai-in-banking) (from "From AI Assistance to Agentic Systems: Scaling Sovereign AI in Banking")
- [Overview of AI applications in banking](https://www.wearedevelopers.com/videos/1088-unleashing-the-power-of-ai-to-prevent-financial-crime) (from "Unleashing the power of AI to prevent financial crime")
- [Scaling generative AI use cases across large enterprises](https://www.wearedevelopers.com/videos/916-beyond-the-hype-real-world-ai-strategies-panel) (from "Beyond the Hype: Real-World AI Strategies Panel")
- [Scaling AI adoption to non-traditional enterprise developers](https://www.wearedevelopers.com/videos/100256-can-this-elephant-dance-ibm-bob-and-the-future-of-ai-first-software-development) (from "Can This Elephant Dance? IBM Bob and the Future of AI-First Software Development")
- [Automating banking workflows with the SAI Pilot assistant](https://www.wearedevelopers.com/videos/100286-the-missing-layer-between-enterprise-data-and-ai-agents) (from "The Missing Layer Between Enterprise Data and AI Agents")
- [Empowering employees with use-case driven transformation](https://www.wearedevelopers.com/videos/100070-from-ai-assistance-to-agentic-systems-scaling-sovereign-ai-in-banking) (from "From AI Assistance to Agentic Systems: Scaling Sovereign AI in Banking")

## Related Articles

- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Panel Discussion: Responsible AI in Practice - Real-World Examples and Challenges](https://www.wearedevelopers.com/magazine/488-panel-discussion-responsible-ai-in-practice-real-world-examples-and-challenges)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)

## Related Jobs

- [AI Software Engineer (Germany)](https://www.wearedevelopers.com/jobs/48317-ai-software-engineer-germany) at **Sunhat**
- [Head of AI Applications](https://www.wearedevelopers.com/jobs/ext/1231536-head-of-ai-applications) at **ZEISS Group**
- [Head of AI Applications](https://www.wearedevelopers.com/jobs/ext/1456210-head-of-ai-applications) at **ZEISS Group**
- [AI Full Stack Engineer](https://www.wearedevelopers.com/jobs/ext/1354435-ai-full-stack-engineer) at **Almedia**
- [Security Architect - AI](https://www.wearedevelopers.com/jobs/ext/1581899-security-architect-ai) at **ZEISS Group**
- [Data Scientist](https://www.wearedevelopers.com/jobs/ext/1351648-data-scientist) at **Almedia**