> Markdown version of [/videos/100070-from-ai-assistance-to-agentic-systems-scaling-sovereign-ai-in-banking?t=1210](https://www.wearedevelopers.com/videos/100070-from-ai-assistance-to-agentic-systems-scaling-sovereign-ai-in-banking?t=1210). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# From AI Assistance to Agentic Systems: Scaling Sovereign AI in Banking

How do you securely scale AI for 200,000 banking employees? Discover how Finanz Informatik built a fully on-premise, agentic AI platform perfectly compliant with strict financial regulations.

- **Speakers:** [Julia Koch](https://www.wearedevelopers.com/@julia-koch), [Markus Hacker](https://www.wearedevelopers.com/@markus-hacker)
- **Event:** World Congress 2026 Europe
- **Published:** July 9, 2026
- **Duration:** 29:49
- **URL:** https://www.wearedevelopers.com/videos/100070-from-ai-assistance-to-agentic-systems-scaling-sovereign-ai-in-banking

## Summary

AI transformation in the highly regulated financial sector requires an architecture built for scale, sovereignty, and everyday impact. Finanz Informatik, supporting the German Savings Banks Finance Group, has spearheaded one of the largest AI implementations worldwide. Serving over 400 legal entities, 200,000 employees, and 50 million customers, they showcase the transition from basic AI assistants to sophisticated, proactive agentic systems. A cornerstone of this success is deploying a fully sovereign, 100% on-premise AI platform that rigorously complies with complex banking regulations like DORA and the EU AI Act.

Driving enterprise adoption at this massive scale relies on integrating AI directly into daily workflows to provide immediate, tangible relief. The introduction of the "SAI Pilot," an on-premise corporate GPT integrated seamlessly with Outlook, served as a vital icebreaker for organizational buy-in. By automating routine tasks such as email management and complex client meeting preparations, the system currently generates over 4 million prompts monthly. Crucially, this AI application does not replace human workers; rather, it augments their capabilities, transforming 45 minutes of manual file reading into instant, actionable summaries that elevate the quality of customer consultations.

Looking toward the future, a strategic partnership with NVIDIA powers the shift from multi-agent environments to fully autonomous systems, often described as agentic "claws." Utilizing NVIDIA's accelerated computing, NeMo Tron, and open-source models, Finanz Informatik is building an expansive sovereign AI factory. This infrastructure bridges the performance gap between frontier and open-source models, enabling powerful localized applications like the regional "Sophie" model. By anchoring these architectures in robust compliance frameworks, banks can effectively turn experimental AI into a reliable growth engine that safely orchestrates tasks across vast enterprise ecosystems.

**Keywords:** sovereign AI architecture, enterprise AI scaling, banking AI transformation, on-premise AI platforms, multi-agent ecosystems, DORA compliance, EU AI act, corporate GPT deployment, client meeting automation, autonomous AI claws, AI-driven employee augmentation, open-source LLM localization, nvidia nemo tron, generative AI workplace solutions

## Chapters

1. **Foundation of the Sparkassen digital ecosystem** (00:12) — Finanz Informatik provides digital infrastructure and multi-client services across four hundred legal entities in the German banking sector.
1. **Deploying AI assistance for banking employees** (04:11) — The on-premise SAI pilot aids hundreds of thousands of employees with email handling and daily workflow tasks.
1. **Automating client meeting preparation with AI** (06:34) — AI assistants aggregate sales figures and contact history across multiple applications to instantly prep consultants for customer appointments.
1. **Scaling agentic systems to fifty million customers** (10:10) — Agent-to-agent interactions integrate external ecosystems like ChatGPT with banking apps to provide intelligent search and transactional advice.
1. **Sovereign architecture for trustworthy banking AI** (12:37) — Operating inside sovereign domestic data centers ensures processes and data remain completely secure and trustworthy for financial institutions.
1. **Accelerating compute with focused developer tools** (15:06) — Libraries and frameworks like CUDA make it easier for developers to accelerate compute-intensive workloads without deep hardware expertise.
1. **Framing AI with the five-layer cake model** (16:44) — Applications sit at the crucial top layer to translate foundational models and hardware into actual business value.
1. **Advancing open source foundation and physical models** (17:46) — The shrinking capability gap between frontier and open-source releases drives investments in accessible model families like NeMo Tron.
1. **Localizing sovereign AI with national data sets** (20:10) — Curating language models on domestic cloud infrastructure ensures region-specific competencies and retains full sovereignty over future assets.
1. **Adapting autonomous agents for enterprise compliance** (22:30) — Enterprises in highly regulated sectors require specialized building blocks to safely construct autonomous systems that proactively manage tasks.
1. **Empowering employees with use-case driven transformation** (26:02) — Adopting agentic AI securely transforms everyday business workflows while allowing precise scalability corresponding to direct customer needs.
1. **Navigating DORA and the EU AI Act** (28:54) — Implementing new AI pipelines requires continuous alignment with the regulatory guardrails demanded by modern European banking compliance.

## Related Moments

- [Scaling generative AI use cases across large enterprises](https://www.wearedevelopers.com/videos/916-beyond-the-hype-real-world-ai-strategies-panel) (from "Beyond the Hype: Real-World AI Strategies Panel")
- [Scaling AI adoption to non-traditional enterprise developers](https://www.wearedevelopers.com/videos/100256-can-this-elephant-dance-ibm-bob-and-the-future-of-ai-first-software-development) (from "Can This Elephant Dance? IBM Bob and the Future of AI-First Software Development")
- [Driving AI implementation for scalable customer support](https://www.wearedevelopers.com/videos/1627-pioneering-ai-assistants-in-banking) (from "Pioneering AI Assistants in Banking")
- [Reviewing key architectural decisions for federated AI computing](https://www.wearedevelopers.com/videos/100355-running-secure-life-science-research-at-scale-using-hybrid-gpu-hpc-and-kubernetes) (from "Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬")
- [Navigating regulatory compliance and data sovereignty in enterprise AI](https://www.wearedevelopers.com/videos/100087-ai-ready-what-enterprise-transformation-actually-takes) (from "AI-Ready? What Enterprise Transformation Actually Takes")
- [Why scaling AI is harder than traditional software](https://www.wearedevelopers.com/videos/100328-the-limits-of-llms-in-real-world-applications) (from "The Limits of LLMs in Real-World Applications")

## Related Articles

- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)

## Related Jobs

- [AI Software Engineer (Germany)](https://www.wearedevelopers.com/jobs/48317-ai-software-engineer-germany) at **Sunhat**
- [Head of AI Applications](https://www.wearedevelopers.com/jobs/ext/1456210-head-of-ai-applications) at **ZEISS Group**
- [Head of AI Applications](https://www.wearedevelopers.com/jobs/ext/1231536-head-of-ai-applications) at **ZEISS Group**
- [Senior AI Agent Software Engineer (Go, Python) (m/f/x)](https://www.wearedevelopers.com/jobs/48277-senior-ai-agent-software-engineer-go-python-m-f-x) at **Dynatrace**
- [AI Operations Manager (all genders)](https://www.wearedevelopers.com/jobs/48263-ai-operations-manager-all-genders) at **envelio**
- [Security Architect - AI](https://www.wearedevelopers.com/jobs/ext/1581899-security-architect-ai) at **ZEISS Group**