WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2025 • Aug 20, 2025 • Session details

How Robots Learn to be Robots

Alexander Schwarz

Training autonomous robots is bottlenecked by costly real-world testing. What if they could master kinematics inside photorealistic digital twins first? Discover how generative AI bridges the sim-to-real gap.

Pause
Mute Enter Fullscreen
#1 about 2 min

Transitioning from digital AI agents to physical AI

Defining physical AI systems that interpret 3D environments and physical behaviors.

#2 about 2 min

Translating sensory inputs into physical robot actions

How robots process camera inputs and language instructions to coordinate physical movements.

#3 about 2 min

Bottlenecks in capturing real-world operational data

The scalability and safety limitations of physical teleoperation and real-world testing.

#4 about 2 min

A three-computer paradigm for robotics development

Structuring workflows around neural network training, synthetic data generation, and digital twin simulation.

#5 about 2 min

Managing heterogeneous AI policies across robot embodiments

Deploying specific foundation models for separate skills like perception, navigation, and manipulation.

#6 about 2 min

Accelerating reinforcement learning through parallel simulation

Training trial-and-error behaviors exponentially faster by running thousands of environments simultaneously on GPUs.

#7 about 1 min

Bootstrap datasets via imitation learning and teleoperation

Capturing expert human trajectories to establish baseline behaviors for complex tasks.

#8 about 2 min

Establishing standardized 3D workflows using OpenUSD

Leveraging the OpenUSD framework to build interoperable, non-destructive digital twins.

#9 about 3 min

Scaling human demonstrations with domain randomization algorithms

Applying perturbations to small sets of simulated teleoperation runs to multiply synthetic training trajectories.

#10 about 3 min

Categorizing world foundation models for physical AI

Introducing models optimized for future state prediction, style transfer, and spatial reasoning.

#11 about 2 min

Bridging the sim-to-real gap with multi-control networks

Converting coarse simulation segmentations into photorealistic video datasets to improve model generalization.

#12 about 3 min

Hallucinating valid trajectories using video diffusion models

Post-training prediction models with robot kinematics to generate new training scenarios without full physics rendering.

#13 about 3 min

Fusing internet video and synthetic telemetry for foundation models

Combining massive unstructured external data with targeted simulated outputs to pre-train highly adaptable control policies.

#14 about 2 min

Validating deployed robotic policies in digital factory environments

Performing large-scale software-in-the-loop testing within virtual industrial spaces before physical rollout.

Matching moments

2:22 min

Introduction to physical AI and the physical world

Moe Sani Moe Sani · World Congress 2026 Europe

2:58 min

Introduction to Omniverse and Isaac Sim platforms

Teresa Conceicao · World Congress 2022

1:20 min

Shifting focus from large language models to physical AI

Sergio Perez Sergio Perez · World Congress 2026 Europe

2:23 min

Development roadmap for world models and physical robotics

Joerg Krall Joerg Krall · World Congress 2026 Europe

1:40 min

The three essential phases for physical AI development

Sergio Perez Sergio Perez · World Congress 2026 Europe

2:55 min

Moving from AI software buzzwords to building actual robots

Iulia Feroli Iulia Feroli · World Congress 2026 Europe

More from World Congress 2025

GenAI Security: Navigating the Unseen Iceberg thumbnail
24:33
11 months ago

GenAI Security: Navigating the Unseen Iceberg

Maish Saidel-Keesing

Behind the Code: How Women Are Powering the Future of AI thumbnail
30:28
about 1 year ago

Behind the Code: How Women Are Powering the Future of AI

Alexandra Wudel, Laura Moritz, Madalina Florean

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise? thumbnail
28:12
about 1 year ago

The AI Hype Filter: What’s Real, What’s Investable, What’s Noise?

Justus Lumpe, Konstantin Vinogradov, Nils Eiteneyer, Stephan Wirris

AI in Leadership: How Technology is Reshaping Executive Roles thumbnail
28:19
about 1 year ago

AI in Leadership: How Technology is Reshaping Executive Roles

Bernd Datler, Jasmin Kaiser, Jeff Hausmann, Sonja Alvarez

The AI-Ready Stack: Rethinking the Engineering Org of the Future thumbnail
28:09
about 1 year ago

The AI-Ready Stack: Rethinking the Engineering Org of the Future

Alex Laubscher, Jan Oberhauser, Keno Dreßel, Mirko Novakovic

AI Sovereignty: What Does It Take? thumbnail
29:13
about 1 year ago

AI Sovereignty: What Does It Take?

Boris Hecker, Clemens Wasner, Robin Hermann, Sonja Alvarez

Related videos

Physical AI for the Next Wave of Industrial Digitalisation thumbnail
29:11
World Congress 2026 Europe • 3 months ago

Physical AI for the Next Wave of Industrial Digitalisation

Sergio Perez

Enhancing AI-based Robotics with Simulation Workflows thumbnail
30:57
World Congress 2022 • over 4 years ago

Enhancing AI-based Robotics with Simulation Workflows

Teresa Conceicao

Robots 2.0: When artificial intelligence meets steel thumbnail
28:19
World Congress 2025 • about 1 year ago

Robots 2.0: When artificial intelligence meets steel

Thomas Tomow

Physical AI: The Era of Intelligent Machines thumbnail
30:12
World Congress 2026 Europe • 3 months ago

Physical AI: The Era of Intelligent Machines

Clemens Wasner, Dr. Ramin Hasani, Vinesh Sukumar, Zohar Fox

How I built my own intelligent Robot Arm from Scratch thumbnail
24:54
World Congress 2026 Europe • 3 months ago

How I built my own intelligent Robot Arm from Scratch

Iulia Feroli

Robots Among us: Advances in AI for Everyday Androids thumbnail
29:51
World Congress 2026 Europe • 3 months ago

Robots Among us: Advances in AI for Everyday Androids

Florian Gather, Thomas Endres

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.