The talk introduces building an interactive AI character inspired by Disney's WALL-E using immersive technologies and generative AI.
Microsoft Mesh integrates into Microsoft Teams to provide a platform for immersive meetings, trainings, and social events.
The project is built using three main components: the Unity game engine, the Mesh Toolkit for deployment, and Azure OpenAI for intelligence.
A C# script in Unity calls the Azure OpenAI REST API to handle communication, parse the JSON response, and manage text-to-speech output.
The Mesh Toolkit provides shaders, visual scripting, and an optimizer to prepare and deploy the Unity environment to the Mesh platform.
A live demonstration shows interaction with the AI character "Anna" using voice commands on a Microsoft HoloLens.
The AI copilot is demonstrated within a shared, multi-user Microsoft Mesh space, showing collaborative interaction with the character.
The final demo showcases how users can join a Microsoft Mesh immersive space directly from a standard Microsoft Teams meeting.
ROSEN Technology and Research Center GmbH
Lingen (Ems), Germany
35:26Zaid Zaim
38:28Zaid Zaim
31:39Rainer Stropek
23:33Oliver Will
1:09:49Simi Olabisi
1:12:04
24:24Damir
26:35Ricardo
Jobs that call for the skills explored in this talk.
Ventures Unlimited
Vienna, United States of America
Enterprise Navitas Midstream Partners LLC
Phoenix, United States of America
Ventures Unlimited
Oakton, United States of America
Ventures Unlimited
Herndon, United States of America
Ventures Unlimited
Sterling, United States of America
