Zaid Zaim
How Mixed Reality, Azure AI and Drones turned me into a Magician?
#1about 4 minutes
Fusing mixed reality, AI, and drones for magical experiences
The talk introduces a project that combines Azure AI, drones, and mixed reality to create immersive, interactive experiences.
#2about 2 minutes
Exploring the core technology stack for the project
An overview of the key technologies used, including the Unity game engine, Meta Quest 3 for mixed reality, and Azure AI Foundry for intelligence.
#3about 1 minute
Getting started with the Azure AI Foundry platform
Azure AI Foundry is presented as a centralized platform for accessing various AI models, developer tools, and services to build generative AI applications.
#4about 4 minutes
A practical walkthrough of the Azure AI Foundry playground
A live demonstration shows how to create a project, deploy a GPT-4o model, and use the chat playground to test the AI before integration.
#5about 4 minutes
Using Unity and the Meta SDK for XR development
The process of building the mixed reality application involves using the Meta SDK in Unity for camera rigs, controller systems, and crucial hand tracking capabilities.
#6about 11 minutes
Programming drone controls with GitHub Copilot
The Tello drone's UDP-based communication protocol is implemented by feeding its technical architecture to GitHub Copilot, which generates the necessary C# code.
#7about 3 minutes
Live demo of the immersive AI assistant Anna
A live demonstration showcases the AI assistant "Anna" in mixed reality, featuring natural language conversation, image recognition, and function calling to manipulate virtual objects.
#8about 4 minutes
Flying a real drone using hand gestures in MR
The final demo shows a real Tello drone being controlled directly through hand movements tracked by the Meta Quest 3 headset, including takeoff and flips.
Related jobs
Jobs that call for the skills explored in this talk.
Featured Partners
Related Videos
31:50Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!
Zaid Zaim
38:28Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!
Zaid Zaim
23:33Azure AI Foundry for Developers: Open Tools, Scalable Agents, Real Impact
Oliver Will
26:35Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure
Ricardo
23:03Unleashing a New Reality: The Transformative Power of XR Technologies for Developers
Bastian Schütz
24:24Best practices: Building Enterprise Applications that leverage GenAI
Damir
1:12:04WeAreDevelopers LIVE - the weekly developer show with Chris Heilmann and Daniel Cranney
25:17AI: Superhero or Supervillain? How and Why with Scott Hanselman
Scott Hanselman
From learning to earning
Jobs that call for the skills explored in this talk.
Microsoft Copilot Studio & Azure AI Foundry Developer- Remote
FDM Group
Charing Cross, United Kingdom
Remote
Senior
Azure
Python
TypeScript
Continuous Integration
Full-Stack Engineer - AI Agentic Systems
autonomous-teaming
Potsdam, Germany
Remote
Linux
Redis
React
Python
+7