Zaid Zaim
How Mixed Reality, Azure AI and Drones turned me into a Magician?
#1about 4 minutes
Fusing mixed reality, AI, and drones for magical experiences
The talk introduces a project that combines Azure AI, drones, and mixed reality to create immersive, interactive experiences.
#2about 2 minutes
Exploring the core technology stack for the project
An overview of the key technologies used, including the Unity game engine, Meta Quest 3 for mixed reality, and Azure AI Foundry for intelligence.
#3about 1 minute
Getting started with the Azure AI Foundry platform
Azure AI Foundry is presented as a centralized platform for accessing various AI models, developer tools, and services to build generative AI applications.
#4about 4 minutes
A practical walkthrough of the Azure AI Foundry playground
A live demonstration shows how to create a project, deploy a GPT-4o model, and use the chat playground to test the AI before integration.
#5about 4 minutes
Using Unity and the Meta SDK for XR development
The process of building the mixed reality application involves using the Meta SDK in Unity for camera rigs, controller systems, and crucial hand tracking capabilities.
#6about 11 minutes
Programming drone controls with GitHub Copilot
The Tello drone's UDP-based communication protocol is implemented by feeding its technical architecture to GitHub Copilot, which generates the necessary C# code.
#7about 3 minutes
Live demo of the immersive AI assistant Anna
A live demonstration showcases the AI assistant "Anna" in mixed reality, featuring natural language conversation, image recognition, and function calling to manipulate virtual objects.
#8about 4 minutes
Flying a real drone using hand gestures in MR
The final demo shows a real Tello drone being controlled directly through hand movements tracked by the Meta Quest 3 headset, including takeoff and flips.
Related jobs
Jobs that call for the skills explored in this talk.
Matching moments
00:55 MIN
Combining spatial computing and drones for new interactions
Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!
04:40 MIN
Exploring the tools for drone and MR development
Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!
27:54 MIN
Demonstrating drone control with the HoloLens
Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!
16:05 MIN
Creating an intelligent cockpit experience with AI and AR
Software defines the vehicle: Why customers and developers will love cars even more
00:45 MIN
Introducing the concept of an immersive AI copilot
Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!
14:40 MIN
Exploring Microsoft's Azure AI services and tools
Inside the AI Revolution: How Microsoft is Empowering the World to Achieve More
14:30 MIN
Live demo of the AI copilot on a HoloLens device
Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!
00:59 MIN
Assessing customer excitement and enterprise AI adoption
Architecting the Future: Leveraging AI, Cloud, and Data for Business Success
Featured Partners
Related Videos
31:50Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!
Zaid Zaim
38:28Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!
Zaid Zaim
23:33Azure AI Foundry for Developers: Open Tools, Scalable Agents, Real Impact
Oliver Will
26:35Agentic AI - From Theory to Practice: Developing Multi-Agent AI Systems on Azure
Ricardo
1:12:04WeAreDevelopers LIVE - the weekly developer show with Chris Heilmann and Daniel Cranney
23:03Unleashing a New Reality: The Transformative Power of XR Technologies for Developers
Bastian Schütz
25:17AI: Superhero or Supervillain? How and Why with Scott Hanselman
Scott Hanselman
24:24Best practices: Building Enterprise Applications that leverage GenAI
Damir
From learning to earning
Jobs that call for the skills explored in this talk.
Software Engineer Extended Reality - Flight Simulation & Training
brainchild GmbH
C++
Unreal Engine
Software Architecture
Engineering Manager, Computer Vision Data and Ground Truth Tools
Magic Leap Multiple Locations
Senior
C++
Python
Computer Vision
Cloud & AI Solution Engineer - Azure Platform
Microsoft
Azure
Linux
VMware
PostgreSQL
Red Hat Enterprise Linux - RHEL