WeAreDevelopers LIVE Apr 28, 2021

AR Kit intro - placing 3D objects in a scene and interacting with them in real-time

Nermin Sehic

Build an interactive augmented reality app in under 200 lines of code. Master ARKit raycasting and SceneKit to seamlessly anchor 3D objects into physical environments.

Pause
Mute Enter Fullscreen
#1 about 3 min

Introduction to building iOS augmented reality applications

An introductory outline covers initial device configurations alongside placing and interacting with 3D models.

#2 about 1 min

Differentiating augmented reality sensing from virtual reality

ARKit gathers hardware sensor input to augment real-world scenes rather than creating entirely new virtual environments.

#3 about 3 min

Evolution of ARKit native features and tracking capabilities

The progression expands plane detection, image scaling, face tracking, and complex mesh generation powered by LiDAR.

#4 about 2 min

Hardware prerequisites and development level debugging limitations

Device hardware specifications and optimal physical staging conditions are critical for compiling functionality safely.

#5 about 3 min

Rendering frameworks compatible with ARKit graphic development

Comparisons contrast SceneKit, SpriteKit, Metal, and RealityKit libraries prioritizing asset integrations inside AR sessions.

#6 about 4 min

Understanding the three-dimensional rendering coordinate system layouts

The geometric x, y, and z axes calculate measurements referencing an established initialization focal point.

#7 about 2 min

Configuring tracking session alignment orientation via device gravity

Gravitational inputs function as the most dependable fallback mapping property determining relative alignments.

#8 about 3 min

Managing 3D objects recursively in the SceneKit hierarchy

Nesting geometries natively streamlines synchronized group animations utilizing root inheritance.

#9 about 2 min

Placing objects securely using dynamic coordinate raycasting operations

Casting algorithms calculate distances intercepting flat matrices providing verified destination vectors automatically.

#10 about 2 min

Reviewing a foundational iOS augmented reality demonstration application

Deploying the starting baseline exposes internal device mapping structures painting active feature locations.

#11 about 6 min

Writing the SceneKit code executing Hello World properties

Defining variables configures standard shadow algorithms natively integrating custom colorized materials wrapping base geometries.

#12 about 4 min

Demonstrating interactive digital placement spanning real furniture spaces

Scanning open floors reveals tracking patterns supporting real-time spatial mounting utilizing robust dynamic scale logic.

#13 about 4 min

Managing downloaded 3D geometry assets and model classifications

Parsing grouped file structures translates pre-built visual materials feeding selection states efficiently.

#14 about 4 min

Initializing customized tracking views handling restricted plane targets

Implementing gesture handlers filters unnecessary topological scanning reserving resources strictly optimizing horizontal bounds.

#15 about 5 min

Leveraging delegate events for capturing architectural anchor updates

Continuous listener loops evaluate discovered structural geometries redrawing valid positional boundaries gracefully.

#16 about 5 min

Applying customized digital textures onto generated SceneKit planes

Scaling image coordinates translates mapped tracking areas supporting accurately rotated dimensional boundaries safely.

#17 about 4 min

Planning advanced application interaction functionalities and scaling logic

Exploring expansion strategies advocates analyzing depth limits ensuring large items resist tiny platforms automatically.

#18 about 1 min

Locating project source code bases covering future enhancements

Committing codebase resources freely provisions reusable architectures supporting external developers implementing sophisticated extensions easily.

Matching moments

1:33 min

Inside-out tracking and introducing mobile AR frameworks

rafek rafek · World Congress 2024

4:51 min

Leveraging the presence platform for spatial development

Bastian Schütz Bastian Schütz · World Congress 2024

1:29 min

Introduction to the concept of augmented reality

Vladimir Novick · World Congress 2021

3:43 min

Exploring Unity AR Foundation for advanced tracking logic

Vladimir Novick · World Congress 2021

2:29 min

Debunking XR misconceptions with practical manufacturing examples

rafek rafek · World Congress 2024

4:50 min

Applying lighting and material textures to AR scenes

Vladimir Novick · World Congress 2021

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 23, 2026 · 10:00–17:00

Stage 11

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

September 25, 2026 · 14:10–14:40

Stage 7

Why Your iOS App Feels Broken After an Hour: Diagnosing Long-Session Performance on Real Devices

Vasuki Uday Kiran Vudathala

Staff Performance Engineer at ServiceNow

Vasuki Uday Kiran Vudathala
Open session

World Congress 2026 North America

September 25, 2026 · 10:20–10:50

Stage 5

Physical AI: 5 Things You Can Build That Aren't Another Chatbot

Vini Senger

Senior Technical Evangelist for Startups

Vini Senger
Open session

World Congress 2026 North America

September 24, 2026 · 11:00–11:30

Tech Leaders Stage

Building AI for the Physical World

Alex Spinelli, Eystein Stenberg, Gerardo Pardo-Castellote

Alex Spinelli
Eystein Stenberg
Gerardo Pardo-Castellote
Open session

World Congress 2026 North America

September 24, 2026 · 16:10–16:40

Stage 5

From Software Agents to Physical Devices: Inside the Agentic Hardware Stack

Michael Yuan, Vivian Hu

Michael Yuan
Vivian Hu
Open session

World Congress 2026 North America

September 24, 2026 · 11:00–13:00

Stage 14

Ducks, Sensors, and Agents

Brian McFadden

Staff Engineer, Developer Relations at Qualcomm

Brian McFadden