WeAreDevelopers LIVE Apr 28, 2021

AR Kit intro - placing 3D objects in a scene and interacting with them in real-time

Nermin Sehic

Build an interactive augmented reality app in under 200 lines of code. Master ARKit raycasting and SceneKit to seamlessly anchor 3D objects into physical environments.

Pause
Mute Enter Fullscreen
#1 about 3 min

Introduction to building iOS augmented reality applications

An introductory outline covers initial device configurations alongside placing and interacting with 3D models.

#2 about 1 min

Differentiating augmented reality sensing from virtual reality

ARKit gathers hardware sensor input to augment real-world scenes rather than creating entirely new virtual environments.

#3 about 3 min

Evolution of ARKit native features and tracking capabilities

The progression expands plane detection, image scaling, face tracking, and complex mesh generation powered by LiDAR.

#4 about 2 min

Hardware prerequisites and development level debugging limitations

Device hardware specifications and optimal physical staging conditions are critical for compiling functionality safely.

#5 about 3 min

Rendering frameworks compatible with ARKit graphic development

Comparisons contrast SceneKit, SpriteKit, Metal, and RealityKit libraries prioritizing asset integrations inside AR sessions.

#6 about 4 min

Understanding the three-dimensional rendering coordinate system layouts

The geometric x, y, and z axes calculate measurements referencing an established initialization focal point.

#7 about 2 min

Configuring tracking session alignment orientation via device gravity

Gravitational inputs function as the most dependable fallback mapping property determining relative alignments.

#8 about 3 min

Managing 3D objects recursively in the SceneKit hierarchy

Nesting geometries natively streamlines synchronized group animations utilizing root inheritance.

#9 about 2 min

Placing objects securely using dynamic coordinate raycasting operations

Casting algorithms calculate distances intercepting flat matrices providing verified destination vectors automatically.

#10 about 2 min

Reviewing a foundational iOS augmented reality demonstration application

Deploying the starting baseline exposes internal device mapping structures painting active feature locations.

#11 about 6 min

Writing the SceneKit code executing Hello World properties

Defining variables configures standard shadow algorithms natively integrating custom colorized materials wrapping base geometries.

#12 about 4 min

Demonstrating interactive digital placement spanning real furniture spaces

Scanning open floors reveals tracking patterns supporting real-time spatial mounting utilizing robust dynamic scale logic.

#13 about 4 min

Managing downloaded 3D geometry assets and model classifications

Parsing grouped file structures translates pre-built visual materials feeding selection states efficiently.

#14 about 4 min

Initializing customized tracking views handling restricted plane targets

Implementing gesture handlers filters unnecessary topological scanning reserving resources strictly optimizing horizontal bounds.

#15 about 5 min

Leveraging delegate events for capturing architectural anchor updates

Continuous listener loops evaluate discovered structural geometries redrawing valid positional boundaries gracefully.

#16 about 5 min

Applying customized digital textures onto generated SceneKit planes

Scaling image coordinates translates mapped tracking areas supporting accurately rotated dimensional boundaries safely.

#17 about 4 min

Planning advanced application interaction functionalities and scaling logic

Exploring expansion strategies advocates analyzing depth limits ensuring large items resist tiny platforms automatically.

#18 about 1 min

Locating project source code bases covering future enhancements

Committing codebase resources freely provisions reusable architectures supporting external developers implementing sophisticated extensions easily.

Matching moments

1:33 min

Inside-out tracking and introducing mobile AR frameworks

rafek rafek · WWC 2024

4:51 min

Leveraging the presence platform for spatial development

Bastian Schütz Bastian Schütz · WWC 2024

1:29 min

Introduction to the concept of augmented reality

Vladimir Novick · WWC 2021

3:43 min

Exploring Unity AR Foundation for advanced tracking logic

Vladimir Novick · WWC 2021

2:29 min

Debunking XR misconceptions with practical manufacturing examples

rafek rafek · WWC 2024

4:50 min

Applying lighting and material textures to AR scenes

Vladimir Novick · WWC 2021

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

From Software Agents to Physical Devices: Inside the Agentic Hardware Stack

Michael Yuan, Vivian Hu

Michael Yuan
Vivian Hu
Open session

World Congress 2026 North America

From Idea to Production with AI: Agentic Development in Practice

Daniel Ostrovsky

UI/UX Architect at Payoneer | AI Architect | Full Cycle Development Expert | Public Speaker | Open Source Contributor |

Daniel Ostrovsky
Open session

World Congress 2026 North America

GitHub’s Team X-Ray: Your Repository Knows More About Your Team Than Your Team Does

Andrea Griffiths

Senior Developer Advocate

Andrea Griffiths
Open session

World Congress 2026 North America

Building World-Aware Robots with Agent Memory and Context Graphs

Zaid Zaim

Developer Advocate EMEA at Neo4j | Microsoft AI MVP

Zaid Zaim
Open session

World Congress 2026 North America

AI ROI: The Hard Unit Economics of AI-Native Engineering

Manu Gurudatha

Manu Gurudatha, VP of Engineering at PagerDuty

Manu Gurudatha