WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Apr 28, 2021

AR Kit intro - placing 3D objects in a scene and interacting with them in real-time

Nermin Sehic

Build an interactive augmented reality app in under 200 lines of code. Master ARKit raycasting and SceneKit to seamlessly anchor 3D objects into physical environments.

Pause
Mute Enter Fullscreen
#1 about 3 min

Introduction to building iOS augmented reality applications

An introductory outline covers initial device configurations alongside placing and interacting with 3D models.

#2 about 1 min

Differentiating augmented reality sensing from virtual reality

ARKit gathers hardware sensor input to augment real-world scenes rather than creating entirely new virtual environments.

#3 about 3 min

Evolution of ARKit native features and tracking capabilities

The progression expands plane detection, image scaling, face tracking, and complex mesh generation powered by LiDAR.

#4 about 2 min

Hardware prerequisites and development level debugging limitations

Device hardware specifications and optimal physical staging conditions are critical for compiling functionality safely.

#5 about 3 min

Rendering frameworks compatible with ARKit graphic development

Comparisons contrast SceneKit, SpriteKit, Metal, and RealityKit libraries prioritizing asset integrations inside AR sessions.

#6 about 4 min

Understanding the three-dimensional rendering coordinate system layouts

The geometric x, y, and z axes calculate measurements referencing an established initialization focal point.

#7 about 2 min

Configuring tracking session alignment orientation via device gravity

Gravitational inputs function as the most dependable fallback mapping property determining relative alignments.

#8 about 3 min

Managing 3D objects recursively in the SceneKit hierarchy

Nesting geometries natively streamlines synchronized group animations utilizing root inheritance.

#9 about 2 min

Placing objects securely using dynamic coordinate raycasting operations

Casting algorithms calculate distances intercepting flat matrices providing verified destination vectors automatically.

#10 about 2 min

Reviewing a foundational iOS augmented reality demonstration application

Deploying the starting baseline exposes internal device mapping structures painting active feature locations.

#11 about 6 min

Writing the SceneKit code executing Hello World properties

Defining variables configures standard shadow algorithms natively integrating custom colorized materials wrapping base geometries.

#12 about 4 min

Demonstrating interactive digital placement spanning real furniture spaces

Scanning open floors reveals tracking patterns supporting real-time spatial mounting utilizing robust dynamic scale logic.

#13 about 4 min

Managing downloaded 3D geometry assets and model classifications

Parsing grouped file structures translates pre-built visual materials feeding selection states efficiently.

#14 about 4 min

Initializing customized tracking views handling restricted plane targets

Implementing gesture handlers filters unnecessary topological scanning reserving resources strictly optimizing horizontal bounds.

#15 about 5 min

Leveraging delegate events for capturing architectural anchor updates

Continuous listener loops evaluate discovered structural geometries redrawing valid positional boundaries gracefully.

#16 about 5 min

Applying customized digital textures onto generated SceneKit planes

Scaling image coordinates translates mapped tracking areas supporting accurately rotated dimensional boundaries safely.

#17 about 4 min

Planning advanced application interaction functionalities and scaling logic

Exploring expansion strategies advocates analyzing depth limits ensuring large items resist tiny platforms automatically.

#18 about 1 min

Locating project source code bases covering future enhancements

Committing codebase resources freely provisions reusable architectures supporting external developers implementing sophisticated extensions easily.

Matching moments

1:33 min

Inside-out tracking and introducing mobile AR frameworks

rafek rafek · World Congress 2024

4:51 min

Leveraging the presence platform for spatial development

Bastian Schütz Bastian Schütz · World Congress 2024

1:29 min

Introduction to the concept of augmented reality

Vladimir Novick · World Congress 2021

3:43 min

Exploring Unity AR Foundation for advanced tracking logic

Vladimir Novick · World Congress 2021

2:29 min

Debunking XR misconceptions with practical manufacturing examples

rafek rafek · World Congress 2024

4:50 min

Applying lighting and material textures to AR scenes

Vladimir Novick · World Congress 2021

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Tech Education in Two Languages thumbnail
1:00:18
3 days ago

WeAreDevelopers LIVE - Tech Education in Two Languages

Daniel Cranney, Roxy Rodriguez-Becker

WeAreDevelopers LIVE - Playing in Production thumbnail
1:06:40
10 days ago

WeAreDevelopers LIVE - Playing in Production

Andrew MacLean, Daniel Cranney, Christian Heilmann

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
24 days ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
about 1 month ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail
4:23
about 1 month ago

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail
1:00:38
about 1 month ago

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Upcoming sessions on this topic

Open session

React Under Fire: Rendering Performance for Streaming Agent UIs

  • Abhirupa Mitra

    Slack

    Senior Member of Technical Staff

Open session

ULTRON: Your Agent Has No Hands - Real-Time Voice, MCP, and Ten Phones on Stage

  • Sagar Tamang

    Two Spoon Technologies

    AI Engineer

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

From Profiler to Production: Measuring What Actually Matters in React & React Native

  • Andrei Tazetdinov

    Dynatrace

    React Native Developer

Open session

Building World-Aware Physical AI with Agent Memory and Context Graphs

  • Vasundhara Shukla

    Neo4j

    Developer Advocate

  • Zaid Zaim

    Neo4j

    Developer Advocate | Microsoft AI MVP

Related videos

Live Coding an Augmented Reality Game with WebXR thumbnail
44:30
World Congress 2021 • over 5 years ago

Live Coding an Augmented Reality Game with WebXR

Christian Grail

Cross platform Augmented Reality development with React Native thumbnail
40:50
World Congress 2021 • over 5 years ago

Cross platform Augmented Reality development with React Native

Vladimir Novick

XR Demystified: Separating Facts from Fiction in 2024 thumbnail
30:46
World Congress 2024 • about 2 years ago

XR Demystified: Separating Facts from Fiction in 2024

rafek

Apple Vision Pro: Proven Development Methods Meet the Latest Technology thumbnail
28:48
World Congress 2024 • about 2 years ago

Apple Vision Pro: Proven Development Methods Meet the Latest Technology

Mario Petricevic

Unleashing a New Reality: The Transformative Power of XR Technologies for Developers thumbnail
23:03
World Congress 2024 • about 2 years ago

Unleashing a New Reality: The Transformative Power of XR Technologies for Developers

Bastian Schütz

Edge AI on iOS: Beyond the Cloud, Designing the Next Generation of Intelligent On-Device Apps thumbnail
26:30
World Congress 2026 Europe • 3 months ago

Edge AI on iOS: Beyond the Cloud, Designing the Next Generation of Intelligent On-Device Apps

Precious Osaro

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.