World Congress 2023 Aug 11, 2023

Trends, Challenges and Best Practices for AI at the Edge

Ekaterina Sirazitdinova

How do you deploy zero-latency AI on devices with strict compute and power limits? Learn to master quantization, pruning, and NVIDIA frameworks to conquer edge deployment.

Pause
Mute Enter Fullscreen
#1 about 7 min

Defining edge AI and its widespread industry applications

Localized data processing enables independent automation and real-time computation across manufacturing, retail, and healthcare.

#2 about 4 min

Hardware constraints and core challenges in edge environments

Operating intelligent models on embedded hardware requires balancing limited compute and power capacities with strict low-latency requirements.

#3 about 2 min

Increasing model accuracy through synthetic data generation

Augmenting realistic scenarios with synthetic data solves expensive manual labeling and effectively covers anomalous edge cases.

#4 about 7 min

Optimizing edge model throughput to ensure real-time performance

Techniques like precision quantization, network pruning, and graph optimization reduce model footprint and accelerate execution on constrained hardware.

#5 about 5 min

Accelerating AI development with software and pretrained models

Utilizing managed toolkits and foundational templates simplifies custom model training, synthetic data generation, and complex multi-node orchestration.

#6 about 6 min

Deploying optimized models for high-throughput video analytics

Specialized deployment SDKs handle layer fusion, memory management, and concurrent sequence execution for complex multi-model pipelines.

#7 about 2 min

Exploring domain gaps and hardware requirements for deployment

Correcting for texturing differences between synthetic and real datasets ensures higher accuracy across various processing units.

Matching moments

2:18 min

The necessity of Edge AI and its driving constraints

Sasha Denisov Sasha Denisov +1 · WWC Europe 2026

1:56 min

Optimizing AI processing capabilities for edge microcontrollers

Stephan Gillich Stephan Gillich +3 · WWC 2024

3:21 min

Reducing cloud dependency with on-device edge AI models

Precious Osaro Precious Osaro · WWC Europe 2026

2:26 min

Cost and latency pressures pushing AI to the edge

Moe Sani Moe Sani · WWC Europe 2026

1:09 min

Deploying algorithms and AI models to edge production

Irina Terekhova Irina Terekhova · WWC Europe 2026

3:19 min

Technological shifts enabling practical edge AI deployment

Sasha Denisov Sasha Denisov · WWC Europe 2026

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Trust, But Verify: Continuous GPU Validation at Scale

Kyle Bell

VP of AI @ TensorWave

Kyle Bell
Open session

World Congress 2026 North America

Compute for your AI model: GPUs, LPUs, TPUs and beyond..

Kushaagra Goyal

Tech Lead at Rubrik, ex-CTO at Gan.AI, ex-Databricks

Kushaagra Goyal
Open session

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan
Open session

World Congress 2026 North America

Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs

Duan Lightfoot

Sr. AI Engineer, Akamai

Duan Lightfoot
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

Engineering the Pivot: How Creative Strategy Solves the Hard Problems of AI Accuracy and Scale

Shruti Tiwari

AI/ML product manager, Dell

Shruti Tiwari