WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2022 • Jun 15, 2022

Finding the unknown unknowns: intelligent data collection for autonomous driving development

Liang Yu

How do self-driving systems learn from unpredictable anomalies without uploading terabytes of junk data? Discover how intelligent edge computing captures only the critical unknown unknowns for rapid model retraining.

Pause
Mute Enter Fullscreen
#1 about 2 min

Unified tech stack and hardware for Volkswagen

An introduction to CARIAD's unified tech stack and hardware platform designed to accelerate innovation for autonomous driving functions.

#2 about 2 min

Traditional sensor data acquisition and storage challenges

The limitations of locally recording all sensor data for manual transfer and inefficient storage.

#3 about 2 min

Introducing the Big Loop intelligent data system

How the Big Loop uses isolated hardware components to safely test software and filter junk information.

#4 about 2 min

Identifying unknown unknowns in perception model scenarios

Defining corner cases like distribution shifts and rare objects that cause perception models to fail on the road.

#5 about 1 min

Methods for finding out-of-distribution perception scenarios

Comparing bayesian inference, anomaly detection, and ensemble methods for finding out-of-distribution samples.

#6 about 3 min

Filtering frames using uncertainty scores in Instinct

How the Instinct software calculates component-wise uncertainty scores on segmentation output to trigger intelligent data uploads.

#7 about 4 min

Real-world retraining and over-the-air model deployment

A pipeline demonstrating how models fail, capture triggers, retrain with auto-labeling, and deploy via over-the-air updates.

#8 about 2 min

Scaling the pioneering test fleet for data collection

Retrofitting existing vehicles enables continuous active learning and data-driven development ahead of standard deployment.

#9 about 5 min

Audience Q&A on autonomous driving models and data

Audience discussions cover handling critical safety decisions, local edge execution, dynamic uncertainty thresholds, and global training datasets.

Matching moments

2:04 min

Managing synthetic data unpredictability alongside multi-sensor autonomous vehicle deployment

Sergio Perez Sergio Perez · World Congress 2026 Europe

2:29 min

Enhancing automated driving through swarm data processing

Peter Bosch Peter Bosch · World Congress 2024

8:55 min

Audience questions on data integration and future action models

Vijay Krishan Gupta +1 · LIVE

2:09 min

Speaker background and the need for robust models

Svetlin Penkov · LIVE

7:31 min

Addressing participant questions on liability and machine learning

Georg Kühberger +1 · LIVE

2:27 min

Creating virtual feedback cycles for in-car artificial intelligence platforms

Jan Zawadzki · World Congress 2022

More from World Congress 2022

What the heck do "declarative" and "reactive" actually mean? thumbnail
30:40
about 4 years ago

What the heck do "declarative" and "reactive" actually mean?

André Kovac

The Design and Evolution of C++ thumbnail
1:01:15
over 4 years ago

The Design and Evolution of C++

Bjarne Stroustrup

But, you're not Facebook thumbnail
31:12
over 4 years ago

But, you're not Facebook

Kristijan Ristovski

Communicate efficiently with Software Architecture Diagrams thumbnail
28:11
over 4 years ago

Communicate efficiently with Software Architecture Diagrams

Simon Lasselsberger

Get Ready for Jakarta EE 10! thumbnail
42:53
over 4 years ago

Get Ready for Jakarta EE 10!

Ivar Grimstad

Keep your code refactorable thumbnail
26:46
over 4 years ago

Keep your code refactorable

Gerrit Stapper

Upcoming sessions on this topic

Open session

Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination

  • Pushkar Mishra

    J.P. Morgan

    Senior Vice President

Open session

Autopsy of an Autonomous Incident: When the Agent Made It Worse

  • Navin Pai

    StackGen

    Director of Engineering

Open session

Building World-Aware Physical AI with Agent Memory and Context Graphs

  • Vasundhara Shukla

    Neo4j

    Developer Advocate

  • Zaid Zaim

    Neo4j

    Developer Advocate | Microsoft AI MVP

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

Agentic Forecasting with sktime: Towards Autonomous Time Series Analysis

  • Franz Kiraly

    sktime

    Director

Open session

Beware of Strangers Bearing Code: Open Source Trust in the Agent Era

  • Vikram Vaswani

    Consultant

Related videos

Intelligent Data Selection for Continual Learning of AI Functions thumbnail
52:10
LIVE • over 4 years ago

Intelligent Data Selection for Continual Learning of AI Functions

Nico Schmidt

What non-automotive Machine Learning projects can learn from automotive Machine Learning projects thumbnail
48:01
World Congress 2022 • over 4 years ago

What non-automotive Machine Learning projects can learn from automotive Machine Learning projects

Jan Zawadzki

How to develop an autonomous car end-to-end: Robotic Drive and the mobility revolution thumbnail
1:18:27
LIVE • about 6 years ago

How to develop an autonomous car end-to-end: Robotic Drive and the mobility revolution

Ulrich Wurstbauer, Mohamed Nassar

How Machine Learning is turning the Automotive Industry upside down thumbnail
26:55
LIVE • almost 6 years ago

How Machine Learning is turning the Automotive Industry upside down

Jan Zawadzki

Developing an AI.SDK thumbnail
38:12
World Congress 2021 • over 5 years ago

Developing an AI.SDK

Daniel Graff, Andreas Wittmann

Uncertainty Estimation of Neural Networks thumbnail
1:00:28
World Congress 2021 • over 5 years ago

Uncertainty Estimation of Neural Networks

Tillman Radmer, Fabian Hüger, Nico Schmidt

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.