Liang Yu

Finding the unknown unknowns: intelligent data collection for autonomous driving development

What if you could cut autonomous driving data collection by 99.9%? Learn how an in-car AI identifies and uploads only the most valuable data for retraining.

Finding the unknown unknowns: intelligent data collection for autonomous driving development
#1about 1 minute

Finding the unknown unknowns in autonomous driving

The primary challenge in autonomous driving is identifying and collecting data on rare, anomalous scenarios that models are not trained to handle.

#2about 1 minute

Introducing Cariad and its unified software platform

Cariad, a Volkswagen subsidiary, is building a unified software and tech stack to accelerate innovation for all Volkswagen group brands.

#3about 2 minutes

The Big Loop system for intelligent data collection

The Big Loop system solves the high cost of traditional data collection by intelligently aggregating only useful information using dedicated hardware.

#4about 3 minutes

Understanding the long-tail problem in driving scenarios

The long-tail problem refers to rare but critical events, like noisy sensor data or unknown objects, that can be identified using methods like uncertainty estimation.

#5about 3 minutes

How INSTINCT software identifies valuable data

The INSTINCT software uses deep neural networks to analyze sensor data in real-time and calculate an uncertainty score to flag challenging scenarios for collection.

#6about 3 minutes

The complete data-driven development cycle in action

The Big Loop enables a continuous cycle of driving, uploading valuable data, labeling, retraining models, and deploying them back to vehicles via over-the-air updates.

#7about 1 minute

Scaling data collection with the pioneering fleet

The Big Loop technology is being deployed in a retrofitted "pioneering fleet" to scale data collection before its full rollout in millions of future vehicles.

#8about 5 minutes

Q&A on ethics, model deployment, and regional data

The discussion covers ethical dilemmas, local vs cloud model execution, setting dynamic uncertainty thresholds, and the goal of creating globally applicable models.

Related jobs
Jobs that call for the skills explored in this talk.

Machine Learning Engineer

Picnic Technologies B.V.

Picnic Technologies B.V.
Amsterdam, Netherlands

Intermediate
Senior
Python
Structured Query Language (SQL)
+1

Matching moments

Skills and challenges of working with automotive AI
29:52 MIN

Skills and challenges of working with automotive AI

Developing an AI.SDK

Applying uncertainty for active learning and corner case detection
27:47 MIN

Applying uncertainty for active learning and corner case detection

Uncertainty Estimation of Neural Networks

Understanding uncertainty through rare events in driving
00:03 MIN

Understanding uncertainty through rare events in driving

Uncertainty Estimation of Neural Networks

Applying machine learning in the automotive industry
22:45 MIN

Applying machine learning in the automotive industry

Getting Started with Machine Learning

The multidisciplinary future of automated driving development
29:07 MIN

The multidisciplinary future of automated driving development

Automated Driving - Why is it so hard to introduce

Building an AI-ready architecture for autonomous driving
19:10 MIN

Building an AI-ready architecture for autonomous driving

What non-automotive Machine Learning projects can learn from automotive Machine Learning projects

Using machine learning and swarm data for automated driving
18:11 MIN

Using machine learning and swarm data for automated driving

Software defines the vehicle: Why customers and developers will love cars even more

Advancing automated driving with AI and neural networks
04:58 MIN

Advancing automated driving with AI and neural networks

Software is the New Fuel, AI the New Horsepower - Pioneering New Paths at Mercedes-Benz

Featured Partners

Related Videos

See all videos
Intelligent Data Selection for Continual Learning of AI Functions52:10

Intelligent Data Selection for Continual Learning of AI Functions

Nico Schmidt

What non-automotive Machine Learning projects can learn from automotive Machine Learning projects48:01

What non-automotive Machine Learning projects can learn from automotive Machine Learning projects

Jan Zawadzki

How Machine Learning is turning the Automotive Industry upside down26:55

How Machine Learning is turning the Automotive Industry upside down

Jan Zawadzki

Uncertainty Estimation of Neural Networks1:00:28

Uncertainty Estimation of Neural Networks

Tillman Radmer & Fabian Hüger & Nico Schmidt

Automated Driving - Why is it so hard to introduce31:23

Automated Driving - Why is it so hard to introduce

Sayed Bouzouraa

Developing an AI.SDK38:12

Developing an AI.SDK

Daniel Graff & Andreas Wittmann

On the straight and narrow path - How to get cars to drive themselves using reinforcement learning and trajectory optimization42:18

On the straight and narrow path - How to get cars to drive themselves using reinforcement learning and trajectory optimization

Francis Powlesland & Elena Kotljarova

How computers learn to see – Applying AI to industry22:11

How computers learn to see – Applying AI to industry

Antonia Hahn

Related Articles

View all articles
DC
Daniel Cranney
How software is steering vehicle technology
The automotive industry is entering a transformative era, and developers have a unique opportunity to be part of it. Cars are no longer just mechanical machines; they’re sophisticated tech platforms with software at their core. This shift, defined by...
How software is steering vehicle technology
CH
Chris Heilmann
With AIs wide open - WeAreDevelopers at All Things Open 2025
Last week our VP of Developer Relations, Chris Heilmann, flew to Raleigh, North Carolina to present at All Things Open . An excellent event he had spoken at a few times in the past and this being the “Lucky 13” edition, he didn’t hesitate to come and...
With AIs wide open - WeAreDevelopers at All Things Open 2025

From learning to earning

Jobs that call for the skills explored in this talk.