Francis Powlesland & Elena Kotljarova
On the straight and narrow path - How to get cars to drive themselves using reinforcement learning and trajectory optimization
#1about 5 minutes
A novel approach to self-driving cars
This project uses reinforcement learning to enable a car to learn on-the-drive, unlike pre-trained models that rely on static data.
#2about 3 minutes
Setting a baseline with a human driver
A human driver completes three laps on the physical racetrack to establish a benchmark time for the AI to compete against.
#3about 5 minutes
Observing the AI learn across 1500 laps
The AI's driving behavior evolves from random and unstable after 15 laps to smooth and optimized after 150, showing diminishing returns by 1500 laps.
#4about 6 minutes
Understanding the core concepts of reinforcement learning
A recap of the demo's results leads into an explanation of reinforcement learning's core ideas like agents, environments, actions, and maximizing rewards.
#5about 5 minutes
Applying Q-learning with states, actions, and Q-tables
Q-learning uses a table of states and actions to store learned values, making it easy to inspect and update the agent's knowledge.
#6about 4 minutes
Key parameters for tuning the Q-learning algorithm
The algorithm's behavior is controlled by key parameters like the learning rate (alpha), discount factor, and the exploration factor (epsilon).
#7about 1 minute
The technical architecture of the race track demo
The demo integrates PS4 controllers, an Arduino, the Watson IoT platform, a Node.js backend, and a React.js frontend.
#8about 3 minutes
Real-world application with Thyssen Krupp
A collaboration with Thyssen Krupp applies these reinforcement learning concepts to a full-size vehicle to learn and adapt its driving style.
#9about 7 minutes
Q&A on data, constraints, and local optima
The speakers answer audience questions about the importance of data quality, how the car stays on the track, and how the algorithm avoids local optima.
Related jobs
Jobs that call for the skills explored in this talk.
Wilken GmbH
Ulm, Germany
Senior
Kubernetes
AI Frameworks
+3
Picnic Technologies B.V.
Amsterdam, Netherlands
Intermediate
Senior
Python
Structured Query Language (SQL)
+1
Matching moments
05:18 MIN
Incentivizing automation with a 'keep what you kill' policy
What 2025 Taught Us: A Year-End Special with Hung Lee
03:28 MIN
Why corporate AI adoption lags behind the hype
What 2025 Taught Us: A Year-End Special with Hung Lee
14:06 MIN
Exploring the role and ethics of AI in gaming
Devs vs. Marketers, COBOL and Copilot, Make Live Coding Easy and more - The Best of LIVE 2025 - Part 3
03:31 MIN
Using AI to make work more human, not replace humans
Turning People Strategy into a Transformation Engine
06:28 MIN
Using AI agents to modernize legacy COBOL systems
Devs vs. Marketers, COBOL and Copilot, Make Live Coding Easy and more - The Best of LIVE 2025 - Part 3
03:15 MIN
The future of recruiting beyond talent acquisition
What 2025 Taught Us: A Year-End Special with Hung Lee
04:04 MIN
Shifting HR from standard products to AI-powered platforms
Turning People Strategy into a Transformation Engine
04:57 MIN
Increasing the value of talk recordings post-event
Cat Herding with Lions and Tigers - Christian Heilmann
Featured Partners
Related Videos
26:55How Machine Learning is turning the Automotive Industry upside down
Jan Zawadzki
48:01What non-automotive Machine Learning projects can learn from automotive Machine Learning projects
Jan Zawadzki
19:24Finding the unknown unknowns: intelligent data collection for autonomous driving development
Liang Yu
22:11How computers learn to see – Applying AI to industry
Antonia Hahn
31:23Automated Driving - Why is it so hard to introduce
Sayed Bouzouraa
38:12Developing an AI.SDK
Daniel Graff & Andreas Wittmann
52:10Intelligent Data Selection for Continual Learning of AI Functions
Nico Schmidt
28:19Robots 2.0: When artificial intelligence meets steel
Thomas Tomow
Related Articles
View all articles
From learning to earning
Jobs that call for the skills explored in this talk.
Robert Bosch GmbH
Renningen, Germany
Spark
Python
Matlab
Machine Learning
autonomous-teaming
Remote
Python
Imec
Azure
Python
PyTorch
TensorFlow
Computer Vision
+1
RIB Deutschland GmbH
Stuttgart, Germany
Python
Machine Learning