WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Feb 5, 2025

CUDA in Python

Andy Terrel

Tired of choosing between Python productivity and C++ hardware speed? Discover how new CUDA tools finally give developers low-level GPU control for maximum performance directly in Python.

Pause
Mute Enter Fullscreen
#1 about 3 min

Understanding the CUDA abstraction stack for developers

Different abstraction layers from PyTorch down to PTX expose unique GPU capabilities.

#2 about 3 min

Bridging the productivity and speed gap in Python

CUDA Python eliminates the rigid tradeoff between high-level scripting productivity and low-level hardware performance.

#3 about 4 min

Optimizing performance through kernel fusion with nvMATH

Fusing matrix multiplication and epilogues into a single kernel prevents excessive host-to-device communication overhead.

#4 about 4 min

Enabling device-side function calls with Numba JIT

Just-in-time linking with LLVM grants Python kernels direct internal access to compiled C++ device functions.

#5 about 3 min

Controlling parallelism and block reductions in Python

CUDA Cooperative enables granular control over threaded hardware blocks without exiting the Python execution environment.

#6 about 3 min

Exposing low-level hardware features via Numba CUDA

Translating C++ templates allows Python developers immediate implementation of optimized hardware floating point types.

#7 about 3 min

Managing host-side GPU resources using Python objects

A native object model replaces complex bindings for instantiating streams, events, and programmatic compiler representations.

#8 about 1 min

Accessing educational resources for Python accelerator computing

Forking the GitHub repository and evaluating reference examples immediately builds proficiency in accelerated Python development.

Matching moments

1:11 min

The expanded CUDA ecosystem and native Python support

Paul Graham Paul Graham · World Congress 2026 Europe

4:37 min

Simplifying parallel programming with the CUDA ecosystem

Paul Graham Paul Graham · LIVE

1:51 min

Accelerating math operations and kernel fusion with nvmath-python

Paul Graham Paul Graham · World Congress 2025

2:27 min

Exploring the CUDA ecosystem and levels of abstraction

Paul Graham Paul Graham · World Congress 2025

1:49 min

Accelerating script execution with CuPy and Numba kernels

Paul Graham Paul Graham · World Congress 2026 Europe

1:37 min

Accelerating compute with focused developer tools

Julia Koch Julia Koch +1 · World Congress 2026 Europe

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
10 days ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
17 days ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail
4:23
18 days ago

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail
1:00:38
24 days ago

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail
6:16
25 days ago

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail
5:46
about 1 month ago

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

Related videos

CUDA Python: GPU programming for the modern developer thumbnail
29:43
World Congress 2026 Europe • 3 months ago

CUDA Python: GPU programming for the modern developer

Paul Graham

Accelerating Python on GPUs thumbnail
24:39
World Congress 2025 • about 1 year ago

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs thumbnail
59:43
LIVE • over 2 years ago

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs thumbnail
22:18
World Congress 2024 • about 2 years ago

Accelerating Python on GPUs

Paul Graham

Coffee with Developers - Stephen Jones - NVIDIA thumbnail
37:32
Coffee With Developers • over 1 year ago

Coffee with Developers - Stephen Jones - NVIDIA

Stephen Jones

WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA thumbnail
22:07
World Congress 2024 • about 2 years ago

WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA

Ankit Patel

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.