Andy Terrel

CUDA in Python

What if your Python code could achieve over 90% of a GPU's theoretical max performance? Learn how NVIDIA is making it possible.

CUDA in Python
#1about 6 minutes

Understanding the CUDA platform stack for Python developers

The CUDA platform is layered from high-level domain libraries to low-level hardware access, with new tools aiming to combine Python's productivity with GPU performance.

#2about 3 minutes

Improving performance by fusing GPU operations

The nvmath-python library enables kernel fusion using epilogues, which combines multiple operations like matrix multiplication and bias addition into a single GPU kernel launch.

#3about 5 minutes

Calling device-side functions directly from Python kernels

Python kernels can now directly call pre-compiled, high-performance device-side functions from libraries like cuBLAS, enabled by a just-in-time linker called nvJitLink.

#4about 2 minutes

Fine-grained parallelism with cooperative groups in Python

The CUB library is exposed to Python, allowing for cooperative operations and reductions at the block or warp level for fine-grained control over GPU parallelism.

#5about 3 minutes

Accelerating language support with numba-cuda and nupack

The numba-cuda module is separated to accelerate feature delivery, while nupack automatically generates Python bindings for C++ templated code.

#6about 4 minutes

A Pythonic object model for host-side GPU control

A new high-level object model allows Python developers to directly manage GPU resources like devices, contexts, streams, and linker objects without boilerplate code.

Related jobs
Jobs that call for the skills explored in this talk.

Machine Learning Engineer

Picnic Technologies B.V.

Picnic Technologies B.V.
Amsterdam, Netherlands

Intermediate
Senior
Python
Structured Query Language (SQL)
+1

Matching moments

How Python became the dominant language for AI
04:09 MIN

How Python became the dominant language for AI

AI in the Open and in Browsers - Tarek Ziadé

The evolving role of the machine learning engineer
02:20 MIN

The evolving role of the machine learning engineer

AI in the Open and in Browsers - Tarek Ziadé

Using AI to overcome challenges in systems programming
02:49 MIN

Using AI to overcome challenges in systems programming

AI in the Open and in Browsers - Tarek Ziadé

The hardware requirements for running LLMs locally
03:55 MIN

The hardware requirements for running LLMs locally

AI in the Open and in Browsers - Tarek Ziadé

Scripting presentations and demos in VS Code
14:14 MIN

Scripting presentations and demos in VS Code

Devs vs. Marketers, COBOL and Copilot, Make Live Coding Easy and more - The Best of LIVE 2025 - Part 3

Building an open source community around AI models
04:28 MIN

Building an open source community around AI models

AI in the Open and in Browsers - Tarek Ziadé

Using Chrome's built-in AI for on-device features
06:44 MIN

Using Chrome's built-in AI for on-device features

Devs vs. Marketers, COBOL and Copilot, Make Live Coding Easy and more - The Best of LIVE 2025 - Part 3

Increasing the value of talk recordings post-event
04:57 MIN

Increasing the value of talk recordings post-event

Cat Herding with Lions and Tigers - Christian Heilmann

Featured Partners

Related Videos

See all videos
Accelerating Python on GPUs59:43

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs22:18

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs24:39

Accelerating Python on GPUs

Paul Graham

Coffee with Developers - Stephen Jones - NVIDIA37:32

Coffee with Developers - Stephen Jones - NVIDIA

Stephen Jones

WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA22:07

WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA

Ankit Patel

The weekly developer show: Boosting Python with CUDA, CSS Updates & Navigating New Tech Stacks1:09:10

The weekly developer show: Boosting Python with CUDA, CSS Updates & Navigating New Tech Stacks

Chris Heilmann, Daniel Cranney & Nicole Jeschko

Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.57:49

Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.

Jodie Burchell

Concurrency in Python33:44

Concurrency in Python

Fabian Schindler

Related Articles

View all articles
DN
Dr. Andy R. Terrel - NVIDIA
What’s the latest in NVIDIA CUDA Python
Python and NVIDIA CUDA have long been friends. Over the last year, NVIDIA teams are working to improve the Pythonista’s experience. This means a top-to-bottom update to the CUDA Platform is fueling the GenAI movement, e.g. llama3, gpt and nemo. These...
What’s the latest in NVIDIA CUDA Python
DC
Daniel Cranney
Dev Digest 157: CUDA in Python, Gemini Code Assist and Back-dooring LLMs
Inside last week’s Dev Digest 157 . 🕹️ Pong in 240 browser tabs 👩‍💻 Gemini Code Assist free for 180k code completions a month 📰 AI is bad at coding and summarising the news 🕵️ Private GitHub repos show up in AI chats 🐍 CUDA for Python developers 🖥️ ...
Dev Digest 157: CUDA in Python, Gemini Code Assist and Back-dooring LLMs
CH
Chris Heilmann
With AIs wide open - WeAreDevelopers at All Things Open 2025
Last week our VP of Developer Relations, Chris Heilmann, flew to Raleigh, North Carolina to present at All Things Open . An excellent event he had spoken at a few times in the past and this being the “Lucky 13” edition, he didn’t hesitate to come and...
With AIs wide open - WeAreDevelopers at All Things Open 2025

From learning to earning

Jobs that call for the skills explored in this talk.