WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Feb 5, 2025

CUDA in Python

Andy Terrel

Tired of choosing between Python productivity and C++ hardware speed? Discover how new CUDA tools finally give developers low-level GPU control for maximum performance directly in Python.

Pause
Mute Enter Fullscreen
#1 about 3 min

Understanding the CUDA abstraction stack for developers

Different abstraction layers from PyTorch down to PTX expose unique GPU capabilities.

#2 about 3 min

Bridging the productivity and speed gap in Python

CUDA Python eliminates the rigid tradeoff between high-level scripting productivity and low-level hardware performance.

#3 about 4 min

Optimizing performance through kernel fusion with nvMATH

Fusing matrix multiplication and epilogues into a single kernel prevents excessive host-to-device communication overhead.

#4 about 4 min

Enabling device-side function calls with Numba JIT

Just-in-time linking with LLVM grants Python kernels direct internal access to compiled C++ device functions.

#5 about 3 min

Controlling parallelism and block reductions in Python

CUDA Cooperative enables granular control over threaded hardware blocks without exiting the Python execution environment.

#6 about 3 min

Exposing low-level hardware features via Numba CUDA

Translating C++ templates allows Python developers immediate implementation of optimized hardware floating point types.

#7 about 3 min

Managing host-side GPU resources using Python objects

A native object model replaces complex bindings for instantiating streams, events, and programmatic compiler representations.

#8 about 1 min

Accessing educational resources for Python accelerator computing

Forking the GitHub repository and evaluating reference examples immediately builds proficiency in accelerated Python development.

Matching moments

1:11 min

The expanded CUDA ecosystem and native Python support

Paul Graham Paul Graham · WWC Europe 2026

4:37 min

Simplifying parallel programming with the CUDA ecosystem

Paul Graham Paul Graham · LIVE

1:51 min

Accelerating math operations and kernel fusion with nvmath-python

Paul Graham Paul Graham · WWC 2025

2:27 min

Exploring the CUDA ecosystem and levels of abstraction

Paul Graham Paul Graham · WWC 2025

1:49 min

Accelerating script execution with CuPy and Numba kernels

Paul Graham Paul Graham · WWC Europe 2026

1:37 min

Accelerating compute with focused developer tools

Julia Koch Julia Koch +1 · WWC Europe 2026

More from WeAreDevelopers LIVE

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz thumbnail
5:43
5 days ago

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Node and Package Security thumbnail
1:08:30
5 days ago

WeAreDevelopers LIVE - Node and Package Security

Chris Heilmann, Daniel Cranney, Zbyszek Tenerowicz

WeAreDevelopers LIVE - Streaming HTML thumbnail
1:10:26
12 days ago

WeAreDevelopers LIVE - Streaming HTML

Chris Heilmann, Daniel Cranney, Jad Joubran

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe thumbnail
1:02:34
19 days ago

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe

Chris Heilmann, Daniel Cranney, Justin Halsall, Werner Jeschko, Nicole Jeschko, Mirco Tomić

WeAreDevelopers LIVE - Web Performance in an AI World thumbnail
1:07:59
26 days ago

WeAreDevelopers LIVE - Web Performance in an AI World

Chris Heilmann, Daniel Cranney

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko thumbnail
5:55
about 2 months ago

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko

Chris Heilmann, Daniel Cranney

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Compute for your AI model: GPUs, LPUs, TPUs and beyond..

Kushaagra Goyal

Tech Lead at Rubrik, ex-CTO at Gan.AI, ex-Databricks

Kushaagra Goyal
Open session

World Congress 2026 North America

Trust, But Verify: Continuous GPU Validation at Scale

Kyle Bell

VP of AI @ TensorWave

Kyle Bell
Open session

World Congress 2026 North America

Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs

Duan Lightfoot

Sr. AI Engineer, Akamai

Duan Lightfoot
Open session

World Congress 2026 North America

Beyond Vibe Coding: Using CLI Tools as Your AI Counterpart in Pair Programming

Ron Veen

Java enthusiast and Special agent for Team Rockstars IT

Ron Veen
Open session

World Congress 2026 North America

Ship 10x Faster: AI-Powered Development with Claude Code and MCP Tools

Viktoria Semaan

Principal Technical Evangelist at Databricks

Viktoria Semaan
Open session

World Congress 2026 North America

From Cloud Native to Multi-Cloud Native: Write Once, Deploy Anywhere

Sandeep Pal

Principal Member of Technical Staff at Salesforce

Sandeep Pal

Related videos

CUDA Python: GPU programming for the modern developer thumbnail
29:43
WWC Europe 2026 • about 1 month ago

CUDA Python: GPU programming for the modern developer

Paul Graham

Accelerating Python on GPUs thumbnail
24:39
WWC 2025 • 12 months ago

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs thumbnail
59:43
LIVE • over 2 years ago

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs thumbnail
22:18
WWC 2024 • almost 2 years ago

Accelerating Python on GPUs

Paul Graham

Coffee with Developers - Stephen Jones - NVIDIA thumbnail
37:32
Coffee With Developers • over 1 year ago

Coffee with Developers - Stephen Jones - NVIDIA

Stephen Jones

WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA thumbnail
22:07
WWC 2024 • about 2 years ago

WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA

Ankit Patel

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.