Coffee With Developers • Feb 26, 2025

Coffee with Developers - Stephen Jones - NVIDIA

Stephen Jones

Stephen Jones asserts the future of computing depends on fracturing hardware into highly specialized domains. See how NVIDIA tackles fundamental physics bottlenecks by evolving CUDA and elevating Python.

Pause
Mute Enter Fullscreen
#1 about 4 min

Transitioning from CUDA software architect to user

How using an internally developed tool on real engineering projects challenges original design assumptions.

#2 about 3 min

Defining CUDA as a comprehensive GPU platform

Understanding CUDA not just as a hardware abstraction language, but as a full stack of compilers, libraries, and interoperable frameworks.

#3 about 4 min

Bridging Fortran and Python in modern computing

The cultural and technical differences between traditional supercomputing running Fortran and modern AI ecosystems relying on Python.

#4 about 3 min

Overcoming threading challenges for Python on GPUs

Translating single-threaded Python logic to accommodate hundreds of thousands of concurrent GPU threads introduces complex race condition management.

#5 about 6 min

Aligning hardware development cycles with software evolution

The difficulty of designing specialized chip architectures years in advance for an artificial intelligence lifecycle that pivots every few months.

#6 about 5 min

Hardware demands of local inference and scaling

Extreme software model optimizations paradoxically lead users to train larger models rather than curbing total hardware computing requirements.

#7 about 6 min

Addressing the power scaling breakdown in transistor density

Modern computing growth is limited by thermal output and wattage requirements rather than the physical density of logic gates.

#8 about 4 min

Exploring physical limits and alternatives to silicon chips

Quantum effects like electron leakage in highly dense semiconductors force the exploration of new materials and optical computing.

#9 about 5 min

Combining quantum, neural, and classical computing paradigms

Future data centers will orchestrate heterogeneous environments to evaluate logic by applying unique hardware architectures to specific computational problems.

#10 about 4 min

Engaging with the open source components of CUDA

Developers can heavily contribute pull requests to upstream community frameworks and data science libraries built over proprietary device drivers.

Matching moments

2:33 min

Architecting CUDA and the AI software stack

Michael Kagan Michael Kagan +1 · World Congress 2026 Europe

2:27 min

Exploring the CUDA ecosystem and levels of abstraction

Paul Graham Paul Graham · World Congress 2025

2:15 min

Introduction to CUDA and general-purpose GPU computing

Paul Graham Paul Graham · World Congress 2026 Europe

4:37 min

Simplifying parallel programming with the CUDA ecosystem

Paul Graham Paul Graham · LIVE

2:08 min

History and scale of NVIDIA GPU computing

Paul Graham Paul Graham · LIVE

3:32 min

Evolution of general purpose GPU computing and Python

Paul Graham Paul Graham · World Congress 2025