WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Coffee With Developers • Feb 26, 2025

Coffee with Developers - Stephen Jones - NVIDIA

Stephen Jones

Stephen Jones asserts the future of computing depends on fracturing hardware into highly specialized domains. See how NVIDIA tackles fundamental physics bottlenecks by evolving CUDA and elevating Python.

Pause
Mute Enter Fullscreen
#1 about 4 min

Transitioning from CUDA software architect to user

How using an internally developed tool on real engineering projects challenges original design assumptions.

#2 about 3 min

Defining CUDA as a comprehensive GPU platform

Understanding CUDA not just as a hardware abstraction language, but as a full stack of compilers, libraries, and interoperable frameworks.

#3 about 4 min

Bridging Fortran and Python in modern computing

The cultural and technical differences between traditional supercomputing running Fortran and modern AI ecosystems relying on Python.

#4 about 3 min

Overcoming threading challenges for Python on GPUs

Translating single-threaded Python logic to accommodate hundreds of thousands of concurrent GPU threads introduces complex race condition management.

#5 about 6 min

Aligning hardware development cycles with software evolution

The difficulty of designing specialized chip architectures years in advance for an artificial intelligence lifecycle that pivots every few months.

#6 about 5 min

Hardware demands of local inference and scaling

Extreme software model optimizations paradoxically lead users to train larger models rather than curbing total hardware computing requirements.

#7 about 6 min

Addressing the power scaling breakdown in transistor density

Modern computing growth is limited by thermal output and wattage requirements rather than the physical density of logic gates.

#8 about 4 min

Exploring physical limits and alternatives to silicon chips

Quantum effects like electron leakage in highly dense semiconductors force the exploration of new materials and optical computing.

#9 about 5 min

Combining quantum, neural, and classical computing paradigms

Future data centers will orchestrate heterogeneous environments to evaluate logic by applying unique hardware architectures to specific computational problems.

#10 about 4 min

Engaging with the open source components of CUDA

Developers can heavily contribute pull requests to upstream community frameworks and data science libraries built over proprietary device drivers.

Matching moments

2:33 min

Architecting CUDA and the AI software stack

Michael Kagan Michael Kagan +1 · WWC Europe 2026

2:27 min

Exploring the CUDA ecosystem and levels of abstraction

Paul Graham Paul Graham · WWC 2025

2:15 min

Introduction to CUDA and general-purpose GPU computing

Paul Graham Paul Graham · WWC Europe 2026

4:37 min

Simplifying parallel programming with the CUDA ecosystem

Paul Graham Paul Graham · LIVE

2:08 min

History and scale of NVIDIA GPU computing

Paul Graham Paul Graham · LIVE

3:32 min

Evolution of general purpose GPU computing and Python

Paul Graham Paul Graham · WWC 2025

More from Coffee With Developers

What to Do About Hackathons in the Time of Agents - Mike Swift thumbnail
46:03
9 days ago

What to Do About Hackathons in the Time of Agents - Mike Swift

Mike Swift

Moving from Playing with AI to Implementing AI - Lee Stott thumbnail
18:43
13 days ago

Moving from Playing with AI to Implementing AI - Lee Stott

Lee Stott

Evals vs. Evil - AI and Package Security - Laurie Voss thumbnail
16:57
22 days ago

Evals vs. Evil - AI and Package Security - Laurie Voss

Laurie Voss

Burning Satellites, Talking Plants and Agents Hiring Each Other - Fake or News with Matt Zeunert thumbnail
4:57
27 days ago

Burning Satellites, Talking Plants and Agents Hiring Each Other - Fake or News with Matt Zeunert

Matt Zeunert

Web Scraping, AI Agents, and the Future of Open Source - Kevin Lewis (Apify) thumbnail
40:29
about 2 months ago

Web Scraping, AI Agents, and the Future of Open Source - Kevin Lewis (Apify)

Making Teaching Code Less Academic and More Market-Ready - Peter Ruppel thumbnail
32:22
about 2 months ago

Making Teaching Code Less Academic and More Market-Ready - Peter Ruppel

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Compute for your AI model: GPUs, LPUs, TPUs and beyond..

Kushaagra Goyal

Tech Lead at Rubrik, ex-CTO at Gan.AI, ex-Databricks

Kushaagra Goyal
Open session

World Congress 2026 North America

Trust, But Verify: Continuous GPU Validation at Scale

Kyle Bell

VP of AI @ TensorWave

Kyle Bell
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

The Broken Rung: How AI is Rebuilding Software Development from the Ground Up

Tomislav Tipurić

Chief Technology Officer, Nephos

Tomislav Tipurić
Open session

World Congress 2026 North America

Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs

Duan Lightfoot

Sr. AI Engineer, Akamai

Duan Lightfoot
Open session

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan

Related videos

Accelerating Python on GPUs thumbnail
59:43
LIVE • over 2 years ago

Accelerating Python on GPUs

Paul Graham

CUDA Python: GPU programming for the modern developer thumbnail
29:43
WWC Europe 2026 • about 1 month ago

CUDA Python: GPU programming for the modern developer

Paul Graham

Accelerating Python on GPUs thumbnail
22:18
WWC 2024 • almost 2 years ago

Accelerating Python on GPUs

Paul Graham

Accelerating Python on GPUs thumbnail
24:39
WWC 2025 • 12 months ago

Accelerating Python on GPUs

Paul Graham

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
WWC Europe 2026 • about 1 month ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

CUDA in Python thumbnail
21:02
LIVE • over 1 year ago

CUDA in Python

Andy Terrel

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.