WEBVTT

1
00:00:03.635 --> 00:00:04.925
<00:00:03.635>Well, <00:00:03.828>for <00:00:04.022>those <00:00:04.215>of <00:00:04.409>you <00:00:04.602>who, <00:00:04.795>uh,

2
00:00:05.365 --> 00:00:07.885
<00:00:05.365>I <00:00:05.520>understand <00:00:05.676>we <00:00:05.831>have <00:00:05.987>a <00:00:06.142>little <00:00:06.298>internet <00:00:06.453>issues <00:00:06.609>right <00:00:06.765>now.

3
00:00:07.885 --> 00:00:10.205
<00:00:07.885>And <00:00:08.025>so <00:00:08.164>for <00:00:08.305>those <00:00:08.445>of <00:00:08.584>you <00:00:08.725>who <00:00:08.865>are <00:00:09.004>missing <00:00:09.145>your <00:00:09.285>flights

4
00:00:10.545 --> 00:00:13.685
<00:00:10.545>and <00:00:10.745>are <00:00:10.945>here <00:00:11.145>because <00:00:11.345>of <00:00:11.545>that, <00:00:11.745>I <00:00:11.945>am

5
00:00:14.465 --> 00:00:15.565
<00:00:14.465>not <00:00:14.663>glad <00:00:14.860>you're <00:00:15.059>missing <00:00:15.257>your <00:00:15.455>flight.

6
00:00:15.565 --> 00:00:16.685
<00:00:15.565>But <00:00:15.709>I'm <00:00:15.853>glad <00:00:15.997>you're <00:00:16.140>here. <00:00:16.285>So <00:00:16.429>thank <00:00:16.573>you.

7
00:00:17.225 --> 00:00:20.605
<00:00:17.225>Um, <00:00:17.400>so <00:00:17.575>I've <00:00:17.750>been <00:00:17.925>at <00:00:18.100>NVIDIA <00:00:18.275>for <00:00:18.450>13 <00:00:18.625>years.

8
00:00:23.475 --> 00:00:24.665
<00:00:23.475>Slide <00:00:23.689>issues. <00:00:23.903>Okay, <00:00:24.117>there <00:00:24.331>we <00:00:24.546>go.

9
00:00:24.805 --> 00:00:26.305
<00:00:24.805>So <00:00:24.997>I've <00:00:25.190>been <00:00:25.383>at <00:00:25.576>NVIDIA <00:00:25.769>for <00:00:25.962>13 <00:00:26.155>years,

10
00:00:26.325 --> 00:00:27.825
<00:00:26.325>and <00:00:26.517>in <00:00:26.710>my <00:00:26.903>13 <00:00:27.096>years <00:00:27.289>I've <00:00:27.482>worked <00:00:27.675>in

11
00:00:28.135 --> 00:00:29.425
<00:00:28.135>lots <00:00:28.367>of, <00:00:28.599>well, <00:00:28.831>almost <00:00:29.063>13 <00:00:29.296>years.

12
00:00:29.425 --> 00:00:30.985
<00:00:29.425>I've <00:00:29.580>worked <00:00:29.736>lots <00:00:29.891>of <00:00:30.047>different <00:00:30.202>areas. <00:00:30.358>I've <00:00:30.513>worked <00:00:30.669>on <00:00:30.825>the

13
00:00:31.145 --> 00:00:33.625
<00:00:31.145>hardware, <00:00:31.320>you <00:00:31.495>know, <00:00:31.669>I've <00:00:31.845>done <00:00:32.019>graphics, <00:00:32.195>I've <00:00:32.369>done <00:00:32.545>compute,

14
00:00:33.655 --> 00:00:36.025
<00:00:33.655>I've <00:00:33.888>worked <00:00:34.121>on <00:00:34.355>the <00:00:34.588>software <00:00:34.821>side, <00:00:35.055>virtualization,

15
00:00:36.165 --> 00:00:38.185
<00:00:36.165>ray <00:00:36.515>tracing, <00:00:36.865>worked <00:00:37.214>on <00:00:37.565>ai,

16
00:00:38.385 --> 00:00:39.785
<00:00:38.385>HPC, <00:00:38.637>all <00:00:38.888>sorts <00:00:39.141>of <00:00:39.392>different <00:00:39.644>things.

17
00:00:39.845 --> 00:00:43.225
<00:00:39.845>But <00:00:40.000>what's <00:00:40.156>been <00:00:40.311>consistent <00:00:40.467>pattern <00:00:40.622>that <00:00:40.778>you <00:00:40.933>see <00:00:41.089>through <00:00:41.245>all

18
00:00:43.225 --> 00:00:44.585
<00:00:43.225>of <00:00:43.531>it <00:00:43.837>is <00:00:44.143>accelerated <00:00:44.449>computing.

19
00:00:44.885 --> 00:00:46.665
<00:00:44.885>So <00:00:45.059>I'm <00:00:45.235>gonna <00:00:45.410>talk <00:00:45.585>to <00:00:45.760>you <00:00:45.934>about <00:00:46.110>two <00:00:46.285>things,

20
00:00:46.935 --> 00:00:48.065
<00:00:46.935>accelerated <00:00:47.952>computing,

21
00:00:48.205 --> 00:00:49.385
<00:00:48.205>and <00:00:48.417>we're <00:00:48.629>gonna <00:00:48.842>talk <00:00:49.054>about <00:00:49.266>applications.

22
00:00:50.285 --> 00:00:51.585
<00:00:50.285>All <00:00:50.519>right? <00:00:50.753>So <00:00:50.987>let's <00:00:51.221>get <00:00:51.455>in.

23
00:00:51.845 --> 00:00:52.945
<00:00:51.845>Um, <00:00:52.175>this <00:00:52.505>is <00:00:52.835>a

24
00:00:52.945 --> 00:00:54.305
<00:00:52.945>developer <00:00:53.119>conference, <00:00:53.294>so <00:00:53.469>we're <00:00:53.644>gonna <00:00:53.819>do <00:00:53.994>some <00:00:54.169>math.

25
00:00:54.685 --> 00:00:56.545
<00:00:54.685>I'm <00:00:54.885>gonna <00:00:55.085>have <00:00:55.285>some <00:00:55.485>code. <00:00:55.685>Bear <00:00:55.885>with <00:00:56.085>me.

26
00:00:57.025 --> 00:00:58.065
<00:00:57.025>I <00:00:57.181>think <00:00:57.336>you <00:00:57.492>guys <00:00:57.649>will <00:00:57.805>be <00:00:57.961>fine.

27
00:00:58.875 --> 00:01:01.065
<00:00:58.875>Let's <00:00:59.108>take <00:00:59.341>a <00:00:59.575>pure <00:00:59.808>CPU <00:01:00.041>application, <00:01:00.275>right?

28
00:01:01.065 --> 00:01:03.425
<00:01:01.065>What <00:01:01.265>we're <00:01:01.464>looking <00:01:01.665>at, <00:01:01.864>this <00:01:02.065>is <00:01:02.265>your <00:01:02.464>application.

29
00:01:03.805 --> 00:01:05.825
<00:01:03.805>It <00:01:04.084>does, <00:01:04.364>there's <00:01:04.644>10 <00:01:04.925>functions, <00:01:05.205>okay?

30
00:01:06.645 --> 00:01:09.425
<00:01:06.645>10 <00:01:06.820>functions <00:01:06.994>will <00:01:07.170>take <00:01:07.345>10 <00:01:07.520>units <00:01:07.695>of <00:01:07.869>time, <00:01:08.045>easy.

31
00:01:10.445 --> 00:01:13.545
<00:01:10.445>Now, <00:01:10.794>this <00:01:11.145>is, <00:01:11.494>um, <00:01:11.845>so

32
00:01:14.665 --> 00:01:16.785
<00:01:14.664>it'll <00:01:14.865>take <00:01:15.065>10 <00:01:15.264>units <00:01:15.464>of <00:01:15.664>time <00:01:15.865>to <00:01:16.065>execute.

33
00:01:17.405 --> 00:01:19.425
<00:01:17.405>So <00:01:17.580>the <00:01:17.755>thing <00:01:17.930>is, <00:01:18.105>remember <00:01:18.280>I <00:01:18.455>said <00:01:18.630>accelerated <00:01:18.805>computing?

34
00:01:19.425 --> 00:01:20.625
<00:01:19.425>So <00:01:19.695>what <00:01:19.965>is <00:01:20.235>accelerated <00:01:20.505>computing?

35
00:01:20.625 --> 00:01:21.945
<00:01:20.625>People <00:01:20.862>kind <00:01:21.100>of <00:01:21.337>think <00:01:21.575>of <00:01:21.812>accelerated

36
00:01:21.945 --> 00:01:23.225
<00:01:21.945>computing <00:01:22.329>and <00:01:22.713>parallel <00:01:23.097>computing.

37
00:01:23.225 --> 00:01:25.105
<00:01:23.225>Interchangeable, <00:01:23.691>not <00:01:24.158>entirely <00:01:24.625>wrong,

38
00:01:25.525 --> 00:01:27.385
<00:01:25.525>but <00:01:25.725>the <00:01:25.925>thing <00:01:26.125>that <00:01:26.325>people <00:01:26.525>don't <00:01:26.725>realize <00:01:26.925>is

39
00:01:27.385 --> 00:01:30.265
<00:01:27.385>that <00:01:27.525>A <00:01:27.665>GPU <00:01:27.805>has <00:01:27.945>a <00:01:28.085>lot <00:01:28.225>of <00:01:28.365>things <00:01:28.505>on <00:01:28.645>it, <00:01:28.785>right?

40
00:01:30.265 --> 00:01:33.985
<00:01:30.265>There's <00:01:30.440>cuda <00:01:30.615>cores, <00:01:30.790>there's <00:01:30.965>a <00:01:31.140>raizer, <00:01:31.315>there's <00:01:31.490>video <00:01:31.665>encoders

41
00:01:33.985 --> 00:01:36.225
<00:01:33.985>and <00:01:34.335>decoders, <00:01:34.685>tensor <00:01:35.035>cores <00:01:35.385>for,

42
00:01:36.225 --> 00:01:37.825
<00:01:36.225>obviously <00:01:36.505>everyone <00:01:36.785>knows <00:01:37.065>10 <00:01:37.345>scores <00:01:37.625>now

43
00:01:37.905 --> 00:01:39.025
<00:01:37.905>'cause <00:01:38.073>of <00:01:38.241>machine <00:01:38.409>learning <00:01:38.577>and <00:01:38.745>deep <00:01:38.913>learning.

44
00:01:39.205 --> 00:01:40.545
<00:01:39.205>We <00:01:39.446>also <00:01:39.687>have <00:01:39.928>ray <00:01:40.169>tracing <00:01:40.411>course.

45
00:01:40.765 --> 00:01:44.825
<00:01:40.765>So <00:01:40.965>all <00:01:41.165>these <00:01:41.365>different, <00:01:41.565>uh, <00:01:41.765>accelerated, <00:01:41.965>uh, <00:01:42.165>modules,

46
00:01:45.365 --> 00:01:47.305
<00:01:45.365>you <00:01:45.520>have <00:01:45.676>to <00:01:45.831>program <00:01:45.987>the <00:01:46.142>software <00:01:46.298>on <00:01:46.453>top <00:01:46.609>of <00:01:46.765>it

47
00:01:47.845 --> 00:01:49.545
<00:01:47.845>and <00:01:48.311>make <00:01:48.778>it <00:01:49.245>parallel.

48
00:01:49.545 --> 00:01:51.385
<00:01:49.545>So <00:01:49.700>what <00:01:49.856>you <00:01:50.011>can, <00:01:50.167>what <00:01:50.322>you're <00:01:50.478>able <00:01:50.633>to <00:01:50.789>do, <00:01:50.945>right?

49
00:01:51.385 --> 00:01:53.985
<00:01:51.384>This <00:01:51.664>works <00:01:51.945>for <00:01:52.225>many, <00:01:52.505>many <00:01:52.785>applications.

50
00:01:53.985 --> 00:01:55.385
<00:01:53.985>So <00:01:54.142>I'm <00:01:54.300>gonna <00:01:54.457>make <00:01:54.615>a <00:01:54.772>claim. <00:01:54.929>It <00:01:55.087>doesn't <00:01:55.244>work

51
00:01:55.385 --> 00:01:57.905
<00:01:55.384>for <00:01:55.559>every <00:01:55.734>application, <00:01:55.910>but <00:01:56.085>for <00:01:56.259>many, <00:01:56.434>many <00:01:56.609>applications <00:01:56.785>like

52
00:01:58.465 --> 00:02:01.425
<00:01:58.465>computer <00:01:58.745>graphics, <00:01:59.025>deep <00:01:59.305>learning, <00:01:59.585>data <00:01:59.865>processing,

53
00:02:01.765 --> 00:02:02.865
<00:02:01.765>you <00:02:02.012>can <00:02:02.259>take <00:02:02.507>that <00:02:02.755>work

54
00:02:03.245 --> 00:02:05.225
<00:02:03.245>and <00:02:03.445>put <00:02:03.645>it <00:02:03.845>on <00:02:04.045>those <00:02:04.245>processors <00:02:04.445>in <00:02:04.645>a

55
00:02:05.225 --> 00:02:07.305
<00:02:05.225>distributed <00:02:05.925>parallel <00:02:06.625>way.

56
00:02:07.305 --> 00:02:09.105
<00:02:07.305>So <00:02:07.480>it <00:02:07.655>all <00:02:07.830>happens <00:02:08.005>at <00:02:08.180>the <00:02:08.355>exact <00:02:08.530>same <00:02:08.705>time.

57
00:02:10.005 --> 00:02:11.995
<00:02:10.005>So <00:02:10.180>what <00:02:10.354>you've <00:02:10.530>done <00:02:10.704>is <00:02:10.880>you've <00:02:11.055>taken <00:02:11.230>the <00:02:11.405>sort

58
00:02:11.995 --> 00:02:15.115
<00:02:11.995>of <00:02:12.170>nine <00:02:12.345>functions <00:02:12.520>that <00:02:12.695>we're <00:02:12.870>able <00:02:13.045>to <00:02:13.220>be <00:02:13.395>paralyzed,

59
00:02:15.175 --> 00:02:17.155
<00:02:15.175>and <00:02:15.350>you <00:02:15.525>ran <00:02:15.700>them <00:02:15.875>on <00:02:16.050>the <00:02:16.225>GPU <00:02:16.400>in <00:02:16.575>parallel.

60
00:02:17.535 --> 00:02:20.635
<00:02:17.535>So <00:02:17.642>now, <00:02:17.750>one <00:02:17.858>unit <00:02:17.965>at <00:02:18.073>a <00:02:18.181>time, <00:02:18.288>let's <00:02:18.396>take <00:02:18.504>a <00:02:18.611>look <00:02:18.719>at <00:02:18.827>an <00:02:18.935>example.

61
00:02:25.155 --> 00:02:27.485
<00:02:25.155>Alright? <00:02:25.435>I <00:02:25.715>introduced <00:02:25.995>to <00:02:26.275>you <00:02:26.555>Leonardo,

62
00:02:27.985 --> 00:02:31.565
<00:02:27.985>and <00:02:28.101>he's <00:02:28.218>going <00:02:28.335>to <00:02:28.451>paint <00:02:28.568>a <00:02:28.685>picture <00:02:28.801>for <00:02:28.918>you <00:02:29.035>guys <00:02:29.151>in <00:02:29.268>the <00:02:29.385>way

63
00:02:31.565 --> 00:02:33.965
<00:02:31.565>that <00:02:31.720>A <00:02:31.876>CPU <00:02:32.031>might <00:02:32.187>do <00:02:32.342>it <00:02:32.498>as <00:02:32.653>a <00:02:32.809>series <00:02:32.965>of

64
00:02:34.525 --> 00:02:36.285
<00:02:34.525>actions <00:02:34.991>performed <00:02:35.458>sequentially, <00:02:35.925>one

65
00:02:36.285 --> 00:02:39.885
<00:02:36.285>after <00:02:36.518>the <00:02:36.751>other <00:02:36.984>in <00:02:37.218>3, <00:02:37.451>2, <00:02:37.685>1.

66
00:02:42.905 --> 00:02:44.165
<00:02:42.905>Uh, <00:02:43.188>lemme <00:02:43.472>speed <00:02:43.755>it <00:02:44.039>up,

67
00:02:51.265 --> 00:02:52.485
<00:02:51.265>ladies <00:02:51.814>and <00:02:52.363>gentlemen.

68
00:02:54.245 --> 00:02:58.085
<00:02:54.245>Leonardo <00:02:55.645>10.0

69
00:02:59.555 --> 00:03:03.925
<00:02:59.555>when <00:02:59.710>we <00:02:59.866>hit <00:03:00.021>this <00:03:00.177>trigger <00:03:00.332>on <00:03:00.488>this <00:03:00.643>thing, <00:03:00.799>2100 <00:03:00.955>gallons

70
00:03:03.985 --> 00:03:05.285
<00:03:03.985>of <00:03:04.570>air <00:03:05.155>goes

71
00:03:05.285 --> 00:03:09.365
<00:03:05.285>through <00:03:05.460>these <00:03:05.635>accumulators <00:03:05.810>out <00:03:05.984>these <00:03:06.160>valves <00:03:06.335>into <00:03:06.510>all <00:03:06.685>1,100

72
00:03:09.385 --> 00:03:12.285
<00:03:09.385>of <00:03:09.524>these <00:03:09.665>tubes, <00:03:09.804>into <00:03:09.945>these <00:03:10.084>tubes <00:03:10.225>with, <00:03:10.364>in <00:03:10.505>which <00:03:10.644>the <00:03:10.785>bottom

73
00:03:12.285 --> 00:03:13.285
<00:03:12.285>of <00:03:12.510>is <00:03:12.734>a <00:03:12.960>paint <00:03:13.185>ball.

74
00:03:13.355 --> 00:03:15.685
<00:03:13.355>Each <00:03:13.510>of <00:03:13.666>those <00:03:13.821>paint <00:03:13.977>balls <00:03:14.132>will <00:03:14.288>fly <00:03:14.443>across <00:03:14.599>seven <00:03:14.755>feet

75
00:03:15.685 --> 00:03:18.885
<00:03:15.685>of <00:03:15.860>space <00:03:16.035>and <00:03:16.210>in <00:03:16.385>80 <00:03:16.560>milliseconds <00:03:16.735>reach <00:03:16.910>its <00:03:17.085>target.

76
00:03:18.995 --> 00:03:21.765
<00:03:18.995>Hopefully, <00:03:19.345>when <00:03:19.695>it's <00:03:20.045>all <00:03:20.395>said

77
00:03:21.765 --> 00:03:23.005
<00:03:21.765>and <00:03:21.924>done, <00:03:22.083>it's <00:03:22.243>gonna <00:03:22.402>paint <00:03:22.562>the <00:03:22.721>Mona <00:03:22.881>Lisa

78
00:03:24.045 --> 00:03:26.525
<00:03:24.045>GPU <00:03:24.745>painting <00:03:25.445>demonstration.

79
00:03:26.665 --> 00:03:27.845
<00:03:26.665>Yep. <00:03:27.727>And

80
00:03:28.425 --> 00:03:33.425
<00:03:28.425>10, <00:03:28.580>9, <00:03:28.736>8, <00:03:28.891>7, <00:03:29.047>6, <00:03:29.202>5, <00:03:29.358>4, <00:03:29.513>3, <00:03:29.669>2, <00:03:29.825>1.

81
00:03:45.945 --> 00:03:47.205
<00:03:45.945>So <00:03:46.107>that's <00:03:46.268>an <00:03:46.430>old <00:03:46.593>video, <00:03:46.755>but <00:03:46.916>it's <00:03:47.078>fun

82
00:03:47.205 --> 00:03:49.165
<00:03:47.204>and <00:03:47.438>it <00:03:47.671>explains <00:03:47.904>what, <00:03:48.138>what <00:03:48.371>happens, <00:03:48.605>right?

83
00:03:49.165 --> 00:03:50.885
<00:03:49.165>You <00:03:49.398>take <00:03:49.631>your <00:03:49.864>application, <00:03:50.098>you <00:03:50.331>run <00:03:50.565>all

84
00:03:50.885 --> 00:03:52.245
<00:03:50.885>that <00:03:51.129>stuff <00:03:51.374>in <00:03:51.619>parallel <00:03:51.864>and <00:03:52.109>bam.

85
00:03:52.665 --> 00:03:54.525
<00:03:52.665>So, <00:03:52.945>but <00:03:53.225>that's <00:03:53.505>not <00:03:53.785>free, <00:03:54.065>right?

86
00:03:54.645 --> 00:03:56.085
<00:03:54.645>If <00:03:54.830>you <00:03:55.015>have <00:03:55.200>a <00:03:55.385>computer <00:03:55.570>with <00:03:55.755>a <00:03:55.941>CPU

87
00:03:56.085 --> 00:03:57.325
<00:03:56.085>and <00:03:56.224>you <00:03:56.364>want <00:03:56.503>to <00:03:56.643>add <00:03:56.782>a <00:03:56.922>GPU <00:03:57.061>to <00:03:57.201>it,

88
00:03:57.325 --> 00:03:58.445
<00:03:57.325>it's <00:03:57.526>gonna <00:03:57.728>cost <00:03:57.929>you <00:03:58.131>more <00:03:58.333>power.

89
00:03:58.555 --> 00:04:01.165
<00:03:58.555>It's <00:03:58.730>gonna <00:03:58.905>cost <00:03:59.080>you <00:03:59.255>more <00:03:59.430>money. <00:03:59.605>Rough <00:03:59.780>math <00:03:59.955>here.

90
00:04:01.685 --> 00:04:03.045
<00:04:01.685>Remember <00:04:01.838>I <00:04:01.991>saying <00:04:02.144>keep <00:04:02.297>it <00:04:02.450>high <00:04:02.602>level <00:04:02.756>rough <00:04:02.909>math,

91
00:04:03.075 --> 00:04:04.565
<00:04:03.075>it's <00:04:03.298>gonna <00:04:03.522>cost <00:04:03.745>you <00:04:03.969>about <00:04:04.192>50% <00:04:04.416>more

92
00:04:04.825 --> 00:04:06.605
<00:04:04.825>and <00:04:05.000>it's <00:04:05.174>gonna <00:04:05.350>take <00:04:05.524>about <00:04:05.700>three <00:04:05.875>x <00:04:06.049>more <00:04:06.225>power.

93
00:04:07.345 --> 00:04:08.765
<00:04:07.345>But <00:04:07.558>what's <00:04:07.771>happening <00:04:07.983>now <00:04:08.197>with <00:04:08.410>deep <00:04:08.623>learning,

94
00:04:08.765 --> 00:04:12.165
<00:04:08.765>it's <00:04:08.892>not <00:04:09.019>uncommon <00:04:09.146>to <00:04:09.274>see, <00:04:09.401>like <00:04:09.528>if <00:04:09.655>you <00:04:09.783>wanna <00:04:09.910>train <00:04:10.037>a, <00:04:10.165>a,

95
00:04:13.285 --> 00:04:15.285
<00:04:13.285>a <00:04:13.440>language <00:04:13.596>model <00:04:13.751>or <00:04:13.907>wanna <00:04:14.062>train <00:04:14.218>a <00:04:14.373>deep <00:04:14.529>learning <00:04:14.685>model,

96
00:04:15.505 --> 00:04:17.285
<00:04:15.505>you <00:04:15.680>know, <00:04:15.855>we're <00:04:16.029>seeing <00:04:16.204>a <00:04:16.380>hundred <00:04:16.555>x <00:04:16.730>speed <00:04:16.904>up.

97
00:04:17.585 --> 00:04:19.565
<00:04:17.584>So <00:04:17.740>what's <00:04:17.896>happening <00:04:18.051>is <00:04:18.207>you're <00:04:18.362>taking <00:04:18.518>that <00:04:18.673>a <00:04:18.829>hundred <00:04:18.984>units

98
00:04:19.585 --> 00:04:22.485
<00:04:19.584>of <00:04:19.740>time <00:04:19.896>and <00:04:20.051>bringing <00:04:20.207>it <00:04:20.362>down <00:04:20.518>to <00:04:20.673>one <00:04:20.829>same <00:04:20.984>idea.

99
00:04:22.795 --> 00:04:25.365
<00:04:22.795>Just <00:04:22.995>the <00:04:23.195>bigger <00:04:23.395>the <00:04:23.595>workload, <00:04:23.795>the <00:04:23.995>more <00:04:24.195>savings

100
00:04:25.425 --> 00:04:26.885
<00:04:25.425>and <00:04:25.612>the <00:04:25.800>more <00:04:25.988>parallel <00:04:26.175>you <00:04:26.363>can <00:04:26.551>make <00:04:26.739>it,

101
00:04:27.145 --> 00:04:28.325
<00:04:27.145>the <00:04:27.357>more <00:04:27.569>the <00:04:27.782>savings <00:04:27.994>you'll <00:04:28.207>see.

102
00:04:28.955 --> 00:04:31.045
<00:04:28.955>Okay? <00:04:29.234>Again, <00:04:29.515>costs <00:04:29.794>you <00:04:30.075>a <00:04:30.354>little,

103
00:04:31.075 --> 00:04:33.365
<00:04:31.075>cost <00:04:31.275>you <00:04:31.474>a <00:04:31.675>little <00:04:31.875>more <00:04:32.075>money, <00:04:32.275>more <00:04:32.474>power.

104
00:04:34.525 --> 00:04:36.385
<00:04:34.525>So <00:04:34.724>often, <00:04:34.924>you <00:04:35.125>know, <00:04:35.325>I'm <00:04:35.525>talking <00:04:35.724>to <00:04:35.924>people

105
00:04:36.385 --> 00:04:37.865
<00:04:36.385>and <00:04:36.651>I <00:04:36.917>hear <00:04:37.184>GPUs <00:04:37.450>are <00:04:37.717>expensive,

106
00:04:37.865 --> 00:04:40.465
<00:04:37.865>and <00:04:38.065>they <00:04:38.265>kind <00:04:38.465>of <00:04:38.665>misunderstand <00:04:38.865>accelerated <00:04:39.065>computing <00:04:39.265>when

107
00:04:40.465 --> 00:04:43.945
<00:04:40.465>they <00:04:40.592>say <00:04:40.719>that, <00:04:40.846>because <00:04:40.974>if <00:04:41.101>you <00:04:41.228>do <00:04:41.355>the <00:04:41.483>math, <00:04:41.610>let's <00:04:41.737>change <00:04:41.865>the,

108
00:04:43.945 --> 00:04:44.945
<00:04:43.945>lemme <00:04:44.245>change <00:04:44.545>the <00:04:44.844>question.

109
00:04:45.045 --> 00:04:47.345
<00:04:45.045>Say, <00:04:45.200>if <00:04:45.356>I <00:04:45.511>want <00:04:45.667>to <00:04:45.822>train <00:04:45.978>a <00:04:46.133>deep <00:04:46.289>learning <00:04:46.445>model

110
00:04:47.805 --> 00:04:52.535
<00:04:47.805>and <00:04:47.932>I <00:04:48.059>want <00:04:48.186>to <00:04:48.314>do <00:04:48.441>it <00:04:48.568>in <00:04:48.695>one <00:04:48.823>day, <00:04:48.950>I <00:04:49.077>could <00:04:49.205>either,

111
00:04:52.595 --> 00:04:54.895
<00:04:52.595>and, <00:04:52.750>and <00:04:52.906>the <00:04:53.061>the <00:04:53.217>speed <00:04:53.372>up <00:04:53.528>is <00:04:53.683>a <00:04:53.839>hundred <00:04:53.995>x.

112
00:04:54.895 --> 00:04:57.935
<00:04:54.895>So <00:04:55.022>in <00:04:55.149>one <00:04:55.276>day <00:04:55.404>I <00:04:55.531>would <00:04:55.658>need <00:04:55.785>a <00:04:55.913>hundred <00:04:56.040>systems, <00:04:56.167>CPU <00:04:56.294>systems

113
00:04:57.935 --> 00:05:00.055
<00:04:57.935>to <00:04:58.110>do <00:04:58.285>it <00:04:58.460>in <00:04:58.635>one <00:04:58.810>day, <00:04:58.985>assuming <00:04:59.160>linear <00:04:59.335>scaling.

114
00:05:01.165 --> 00:05:03.905
<00:05:01.165>Or <00:05:01.365>I <00:05:01.565>could <00:05:01.765>just <00:05:01.965>get <00:05:02.165>one <00:05:02.365>accelerated <00:05:02.565>computing

115
00:05:03.905 --> 00:05:04.985
<00:05:03.905>system <00:05:04.229>within <00:05:04.553>NV <00:05:04.877>GPUs.

116
00:05:06.305 --> 00:05:08.445
<00:05:06.305>So <00:05:06.445>if <00:05:06.585>you <00:05:06.725>do <00:05:06.865>the <00:05:07.005>math <00:05:07.145>on <00:05:07.285>that, <00:05:07.425>you <00:05:07.565>say, <00:05:07.705>Hey,

117
00:05:08.685 --> 00:05:10.765
<00:05:08.685>a <00:05:08.965>hundred <00:05:09.245>systems <00:05:09.525>times, <00:05:09.805>you <00:05:10.085>know,

118
00:05:10.925 --> 00:05:14.885
<00:05:10.925>x <00:05:11.052>euros <00:05:11.179>per <00:05:11.306>system <00:05:11.434>is <00:05:11.561>a <00:05:11.688>hundred <00:05:11.815>x <00:05:11.943>euros <00:05:12.070>versus <00:05:12.197>one <00:05:12.325>system,

119
00:05:14.975 --> 00:05:17.325
<00:05:14.975>which <00:05:15.175>was <00:05:15.375>50% <00:05:15.575>more <00:05:15.775>is <00:05:15.975>one <00:05:16.175>point <00:05:16.375>x.

120
00:05:17.325 --> 00:05:19.005
<00:05:17.325>That's <00:05:17.675>a <00:05:18.025>98% <00:05:18.375>cost <00:05:18.724>savings.

121
00:05:19.845 --> 00:05:21.665
<00:05:19.845>You <00:05:20.020>can <00:05:20.195>do <00:05:20.370>the <00:05:20.545>same <00:05:20.720>math <00:05:20.895>for <00:05:21.070>power, <00:05:21.245>right?

122
00:05:22.125 --> 00:05:24.505
<00:05:22.125>The <00:05:22.280>power <00:05:22.436>savings <00:05:22.591>went <00:05:22.747>on <00:05:22.902>a <00:05:23.058>hundred <00:05:23.213>systems <00:05:23.369>is <00:05:23.525>a

123
00:05:24.505 --> 00:05:25.545
<00:05:24.505>hundred <00:05:24.817>systems <00:05:25.129>times <00:05:25.441>whatever.

124
00:05:25.835 --> 00:05:28.545
<00:05:25.835>Watts <00:05:25.974>per <00:05:26.114>system. <00:05:26.255>X <00:05:26.395>per <00:05:26.534>system <00:05:26.674>is <00:05:26.815>a <00:05:26.955>hundred <00:05:27.094>x <00:05:27.234>watts

125
00:05:28.645 --> 00:05:29.785
<00:05:28.645>versus <00:05:28.986>a <00:05:29.329>single <00:05:29.671>system.

126
00:05:30.165 --> 00:05:31.345
<00:05:30.165>If <00:05:30.342>we <00:05:30.519>said <00:05:30.696>three <00:05:30.873>x <00:05:31.050>the <00:05:31.227>power,

127
00:05:31.345 --> 00:05:32.425
<00:05:31.345>if <00:05:31.507>you <00:05:31.669>assume <00:05:31.831>four <00:05:31.993>x <00:05:32.155>the <00:05:32.317>power,

128
00:05:32.425 --> 00:05:33.545
<00:05:32.425>you <00:05:32.626>can <00:05:32.828>adjust <00:05:33.029>these <00:05:33.231>numbers, <00:05:33.433>right?

129
00:05:33.725 --> 00:05:35.985
<00:05:33.725>To <00:05:33.900>what? <00:05:34.075>But <00:05:34.250>they're <00:05:34.425>gonna <00:05:34.600>be <00:05:34.775>amazing <00:05:34.950>in <00:05:35.125>terms

130
00:05:35.985 --> 00:05:36.985
<00:05:35.985>of <00:05:36.435>accelerate <00:05:36.885>computing.

131
00:05:37.045 --> 00:05:39.265
<00:05:37.045>But <00:05:37.245>it's <00:05:37.445>a <00:05:37.645>function <00:05:37.845>of <00:05:38.045>how <00:05:38.245>much <00:05:38.445>the,

132
00:05:39.565 --> 00:05:41.185
<00:05:39.565>how <00:05:39.798>much <00:05:40.031>you <00:05:40.265>can <00:05:40.498>accelerate <00:05:40.731>the <00:05:40.965>application.

133
00:05:41.185 --> 00:05:44.145
<00:05:41.185>And <00:05:41.385>every <00:05:41.585>workload, <00:05:41.785>uh, <00:05:41.985>you <00:05:42.185>know, <00:05:42.385>we <00:05:42.585>have,

134
00:05:44.165 --> 00:05:46.385
<00:05:44.165>and <00:05:44.305>that's <00:05:44.445>what, <00:05:44.585>so <00:05:44.725>that <00:05:44.865>would <00:05:45.005>get <00:05:45.145>to <00:05:45.285>my <00:05:45.425>main <00:05:45.565>slide.

135
00:05:46.385 --> 00:05:47.985
<00:05:46.385>That <00:05:46.585>was <00:05:46.784>the <00:05:46.985>primer <00:05:47.185>to <00:05:47.385>help <00:05:47.585>you <00:05:47.784>understand

136
00:05:48.875 --> 00:05:50.025
<00:05:48.875>accelerate <00:05:49.909>computing.

137
00:05:50.605 --> 00:05:53.385
<00:05:50.605>And <00:05:50.805>so <00:05:51.005>let's <00:05:51.205>talk <00:05:51.405>about <00:05:51.605>some <00:05:51.805>workloads, <00:05:52.005>right?

138
00:05:53.385 --> 00:05:56.105
<00:05:53.385>We <00:05:53.512>talk <00:05:53.639>about <00:05:53.766>refactor. <00:05:53.894>So <00:05:54.021>in <00:05:54.148>order <00:05:54.275>to <00:05:54.403>take <00:05:54.530>advantage <00:05:54.657>of <00:05:54.784>it,

139
00:05:56.305 --> 00:05:57.365
<00:05:56.305>remember <00:05:56.441>I <00:05:56.577>said <00:05:56.713>you <00:05:56.850>gotta <00:05:56.986>take <00:05:57.122>your <00:05:57.259>functions,

140
00:05:57.365 --> 00:05:58.365
<00:05:57.365>you <00:05:57.515>gotta <00:05:57.665>put <00:05:57.815>'em <00:05:57.965>on <00:05:58.115>the <00:05:58.265>GPU.

141
00:05:58.555 --> 00:06:01.125
<00:05:58.555>That <00:05:58.788>requires <00:05:59.021>writing <00:05:59.255>some <00:05:59.488>code <00:05:59.721>requires <00:05:59.955>potentially

142
00:06:01.125 --> 00:06:02.205
<00:06:01.125>refactoring <00:06:02.097>applications.

143
00:06:02.515 --> 00:06:03.925
<00:06:02.515>What <00:06:02.726>NVIDIA <00:06:02.938>does <00:06:03.149>to <00:06:03.361>make <00:06:03.572>it <00:06:03.784>easier

144
00:06:03.925 --> 00:06:06.525
<00:06:03.925>for <00:06:04.100>you <00:06:04.275>is <00:06:04.450>we've <00:06:04.625>got <00:06:04.800>all <00:06:04.975>these <00:06:05.150>libraries, <00:06:05.325>domain

145
00:06:07.125 --> 00:06:09.605
<00:06:07.125>specific <00:06:07.475>libraries <00:06:07.825>that <00:06:08.175>help <00:06:08.525>accelerate.

146
00:06:09.605 --> 00:06:11.525
<00:06:09.605>Because <00:06:09.838>in <00:06:10.071>order <00:06:10.305>to <00:06:10.538>do <00:06:10.771>that <00:06:11.005>overlapping

147
00:06:11.545 --> 00:06:13.965
<00:06:11.545>and <00:06:11.700>parallel <00:06:11.856>work, <00:06:12.011>you <00:06:12.167>have <00:06:12.322>to <00:06:12.478>have <00:06:12.633>an <00:06:12.789>an <00:06:12.945>idea,

148
00:06:14.065 --> 00:06:16.605
<00:06:14.065>an <00:06:14.240>understanding <00:06:14.415>of <00:06:14.590>the <00:06:14.765>problem <00:06:14.940>you're <00:06:15.115>trying <00:06:15.290>to <00:06:15.465>solve

149
00:06:16.605 --> 00:06:18.165
<00:06:16.605>with <00:06:16.838>the <00:06:17.071>space <00:06:17.305>that <00:06:17.538>you're <00:06:17.771>working <00:06:18.005>in.

150
00:06:18.425 --> 00:06:21.165
<00:06:18.425>And <00:06:18.580>so, <00:06:18.736>a <00:06:18.891>couple <00:06:19.047>of <00:06:19.202>examples, <00:06:19.358>QDF <00:06:19.513>is <00:06:19.669>our, <00:06:19.825>um,

151
00:06:21.835 --> 00:06:23.765
<00:06:21.835>open <00:06:22.114>source <00:06:22.395>library <00:06:22.674>for <00:06:22.955>data <00:06:23.234>processing.

152
00:06:24.065 --> 00:06:27.005
<00:06:24.065>Uh, <00:06:24.220>we <00:06:24.376>just <00:06:24.531>announced <00:06:24.687>NV <00:06:24.842>Math, <00:06:24.998>Python, <00:06:25.153>it's <00:06:25.309>in <00:06:25.465>beta.

153
00:06:27.185 --> 00:06:30.405
<00:06:27.185>So <00:06:27.325>you <00:06:27.465>know, <00:06:27.605>these <00:06:27.745>math, <00:06:27.885>uh, <00:06:28.025>core <00:06:28.165>math <00:06:28.305>functions <00:06:28.445>like, <00:06:28.585>uh,

154
00:06:30.865 --> 00:06:33.685
<00:06:30.865>matrix, <00:06:31.065>matrix, <00:06:31.265>multiply <00:06:31.465>and <00:06:31.665>fast <00:06:31.865>for <00:06:32.065>your <00:06:32.265>transforms.

155
00:06:33.825 --> 00:06:36.565
<00:06:33.825>We <00:06:33.941>have <00:06:34.058>those. <00:06:34.175>We <00:06:34.291>always <00:06:34.408>had <00:06:34.525>those <00:06:34.641>in <00:06:34.758>c <00:06:34.875>plus <00:06:34.991>plus <00:06:35.108>when <00:06:35.224>we

156
00:06:36.565 --> 00:06:39.165
<00:06:36.565>have <00:06:36.720>them <00:06:36.876>now, <00:06:37.031>we <00:06:37.187>have <00:06:37.342>them <00:06:37.498>easily <00:06:37.653>accessible <00:06:37.809>in <00:06:37.965>Python.

157
00:06:39.585 --> 00:06:42.325
<00:06:39.585>Go <00:06:39.724>check <00:06:39.864>it <00:06:40.005>out. <00:06:40.145>We <00:06:40.284>have, <00:06:40.424>uh, <00:06:40.565>you <00:06:40.705>know, <00:06:40.844>maybe <00:06:40.984>many

158
00:06:42.325 --> 00:06:44.965
<00:06:42.325>of <00:06:42.500>you're <00:06:42.675>familiar <00:06:42.849>with, <00:06:43.025>uh, <00:06:43.200>PyTorch <00:06:43.375>or <00:06:43.550>TensorFlow, <00:06:43.724>right?

159
00:06:44.965 --> 00:06:46.165
<00:06:44.965>We <00:06:45.235>have <00:06:45.505>CDNN, <00:06:45.775>the <00:06:46.045>library

160
00:06:46.345 --> 00:06:48.485
<00:06:46.345>for <00:06:46.695>accelerating <00:06:47.045>deep <00:06:47.395>learning <00:06:47.745>integrated.

161
00:06:48.485 --> 00:06:49.885
<00:06:48.485>And <00:06:48.642>you <00:06:48.800>never <00:06:48.957>even, <00:06:49.115>you <00:06:49.272>know, <00:06:49.430>many <00:06:49.587>of <00:06:49.745>you

162
00:06:50.525 --> 00:06:52.285
<00:06:50.525>probably <00:06:50.758>never <00:06:50.991>have <00:06:51.224>to <00:06:51.458>go <00:06:51.691>interact <00:06:51.924>directly

163
00:06:52.285 --> 00:06:53.805
<00:06:52.284>with <00:06:52.558>CDNA, <00:06:52.832>you <00:06:53.105>just <00:06:53.379>use <00:06:53.653>PyTorch.

164
00:06:53.865 --> 00:06:55.645
<00:06:53.865>But <00:06:54.040>you <00:06:54.215>got <00:06:54.390>the <00:06:54.565>acceleration, <00:06:54.740>you <00:06:54.915>got <00:06:55.090>the <00:06:55.265>benefits.

165
00:06:55.645 --> 00:06:57.445
<00:06:55.645>That's <00:06:55.844>what <00:06:56.044>NVIDIA <00:06:56.245>is <00:06:56.445>doing <00:06:56.645>with <00:06:56.844>accelerate <00:06:57.044>computers.

166
00:06:57.445 --> 00:07:00.805
<00:06:57.445>We're <00:06:57.572>trying <00:06:57.699>to <00:06:57.826>get <00:06:57.954>it <00:06:58.081>to <00:06:58.208>the <00:06:58.335>tools <00:06:58.463>that <00:06:58.590>you <00:06:58.717>use. <00:06:58.844>Modulus.

167
00:07:00.805 --> 00:07:03.645
<00:07:00.805>I'll <00:07:00.980>use <00:07:01.155>two <00:07:01.330>more <00:07:01.505>examples. <00:07:01.680>Modulus <00:07:01.855>is <00:07:02.030>a, <00:07:02.205>um,

168
00:07:04.515 --> 00:07:07.605
<00:07:04.515>it's <00:07:04.690>a <00:07:04.865>framework <00:07:05.039>for <00:07:05.215>building <00:07:05.390>train, <00:07:05.565>uh, <00:07:05.740>building <00:07:05.914>training

169
00:07:07.605 --> 00:07:11.365
<00:07:07.605>and <00:07:07.805>fine <00:07:08.005>tuning, <00:07:08.205>uh, <00:07:08.405>physics <00:07:08.605>informed <00:07:08.805>neural <00:07:09.005>networks.

170
00:07:11.525 --> 00:07:14.525
<00:07:11.525>So <00:07:11.680>these <00:07:11.836>are, <00:07:11.991>uh, <00:07:12.147>neural <00:07:12.302>networks <00:07:12.458>that <00:07:12.613>incorporate <00:07:12.769>the <00:07:12.924>laws

171
00:07:14.525 --> 00:07:17.285
<00:07:14.525>of <00:07:14.724>physics <00:07:14.924>into <00:07:15.125>the, <00:07:15.325>while <00:07:15.525>the <00:07:15.724>model's <00:07:15.924>learning.

172
00:07:17.545 --> 00:07:22.125
<00:07:17.545>And <00:07:17.661>then <00:07:17.778>Shona <00:07:17.895>is <00:07:18.011>a <00:07:18.128>re <00:07:18.245>a <00:07:18.361>library <00:07:18.478>for <00:07:18.595>researchers <00:07:18.711>to <00:07:18.828>be <00:07:18.945>able

173
00:07:22.125 --> 00:07:25.445
<00:07:22.125>to, <00:07:22.300>uh, <00:07:22.475>simulate <00:07:22.650>the <00:07:22.825>physical <00:07:23.000>layer <00:07:23.175>for <00:07:23.350>wireless, <00:07:23.525>right?

174
00:07:25.445 --> 00:07:29.285
<00:07:25.445>So <00:07:25.585>we <00:07:25.724>continue <00:07:25.865>to <00:07:26.005>find <00:07:26.145>new <00:07:26.284>applications <00:07:26.425>where <00:07:26.565>we <00:07:26.705>can <00:07:26.844>peril,

175
00:07:29.285 --> 00:07:32.645
<00:07:29.285>where <00:07:29.485>we <00:07:29.685>can <00:07:29.885>take <00:07:30.085>that, <00:07:30.285>accelerate <00:07:30.485>the <00:07:30.685>workloads,

176
00:07:32.645 --> 00:07:33.765
<00:07:32.645>accelerate <00:07:33.149>the <00:07:33.652>algorithms.

177
00:07:33.765 --> 00:07:37.525
<00:07:33.765>We <00:07:33.905>package <00:07:34.044>that <00:07:34.185>into <00:07:34.325>libraries. <00:07:34.465>We <00:07:34.604>have <00:07:34.745>900 <00:07:34.885>SDKs <00:07:35.025>and <00:07:35.164>models.

178
00:07:37.585 --> 00:07:39.845
<00:07:37.585>So <00:07:37.724>lots <00:07:37.864>of <00:07:38.005>different <00:07:38.145>domains. <00:07:38.284>This <00:07:38.424>is <00:07:38.565>our <00:07:38.705>body <00:07:38.844>of <00:07:38.984>work.

179
00:07:39.845 --> 00:07:41.725
<00:07:39.845>We've <00:07:40.000>been <00:07:40.156>doing <00:07:40.311>this <00:07:40.467>for <00:07:40.622>so <00:07:40.778>many <00:07:40.933>years. <00:07:41.089>We <00:07:41.245>have.

180
00:07:41.945 --> 00:07:43.325
<00:07:41.945>And, <00:07:42.122>and <00:07:42.299>many <00:07:42.477>of <00:07:42.654>those <00:07:42.832>are <00:07:43.009>open <00:07:43.187>source.

181
00:07:43.585 --> 00:07:47.325
<00:07:43.585>We <00:07:43.740>just <00:07:43.896>counted <00:07:44.051>yesterday. <00:07:44.207>We <00:07:44.362>have <00:07:44.518>750, <00:07:44.673>uh, <00:07:44.829>open <00:07:44.984>source,

182
00:07:47.605 --> 00:07:51.005
<00:07:47.605>IE <00:07:47.838>permissively <00:07:48.071>licensed <00:07:48.305>projects, <00:07:48.538>uh, <00:07:48.771>from <00:07:49.005>Nvidia.

183
00:07:52.075 --> 00:07:54.375
<00:07:52.075>So <00:07:52.250>lemme <00:07:52.425>give <00:07:52.599>you <00:07:52.775>an <00:07:52.950>easy <00:07:53.125>example <00:07:53.300>of <00:07:53.474>how

184
00:07:55.075 --> 00:07:56.295
<00:07:55.075>you <00:07:55.258>can <00:07:55.441>take <00:07:55.624>advantage <00:07:55.807>of <00:07:55.990>it, <00:07:56.173>right?

185
00:07:56.295 --> 00:07:57.935
<00:07:56.295>You <00:07:56.470>don't <00:07:56.645>have <00:07:56.820>to <00:07:56.995>go <00:07:57.170>refactory <00:07:57.345>application <00:07:57.520>that <00:07:57.695>much.

186
00:07:58.135 --> 00:08:00.975
<00:07:58.135>Remember <00:07:58.290>I <00:07:58.446>said <00:07:58.601>there's <00:07:58.757>some <00:07:58.912>code. <00:07:59.068>So <00:07:59.223>this <00:07:59.379>is <00:07:59.534>for

187
00:08:00.995 --> 00:08:02.295
<00:08:00.995>how <00:08:01.229>many <00:08:01.463>you're <00:08:01.697>familiar <00:08:01.931>with <00:08:02.165>pandas?

188
00:08:02.465 --> 00:08:03.935
<00:08:02.465>Maybe <00:08:02.685>use <00:08:02.906>pandas. <00:08:03.126>Yeah, <00:08:03.347>I, <00:08:03.567>it's <00:08:03.788>pandas.

189
00:08:04.035 --> 00:08:07.285
<00:08:04.035>So <00:08:04.162>you <00:08:04.289>can, <00:08:04.416>you <00:08:04.544>know, <00:08:04.671>this <00:08:04.798>is <00:08:04.925>what <00:08:05.053>a <00:08:05.180>tip, <00:08:05.307>very <00:08:05.435>simple,

190
00:08:07.625 --> 00:08:09.205
<00:08:07.625>you <00:08:07.858>know, <00:08:08.091>tip <00:08:08.325>calculator <00:08:08.558>type <00:08:08.791>of <00:08:09.025>thing.

191
00:08:09.205 --> 00:08:11.045
<00:08:09.205>Popular. <00:08:09.360>And <00:08:09.516>you <00:08:09.671>guys <00:08:09.827>all <00:08:09.982>know <00:08:10.138>what <00:08:10.293>PANDAS <00:08:10.449>is, <00:08:10.604>right?

192
00:08:11.045 --> 00:08:14.645
<00:08:11.045>It's <00:08:11.220>a <00:08:11.395>data <00:08:11.570>frame <00:08:11.745>processing <00:08:11.920>library <00:08:12.095>on <00:08:12.270>the <00:08:12.445>CPU.

193
00:08:15.605 --> 00:08:18.065
<00:08:15.605>If <00:08:15.780>you <00:08:15.955>wanna <00:08:16.130>use <00:08:16.305>accelerated, <00:08:16.480>if <00:08:16.655>you <00:08:16.830>wanna <00:08:17.005>accelerate,

194
00:08:18.085 --> 00:08:21.225
<00:08:18.085>you <00:08:18.284>literally <00:08:18.484>just <00:08:18.685>replace <00:08:18.885>the <00:08:19.085>import <00:08:19.284>with <00:08:19.484>QDF

195
00:08:21.225 --> 00:08:23.705
<00:08:21.225>because <00:08:21.352>we've <00:08:21.479>made <00:08:21.606>it <00:08:21.734>as <00:08:21.861>easy <00:08:21.988>as <00:08:22.115>possible <00:08:22.243>for <00:08:22.370>you <00:08:22.497>to <00:08:22.625>do.

196
00:08:24.035 --> 00:08:25.545
<00:08:24.035>There <00:08:24.306>are <00:08:24.578>definitely, <00:08:24.850>I'll <00:08:25.122>be <00:08:25.394>trans,

197
00:08:25.545 --> 00:08:28.265
<00:08:25.545>there <00:08:25.778>are <00:08:26.011>some <00:08:26.245>operators <00:08:26.478>that <00:08:26.711>won't <00:08:26.945>work,

198
00:08:28.285 --> 00:08:30.025
<00:08:28.285>but, <00:08:28.440>you <00:08:28.596>know, <00:08:28.751>it <00:08:28.907>was <00:08:29.062>a <00:08:29.218>very <00:08:29.373>minor <00:08:29.529>code <00:08:29.685>change.

199
00:08:30.525 --> 00:08:31.545
<00:08:30.525>So <00:08:30.708>we're <00:08:30.892>like, <00:08:31.075>well, <00:08:31.259>you <00:08:31.443>know,

200
00:08:31.545 --> 00:08:33.385
<00:08:31.545>some <00:08:31.720>people <00:08:31.895>don't <00:08:32.070>really <00:08:32.245>wanna <00:08:32.420>make <00:08:32.595>that <00:08:32.770>code <00:08:32.945>change

201
00:08:33.585 --> 00:08:35.625
<00:08:33.585>'cause <00:08:33.818>there's <00:08:34.051>DevOps <00:08:34.285>management <00:08:34.518>issues <00:08:34.751>and <00:08:34.985>stuff.

202
00:08:35.965 --> 00:08:38.265
<00:08:35.965>So <00:08:36.120>we <00:08:36.276>said, <00:08:36.431>all <00:08:36.587>right, <00:08:36.742>we'll <00:08:36.898>make <00:08:37.053>an <00:08:37.209>accelerator <00:08:37.365>plugin

203
00:08:38.265 --> 00:08:39.665
<00:08:38.265>that <00:08:38.475>you <00:08:38.684>install <00:08:38.895>on <00:08:39.105>the <00:08:39.314>system <00:08:39.525>level.

204
00:08:40.005 --> 00:08:41.665
<00:08:40.005>So, <00:08:40.179>you <00:08:40.355>know, <00:08:40.530>when <00:08:40.705>you <00:08:40.880>run <00:08:41.054>your <00:08:41.230>Python <00:08:41.405>code,

205
00:08:42.205 --> 00:08:44.865
<00:08:42.205>you <00:08:42.360>just <00:08:42.516>run <00:08:42.671>your <00:08:42.827>Python <00:08:42.982>script, <00:08:43.138>you <00:08:43.293>save <00:08:43.449>run <00:08:43.605>it,

206
00:08:45.945 --> 00:08:47.405
<00:08:45.945>you <00:08:46.273>use <00:08:46.602>the <00:08:46.930>module <00:08:47.259>command

207
00:08:48.095 --> 00:08:50.315
<00:08:48.095>and <00:08:48.250>you <00:08:48.406>say, <00:08:48.561>I'm <00:08:48.717>gonna <00:08:48.872>run <00:08:49.028>it <00:08:49.183>with <00:08:49.339>QDF <00:08:49.495>pandas.

208
00:08:51.185 --> 00:08:55.115
<00:08:51.185>What <00:08:51.324>that <00:08:51.464>does <00:08:51.604>is, <00:08:51.744>now <00:08:51.885>your, <00:08:52.025>your, <00:08:52.165>your <00:08:52.305>script <00:08:52.444>is <00:08:52.584>unchanged.

209
00:08:55.435 --> 00:08:58.165
<00:08:55.435>It's <00:08:55.635>import <00:08:55.834>pandas <00:08:56.035>runs <00:08:56.234>on <00:08:56.435>the <00:08:56.635>CPU <00:08:56.834>unchanged.

210
00:08:58.465 --> 00:09:02.525
<00:08:58.465>But <00:08:58.581>what <00:08:58.698>the <00:08:58.815>module <00:08:58.931>does <00:08:59.048>is <00:08:59.165>the <00:08:59.281>module <00:08:59.398>will <00:08:59.515>run <00:08:59.631>your <00:08:59.748>code <00:08:59.865>on

211
00:09:02.585 --> 00:09:05.445
<00:09:02.585>the <00:09:02.865>GPU, <00:09:03.145>so <00:09:03.425>it'll <00:09:03.705>be <00:09:03.985>accelerated.

212
00:09:05.545 --> 00:09:08.645
<00:09:05.545>And <00:09:05.745>when <00:09:05.944>there's <00:09:06.145>an <00:09:06.344>issue <00:09:06.545>of <00:09:06.745>whatever <00:09:06.944>reason,

213
00:09:08.675 --> 00:09:10.445
<00:09:08.675>something <00:09:08.954>cannot <00:09:09.234>run <00:09:09.515>an <00:09:09.795>operator's <00:09:10.074>missing

214
00:09:10.445 --> 00:09:13.925
<00:09:10.445>or <00:09:10.600>something, <00:09:10.756>it'll <00:09:10.911>take <00:09:11.067>care <00:09:11.222>of <00:09:11.378>managing, <00:09:11.533>moving <00:09:11.689>the <00:09:11.845>data

215
00:09:13.965 --> 00:09:15.445
<00:09:13.965>around <00:09:14.131>and <00:09:14.298>everything <00:09:14.464>to <00:09:14.631>be <00:09:14.797>able <00:09:14.964>to <00:09:15.130>fall <00:09:15.297>back

216
00:09:15.445 --> 00:09:16.725
<00:09:15.445>and <00:09:15.675>run <00:09:15.905>it <00:09:16.136>on <00:09:16.366>the <00:09:16.597>CPU.

217
00:09:17.305 --> 00:09:18.965
<00:09:17.305>So <00:09:17.584>your, <00:09:17.864>if <00:09:18.145>you <00:09:18.425>did <00:09:18.704>this,

218
00:09:19.905 --> 00:09:22.565
<00:09:19.905>the <00:09:20.079>worst <00:09:20.255>case <00:09:20.430>scenario <00:09:20.605>is <00:09:20.780>it's <00:09:20.954>exactly <00:09:21.130>the <00:09:21.305>same

219
00:09:22.985 --> 00:09:26.685
<00:09:22.985>as <00:09:23.125>you <00:09:23.265>ran <00:09:23.405>it <00:09:23.545>today, <00:09:23.685>but, <00:09:23.825>you <00:09:23.965>know, <00:09:24.105>I've <00:09:24.245>had <00:09:24.385>feedback

220
00:09:26.685 --> 00:09:28.725
<00:09:26.685>of <00:09:26.918>people <00:09:27.151>seeing <00:09:27.385>50 <00:09:27.618>x, <00:09:27.851>60 <00:09:28.084>x,

221
00:09:28.725 --> 00:09:32.125
<00:09:28.725>70 <00:09:28.880>x <00:09:29.036>acceleration <00:09:29.191>on <00:09:29.347>doing <00:09:29.502>this <00:09:29.658>type <00:09:29.813>of <00:09:29.969>stuff, <00:09:30.125>right?

222
00:09:32.285 --> 00:09:35.005
<00:09:32.285>Depending <00:09:32.440>on <00:09:32.596>the <00:09:32.751>size <00:09:32.907>of <00:09:33.062>the <00:09:33.218>workload, <00:09:33.373>depending <00:09:33.529>on <00:09:33.685>the,

223
00:09:35.065 --> 00:09:36.765
<00:09:35.065>the, <00:09:35.345>the <00:09:35.625>operators <00:09:35.905>that <00:09:36.185>they're <00:09:36.465>doing,

224
00:09:36.765 --> 00:09:38.045
<00:09:36.765>depending <00:09:36.957>on <00:09:37.149>their <00:09:37.341>system <00:09:37.533>that <00:09:37.725>they <00:09:37.916>have.

225
00:09:38.265 --> 00:09:40.125
<00:09:38.265>So <00:09:38.405>those <00:09:38.545>factors <00:09:38.685>come <00:09:38.824>in, <00:09:38.965>but <00:09:39.105>this <00:09:39.245>takes <00:09:39.385>care <00:09:39.525>of <00:09:39.665>it.

226
00:09:40.265 --> 00:09:43.405
<00:09:40.265>So <00:09:40.420>we're <00:09:40.576>making <00:09:40.731>it <00:09:40.887>easy <00:09:41.042>for <00:09:41.198>you <00:09:41.353>to, <00:09:41.509>to <00:09:41.665>consume,

227
00:09:43.405 --> 00:09:44.325
<00:09:43.405>take <00:09:43.681>advantage <00:09:43.957>of, <00:09:44.233>and

228
00:09:44.325 --> 00:09:45.405
<00:09:44.325>we're <00:09:44.446>trying <00:09:44.568>to <00:09:44.689>meet <00:09:44.811>you <00:09:44.932>where <00:09:45.054>you <00:09:45.175>are, <00:09:45.297>right?

229
00:09:45.405 --> 00:09:47.325
<00:09:45.405>That's <00:09:45.560>one <00:09:45.716>of <00:09:45.871>the, <00:09:46.027>meet <00:09:46.182>the <00:09:46.338>developers <00:09:46.493>where <00:09:46.649>they <00:09:46.805>are.

230
00:09:48.185 --> 00:09:50.165
<00:09:48.185>So <00:09:48.535>that's <00:09:48.885>the <00:09:49.234>accelerate <00:09:49.584>computing.

231
00:09:50.165 --> 00:09:51.245
<00:09:50.165>We <00:09:50.408>have <00:09:50.651>lots <00:09:50.894>of <00:09:51.137>libraries.

232
00:09:51.625 --> 00:09:53.725
<00:09:51.625>You <00:09:51.825>guys <00:09:52.025>can, <00:09:52.225>uh, <00:09:52.425>depending <00:09:52.625>on <00:09:52.825>whatever <00:09:53.025>domain,

233
00:09:53.725 --> 00:09:55.645
<00:09:53.725>many <00:09:54.075>domains <00:09:54.425>are <00:09:54.775>now <00:09:55.125>accelerated.

234
00:09:55.945 --> 00:09:58.885
<00:09:55.945>So <00:09:56.085>you <00:09:56.225>can <00:09:56.365>go <00:09:56.505>do <00:09:56.645>that. <00:09:56.785>Let's <00:09:56.925>talk <00:09:57.065>about <00:09:57.205>new <00:09:57.345>applications.

235
00:09:58.905 --> 00:10:00.325
<00:09:58.905>So <00:09:59.087>that's <00:09:59.270>the <00:09:59.452>second <00:09:59.635>thing <00:09:59.817>I <00:10:00.000>talk <00:10:00.183>about.

236
00:10:00.325 --> 00:10:01.805
<00:10:00.325>Two <00:10:00.769>things <00:10:01.213>accelerate <00:10:01.656>computing.

237
00:10:01.905 --> 00:10:04.325
<00:10:01.905>And <00:10:02.105>so <00:10:02.305>accelerate <00:10:02.505>computing <00:10:02.704>is <00:10:02.905>about <00:10:03.105>accelerated <00:10:03.305>libraries.

238
00:10:04.705 --> 00:10:06.245
<00:10:04.705>And <00:10:04.982>let's <00:10:05.259>talk <00:10:05.536>about <00:10:05.813>new <00:10:06.091>applications.

239
00:10:06.245 --> 00:10:07.805
<00:10:06.245>So <00:10:06.595>mention <00:10:06.945>talking <00:10:07.295>about <00:10:07.645>ai.

240
00:10:08.265 --> 00:10:11.205
<00:10:08.265>So <00:10:08.498>this <00:10:08.731>is <00:10:08.965>a <00:10:09.198>traditional <00:10:09.431>application, <00:10:09.665>right?

241
00:10:11.745 --> 00:10:15.205
<00:10:11.745>You, <00:10:11.945>there's <00:10:12.145>many, <00:10:12.345>okay, <00:10:12.545>let's <00:10:12.745>keep <00:10:12.945>it <00:10:13.145>simple.

242
00:10:15.205 --> 00:10:18.325
<00:10:15.205>There's, <00:10:15.360>what <00:10:15.516>this <00:10:15.671>application <00:10:15.827>does <00:10:15.982>is <00:10:16.138>it <00:10:16.293>loads <00:10:16.449>a <00:10:16.605>bunch

243
00:10:18.325 --> 00:10:22.245
<00:10:18.325>of <00:10:18.500>reviews <00:10:18.675>and <00:10:18.850>it <00:10:19.025>creates <00:10:19.200>a <00:10:19.375>sentiment <00:10:19.550>report, <00:10:19.725>okay?

244
00:10:22.745 --> 00:10:24.965
<00:10:22.745>Uh, <00:10:22.945>I'm <00:10:23.145>not <00:10:23.345>expecting <00:10:23.545>you <00:10:23.745>to <00:10:23.945>execute <00:10:24.145>this.

245
00:10:24.965 --> 00:10:26.525
<00:10:24.965>You're <00:10:25.140>not <00:10:25.315>gonna <00:10:25.490>cut <00:10:25.665>paste <00:10:25.840>it. <00:10:26.015>There's, <00:10:26.190>you <00:10:26.365>know,

246
00:10:26.525 --> 00:10:27.725
<00:10:26.525>there's <00:10:26.741>things <00:10:26.957>missing <00:10:27.173>and <00:10:27.389>there's <00:10:27.605>lots

247
00:10:27.725 --> 00:10:29.045
<00:10:27.725>of <00:10:27.873>no <00:10:28.022>error <00:10:28.170>handling <00:10:28.319>or <00:10:28.467>that <00:10:28.616>kind <00:10:28.764>of <00:10:28.913>stuff.

248
00:10:29.065 --> 00:10:31.045
<00:10:29.065>So <00:10:29.298>there's <00:10:29.531>just <00:10:29.765>focus <00:10:29.998>on <00:10:30.231>two <00:10:30.465>parts.

249
00:10:31.395 --> 00:10:34.245
<00:10:31.395>There's <00:10:31.745>the, <00:10:32.095>the <00:10:32.444>tooling, <00:10:32.795>right?

250
00:10:34.245 --> 00:10:35.165
<00:10:34.245>The <00:10:34.452>file <00:10:34.659>loading <00:10:34.866>and <00:10:35.073>things

251
00:10:35.165 --> 00:10:36.045
<00:10:35.165>like <00:10:35.278>that <00:10:35.391>that <00:10:35.504>you <00:10:35.617>have <00:10:35.730>to <00:10:35.843>worry <00:10:35.957>about.

252
00:10:36.045 --> 00:10:37.085
<00:10:36.045>There's <00:10:36.232>the, <00:10:36.419>in <00:10:36.606>the <00:10:36.793>main <00:10:36.981>here,

253
00:10:37.145 --> 00:10:40.365
<00:10:37.145>and <00:10:37.345>then <00:10:37.545>there's <00:10:37.745>this <00:10:37.944>function, <00:10:38.145>analyze <00:10:38.345>sentiment, <00:10:38.545>right?

254
00:10:40.545 --> 00:10:42.725
<00:10:40.545>And <00:10:40.700>the <00:10:40.856>way <00:10:41.011>that <00:10:41.167>the, <00:10:41.322>the <00:10:41.478>function's <00:10:41.633>implemented <00:10:41.789>is, <00:10:41.944>Hey,

255
00:10:42.725 --> 00:10:45.005
<00:10:42.725>I <00:10:42.880>had <00:10:43.036>to <00:10:43.191>come <00:10:43.347>up <00:10:43.502>with <00:10:43.658>a <00:10:43.813>bunch <00:10:43.969>of <00:10:44.125>keywords

256
00:10:45.265 --> 00:10:47.525
<00:10:45.265>and <00:10:45.420>then <00:10:45.576>I <00:10:45.731>gotta <00:10:45.887>think <00:10:46.042>about <00:10:46.198>them <00:10:46.353>in <00:10:46.509>different <00:10:46.665>languages.

257
00:10:47.605 --> 00:10:49.045
<00:10:47.605>I <00:10:47.749>gotta <00:10:47.893>think <00:10:48.037>about <00:10:48.181>all <00:10:48.325>these <00:10:48.468>things <00:10:48.613>and <00:10:48.757>say, <00:10:48.901>okay,

258
00:10:49.065 --> 00:10:51.125
<00:10:49.065>I'm <00:10:49.240>gonna <00:10:49.415>come <00:10:49.590>up <00:10:49.765>with <00:10:49.940>some <00:10:50.115>list <00:10:50.290>of <00:10:50.465>keywords.

259
00:10:51.265 --> 00:10:52.125
<00:10:51.265>And <00:10:51.458>some <00:10:51.652>of <00:10:51.845>these <00:10:52.039>are

260
00:10:52.405 --> 00:10:53.525
<00:10:52.405>positive <00:10:52.573>and <00:10:52.741>some <00:10:52.909>of <00:10:53.077>these <00:10:53.245>are <00:10:53.413>negative.

261
00:10:53.525 --> 00:10:54.725
<00:10:53.525>I <00:10:53.660>could <00:10:53.795>have <00:10:53.930>added <00:10:54.065>neutral <00:10:54.200>if <00:10:54.335>I <00:10:54.470>wanted <00:10:54.605>to,

262
00:10:54.745 --> 00:10:56.085
<00:10:54.745>but <00:10:55.046>kept <00:10:55.348>it <00:10:55.649>simple, <00:10:55.951>right?

263
00:10:56.085 --> 00:10:59.365
<00:10:56.085>So <00:10:56.212>it's <00:10:56.339>like, <00:10:56.466>now <00:10:56.594>if <00:10:56.721>I <00:10:56.848>find <00:10:56.975>the <00:10:57.103>word, <00:10:57.230>I'll <00:10:57.357>decide <00:10:57.485>how.

264
00:10:59.365 --> 00:11:00.485
<00:10:59.365>So <00:10:59.533>that's <00:10:59.701>how <00:10:59.869>you'd <00:11:00.037>implement <00:11:00.205>it, <00:11:00.373>right?

265
00:11:00.485 --> 00:11:04.845
<00:11:00.485>That's <00:11:00.718>traditional <00:11:00.951>what's <00:11:01.185>happening <00:11:01.418>now <00:11:01.651>with <00:11:01.885>advance

266
00:11:04.965 --> 00:11:08.485
<00:11:04.965>of <00:11:05.140>ai, <00:11:05.315>notice <00:11:05.490>nothing <00:11:05.665>changed <00:11:05.840>at <00:11:06.015>the <00:11:06.190>bottom, <00:11:06.365>right?

267
00:11:08.565 --> 00:11:09.645
<00:11:08.565>I <00:11:08.703>still <00:11:08.842>have <00:11:08.981>to <00:11:09.120>do <00:11:09.259>all <00:11:09.398>the <00:11:09.537>tooling.

268
00:11:09.645 --> 00:11:10.925
<00:11:09.645>I <00:11:09.789>still <00:11:09.933>have <00:11:10.077>to <00:11:10.221>do <00:11:10.365>all <00:11:10.509>that <00:11:10.652>work, <00:11:10.796>right?

269
00:11:10.925 --> 00:11:12.605
<00:11:10.925>Developers <00:11:11.099>still <00:11:11.275>have <00:11:11.449>a <00:11:11.625>bunch <00:11:11.800>of <00:11:11.974>work <00:11:12.150>to <00:11:12.324>do.

270
00:11:12.825 --> 00:11:15.045
<00:11:12.825>The <00:11:12.965>difference <00:11:13.105>is <00:11:13.245>now <00:11:13.385>my <00:11:13.525>thinking <00:11:13.665>has <00:11:13.805>changed <00:11:13.945>in <00:11:14.085>that <00:11:14.225>my

271
00:11:15.725 --> 00:11:20.325
<00:11:15.725>function <00:11:15.841>can <00:11:15.958>now <00:11:16.075>be, <00:11:16.191>I <00:11:16.308>can <00:11:16.425>prompt <00:11:16.541>an <00:11:16.658>LLM <00:11:16.775>to <00:11:16.891>help <00:11:17.008>me <00:11:17.125>with

272
00:11:20.325 --> 00:11:21.765
<00:11:20.325>that <00:11:20.973>function, <00:11:21.621>right?

273
00:11:21.995 --> 00:11:26.935
<00:11:21.995>So <00:11:22.228>now <00:11:22.461>my <00:11:22.695>logic <00:11:22.928>is <00:11:23.161>differently <00:11:23.395>thought

274
00:11:26.935 --> 00:11:31.455
<00:11:26.935>of, <00:11:27.074>but <00:11:27.214>the <00:11:27.354>thing <00:11:27.494>is, <00:11:27.635>I'm <00:11:27.775>still <00:11:27.915>expressing <00:11:28.055>that <00:11:28.194>logic <00:11:28.334>in

275
00:11:32.015 --> 00:11:34.175
<00:11:32.015>a, <00:11:32.295>in <00:11:32.574>just <00:11:32.855>plain <00:11:33.135>English, <00:11:33.415>right?

276
00:11:34.555 --> 00:11:36.335
<00:11:34.555>I'm, <00:11:34.755>and <00:11:34.954>to <00:11:35.155>be <00:11:35.354>a <00:11:35.555>good, <00:11:35.755>you <00:11:35.954>know,

277
00:11:36.335 --> 00:11:37.775
<00:11:36.335>to <00:11:36.659>some <00:11:36.983>prompting <00:11:37.307>tips, <00:11:37.631>right?

278
00:11:37.775 --> 00:11:39.815
<00:11:37.775>You <00:11:37.949>wanna <00:11:38.125>be <00:11:38.300>very, <00:11:38.475>you <00:11:38.650>wanna <00:11:38.824>be <00:11:39.000>very <00:11:39.175>descriptive.

279
00:11:39.875 --> 00:11:42.455
<00:11:39.875>You <00:11:40.108>wanna <00:11:40.341>provide <00:11:40.575>context, <00:11:40.808>maybe <00:11:41.041>a <00:11:41.275>persona.

280
00:11:43.035 --> 00:11:45.255
<00:11:43.035>You <00:11:43.314>wanna <00:11:43.594>give <00:11:43.875>very <00:11:44.155>precise <00:11:44.435>instructions.

281
00:11:45.255 --> 00:11:48.095
<00:11:45.255>You <00:11:45.410>want <00:11:45.566>the <00:11:45.721>output. <00:11:45.877>Like <00:11:46.032>that's <00:11:46.188>all <00:11:46.343>the <00:11:46.499>same <00:11:46.655>type

282
00:11:48.095 --> 00:11:51.175
<00:11:48.095>of <00:11:48.270>thinking <00:11:48.445>as <00:11:48.620>a <00:11:48.795>developer <00:11:48.970>you've <00:11:49.145>had <00:11:49.320>to <00:11:49.495>do

283
00:11:51.175 --> 00:11:52.175
<00:11:51.175>for <00:11:51.400>a <00:11:51.625>really <00:11:51.849>long <00:11:52.074>time.

284
00:11:52.175 --> 00:11:55.005
<00:11:52.175>You're <00:11:52.349>just <00:11:52.525>applying <00:11:52.699>it <00:11:52.875>now <00:11:53.050>in <00:11:53.224>a <00:11:53.400>different <00:11:53.574>language,

285
00:11:55.005 --> 00:11:56.125
<00:11:55.005>which <00:11:55.257>happens <00:11:55.509>to <00:11:55.761>be <00:11:56.013>English.

286
00:11:56.185 --> 00:11:57.725
<00:11:56.185>The <00:11:56.462>challenge <00:11:56.739>is <00:11:57.016>actually, <00:11:57.293>it's <00:11:57.571>harder

287
00:11:57.725 --> 00:12:01.935
<00:11:57.725>because <00:11:57.900>English <00:11:58.075>isn't <00:11:58.250>as, <00:11:58.425>um, <00:11:58.600>as <00:11:58.775>dis <00:11:58.950>as <00:11:59.125>as,

288
00:12:01.955 --> 00:12:03.575
<00:12:01.955>uh, <00:12:02.655>discreet, <00:12:03.355>right?

289
00:12:03.575 --> 00:12:07.895
<00:12:03.575>You <00:12:03.675>have <00:12:03.775>a <00:12:03.875>lot <00:12:03.975>of, <00:12:04.075>uh, <00:12:04.175>what <00:12:04.275>is, <00:12:04.375>uh, <00:12:04.475>you <00:12:04.575>have <00:12:04.675>a <00:12:04.775>lot <00:12:04.875>of <00:12:04.975>ways

290
00:12:07.895 --> 00:12:11.965
<00:12:07.895>that <00:12:08.069>you <00:12:08.245>can <00:12:08.420>go, <00:12:08.595>you <00:12:08.770>know, <00:12:08.944>not <00:12:09.120>exactly <00:12:09.295>precise.

291
00:12:11.965 --> 00:12:14.285
<00:12:11.965>It's <00:12:12.081>not <00:12:12.198>as <00:12:12.315>precise. <00:12:12.431>And <00:12:12.548>so <00:12:12.665>you <00:12:12.781>have <00:12:12.898>to <00:12:13.015>ar <00:12:13.131>you <00:12:13.248>actually <00:12:13.365>have

292
00:12:14.285 --> 00:12:15.565
<00:12:14.285>to <00:12:14.429>add <00:12:14.573>more, <00:12:14.717>you <00:12:14.861>have <00:12:15.005>to <00:12:15.149>add <00:12:15.293>more <00:12:15.437>tooling.

293
00:12:15.665 --> 00:12:18.245
<00:12:15.665>You <00:12:15.805>have <00:12:15.944>to <00:12:16.084>add <00:12:16.224>guardrails, <00:12:16.365>you <00:12:16.505>have <00:12:16.645>to <00:12:16.785>add <00:12:16.925>other <00:12:17.064>things

294
00:12:18.245 --> 00:12:19.565
<00:12:18.245>that <00:12:18.443>you <00:12:18.641>need <00:12:18.839>to <00:12:19.037>do <00:12:19.235>around <00:12:19.433>it.

295
00:12:19.745 --> 00:12:22.405
<00:12:19.745>And <00:12:19.885>then, <00:12:20.025>um, <00:12:20.165>actually <00:12:20.305>I'm <00:12:20.445>gonna <00:12:20.585>lift, <00:12:20.725>I'm <00:12:20.865>gonna <00:12:21.005>leave <00:12:21.145>the,

296
00:12:22.465 --> 00:12:24.685
<00:12:22.465>the <00:12:22.745>cloud <00:12:23.025>stuff <00:12:23.305>for <00:12:23.585>a <00:12:23.865>second.

297
00:12:24.715 --> 00:12:25.645
<00:12:24.715>I'll <00:12:24.882>come <00:12:25.049>back <00:12:25.217>to <00:12:25.384>that. <00:12:25.552>But

298
00:12:25.645 --> 00:12:26.485
<00:12:25.645>let <00:12:25.752>me, <00:12:25.861>let <00:12:25.969>me <00:12:26.077>give <00:12:26.185>you <00:12:26.293>an <00:12:26.401>example.

299
00:12:26.485 --> 00:12:29.035
<00:12:26.485>Okay? <00:12:27.185>Let, <00:12:27.885>and,

300
00:12:29.035 --> 00:12:31.995
<00:12:29.035>and <00:12:29.190>then <00:12:29.346>that <00:12:29.501>was <00:12:29.657>one <00:12:29.812>function, <00:12:29.968>like <00:12:30.123>the <00:12:30.279>summarize <00:12:30.435>function.

301
00:12:32.535 --> 00:12:35.075
<00:12:32.535>You <00:12:32.709>also <00:12:32.885>have <00:12:33.060>to <00:12:33.235>apply <00:12:33.410>judgment. <00:12:33.584>That <00:12:33.760>summarized <00:12:33.935>function.

302
00:12:35.195 --> 00:12:38.495
<00:12:35.195>I <00:12:35.370>could <00:12:35.545>have, <00:12:35.720>uh, <00:12:35.895>I <00:12:36.070>could <00:12:36.245>do <00:12:36.420>another <00:12:36.595>prompt,

303
00:12:38.915 --> 00:12:40.215
<00:12:38.915>or <00:12:39.110>if <00:12:39.305>I'm <00:12:39.500>just <00:12:39.695>doing <00:12:39.890>simple <00:12:40.085>math,

304
00:12:40.215 --> 00:12:41.295
<00:12:40.215>I'll <00:12:40.377>just <00:12:40.539>use <00:12:40.701>the <00:12:40.863>simple <00:12:41.025>math, <00:12:41.187>right?

305
00:12:41.315 --> 00:12:42.575
<00:12:41.315>I'm <00:12:41.504>not <00:12:41.693>gonna <00:12:41.882>do <00:12:42.071>another <00:12:42.260>prompt <00:12:42.449>for

306
00:12:42.575 --> 00:12:43.815
<00:12:42.575>the <00:12:42.761>summarize, <00:12:42.947>'cause <00:12:43.133>I <00:12:43.319>don't <00:12:43.505>need <00:12:43.691>that.

307
00:12:44.555 --> 00:12:46.415
<00:12:44.555>But <00:12:44.710>what's <00:12:44.866>also <00:12:45.021>happening <00:12:45.177>is <00:12:45.332>now <00:12:45.488>you're <00:12:45.643>able <00:12:45.799>to <00:12:45.954>take

308
00:12:47.375 --> 00:12:50.735
<00:12:47.375>multiple <00:12:47.575>language <00:12:47.775>models <00:12:47.975>or <00:12:48.175>other <00:12:48.375>things, <00:12:48.575>AI <00:12:48.775>models

309
00:12:50.795 --> 00:12:52.975
<00:12:50.795>and <00:12:51.074>put <00:12:51.354>them <00:12:51.635>together <00:12:51.915>as <00:12:52.194>functions

310
00:12:53.435 --> 00:12:54.935
<00:12:53.435>to <00:12:53.885>compose <00:12:54.334>an <00:12:54.785>application.

311
00:12:55.435 --> 00:12:57.695
<00:12:55.435>And <00:12:55.609>what's <00:12:55.785>great, <00:12:55.959>now <00:12:56.135>you're <00:12:56.310>able <00:12:56.484>to <00:12:56.660>do <00:12:56.834>things

312
00:12:57.695 --> 00:13:00.015
<00:12:57.695>that <00:12:57.975>were <00:12:58.255>just <00:12:58.535>like, <00:12:58.815>not <00:12:59.095>possible.

313
00:13:00.095 --> 00:13:01.455
<00:13:00.095>I <00:13:00.339>couldn't <00:13:00.584>imagine <00:13:00.829>this <00:13:01.074>being <00:13:01.319>possible.

314
00:13:01.635 --> 00:13:02.775
<00:13:01.635>So <00:13:01.806>lemme <00:13:01.977>give <00:13:02.148>you <00:13:02.319>an <00:13:02.490>example <00:13:02.661>here.

315
00:13:03.035 --> 00:13:04.975
<00:13:03.035>So <00:13:03.190>I'm <00:13:03.346>trying <00:13:03.501>to <00:13:03.657>figure <00:13:03.812>out <00:13:03.968>if <00:13:04.123>I <00:13:04.279>play <00:13:04.435>this

316
00:13:04.975 --> 00:13:06.855
<00:13:04.975>or, <00:13:05.208>okay, <00:13:05.441>what, <00:13:05.675>what <00:13:05.908>you're <00:13:06.141>looking <00:13:06.375>at.

317
00:13:06.885 --> 00:13:08.095
<00:13:06.885>I'll <00:13:07.040>just <00:13:07.196>give <00:13:07.351>you <00:13:07.507>a <00:13:07.662>quick, <00:13:07.818>quick <00:13:07.974>hint.

318
00:13:08.095 --> 00:13:09.495
<00:13:08.095>There's <00:13:08.305>a <00:13:08.515>lot <00:13:08.725>going <00:13:08.935>on <00:13:09.145>here. <00:13:09.355>Okay?

319
00:13:09.685 --> 00:13:13.055
<00:13:09.685>This <00:13:09.885>is <00:13:10.084>a <00:13:10.285>simple <00:13:10.484>application <00:13:10.685>that, <00:13:10.885>um, <00:13:11.084>one

320
00:13:13.055 --> 00:13:15.295
<00:13:13.055>of <00:13:13.229>the <00:13:13.405>dev <00:13:13.579>ads <00:13:13.755>advocates <00:13:13.930>on <00:13:14.104>our <00:13:14.280>team <00:13:14.454>built.

321
00:13:15.315 --> 00:13:16.695
<00:13:15.315>You <00:13:15.492>guys <00:13:15.669>can <00:13:15.847>get <00:13:16.024>your <00:13:16.202>hands <00:13:16.379>on <00:13:16.557>it,

322
00:13:16.915 --> 00:13:18.655
<00:13:16.915>but <00:13:17.148>what <00:13:17.381>you're <00:13:17.615>at <00:13:17.848>the <00:13:18.081>bottom <00:13:18.314>right?

323
00:13:18.655 --> 00:13:22.375
<00:13:18.655>You <00:13:18.795>have <00:13:18.935>the <00:13:19.074>video <00:13:19.214>output <00:13:19.355>and <00:13:19.495>there's <00:13:19.635>a <00:13:19.775>camera <00:13:19.915>coming <00:13:20.055>in.

324
00:13:22.375 --> 00:13:23.535
<00:13:22.375>And <00:13:22.491>what <00:13:22.607>you're <00:13:22.723>trying <00:13:22.839>to <00:13:22.954>do <00:13:23.071>is <00:13:23.187>you're <00:13:23.303>saying, <00:13:23.419>Hey,

325
00:13:23.555 --> 00:13:24.655
<00:13:23.555>I'm <00:13:23.802>gonna <00:13:24.050>monitor <00:13:24.297>the <00:13:24.545>streets,

326
00:13:24.875 --> 00:13:26.815
<00:13:24.875>and <00:13:25.030>when <00:13:25.186>the <00:13:25.341>school <00:13:25.497>bus <00:13:25.652>is <00:13:25.808>coming <00:13:25.963>in <00:13:26.119>the <00:13:26.275>morning,

327
00:13:26.845 --> 00:13:28.375
<00:13:26.845>it's <00:13:27.017>gonna <00:13:27.189>tell <00:13:27.361>me, <00:13:27.533>Hey, <00:13:27.705>school <00:13:27.877>bus <00:13:28.049>is <00:13:28.222>coming.

328
00:13:28.915 --> 00:13:31.495
<00:13:28.915>So <00:13:29.115>I'll, <00:13:29.314>I'll, <00:13:29.515>I'll, <00:13:29.714>I'll <00:13:29.915>play <00:13:30.115>it <00:13:30.314>then

329
00:13:31.495 --> 00:13:32.655
<00:13:31.495>and <00:13:31.669>I'll <00:13:31.843>talk <00:13:32.016>over <00:13:32.191>some <00:13:32.365>of <00:13:32.539>it.

330
00:13:32.955 --> 00:13:36.925
<00:13:32.955>But <00:13:34.355>we

331
00:13:36.925 --> 00:13:38.205
<00:13:36.925>don't <00:13:37.213>practice <00:13:37.501>these <00:13:37.789>things, <00:13:38.077>okay?

332
00:13:38.205 --> 00:13:40.165
<00:13:38.205>Yeah. <00:13:38.345>So <00:13:38.485>what <00:13:38.625>you <00:13:38.765>have <00:13:38.905>is <00:13:39.045>the <00:13:39.185>video <00:13:39.325>source <00:13:39.465>coming <00:13:39.605>in.

333
00:13:40.555 --> 00:13:42.365
<00:13:40.555>It's <00:13:40.834>going <00:13:41.114>into <00:13:41.395>this <00:13:41.675>villa <00:13:41.954>model.

334
00:13:42.365 --> 00:13:44.765
<00:13:42.365>What <00:13:42.505>the <00:13:42.645>villa <00:13:42.785>model <00:13:42.925>does, <00:13:43.065>it's <00:13:43.205>a <00:13:43.345>model <00:13:43.485>morning <00:13:43.625>that <00:13:43.765>was

335
00:13:45.465 --> 00:13:47.405
<00:13:45.465>The <00:13:45.815>school <00:13:46.165>bus <00:13:46.515>is <00:13:46.865>approaching,

336
00:13:48.065 --> 00:13:50.285
<00:13:48.065>Uh, <00:13:48.298>a <00:13:48.531>vision <00:13:48.765>language <00:13:48.998>model <00:13:49.231>developed <00:13:49.465>in

337
00:13:50.485 --> 00:13:51.805
<00:13:50.485>collaboration <00:13:51.079>with <00:13:51.673>MIT.

338
00:13:51.805 --> 00:13:54.605
<00:13:51.805>So <00:13:51.960>MIT <00:13:52.116>and <00:13:52.271>Nvidia. <00:13:52.427>It <00:13:52.582>provides <00:13:52.738>a, <00:13:52.893>a <00:13:53.049>text <00:13:53.204>output.

339
00:13:54.715 --> 00:13:57.365
<00:13:54.715>That <00:13:54.855>text <00:13:54.995>output <00:13:55.135>is <00:13:55.275>put <00:13:55.415>on <00:13:55.555>the <00:13:55.695>overlay <00:13:55.835>warning, <00:13:55.975>but <00:13:56.115>it's

340
00:13:58.025 --> 00:14:00.725
<00:13:58.025>The <00:13:58.199>school <00:13:58.375>bus <00:13:58.550>is <00:13:58.725>currently <00:13:58.900>driving <00:13:59.074>down <00:13:59.250>the <00:13:59.425>street.

341
00:14:01.855 --> 00:14:05.345
<00:14:01.855>That <00:14:02.088>information <00:14:02.321>then <00:14:02.555>goes <00:14:02.788>into <00:14:03.021>this <00:14:03.255>yellow

342
00:14:05.345 --> 00:14:07.465
<00:14:05.345>School <00:14:05.578>bus <00:14:05.811>is <00:14:06.045>driving <00:14:06.278>down <00:14:06.511>the <00:14:06.745>street.

343
00:14:08.125 --> 00:14:09.745
<00:14:08.125>So <00:14:08.358>that <00:14:08.591>goes <00:14:08.825>into <00:14:09.058>this <00:14:09.291>Hermes <00:14:09.525>model.

344
00:14:10.205 --> 00:14:12.385
<00:14:10.205>And <00:14:10.405>that <00:14:10.605>Hermes <00:14:10.805>model <00:14:11.005>is <00:14:11.205>actually <00:14:11.405>an <00:14:11.605>LLM

345
00:14:12.385 --> 00:14:13.545
<00:14:12.385>that <00:14:12.559>knows <00:14:12.733>how <00:14:12.906>to <00:14:13.081>use <00:14:13.255>the <00:14:13.429>tools.

346
00:14:14.895 --> 00:14:16.275
<00:14:14.895>So <00:14:15.143>you <00:14:15.391>give <00:14:15.640>it <00:14:15.888>the <00:14:16.137>tool

347
00:14:16.735 --> 00:14:19.235
<00:14:16.735>and <00:14:16.890>you <00:14:17.046>say, <00:14:17.201>Hey, <00:14:17.357>when <00:14:17.512>you <00:14:17.668>see <00:14:17.823>a <00:14:17.979>school <00:14:18.135>bus,

348
00:14:19.295 --> 00:14:20.515
<00:14:19.295>do <00:14:19.661>the <00:14:20.026>notification <00:14:20.393>tool,

349
00:14:20.775 --> 00:14:22.395
<00:14:20.775>or <00:14:20.975>actually <00:14:21.175>no, <00:14:21.375>you <00:14:21.574>say <00:14:21.775>use, <00:14:21.975>you <00:14:22.175>connected.

350
00:14:22.855 --> 00:14:25.315
<00:14:22.855>The <00:14:23.030>school <00:14:23.205>bus <00:14:23.380>is <00:14:23.555>currently <00:14:23.730>driving <00:14:23.905>down <00:14:24.080>the <00:14:24.255>street,

351
00:14:26.415 --> 00:14:27.605
<00:14:26.415>Right? <00:14:26.771>Super <00:14:27.129>simple. <00:14:27.486>The

352
00:14:27.605 --> 00:14:28.405
<00:14:27.605>School <00:14:27.845>bus <00:14:28.085>with <00:14:28.324>number

353
00:14:28.405 --> 00:14:30.965
<00:14:28.405>seven, <00:14:28.638>a <00:14:28.871>hundred <00:14:29.105>seventy <00:14:29.338>two <00:14:29.571>is <00:14:29.805>approaching,

354
00:14:33.555 --> 00:14:34.965
<00:14:33.555>Yeah, <00:14:33.978>super <00:14:34.401>simple, <00:14:34.824>right?

355
00:14:34.965 --> 00:14:36.485
<00:14:34.965>Like, <00:14:35.136>it <00:14:35.307>looks <00:14:35.478>like <00:14:35.649>a <00:14:35.820>very <00:14:35.991>simple, <00:14:36.162>it's <00:14:36.333>a,

356
00:14:36.485 --> 00:14:38.445
<00:14:36.485>it's <00:14:36.685>a <00:14:36.885>very <00:14:37.085>simple <00:14:37.285>but <00:14:37.485>very <00:14:37.685>capable <00:14:37.885>application.

357
00:14:38.445 --> 00:14:40.365
<00:14:38.445>Now <00:14:38.600>think <00:14:38.756>about <00:14:38.911>how <00:14:39.067>would <00:14:39.222>you <00:14:39.378>have <00:14:39.533>written <00:14:39.689>an <00:14:39.845>application

358
00:14:40.365 --> 00:14:44.295
<00:14:40.365>like <00:14:40.831>that <00:14:41.298>traditionally, <00:14:41.765>right?

359
00:14:44.445 --> 00:14:46.415
<00:14:44.445>It's <00:14:44.620>not, <00:14:44.795>but <00:14:44.970>now <00:14:45.145>you're <00:14:45.320>able <00:14:45.495>to <00:14:45.670>do <00:14:45.845>it.

360
00:14:46.415 --> 00:14:48.495
<00:14:46.415>In <00:14:46.531>fact, <00:14:46.648>you <00:14:46.765>can <00:14:46.881>do <00:14:46.998>it <00:14:47.115>with <00:14:47.231>a <00:14:47.348>no <00:14:47.464>no-code <00:14:47.581>interface <00:14:47.698>as <00:14:47.814>well.

361
00:14:49.035 --> 00:14:51.205
<00:14:49.035>So, <00:14:49.314>got <00:14:49.594>the <00:14:49.875>video <00:14:50.155>coming <00:14:50.435>in,

362
00:14:51.225 --> 00:14:52.605
<00:14:51.225>you're <00:14:51.535>doing <00:14:51.846>some <00:14:52.156>overlay <00:14:52.467>stuff,

363
00:14:52.625 --> 00:14:54.085
<00:14:52.625>but <00:14:52.789>you're <00:14:52.953>sending, <00:14:53.117>the, <00:14:53.282>the <00:14:53.446>thing <00:14:53.610>I <00:14:53.774>was <00:14:53.939>trying

364
00:14:54.085 --> 00:14:56.845
<00:14:54.085>to <00:14:54.240>get <00:14:54.396>at <00:14:54.551>is <00:14:54.707>you're <00:14:54.862>taking <00:14:55.018>the <00:14:55.173>output <00:14:55.329>from <00:14:55.485>the,

365
00:14:57.425 --> 00:14:58.805
<00:14:57.425>the <00:14:57.673>computer <00:14:57.921>vision <00:14:58.170>model <00:14:58.418>that <00:14:58.666>kind

366
00:14:58.805 --> 00:14:59.925
<00:14:58.805>of <00:14:59.006>identifies <00:14:59.208>what's <00:14:59.409>going <00:14:59.611>on <00:14:59.813>there.

367
00:15:00.025 --> 00:15:01.965
<00:15:00.025>You're <00:15:00.258>sending <00:15:00.491>it <00:15:00.725>to <00:15:00.958>another <00:15:01.191>language <00:15:01.425>model.

368
00:15:01.965 --> 00:15:05.845
<00:15:01.965>So <00:15:02.105>I <00:15:02.245>got <00:15:02.385>two <00:15:02.525>ais <00:15:02.665>that <00:15:02.805>are <00:15:02.945>working <00:15:03.085>together <00:15:03.225>that <00:15:03.365>then

369
00:15:06.635 --> 00:15:09.045
<00:15:06.635>decides <00:15:06.835>that, <00:15:07.035>hey, <00:15:07.235>I'm <00:15:07.435>gonna <00:15:07.635>call <00:15:07.835>a <00:15:08.035>tool.

370
00:15:09.235 --> 00:15:10.525
<00:15:09.235>There's <00:15:09.622>a <00:15:10.009>notification <00:15:10.396>tool.

371
00:15:10.525 --> 00:15:12.765
<00:15:10.525>So <00:15:10.680>that <00:15:10.836>language <00:15:10.991>model <00:15:11.147>has <00:15:11.302>actually <00:15:11.458>been <00:15:11.613>optimized, <00:15:11.769>is, <00:15:11.925>uh,

372
00:15:12.785 --> 00:15:13.845
<00:15:12.785>is <00:15:13.023>good <00:15:13.262>at <00:15:13.500>calling <00:15:13.739>tools.

373
00:15:13.985 --> 00:15:15.125
<00:15:13.985>And <00:15:14.113>it <00:15:14.241>says, <00:15:14.369>when <00:15:14.498>I <00:15:14.626>see <00:15:14.754>a <00:15:14.882>school <00:15:15.011>bus,

374
00:15:15.145 --> 00:15:16.485
<00:15:15.145>I'm <00:15:15.386>gonna <00:15:15.627>call <00:15:15.868>this <00:15:16.109>notification <00:15:16.351>tool.

375
00:15:16.905 --> 00:15:18.765
<00:15:16.905>And <00:15:17.105>then <00:15:17.305>the <00:15:17.505>notification <00:15:17.704>tool, <00:15:17.905>the <00:15:18.105>output <00:15:18.305>of

376
00:15:18.765 --> 00:15:21.845
<00:15:18.765>that <00:15:18.905>is <00:15:19.045>put <00:15:19.185>into <00:15:19.324>another <00:15:19.465>language <00:15:19.605>model <00:15:19.745>that <00:15:19.885>takes <00:15:20.025>the <00:15:20.165>text.

377
00:15:22.445 --> 00:15:23.805
<00:15:22.445>'cause <00:15:22.649>the <00:15:22.853>notification <00:15:23.057>comes <00:15:23.261>out <00:15:23.464>as <00:15:23.669>text

378
00:15:23.805 --> 00:15:25.925
<00:15:23.805>and <00:15:23.979>then <00:15:24.155>it <00:15:24.329>does <00:15:24.505>a <00:15:24.680>text <00:15:24.854>to <00:15:25.030>speech <00:15:25.204>translation.

379
00:15:25.925 --> 00:15:27.605
<00:15:25.925>So <00:15:26.125>you <00:15:26.324>can <00:15:26.525>hear <00:15:26.724>what <00:15:26.925>it's <00:15:27.125>saying, <00:15:27.324>right?

380
00:15:27.615 --> 00:15:28.885
<00:15:27.615>Think <00:15:27.843>about, <00:15:28.072>just <00:15:28.300>think <00:15:28.529>about <00:15:28.758>all

381
00:15:28.885 --> 00:15:30.005
<00:15:28.885>the <00:15:29.086>different <00:15:29.288>things <00:15:29.489>that <00:15:29.691>are <00:15:29.893>happening.

382
00:15:30.005 --> 00:15:31.845
<00:15:30.005>You're <00:15:30.285>composing <00:15:30.564>this <00:15:30.845>together, <00:15:31.125>but <00:15:31.405>many

383
00:15:31.845 --> 00:15:33.045
<00:15:31.845>of <00:15:32.061>you <00:15:32.277>here <00:15:32.492>are <00:15:32.709>cloud <00:15:32.925>engineers.

384
00:15:33.045 --> 00:15:34.645
<00:15:33.045>You <00:15:33.185>guys <00:15:33.324>are <00:15:33.464>working <00:15:33.604>on <00:15:33.745>Kubernetes, <00:15:33.885>you <00:15:34.025>guys <00:15:34.165>are <00:15:34.305>doing <00:15:34.444>all,

385
00:15:34.745 --> 00:15:36.245
<00:15:34.745>all <00:15:35.082>this <00:15:35.420>stuff <00:15:35.757>already, <00:15:36.095>right?

386
00:15:37.265 --> 00:15:38.485
<00:15:37.265>So <00:15:37.814>you <00:15:38.363>kind

387
00:15:38.485 --> 00:15:40.285
<00:15:38.485>of <00:15:38.835>have <00:15:39.185>these <00:15:39.535>composable <00:15:39.885>distributed

388
00:15:40.285 --> 00:15:42.445
<00:15:40.285>applications <00:15:40.751>for <00:15:41.218>that <00:15:41.685>application.

389
00:15:42.445 --> 00:15:44.005
<00:15:42.445>You <00:15:42.600>guys <00:15:42.756>can <00:15:42.911>try <00:15:43.067>it <00:15:43.222>out. <00:15:43.378>If <00:15:43.533>you <00:15:43.689>go <00:15:43.845>to

390
00:15:44.745 --> 00:15:49.485
<00:15:44.745>jetson-ai-lab.com, <00:15:44.945>we <00:15:45.145>have <00:15:45.345>a <00:15:45.545>whole <00:15:45.745>bunch <00:15:45.945>of <00:15:46.145>tutorials.

391
00:15:49.585 --> 00:15:50.685
<00:15:49.585>So <00:15:49.726>if <00:15:49.867>you <00:15:50.009>wanna <00:15:50.150>play <00:15:50.292>with <00:15:50.433>this <00:15:50.574>stuff

392
00:15:50.685 --> 00:15:52.765
<00:15:50.685>and <00:15:50.824>you <00:15:50.964>wanna <00:15:51.104>get <00:15:51.244>your <00:15:51.385>hands <00:15:51.525>dirty, <00:15:51.665>you <00:15:51.805>guys <00:15:51.944>can <00:15:52.084>go,

393
00:15:52.785 --> 00:15:53.885
<00:15:52.785>go <00:15:53.032>get <00:15:53.280>this <00:15:53.527>over <00:15:53.775>there.

394
00:15:54.635 --> 00:15:57.165
<00:15:54.635>Okay? <00:15:54.868>Um, <00:15:55.101>and <00:15:55.335>that's <00:15:55.568>called <00:15:55.801>agent <00:15:56.035>studio.

395
00:15:58.225 --> 00:16:00.965
<00:15:58.225>But <00:15:58.400>like <00:15:58.575>I <00:15:58.750>was <00:15:58.925>saying, <00:15:59.100>applications <00:15:59.275>are <00:15:59.450>cloud <00:15:59.625>applications,

396
00:16:00.965 --> 00:16:02.245
<00:16:00.965>they're <00:16:01.541>distributed <00:16:02.117>applications.

397
00:16:02.245 --> 00:16:04.045
<00:16:02.245>You <00:16:02.420>have <00:16:02.595>containers <00:16:02.770>running <00:16:02.945>in <00:16:03.120>lots <00:16:03.295>of <00:16:03.470>different <00:16:03.645>places.

398
00:16:04.585 --> 00:16:07.565
<00:16:04.585>And <00:16:04.740>so <00:16:04.896>we <00:16:05.051>Nvidia, <00:16:05.207>again, <00:16:05.362>back <00:16:05.518>to <00:16:05.673>the <00:16:05.829>library's <00:16:05.985>idea

399
00:16:07.565 --> 00:16:08.605
<00:16:07.565>where <00:16:07.752>we <00:16:07.939>go <00:16:08.126>and <00:16:08.313>we <00:16:08.501>invest

400
00:16:08.625 --> 00:16:12.245
<00:16:08.625>and <00:16:08.765>we <00:16:08.905>make <00:16:09.045>sure <00:16:09.185>that <00:16:09.325>you're <00:16:09.465>able <00:16:09.605>to <00:16:09.745>access <00:16:09.885>Nvidia, <00:16:10.025>uh,

401
00:16:12.395 --> 00:16:15.005
<00:16:12.395>comp <00:16:12.675>accelerated <00:16:12.954>computing <00:16:13.235>through <00:16:13.515>whatever <00:16:13.795>kind

402
00:16:15.005 --> 00:16:17.125
<00:16:15.005>of <00:16:15.355>application <00:16:15.705>environment, <00:16:16.055>application <00:16:16.405>deployment,

403
00:16:17.355 --> 00:16:19.365
<00:16:17.355>development <00:16:17.635>and <00:16:17.915>deployment <00:16:18.195>environment <00:16:18.475>you're <00:16:18.755>using.

404
00:16:19.785 --> 00:16:22.085
<00:16:19.785>We <00:16:19.940>invest <00:16:20.096>in <00:16:20.251>these <00:16:20.407>things, <00:16:20.562>right? <00:16:20.718>We <00:16:20.873>optimize <00:16:21.029>these <00:16:21.185>models.

405
00:16:22.085 --> 00:16:23.805
<00:16:22.085>So <00:16:22.318>you <00:16:22.551>got <00:16:22.785>these, <00:16:23.018>uh, <00:16:23.251>AI <00:16:23.485>models.

406
00:16:24.025 --> 00:16:25.285
<00:16:24.025>We <00:16:24.214>optimize <00:16:24.403>a <00:16:24.592>whole <00:16:24.781>bunch <00:16:24.970>of <00:16:25.159>'em.

407
00:16:25.285 --> 00:16:27.525
<00:16:25.285>We <00:16:25.440>continue <00:16:25.596>to <00:16:25.751>optimize <00:16:25.907>'em, <00:16:26.062>we <00:16:26.218>optimize <00:16:26.373>them <00:16:26.529>with <00:16:26.685>CDNN,

408
00:16:27.525 --> 00:16:28.765
<00:16:27.525>with <00:16:28.083>tensor <00:16:28.641>rt.

409
00:16:29.105 --> 00:16:30.485
<00:16:29.105>We <00:16:29.353>optimize <00:16:29.601>the <00:16:29.850>training <00:16:30.098>of <00:16:30.347>them,

410
00:16:30.485 --> 00:16:31.765
<00:16:30.485>but <00:16:30.715>also <00:16:30.945>the <00:16:31.176>deployment <00:16:31.406>of <00:16:31.637>them.

411
00:16:32.185 --> 00:16:35.805
<00:16:32.185>We <00:16:32.340>do <00:16:32.496>a <00:16:32.651>bunch <00:16:32.807>of <00:16:32.962>work <00:16:33.118>in, <00:16:33.273>uh, <00:16:33.429>model <00:16:33.584>serving.

412
00:16:36.065 --> 00:16:38.805
<00:16:36.065>So <00:16:36.265>remember <00:16:36.465>I, <00:16:36.665>there <00:16:36.865>are <00:16:37.065>the <00:16:37.265>AI <00:16:37.465>model,

413
00:16:38.805 --> 00:16:40.285
<00:16:38.805>but <00:16:38.971>there's <00:16:39.137>a <00:16:39.304>whole <00:16:39.471>lot <00:16:39.637>of <00:16:39.804>tooling <00:16:39.970>around <00:16:40.137>it.

414
00:16:40.345 --> 00:16:43.165
<00:16:40.345>We <00:16:40.695>have <00:16:41.045>oftentimes <00:16:41.395>these <00:16:41.745>models

415
00:16:43.265 --> 00:16:45.445
<00:16:43.265>before <00:16:43.498>they <00:16:43.731>need, <00:16:43.965>they <00:16:44.198>get <00:16:44.431>the <00:16:44.665>input.

416
00:16:45.445 --> 00:16:47.005
<00:16:45.445>There's <00:16:45.678>a <00:16:45.911>bunch <00:16:46.145>of <00:16:46.378>pre-processing <00:16:46.611>that <00:16:46.845>happens.

417
00:16:47.005 --> 00:16:48.285
<00:16:47.005>There's <00:16:47.293>a <00:16:47.581>bunch <00:16:47.869>of <00:16:48.156>post-processing.

418
00:16:48.325 --> 00:16:49.565
<00:16:48.325>I <00:16:48.464>didn't <00:16:48.604>talk <00:16:48.743>about <00:16:48.883>it <00:16:49.022>in <00:16:49.162>the <00:16:49.301>other <00:16:49.441>application,

419
00:16:49.565 --> 00:16:50.725
<00:16:49.565>but <00:16:49.826>there <00:16:50.087>was <00:16:50.348>rate <00:16:50.609>limiters.

420
00:16:50.725 --> 00:16:53.285
<00:16:50.725>All <00:16:50.880>these <00:16:51.036>things <00:16:51.191>that <00:16:51.347>get <00:16:51.502>put <00:16:51.658>in <00:16:51.813>there <00:16:51.969>to <00:16:52.125>tooling.

421
00:16:53.485 --> 00:16:54.485
<00:16:53.485>Remember <00:16:53.665>I <00:16:53.845>said <00:16:54.025>developers, <00:16:54.205>you <00:16:54.385>said

422
00:16:54.485 --> 00:16:55.565
<00:16:54.485>guys <00:16:54.647>still <00:16:54.809>need <00:16:54.971>to <00:16:55.133>build <00:16:55.295>the <00:16:55.457>tooling.

423
00:16:55.865 --> 00:16:57.525
<00:16:55.865>And <00:16:56.331>so <00:16:56.798>that <00:16:57.265>happens.

424
00:16:57.545 --> 00:16:59.165
<00:16:57.545>And <00:16:57.778>we <00:16:58.011>got <00:16:58.245>libraries <00:16:58.478>like <00:16:58.711>CV <00:16:58.944>cuda

425
00:16:59.165 --> 00:17:01.765
<00:16:59.165>that <00:16:59.365>are <00:16:59.564>specifically <00:16:59.765>designed <00:16:59.964>to <00:17:00.165>do <00:17:00.365>the <00:17:00.564>pre-processing

426
00:17:01.765 --> 00:17:04.285
<00:17:01.765>and <00:17:01.965>post-processing <00:17:02.165>for <00:17:02.365>AI <00:17:02.564>models <00:17:02.765>on <00:17:02.965>the <00:17:03.165>GPU

427
00:17:04.975 --> 00:17:06.675
<00:17:04.974>and <00:17:05.149>to <00:17:05.324>take <00:17:05.500>advantage <00:17:05.675>of <00:17:05.849>those <00:17:06.024>type <00:17:06.199>of <00:17:06.375>libraries.

428
00:17:06.675 --> 00:17:09.115
<00:17:06.675>There's <00:17:06.815>again, <00:17:06.954>hundreds. <00:17:07.095>We <00:17:07.234>do <00:17:07.375>a <00:17:07.514>bunch <00:17:07.655>of <00:17:07.794>work <00:17:07.935>in <00:17:08.075>Kubernetes

429
00:17:09.415 --> 00:17:11.875
<00:17:09.415>to <00:17:09.615>make <00:17:09.815>sure <00:17:10.014>you <00:17:10.214>can <00:17:10.415>access <00:17:10.615>GPU <00:17:10.815>resources,

430
00:17:11.875 --> 00:17:13.315
<00:17:11.875>you <00:17:12.060>can <00:17:12.245>monitor <00:17:12.430>it, <00:17:12.615>you <00:17:12.800>can <00:17:12.985>deploy <00:17:13.171>it.

431
00:17:13.345 --> 00:17:14.475
<00:17:13.345>There's <00:17:13.548>a <00:17:13.751>bunch <00:17:13.955>of <00:17:14.158>work <00:17:14.361>there.

432
00:17:14.475 --> 00:17:17.475
<00:17:14.474>There's, <00:17:14.649>there's, <00:17:14.824>and <00:17:15.000>we <00:17:15.175>continue <00:17:15.349>to <00:17:15.524>contribute <00:17:15.699>openly <00:17:15.875>and,

433
00:17:17.735 --> 00:17:19.875
<00:17:17.734>and <00:17:17.968>have <00:17:18.201>it <00:17:18.435>available <00:17:18.668>to <00:17:18.901>the <00:17:19.135>community.

434
00:17:20.095 --> 00:17:23.195
<00:17:20.095>We <00:17:20.295>go <00:17:20.495>one <00:17:20.694>step <00:17:20.895>further <00:17:21.095>for <00:17:21.295>enterprise <00:17:21.495>customers,

435
00:17:23.695 --> 00:17:25.115
<00:17:23.694>we <00:17:23.950>go <00:17:24.206>even <00:17:24.461>further <00:17:24.717>and <00:17:24.973>we,

436
00:17:25.175 --> 00:17:27.355
<00:17:25.175>we <00:17:25.524>add <00:17:25.875>enterprise <00:17:26.224>management, <00:17:26.575>right?

437
00:17:27.415 --> 00:17:29.115
<00:17:27.415>So <00:17:27.648>health <00:17:27.881>checkers <00:17:28.115>and <00:17:28.348>things <00:17:28.581>like <00:17:28.815>that.

438
00:17:29.175 --> 00:17:32.995
<00:17:29.175>We <00:17:29.375>add <00:17:29.575>additional <00:17:29.774>tooling <00:17:29.975>for <00:17:30.175>enterprise <00:17:30.375>type <00:17:30.575>customization,

439
00:17:33.315 --> 00:17:34.595
<00:17:33.315>workflows <00:17:33.545>and <00:17:33.775>customer <00:17:34.006>station <00:17:34.236>use <00:17:34.467>cases.

440
00:17:35.295 --> 00:17:38.395
<00:17:35.295>Uh, <00:17:35.450>we <00:17:35.606>have <00:17:35.761>a <00:17:35.917>whole <00:17:36.072>bunch <00:17:36.228>of <00:17:36.383>enterprise <00:17:36.539>microservices <00:17:36.695>there.

441
00:17:39.575 --> 00:17:42.835
<00:17:39.575>We <00:17:39.855>also <00:17:40.135>have, <00:17:40.415>um, <00:17:40.695>runtime <00:17:40.975>optimization.

442
00:17:42.835 --> 00:17:43.795
<00:17:42.835>So <00:17:43.051>there's <00:17:43.267>something <00:17:43.483>called, <00:17:43.699>uh,

443
00:17:44.185 --> 00:17:45.755
<00:17:44.185>dynamic <00:17:44.885>resource <00:17:45.585>allocation.

444
00:17:45.975 --> 00:17:47.475
<00:17:45.975>So <00:17:46.167>we're <00:17:46.360>doing <00:17:46.553>that <00:17:46.746>kind <00:17:46.939>of <00:17:47.132>work <00:17:47.324>that,

445
00:17:47.475 --> 00:17:48.995
<00:17:47.475>that <00:17:47.748>gets <00:17:48.022>put, <00:17:48.295>put <00:17:48.569>into <00:17:48.842>there.

446
00:17:49.065 --> 00:17:50.325
<00:17:49.065>So <00:17:49.348>all <00:17:49.632>these <00:17:49.915>things, <00:17:50.199>uh,

447
00:17:50.325 --> 00:17:52.765
<00:17:50.325>well <00:17:50.558>obviously <00:17:50.791>there's <00:17:51.025>enterprise <00:17:51.258>support <00:17:51.491>and <00:17:51.725>stable

448
00:17:52.985 --> 00:17:57.195
<00:17:52.985>and <00:17:53.125>all <00:17:53.264>of <00:17:53.405>that <00:17:53.544>is <00:17:53.685>packaged <00:17:53.824>up <00:17:53.965>with <00:17:54.104>a <00:17:54.245>stable, <00:17:54.385>uh,

449
00:17:57.635 --> 00:17:59.555
<00:17:57.635>A <00:17:57.985>PIA <00:17:58.335>secured <00:17:58.685>stable <00:17:59.035>API.

450
00:17:59.555 --> 00:18:01.915
<00:17:59.555>So <00:17:59.755>you <00:17:59.955>as <00:18:00.155>a <00:18:00.355>enterprise <00:18:00.555>developer <00:18:00.755>can <00:18:00.955>kind

451
00:18:01.915 --> 00:18:03.395
<00:18:01.915>of <00:18:02.181>rely <00:18:02.447>on <00:18:02.714>this <00:18:02.980>being <00:18:03.247>stable.

452
00:18:03.415 --> 00:18:05.315
<00:18:03.415>And <00:18:03.648>we <00:18:03.881>call <00:18:04.115>this, <00:18:04.348>uh, <00:18:04.581>NVIDIA <00:18:04.815>nim.

453
00:18:05.655 --> 00:18:07.915
<00:18:05.655>So <00:18:05.855>you <00:18:06.055>can <00:18:06.254>go <00:18:06.455>get <00:18:06.655>information <00:18:06.855>about <00:18:07.055>that.

454
00:18:08.295 --> 00:18:12.515
<00:18:08.295>Uh, <00:18:08.450>and <00:18:08.606>if <00:18:08.761>you <00:18:08.917>want <00:18:09.072>to <00:18:09.228>actually <00:18:09.383>try <00:18:09.539>your <00:18:09.695>hands

455
00:18:12.515 --> 00:18:14.835
<00:18:12.515>with <00:18:12.748>NV <00:18:12.981>Nim, <00:18:13.215>join <00:18:13.448>our <00:18:13.681>developer <00:18:13.915>program

456
00:18:14.935 --> 00:18:17.355
<00:18:14.935>and <00:18:15.110>any <00:18:15.284>of <00:18:15.460>the <00:18:15.635>libraries, <00:18:15.810>there's <00:18:15.985>lots <00:18:16.159>of <00:18:16.335>resources.

457
00:18:17.855 --> 00:18:20.315
<00:18:17.855>So <00:18:18.055>you <00:18:18.255>can, <00:18:18.455>uh, <00:18:18.655>join <00:18:18.855>the <00:18:19.055>developer <00:18:19.255>program

458
00:18:20.415 --> 00:18:22.275
<00:18:20.415>and <00:18:20.648>just, <00:18:20.881>you <00:18:21.115>know, <00:18:21.348>download, <00:18:21.581>go <00:18:21.815>ahead.

459
00:18:22.275 --> 00:18:23.955
<00:18:22.275>There's <00:18:22.475>a <00:18:22.675>llama <00:18:22.875>nim <00:18:23.075>that <00:18:23.275>you <00:18:23.475>can <00:18:23.675>download.

460
00:18:24.295 --> 00:18:26.115
<00:18:24.295>So <00:18:24.528>you <00:18:24.761>can <00:18:24.995>download <00:18:25.228>the <00:18:25.461>lama <00:18:25.695>nim,

461
00:18:26.455 --> 00:18:29.235
<00:18:26.455>run <00:18:26.610>a <00:18:26.766>local <00:18:26.921>docker <00:18:27.077>instance <00:18:27.232>'cause <00:18:27.388>the <00:18:27.543>NIMS <00:18:27.699>are <00:18:27.855>containers.

462
00:18:29.895 --> 00:18:31.195
<00:18:29.895>Run <00:18:30.187>a <00:18:30.480>local <00:18:30.772>docker <00:18:31.065>instance

463
00:18:31.215 --> 00:18:33.355
<00:18:31.215>and <00:18:31.448>then <00:18:31.681>start <00:18:31.915>your <00:18:32.148>deployment, <00:18:32.381>uh, <00:18:32.615>development.

464
00:18:33.635 --> 00:18:35.275
<00:18:33.635>'cause <00:18:33.810>you <00:18:33.985>have <00:18:34.160>to, <00:18:34.335>you <00:18:34.510>can <00:18:34.685>develop <00:18:34.860>as <00:18:35.035>much

465
00:18:35.275 --> 00:18:36.395
<00:18:35.275>as <00:18:35.527>you <00:18:35.779>want <00:18:36.031>for <00:18:36.283>free.

466
00:18:36.395 --> 00:18:40.155
<00:18:36.395>There's <00:18:36.535>no <00:18:36.675>issue <00:18:36.815>there. <00:18:36.955>Um, <00:18:37.095>and <00:18:37.235>yeah, <00:18:37.375>you <00:18:37.514>can <00:18:37.655>get <00:18:37.795>started.

467
00:18:40.155 --> 00:18:41.395
<00:18:40.155>You <00:18:40.294>can <00:18:40.434>get <00:18:40.573>access <00:18:40.713>to <00:18:40.852>all <00:18:40.992>sorts <00:18:41.131>of <00:18:41.271>libraries,

468
00:18:41.395 --> 00:18:42.475
<00:18:41.395>all <00:18:41.638>sorts <00:18:41.880>of <00:18:42.124>other <00:18:42.367>resources.

469
00:18:42.475 --> 00:18:44.915
<00:18:42.475>So <00:18:42.708>we <00:18:42.941>have <00:18:43.175>training, <00:18:43.408>speaking <00:18:43.641>of <00:18:43.875>training

470
00:18:45.015 --> 00:18:46.315
<00:18:45.015>and, <00:18:45.600>and <00:18:46.185>certification.

471
00:18:46.935 --> 00:18:49.875
<00:18:46.935>We <00:18:47.062>also <00:18:47.189>have, <00:18:47.316>oops, <00:18:47.444>the <00:18:47.571>slides. <00:18:47.698>We <00:18:47.825>also <00:18:47.953>have <00:18:48.080>a <00:18:48.207>free <00:18:48.335>course.

472
00:18:50.295 --> 00:18:53.595
<00:18:50.295>So <00:18:50.411>if <00:18:50.528>you <00:18:50.645>guys <00:18:50.761>wanna <00:18:50.878>take, <00:18:50.995>grab <00:18:51.111>that <00:18:51.228>QR <00:18:51.345>code, <00:18:51.461>you <00:18:51.578>can <00:18:51.695>go,

473
00:18:54.055 --> 00:18:57.155
<00:18:54.055>uh, <00:18:54.255>to <00:18:54.455>the <00:18:54.655>Deep <00:18:54.855>Learning <00:18:55.055>Institute, <00:18:55.255>join <00:18:55.455>again.

474
00:18:57.155 --> 00:18:58.515
<00:18:57.155>It's <00:18:57.308>gonna <00:18:57.461>ask <00:18:57.614>you <00:18:57.767>to <00:18:57.920>join <00:18:58.073>the <00:18:58.226>developer <00:18:58.379>program.

475
00:18:59.215 --> 00:19:00.875
<00:18:59.215>And <00:18:59.415>you <00:18:59.615>can <00:18:59.814>get <00:19:00.014>access <00:19:00.215>to <00:19:00.415>a <00:19:00.615>free,

476
00:19:00.875 --> 00:19:02.075
<00:19:00.875>there's <00:19:01.029>a <00:19:01.183>whole <00:19:01.337>bunch <00:19:01.492>of <00:19:01.646>different <00:19:01.800>courses <00:19:01.955>there.

477
00:19:02.075 --> 00:19:03.075
<00:19:02.075>There's <00:19:02.300>courses <00:19:02.525>on <00:19:02.750>computer <00:19:02.975>vision,

478
00:19:03.075 --> 00:19:04.475
<00:19:03.075>there's <00:19:03.327>courses <00:19:03.579>on <00:19:03.831>large <00:19:04.082>language <00:19:04.335>models.

479
00:19:04.585 --> 00:19:06.595
<00:19:04.585>There's <00:19:04.740>all <00:19:04.896>sorts <00:19:05.051>of <00:19:05.207>different <00:19:05.362>courses <00:19:05.518>that <00:19:05.673>you <00:19:05.829>can <00:19:05.985>access.

480
00:19:08.415 --> 00:19:10.435
<00:19:08.415>And <00:19:08.542>so <00:19:08.669>those <00:19:08.796>are <00:19:08.924>the <00:19:09.051>two <00:19:09.178>things, <00:19:09.305>right? <00:19:09.433>I'm <00:19:09.560>gonna <00:19:09.687>go <00:19:09.815>back.

481
00:19:11.215 --> 00:19:13.635
<00:19:11.215>Number <00:19:11.564>one <00:19:11.915>was <00:19:12.264>accelerated <00:19:12.615>computing

482
00:19:13.775 --> 00:19:15.475
<00:19:13.775>and <00:19:14.241>acceleration <00:19:14.708>libraries, <00:19:15.175>right?

483
00:19:15.475 --> 00:19:16.675
<00:19:15.475>That's <00:19:15.690>how <00:19:15.907>you <00:19:16.123>take <00:19:16.339>advantage <00:19:16.554>of,

484
00:19:16.895 --> 00:19:17.915
<00:19:16.895>and <00:19:17.026>we <00:19:17.157>do <00:19:17.288>a <00:19:17.419>bunch <00:19:17.550>of <00:19:17.681>work <00:19:17.812>so

485
00:19:17.915 --> 00:19:19.075
<00:19:17.915>that <00:19:18.089>you <00:19:18.263>can <00:19:18.437>use <00:19:18.611>just <00:19:18.785>the <00:19:18.959>libraries

486
00:19:19.215 --> 00:19:22.115
<00:19:19.215>and <00:19:19.342>you <00:19:19.469>don't <00:19:19.596>have <00:19:19.724>to <00:19:19.851>go <00:19:19.978>to <00:19:20.105>the, <00:19:20.233>you <00:19:20.360>know, <00:19:20.487>all <00:19:20.615>that

487
00:19:22.425 --> 00:19:24.675
<00:19:22.425>because <00:19:22.600>we <00:19:22.774>have, <00:19:22.950>that's, <00:19:23.125>that's, <00:19:23.300>that's <00:19:23.475>our <00:19:23.649>work, <00:19:23.825>right?

488
00:19:24.675 --> 00:19:28.195
<00:19:24.675>We're <00:19:24.830>gonna <00:19:24.986>optimize <00:19:25.141>it. <00:19:25.297>When <00:19:25.452>we <00:19:25.608>go <00:19:25.763>from, <00:19:25.919>um, <00:19:26.075>hopper

489
00:19:28.295 --> 00:19:29.915
<00:19:28.295>to <00:19:28.470>Blackwell, <00:19:28.645>we <00:19:28.820>have <00:19:28.995>a <00:19:29.170>whole <00:19:29.345>bunch <00:19:29.520>of <00:19:29.695>engineers

490
00:19:29.915 --> 00:19:31.235
<00:19:29.915>that <00:19:30.084>are <00:19:30.254>going <00:19:30.424>in <00:19:30.593>there <00:19:30.763>and <00:19:30.933>you <00:19:31.102>know,

491
00:19:31.235 --> 00:19:32.715
<00:19:31.235>those <00:19:31.456>FFT <00:19:31.678>functions <00:19:31.900>I <00:19:32.122>told <00:19:32.344>you <00:19:32.567>about?

492
00:19:32.715 --> 00:19:33.755
<00:19:32.715>Well, <00:19:32.949>they're <00:19:33.183>gonna <00:19:33.417>go <00:19:33.651>in

493
00:19:33.755 --> 00:19:35.755
<00:19:33.755>and <00:19:33.930>they're <00:19:34.105>gonna <00:19:34.280>tweak <00:19:34.455>the <00:19:34.630>parameters <00:19:34.805>of <00:19:34.980>it <00:19:35.155>so

494
00:19:35.755 --> 00:19:38.955
<00:19:35.755>that <00:19:35.988>it's <00:19:36.221>optimal <00:19:36.455>on <00:19:36.688>Blackwell, <00:19:36.921>it's <00:19:37.155>optimal,

495
00:19:39.175 --> 00:19:40.635
<00:19:39.175>on <00:19:39.613>the <00:19:40.051>different <00:19:40.489>GPUs.

496
00:19:40.905 --> 00:19:42.595
<00:19:40.905>It's <00:19:41.138>optimal <00:19:41.371>in <00:19:41.605>the <00:19:41.838>different <00:19:42.071>use <00:19:42.305>cases.

497
00:19:43.055 --> 00:19:44.275
<00:19:43.055>In <00:19:43.238>the <00:19:43.421>case <00:19:43.604>of <00:19:43.787>nims, <00:19:43.970>that's <00:19:44.153>one

498
00:19:44.275 --> 00:19:46.195
<00:19:44.275>of <00:19:44.430>the <00:19:44.586>other <00:19:44.741>enterprise <00:19:44.897>things <00:19:45.052>is <00:19:45.208>when <00:19:45.363>you <00:19:45.519>deploy <00:19:45.675>these

499
00:19:46.195 --> 00:19:47.195
<00:19:46.195>applications <00:19:46.495>in <00:19:46.794>the <00:19:47.095>cloud,

500
00:19:47.195 --> 00:19:49.315
<00:19:47.195>you're <00:19:47.428>gonna <00:19:47.661>go <00:19:47.895>into <00:19:48.128>various <00:19:48.361>different <00:19:48.595>environments.

501
00:19:49.625 --> 00:19:52.195
<00:19:49.625>What <00:19:49.780>the <00:19:49.936>NIM <00:19:50.091>does <00:19:50.247>is <00:19:50.402>it <00:19:50.558>separates <00:19:50.713>out <00:19:50.869>the <00:19:51.025>base

502
00:19:52.195 --> 00:19:53.875
<00:19:52.195>container <00:19:52.661>from <00:19:53.128>the <00:19:53.595>runtime.

503
00:19:53.895 --> 00:19:56.795
<00:19:53.895>So <00:19:54.050>when <00:19:54.206>you're <00:19:54.361>putting <00:19:54.517>your, <00:19:54.672>deploying <00:19:54.828>your <00:19:54.983>nims, <00:19:55.139>it'll <00:19:55.295>know

504
00:19:56.795 --> 00:19:57.875
<00:19:56.795>what <00:19:57.119>environment <00:19:57.443>you're <00:19:57.767>in,

505
00:19:57.935 --> 00:20:00.515
<00:19:57.935>and <00:19:58.168>then <00:19:58.401>it'll <00:19:58.635>pick <00:19:58.868>the <00:19:59.101>most <00:19:59.335>optimized

506
00:20:00.665 --> 00:20:02.075
<00:20:00.665>version <00:20:00.982>of <00:20:01.299>the <00:20:01.616>model, <00:20:01.934>right?

507
00:20:02.105 --> 00:20:05.475
<00:20:02.105>Optimized <00:20:02.338>for <00:20:02.571>latency, <00:20:02.805>optimized <00:20:03.038>for <00:20:03.271>throughput, <00:20:03.505>optimized

508
00:20:05.475 --> 00:20:10.275
<00:20:05.475>for, <00:20:05.591>um, <00:20:05.708>an <00:20:05.824>a <00:20:05.941>100 <00:20:06.058>versus <00:20:06.175>an <00:20:06.291>H <00:20:06.408>100 <00:20:06.524>versus <00:20:06.641>an <00:20:06.758>H <00:20:06.875>200.

509
00:20:10.445 --> 00:20:13.435
<00:20:10.445>These <00:20:10.645>different <00:20:10.845>runtimes <00:20:11.044>that <00:20:11.245>are <00:20:11.445>tweaked <00:20:11.645>to <00:20:11.845>be,

510
00:20:13.435 --> 00:20:15.115
<00:20:13.435>give <00:20:13.715>you <00:20:13.995>the <00:20:14.274>best, <00:20:14.554>best <00:20:14.835>performance.

511
00:20:15.115 --> 00:20:17.595
<00:20:15.115>Because <00:20:15.290>as <00:20:15.465>I <00:20:15.640>showed <00:20:15.815>you <00:20:15.990>earlier, <00:20:16.165>every <00:20:16.340>little <00:20:16.515>bit

512
00:20:17.875 --> 00:20:21.715
<00:20:17.875>of <00:20:18.050>extra <00:20:18.225>performance <00:20:18.400>translates <00:20:18.575>into <00:20:18.750>value <00:20:18.925>for <00:20:19.100>you, <00:20:19.275>right?

513
00:20:21.715 --> 00:20:23.675
<00:20:21.715>And <00:20:21.855>we <00:20:21.995>wanna <00:20:22.135>make <00:20:22.274>sure <00:20:22.415>that <00:20:22.554>the <00:20:22.695>GPUs <00:20:22.834>that <00:20:22.975>you <00:20:23.115>use,

514
00:20:23.815 --> 00:20:25.435
<00:20:23.815>you <00:20:24.015>get <00:20:24.215>the <00:20:24.415>maximum <00:20:24.615>value <00:20:24.815>out <00:20:25.015>of <00:20:25.215>them.

515
00:20:26.335 --> 00:20:28.995
<00:20:26.335>And <00:20:26.535>then <00:20:26.735>we <00:20:26.935>talked <00:20:27.135>about, <00:20:27.335>uh, <00:20:27.535>cloud <00:20:27.735>applications.

516
00:20:29.135 --> 00:20:31.875
<00:20:29.135>We <00:20:29.290>talked <00:20:29.446>about <00:20:29.601>how, <00:20:29.757>you <00:20:29.912>know, <00:20:30.068>you <00:20:30.223>have <00:20:30.379>as <00:20:30.535>developers,

517
00:20:31.875 --> 00:20:33.035
<00:20:31.875>you <00:20:32.049>know, <00:20:32.223>some <00:20:32.397>of <00:20:32.571>you're <00:20:32.745>new <00:20:32.919>developers

518
00:20:33.035 --> 00:20:36.755
<00:20:33.035>and <00:20:33.175>you're <00:20:33.315>thinking, <00:20:33.455>oh, <00:20:33.595>AI's <00:20:33.735>gonna <00:20:33.875>change <00:20:34.015>a <00:20:34.155>bunch <00:20:34.295>of <00:20:34.435>stuff.

519
00:20:36.815 --> 00:20:41.355
<00:20:36.815>And <00:20:36.970>yes, <00:20:37.126>but <00:20:37.281>it's, <00:20:37.437>I <00:20:37.592>think <00:20:37.748>gonna <00:20:37.903>need <00:20:38.059>more <00:20:38.215>developers.

520
00:20:41.375 --> 00:20:43.435
<00:20:41.375>You're <00:20:41.550>gonna <00:20:41.725>need <00:20:41.900>more <00:20:42.075>developers <00:20:42.250>to <00:20:42.425>figure <00:20:42.600>out <00:20:42.775>how

521
00:20:43.435 --> 00:20:44.595
<00:20:43.435>to <00:20:43.696>tool <00:20:43.956>all <00:20:44.218>these <00:20:44.479>things.

522
00:20:44.615 --> 00:20:46.795
<00:20:44.615>How <00:20:44.848>to <00:20:45.081>manage <00:20:45.315>the <00:20:45.548>DevOps <00:20:45.781>is <00:20:46.015>different.

523
00:20:46.945 --> 00:20:48.245
<00:20:46.945>The <00:20:47.178>all <00:20:47.413>sorts <00:20:47.647>of <00:20:47.880>things <00:20:48.114>are,

524
00:20:48.265 --> 00:20:50.925
<00:20:48.265>are <00:20:48.498>need <00:20:48.731>extra <00:20:48.965>thought <00:20:49.198>and <00:20:49.431>different <00:20:49.665>things.

525
00:20:51.145 --> 00:20:52.365
<00:20:51.145>So, <00:20:51.328>you <00:20:51.511>know, <00:20:51.694>we <00:20:51.877>continue <00:20:52.060>to <00:20:52.243>evolve.

526
00:20:52.365 --> 00:20:56.975
<00:20:52.365>We <00:20:52.505>had <00:20:52.645>the <00:20:52.785>same <00:20:52.925>problem <00:20:53.065>when <00:20:53.205>we <00:20:53.345>went <00:20:53.485>from, <00:20:53.625>um, <00:20:53.765>PC

527
00:20:56.975 --> 00:20:58.455
<00:20:56.975>to <00:20:57.308>mobile <00:20:57.640>or <00:20:57.974>to <00:20:58.307>internet.

528
00:20:58.475 --> 00:21:00.375
<00:20:58.475>And <00:20:58.675>so <00:20:58.875>we've <00:20:59.074>had, <00:20:59.274>so <00:20:59.475>developers, <00:20:59.675>that's <00:20:59.875>some

529
00:21:00.375 --> 00:21:02.575
<00:21:00.375>of <00:21:00.608>the <00:21:00.841>things <00:21:01.075>we're <00:21:01.308>very, <00:21:01.541>uh, <00:21:01.775>adaptable.

530
00:21:02.795 --> 00:21:03.855
<00:21:02.795>So <00:21:03.033>another <00:21:03.272>time <00:21:03.510>to <00:21:03.749>adapt.

531
00:21:03.855 --> 00:21:07.375
<00:21:03.855>And <00:21:04.010>this <00:21:04.166>is <00:21:04.321>a <00:21:04.477>great <00:21:04.632>opportunity <00:21:04.788>for <00:21:04.943>many <00:21:05.099>new <00:21:05.255>applications,

532
00:21:07.555 --> 00:21:10.615
<00:21:07.555>new <00:21:07.730>businesses, <00:21:07.905>new <00:21:08.080>use <00:21:08.255>cases, <00:21:08.430>things <00:21:08.605>that <00:21:08.780>were <00:21:08.955>kind

533
00:21:10.615 --> 00:21:13.335
<00:21:10.615>of <00:21:10.848>impossible <00:21:11.081>before <00:21:11.315>now <00:21:11.548>become <00:21:11.781>possible, <00:21:12.015>right?

534
00:21:13.335 --> 00:21:15.495
<00:21:13.335>And <00:21:13.510>that's <00:21:13.685>always <00:21:13.860>a <00:21:14.035>great <00:21:14.210>opportunity <00:21:14.385>to <00:21:14.560>go, <00:21:14.735>Hmm,

535
00:21:15.795 --> 00:21:18.255
<00:21:15.795>how <00:21:15.995>can <00:21:16.195>I <00:21:16.395>take <00:21:16.595>advantage <00:21:16.795>of <00:21:16.995>this <00:21:17.195>opportunity?

536
00:21:18.315 --> 00:21:21.695
<00:21:18.315>So <00:21:18.470>I <00:21:18.626>implore <00:21:18.781>you, <00:21:18.937>uh, <00:21:19.092>as <00:21:19.248>the <00:21:19.403>many <00:21:19.559>developers <00:21:19.715>here,

537
00:21:21.695 --> 00:21:23.255
<00:21:21.695>think <00:21:22.161>about <00:21:22.628>the <00:21:23.095>applications

538
00:21:23.255 --> 00:21:25.455
<00:21:23.255>and <00:21:23.455>the <00:21:23.655>use <00:21:23.855>cases, <00:21:24.055>build <00:21:24.255>it <00:21:24.455>on <00:21:24.655>Nvidia.

539
00:21:25.555 --> 00:21:27.135
<00:21:25.555>We <00:21:25.835>have <00:21:26.115>a <00:21:26.395>inception <00:21:26.675>startup <00:21:26.955>program.

540
00:21:27.195 --> 00:21:28.975
<00:21:27.195>We <00:21:27.370>have <00:21:27.544>all <00:21:27.720>sorts <00:21:27.895>of <00:21:28.070>resources <00:21:28.245>to <00:21:28.419>help <00:21:28.595>you.

541
00:21:29.275 --> 00:21:31.135
<00:21:29.275>So <00:21:29.450>that's <00:21:29.625>kind <00:21:29.800>of, <00:21:29.975>and <00:21:30.150>that's <00:21:30.325>the <00:21:30.500>second <00:21:30.675>part.

542
00:21:32.815 --> 00:21:33.895
<00:21:32.815>I <00:21:33.009>don't <00:21:33.203>think <00:21:33.398>we're <00:21:33.592>doing <00:21:33.787>questions.

543
00:21:33.935 --> 00:21:36.335
<00:21:33.935>I <00:21:34.110>think <00:21:34.284>the <00:21:34.460>questions <00:21:34.635>are <00:21:34.810>in <00:21:34.985>the, <00:21:35.159>the <00:21:35.335>application.

544
00:21:36.355 --> 00:21:39.135
<00:21:36.355>But <00:21:36.471>if <00:21:36.588>you <00:21:36.705>do <00:21:36.821>want <00:21:36.938>to <00:21:37.055>come <00:21:37.171>see <00:21:37.288>us, <00:21:37.405>we're <00:21:37.521>in <00:21:37.638>two <00:21:37.755>places.

545
00:21:39.385 --> 00:21:44.015
<00:21:39.385>We're <00:21:39.512>in <00:21:39.639>the <00:21:39.766>amber, <00:21:39.894>uh, <00:21:40.021>booth, <00:21:40.148>which <00:21:40.275>is <00:21:40.403>on <00:21:40.530>the <00:21:40.657>second <00:21:40.785>floor.

546
00:21:44.155 --> 00:21:46.415
<00:21:44.155>In <00:21:44.388>the <00:21:44.621>other <00:21:44.855>hall. <00:21:45.088>We <00:21:45.321>have <00:21:45.555>self-paced.

547
00:21:46.415 --> 00:21:49.695
<00:21:46.415>So <00:21:46.570>the, <00:21:46.726>I <00:21:46.881>told <00:21:47.037>you <00:21:47.192>the <00:21:47.348>DLI, <00:21:47.503>the <00:21:47.659>self-paced <00:21:47.815>learning,

548
00:21:49.715 --> 00:21:51.935
<00:21:49.715>the <00:21:49.915>training <00:21:50.115>classes, <00:21:50.314>you <00:21:50.514>can <00:21:50.715>actually <00:21:50.915>start <00:21:51.115>one

549
00:21:51.935 --> 00:21:53.255
<00:21:51.935>and <00:21:52.133>do <00:21:52.331>it <00:21:52.529>there <00:21:52.727>if <00:21:52.925>you <00:21:53.123>want.

550
00:21:53.555 --> 00:21:57.095
<00:21:53.555>But <00:21:53.695>we <00:21:53.835>also <00:21:53.975>have, <00:21:54.115>uh, <00:21:54.255>our <00:21:54.395>engineers <00:21:54.535>in <00:21:54.675>the <00:21:54.815>Ionis <00:21:54.955>booth,

551
00:21:57.095 --> 00:21:58.655
<00:21:57.095>which <00:21:57.270>is <00:21:57.445>just <00:21:57.620>downstairs <00:21:57.795>on <00:21:57.970>the <00:21:58.145>left <00:21:58.320>over <00:21:58.495>there.

552
00:21:58.835 --> 00:22:00.095
<00:21:58.835>And <00:21:58.976>so <00:21:59.118>you <00:21:59.260>come <00:21:59.402>talk <00:21:59.543>to <00:21:59.685>us <00:21:59.827>over <00:21:59.969>there.