WEBVTT

1
00:00:04.875 --> 00:00:05.695
<00:00:04.875>Hey, <00:00:05.244>good <00:00:05.613>afternoon.

2
00:00:05.705 --> 00:00:06.735
<00:00:05.705>Great <00:00:05.936>to <00:00:06.168>see <00:00:06.400>you <00:00:06.632>all

3
00:00:07.035 --> 00:00:10.095
<00:00:07.035>and <00:00:07.162>welcome <00:00:07.289>to <00:00:07.416>this <00:00:07.544>next <00:00:07.671>talk <00:00:07.798>about, <00:00:07.925>uh, <00:00:08.053>prompt <00:00:08.180>API <00:00:08.307>and <00:00:08.435>web,

4
00:00:10.195 --> 00:00:13.815
<00:00:10.195>and <00:00:10.350>two <00:00:10.506>very <00:00:10.661>promising <00:00:10.817>APIs <00:00:10.972>that <00:00:11.128>would <00:00:11.283>make <00:00:11.439>it <00:00:11.595>possible

5
00:00:13.815 --> 00:00:15.295
<00:00:13.815>to <00:00:14.148>run <00:00:14.481>large <00:00:14.814>language <00:00:15.147>models,

6
00:00:15.355 --> 00:00:16.695
<00:00:15.355>but <00:00:15.757>also <00:00:16.158>other, <00:00:16.561>uh,

7
00:00:16.695 --> 00:00:18.535
<00:00:16.695>large <00:00:16.928>language <00:00:17.161>models <00:00:17.395>right <00:00:17.628>in <00:00:17.861>your <00:00:18.095>browser.

8
00:00:19.675 --> 00:00:23.815
<00:00:19.675>Um, <00:00:19.791>so <00:00:19.908>I <00:00:20.025>mean, <00:00:20.141>the <00:00:20.258>most <00:00:20.375>obvious <00:00:20.491>thing <00:00:20.608>to <00:00:20.725>do <00:00:20.841>if <00:00:20.958>you <00:00:21.075>wanted

9
00:00:23.815 --> 00:00:25.095
<00:00:23.815>to <00:00:24.391>integrate <00:00:24.967>AI

10
00:00:25.155 --> 00:00:28.335
<00:00:25.155>or <00:00:25.355>ml, <00:00:25.555>uh, <00:00:25.755>capabilities <00:00:25.955>in <00:00:26.155>your <00:00:26.355>application <00:00:26.555>is

11
00:00:28.475 --> 00:00:29.895
<00:00:28.475>to <00:00:28.688>just <00:00:28.901>use <00:00:29.114>one <00:00:29.327>of <00:00:29.540>those <00:00:29.753>many

12
00:00:29.895 --> 00:00:31.255
<00:00:29.895>cloud <00:00:30.139>providers <00:00:30.384>that <00:00:30.629>are <00:00:30.874>out <00:00:31.119>there.

13
00:00:31.515 --> 00:00:32.775
<00:00:31.515>So <00:00:31.893>there's <00:00:32.271>open <00:00:32.649>AI

14
00:00:33.195 --> 00:00:36.775
<00:00:33.195>or <00:00:33.395>Azure <00:00:33.595>Open <00:00:33.795>ai, <00:00:33.995>there's <00:00:34.195>grok, <00:00:34.395>Google <00:00:34.595>Cloud,

15
00:00:36.795 --> 00:00:38.095
<00:00:36.795>and <00:00:37.087>many, <00:00:37.380>many <00:00:37.672>more, <00:00:37.964>right?

16
00:00:38.195 --> 00:00:41.215
<00:00:38.195>And <00:00:38.395>they're <00:00:38.595>all <00:00:38.795>good, <00:00:38.995>they're <00:00:39.195>all <00:00:39.395>great <00:00:39.595>services.

17
00:00:41.795 --> 00:00:46.455
<00:00:41.795>But <00:00:41.922>what <00:00:42.049>is, <00:00:42.176>if <00:00:42.304>you <00:00:42.431>have <00:00:42.558>one <00:00:42.685>of <00:00:42.813>the <00:00:42.940>four <00:00:43.067>following <00:00:43.195>issues,

18
00:00:47.515 --> 00:00:50.935
<00:00:47.515>number <00:00:47.715>one, <00:00:47.915>what <00:00:48.115>if <00:00:48.315>your <00:00:48.515>user <00:00:48.715>is <00:00:48.915>offline?

19
00:00:51.275 --> 00:00:54.695
<00:00:51.275>So <00:00:51.415>currently <00:00:51.555>on <00:00:51.695>a <00:00:51.835>plane <00:00:51.975>or, <00:00:52.114>uh, <00:00:52.254>riding <00:00:52.394>a <00:00:52.535>train, <00:00:52.675>um,

20
00:00:54.755 --> 00:00:58.015
<00:00:54.755>and <00:00:54.955>still <00:00:55.155>wants <00:00:55.355>to <00:00:55.555>use, <00:00:55.755>um, <00:00:55.955>AI <00:00:56.155>capabilities

21
00:00:58.315 --> 00:01:01.255
<00:00:58.315>or <00:00:58.515>maybe <00:00:58.714>is <00:00:58.915>on <00:00:59.114>an <00:00:59.315>unreliable <00:00:59.515>internet <00:00:59.714>connection,

22
00:01:01.345 --> 00:01:03.175
<00:01:01.345>maybe <00:01:01.578>on <00:01:01.811>certain <00:01:02.045>parts <00:01:02.278>of <00:01:02.511>the <00:01:02.745>world

23
00:01:03.175 --> 00:01:06.135
<00:01:03.175>where <00:01:03.408>there're <00:01:03.641>simply <00:01:03.875>not <00:01:04.108>stable <00:01:04.341>internet <00:01:04.575>coverage.

24
00:01:07.205 --> 00:01:11.215
<00:01:07.205>What <00:01:07.360>happens <00:01:07.516>if, <00:01:07.671>um, <00:01:07.827>your <00:01:07.982>cloud <00:01:08.138>server <00:01:08.293>is <00:01:08.449>at <00:01:08.605>capacity?

25
00:01:11.505 --> 00:01:14.375
<00:01:11.505>Maybe <00:01:11.645>if <00:01:11.785>you've <00:01:11.925>used <00:01:12.065>a <00:01:12.205>chat <00:01:12.345>CPT <00:01:12.485>at <00:01:12.625>the <00:01:12.765>very <00:01:12.905>beginning,

26
00:01:14.515 --> 00:01:16.375
<00:01:14.515>you've <00:01:14.981>hit <00:01:15.448>capacity <00:01:15.915>issues.

27
00:01:16.715 --> 00:01:18.895
<00:01:16.715>Or <00:01:16.870>even <00:01:17.026>now <00:01:17.181>if <00:01:17.337>you <00:01:17.492>are <00:01:17.648>generating <00:01:17.803>an <00:01:17.959>image, <00:01:18.115>right?

28
00:01:18.895 --> 00:01:20.335
<00:01:18.895>Sometimes <00:01:19.219>they'll <00:01:19.543>tell <00:01:19.867>you, <00:01:20.191>Hey,

29
00:01:20.405 --> 00:01:23.255
<00:01:20.405>this <00:01:20.521>takes <00:01:20.638>a <00:01:20.755>little <00:01:20.871>bit <00:01:20.988>longer, <00:01:21.105>or <00:01:21.221>we <00:01:21.338>cannot <00:01:21.455>do <00:01:21.571>it <00:01:21.688>right <00:01:21.805>now

30
00:01:23.255 --> 00:01:25.175
<00:01:23.255>because <00:01:23.535>our <00:01:23.815>service <00:01:24.095>are <00:01:24.375>at <00:01:24.655>capacity.

31
00:01:25.485 --> 00:01:29.375
<00:01:25.485>What <00:01:25.660>if <00:01:25.835>you <00:01:26.010>could <00:01:26.185>have <00:01:26.360>like <00:01:26.535>guaranteed, <00:01:26.710>um, <00:01:26.885>capacity

32
00:01:29.435 --> 00:01:30.655
<00:01:29.435>for <00:01:29.801>your <00:01:30.167>AI <00:01:30.533>workloads?

33
00:01:32.855 --> 00:01:34.615
<00:01:32.854>I <00:01:33.054>think <00:01:33.255>the <00:01:33.454>most <00:01:33.654>important <00:01:33.854>point <00:01:34.054>is <00:01:34.255>this.

34
00:01:34.615 --> 00:01:37.375
<00:01:34.615>However, <00:01:34.815>um, <00:01:35.015>if <00:01:35.215>you <00:01:35.415>use <00:01:35.615>a <00:01:35.815>cloud <00:01:36.015>service,

35
00:01:37.555 --> 00:01:39.335
<00:01:37.555>you <00:01:37.905>will <00:01:38.255>transfer <00:01:38.605>your <00:01:38.955>data

36
00:01:39.475 --> 00:01:43.575
<00:01:39.475>and <00:01:39.615>your <00:01:39.755>user's <00:01:39.895>data <00:01:40.035>over <00:01:40.175>to <00:01:40.315>the <00:01:40.455>cloud <00:01:40.595>service <00:01:40.735>provider <00:01:40.875>that

37
00:01:43.605 --> 00:01:45.455
<00:01:43.604>that <00:01:43.804>may <00:01:44.005>be <00:01:44.204>in <00:01:44.404>a <00:01:44.604>different <00:01:44.804>region, <00:01:45.005>right?

38
00:01:45.605 --> 00:01:47.975
<00:01:45.604>That <00:01:45.804>may <00:01:46.005>be <00:01:46.204>a <00:01:46.404>cloud <00:01:46.604>provider <00:01:46.804>that <00:01:47.005>wants

39
00:01:47.975 --> 00:01:49.255
<00:01:47.975>to <00:01:48.205>use <00:01:48.435>your <00:01:48.666>data <00:01:48.896>for <00:01:49.127>training.

40
00:01:49.795 --> 00:01:53.375
<00:01:49.795>Um, <00:01:49.922>so <00:01:50.049>what <00:01:50.176>if <00:01:50.304>you <00:01:50.431>have <00:01:50.558>data <00:01:50.685>that <00:01:50.813>should <00:01:50.940>not <00:01:51.067>ever, <00:01:51.195>uh,

41
00:01:53.375 --> 00:01:55.455
<00:01:53.375>and <00:01:53.608>guaranteed <00:01:53.841>be <00:01:54.075>used <00:01:54.308>by <00:01:54.541>someone <00:01:54.775>else?

42
00:01:57.715 --> 00:01:58.735
<00:01:57.715>And <00:01:57.944>the <00:01:58.174>last <00:01:58.403>point <00:01:58.633>is

43
00:01:58.885 --> 00:02:01.735
<00:01:58.884>that <00:01:59.118>cloud <00:01:59.351>services <00:01:59.585>usually <00:01:59.818>require <00:02:00.051>a <00:02:00.285>subscription.

44
00:02:01.735 --> 00:02:03.855
<00:02:01.735>Typically <00:02:02.015>you <00:02:02.295>pay <00:02:02.575>per <00:02:02.855>process <00:02:03.135>token.

45
00:02:04.275 --> 00:02:08.175
<00:02:04.275>Um, <00:02:04.402>and <00:02:04.529>there's <00:02:04.656>a <00:02:04.784>great <00:02:04.911>way <00:02:05.038>for <00:02:05.165>you, <00:02:05.293>uh, <00:02:05.420>as <00:02:05.547>a <00:02:05.675>developer

46
00:02:08.175 --> 00:02:11.175
<00:02:08.175>or <00:02:08.302>as <00:02:08.429>a <00:02:08.556>provider <00:02:08.684>to <00:02:08.811>save <00:02:08.938>money <00:02:09.065>if <00:02:09.193>you <00:02:09.320>would <00:02:09.447>simply <00:02:09.575>basically

47
00:02:11.235 --> 00:02:13.015
<00:02:11.235>let <00:02:11.515>your <00:02:11.795>users <00:02:12.075>do <00:02:12.355>the <00:02:12.635>inference.

48
00:02:13.275 --> 00:02:17.095
<00:02:13.275>That's <00:02:13.508>the <00:02:13.741>four <00:02:13.975>drawbacks <00:02:14.208>of <00:02:14.441>cloud <00:02:14.675>providers

49
00:02:17.095 --> 00:02:20.415
<00:02:17.095>and <00:02:17.295>of <00:02:17.495>cloud <00:02:17.695>services <00:02:17.895>that <00:02:18.095>are <00:02:18.295>the <00:02:18.495>chances

50
00:02:20.415 --> 00:02:23.535
<00:02:20.415>and <00:02:20.590>the <00:02:20.765>opportunities, <00:02:20.940>so <00:02:21.114>to <00:02:21.290>say, <00:02:21.465>for <00:02:21.640>local <00:02:21.815>ai.

51
00:02:24.155 --> 00:02:28.255
<00:02:24.155>So <00:02:24.295>the <00:02:24.435>question <00:02:24.575>is, <00:02:24.715>can <00:02:24.855>we <00:02:24.995>run <00:02:25.135>generative <00:02:25.275>AI <00:02:25.415>models <00:02:25.555>locally?

52
00:02:28.955 --> 00:02:32.135
<00:02:28.954>The <00:02:29.082>answer <00:02:29.209>is <00:02:29.336>yes. <00:02:29.464>And <00:02:29.591>this <00:02:29.718>session <00:02:29.845>I <00:02:29.973>wanna <00:02:30.100>show <00:02:30.227>you <00:02:30.355>how

53
00:02:32.275 --> 00:02:34.495
<00:02:32.275>and <00:02:32.430>how <00:02:32.586>you <00:02:32.741>can <00:02:32.897>do <00:02:33.052>that <00:02:33.208>right <00:02:33.363>in <00:02:33.519>your <00:02:33.675>browser.

54
00:02:34.635 --> 00:02:37.535
<00:02:34.635>So <00:02:34.834>right <00:02:35.035>inside, <00:02:35.234>um, <00:02:35.435>let's <00:02:35.635>say <00:02:35.834>Google <00:02:36.035>Chrome,

55
00:02:38.615 --> 00:02:39.615
<00:02:38.615>Microsoft <00:02:38.840>Edge, <00:02:39.065>and <00:02:39.290>also <00:02:39.515>others.

56
00:02:42.455 --> 00:02:45.355
<00:02:42.454>So <00:02:42.804>for <00:02:43.154>local <00:02:43.505>AI <00:02:43.855>inference,

57
00:02:45.525 --> 00:02:47.795
<00:02:45.525>there <00:02:45.700>are <00:02:45.875>two <00:02:46.050>different <00:02:46.225>approaches <00:02:46.400>that <00:02:46.575>you <00:02:46.750>can <00:02:46.925>take.

58
00:02:48.415 --> 00:02:50.395
<00:02:48.415>I'm <00:02:48.590>a <00:02:48.765>member <00:02:48.940>of <00:02:49.114>the <00:02:49.290>web <00:02:49.465>ML <00:02:49.640>working <00:02:49.815>group

59
00:02:50.415 --> 00:02:52.755
<00:02:50.415>and <00:02:50.614>community <00:02:50.815>group, <00:02:51.015>and <00:02:51.215>there <00:02:51.415>are <00:02:51.614>two <00:02:51.815>approaches

60
00:02:52.755 --> 00:02:54.035
<00:02:52.755>that <00:02:53.043>are <00:02:53.331>currently <00:02:53.619>being <00:02:53.906>discussed.

61
00:02:54.175 --> 00:02:56.835
<00:02:54.175>And <00:02:54.315>you <00:02:54.455>will <00:02:54.595>find <00:02:54.735>the <00:02:54.875>working <00:02:55.015>group <00:02:55.155>ones <00:02:55.295>in <00:02:55.435>one <00:02:55.575>column

62
00:02:56.975 --> 00:02:58.795
<00:02:56.975>and <00:02:57.150>the <00:02:57.325>community <00:02:57.500>group <00:02:57.674>ones <00:02:57.850>in <00:02:58.025>the <00:02:58.200>other <00:02:58.375>column.

63
00:02:59.585 --> 00:03:03.365
<00:02:59.585>So <00:02:59.712>first <00:02:59.839>of <00:02:59.966>all, <00:03:00.094>there <00:03:00.221>is <00:03:00.348>the <00:03:00.475>so-called <00:03:00.603>bring <00:03:00.730>your <00:03:00.857>own <00:03:00.985>AI

64
00:03:03.685 --> 00:03:08.605
<00:03:03.685>approach <00:03:03.840>or <00:03:03.996>BYO <00:03:04.151>AI <00:03:04.307>that <00:03:04.462>is, <00:03:04.618>uh, <00:03:04.773>certain <00:03:04.929>libraries <00:03:05.085>such

65
00:03:08.605 --> 00:03:12.805
<00:03:08.605>as <00:03:08.744>web <00:03:08.885>LLM <00:03:09.024>or <00:03:09.165>Transformers <00:03:09.304>js, <00:03:09.445>they <00:03:09.584>use <00:03:09.725>let's <00:03:09.864>say <00:03:10.005>webinar,

66
00:03:12.945 --> 00:03:14.885
<00:03:12.945>but <00:03:13.225>also, <00:03:13.505>uh, <00:03:13.785>maybe <00:03:14.065>web <00:03:14.345>GPU.

67
00:03:15.425 --> 00:03:19.045
<00:03:15.425>Um, <00:03:15.565>and <00:03:15.705>they <00:03:15.845>allow <00:03:15.985>you <00:03:16.125>to <00:03:16.265>run <00:03:16.405>your <00:03:16.545>own <00:03:16.685>AI <00:03:16.825>model

68
00:03:19.045 --> 00:03:22.125
<00:03:19.045>that <00:03:19.200>you <00:03:19.356>wanna <00:03:19.511>bring, <00:03:19.667>um, <00:03:19.822>in <00:03:19.978>right <00:03:20.133>inside <00:03:20.289>your <00:03:20.445>browser.

69
00:03:23.195 --> 00:03:25.335
<00:03:23.195>And <00:03:23.428>then <00:03:23.661>there's <00:03:23.894>frameworks <00:03:24.128>like <00:03:24.361>OnX <00:03:24.595>Runtime

70
00:03:25.355 --> 00:03:28.375
<00:03:25.355>or <00:03:25.530>TensorFlow <00:03:25.704>js, <00:03:25.880>and <00:03:26.054>then <00:03:26.230>there's <00:03:26.405>APIs <00:03:26.579>for <00:03:26.755>that.

71
00:03:28.675 --> 00:03:31.015
<00:03:28.675>For <00:03:28.830>example, <00:03:28.986>web <00:03:29.141>and <00:03:29.297>N <00:03:29.452>that <00:03:29.608>I <00:03:29.763>already <00:03:29.919>talked <00:03:30.075>about.

72
00:03:31.345 --> 00:03:32.695
<00:03:31.345>Cross <00:03:31.648>origin <00:03:31.952>storage <00:03:32.256>is <00:03:32.560>related.

73
00:03:32.755 --> 00:03:33.935
<00:03:32.755>We <00:03:32.932>will <00:03:33.109>discuss <00:03:33.286>that <00:03:33.463>in <00:03:33.640>a <00:03:33.817>minute.

74
00:03:35.555 --> 00:03:38.135
<00:03:35.555>And <00:03:35.730>that's <00:03:35.905>the <00:03:36.080>stuff <00:03:36.255>that <00:03:36.430>is <00:03:36.605>in <00:03:36.780>the, <00:03:36.955>um,

75
00:03:38.195 --> 00:03:40.495
<00:03:38.195>web <00:03:38.545>ML <00:03:38.894>working <00:03:39.245>group <00:03:39.595>webinar.

76
00:03:40.765 --> 00:03:42.575
<00:03:40.765>It's <00:03:40.998>a <00:03:41.231>specification <00:03:41.464>from <00:03:41.698>the <00:03:41.931>working <00:03:42.165>group.

77
00:03:42.685 --> 00:03:46.295
<00:03:42.685>Working <00:03:42.885>groups <00:03:43.085>can <00:03:43.285>publish <00:03:43.485>W <00:03:43.685>three <00:03:43.885>C <00:03:44.085>recommendations.

78
00:03:46.645 --> 00:03:48.455
<00:03:46.645>That <00:03:46.925>is <00:03:47.205>an <00:03:47.485>actual <00:03:47.765>web <00:03:48.045>standard.

79
00:03:49.005 --> 00:03:50.495
<00:03:49.005>What <00:03:49.196>you <00:03:49.388>will <00:03:49.579>see <00:03:49.771>on <00:03:49.962>the <00:03:50.154>right <00:03:50.346>side

80
00:03:50.495 --> 00:03:52.095
<00:03:50.495>of <00:03:50.775>the <00:03:51.055>screen <00:03:51.335>now <00:03:51.615>is <00:03:51.895>stuff

81
00:03:52.095 --> 00:03:55.415
<00:03:52.095>that <00:03:52.250>are <00:03:52.406>currently <00:03:52.561>being <00:03:52.717>worked <00:03:52.872>on <00:03:53.028>in <00:03:53.183>the <00:03:53.339>community <00:03:53.495>group.

82
00:03:55.725 --> 00:03:57.895
<00:03:55.725>Community <00:03:56.075>groups <00:03:56.424>cannot <00:03:56.775>publish <00:03:57.125>standards.

83
00:03:57.895 --> 00:03:59.775
<00:03:57.895>So <00:03:58.175>basically <00:03:58.455>this <00:03:58.735>is <00:03:59.015>more <00:03:59.295>experimental,

84
00:03:59.925 --> 00:04:02.055
<00:03:59.925>this <00:04:00.158>is <00:04:00.391>more <00:04:00.625>like <00:04:00.858>trying <00:04:01.091>out <00:04:01.325>stuff.

85
00:04:02.395 --> 00:04:05.615
<00:04:02.395>And <00:04:02.570>here <00:04:02.745>are <00:04:02.920>the <00:04:03.095>APIs <00:04:03.270>for <00:04:03.445>built <00:04:03.620>in <00:04:03.795>ai.

86
00:04:06.475 --> 00:04:09.215
<00:04:06.475>And <00:04:06.614>here, <00:04:06.755>first <00:04:06.894>of <00:04:07.035>all, <00:04:07.174>we <00:04:07.315>have <00:04:07.454>the <00:04:07.595>writing <00:04:07.734>systems <00:04:07.875>APIs

87
00:04:09.775 --> 00:04:12.535
<00:04:09.775>summarize <00:04:09.975>our <00:04:10.175>writer <00:04:10.375>rewrite <00:04:10.575>API <00:04:10.775>i, <00:04:10.975>the <00:04:11.175>translator

88
00:04:12.595 --> 00:04:14.335
<00:04:12.595>and <00:04:13.061>language <00:04:13.528>sector <00:04:13.995>APIs

89
00:04:14.675 --> 00:04:17.575
<00:04:14.675>or <00:04:14.850>the <00:04:15.025>Prompt <00:04:15.200>API <00:04:15.375>that <00:04:15.550>allow <00:04:15.725>you <00:04:15.900>to <00:04:16.075>talk

90
00:04:17.575 --> 00:04:19.255
<00:04:17.575>to <00:04:17.925>a <00:04:18.274>locally <00:04:18.625>installed, <00:04:18.974>uh,

91
00:04:19.255 --> 00:04:21.135
<00:04:19.255>large <00:04:19.488>language <00:04:19.721>model <00:04:19.954>right <00:04:20.188>in <00:04:20.421>the <00:04:20.654>browser.

92
00:04:23.605 --> 00:04:27.105
<00:04:23.605>And <00:04:23.712>the <00:04:23.820>first <00:04:23.928>demo <00:04:24.035>that <00:04:24.143>I <00:04:24.251>wanna <00:04:24.358>show <00:04:24.466>you <00:04:24.574>is <00:04:24.681>web <00:04:24.789>LLM <00:04:24.897>Web <00:04:25.005>LLM

93
00:04:27.135 --> 00:04:28.625
<00:04:27.135>uses <00:04:27.403>web <00:04:27.671>GPU <00:04:27.939>under <00:04:28.207>the <00:04:28.476>hood

94
00:04:28.725 --> 00:04:31.545
<00:04:28.725>and <00:04:28.880>it <00:04:29.036>allows <00:04:29.191>you <00:04:29.347>to <00:04:29.502>run <00:04:29.658>arbitrary <00:04:29.813>large <00:04:29.969>language <00:04:30.125>models

95
00:04:31.805 --> 00:04:33.385
<00:04:31.805>or <00:04:32.155>at <00:04:32.505>least <00:04:32.855>open <00:04:33.205>weights,

96
00:04:33.385 --> 00:04:35.945
<00:04:33.385>large <00:04:33.618>language <00:04:33.851>models <00:04:34.085>right <00:04:34.318>inside <00:04:34.551>your <00:04:34.784>browser.

97
00:04:36.405 --> 00:04:40.185
<00:04:36.405>So <00:04:36.638>let's <00:04:36.871>have <00:04:37.104>a <00:04:37.338>look, <00:04:37.571>um, <00:04:37.804>here,

98
00:04:40.665 --> 00:04:41.865
<00:04:40.665>I <00:04:41.025>prepared <00:04:41.385>that <00:04:41.745>already.

99
00:04:42.005 --> 00:04:45.705
<00:04:42.005>So <00:04:42.132>if <00:04:42.259>we <00:04:42.386>go <00:04:42.514>to <00:04:42.641>the <00:04:42.768>web <00:04:42.895>LLM <00:04:43.023>side, <00:04:43.150>I've <00:04:43.277>already <00:04:43.405>downloaded,

100
00:04:46.045 --> 00:04:47.065
<00:04:46.045>um, <00:04:46.351>a <00:04:46.657>local <00:04:46.963>model.

101
00:04:47.365 --> 00:04:50.745
<00:04:47.365>Uh, <00:04:47.481>so <00:04:47.598>here <00:04:47.715>you <00:04:47.831>can <00:04:47.948>see <00:04:48.065>a <00:04:48.181>long <00:04:48.298>list <00:04:48.415>of <00:04:48.531>open <00:04:48.648>weights, <00:04:48.765>uh,

102
00:04:50.765 --> 00:04:52.265
<00:04:50.765>models <00:04:51.034>that <00:04:51.305>you <00:04:51.575>can <00:04:51.844>choose <00:04:52.115>from,

103
00:04:53.645 --> 00:04:54.645
<00:04:53.645>Huh? <00:04:54.094>Yeah. <00:04:54.544>Okay,

104
00:04:54.645 --> 00:04:58.585
<00:04:54.645>thanks <00:04:54.800>for <00:04:54.956>letting <00:04:55.111>me <00:04:55.267>know. <00:04:55.422>Um, <00:04:55.578>so <00:04:55.733>let <00:04:55.889>me <00:04:56.044>see.

105
00:05:00.165 --> 00:05:00.385
Uh,

106
00:05:05.285 --> 00:05:06.345
<00:05:05.285>So <00:05:05.523>that <00:05:05.762>looks <00:05:06.000>better, <00:05:06.239>right?

107
00:05:06.805 --> 00:05:09.785
<00:05:06.805>So <00:05:06.945>here <00:05:07.085>we <00:05:07.225>have <00:05:07.365>a <00:05:07.505>large <00:05:07.645>list <00:05:07.785>of <00:05:07.925>large <00:05:08.065>language <00:05:08.205>models

108
00:05:10.175 --> 00:05:11.185
<00:05:10.175>that <00:05:10.402>you <00:05:10.629>can <00:05:10.856>choose <00:05:11.084>from.

109
00:05:11.485 --> 00:05:14.745
<00:05:11.485>Um, <00:05:11.660>and <00:05:11.835>I <00:05:12.010>selected, <00:05:12.185>uh, <00:05:12.360>here <00:05:12.535>the <00:05:12.710>LAMA <00:05:12.885>three,

110
00:05:14.805 --> 00:05:15.825
<00:05:14.805>two <00:05:15.264>model <00:05:15.723>before.

111
00:05:16.085 --> 00:05:19.545
<00:05:16.085>And <00:05:16.224>now <00:05:16.364>all <00:05:16.505>we <00:05:16.645>can <00:05:16.784>do <00:05:16.924>is <00:05:17.065>basically, <00:05:17.205>um, <00:05:17.344>process <00:05:17.484>locally.

112
00:05:19.685 --> 00:05:22.065
<00:05:19.685>So <00:05:19.860>we <00:05:20.035>can <00:05:20.210>ask <00:05:20.385>normal <00:05:20.560>questions <00:05:20.735>like, <00:05:20.910>uh, <00:05:21.085>what

113
00:05:22.765 --> 00:05:25.145
<00:05:22.765>is <00:05:22.998>the <00:05:23.231>capital <00:05:23.465>of <00:05:23.698>Germany, <00:05:23.931>for <00:05:24.164>example?

114
00:05:25.765 --> 00:05:29.345
<00:05:25.765>Uh, <00:05:25.905>and <00:05:26.044>now <00:05:26.185>we <00:05:26.325>can <00:05:26.465>also <00:05:26.604>just <00:05:26.745>kill <00:05:26.885>the <00:05:27.025>internet <00:05:27.164>connection.

115
00:05:29.645 --> 00:05:33.345
<00:05:29.645>We <00:05:29.772>click <00:05:29.899>send <00:05:30.026>and <00:05:30.154>it <00:05:30.281>now <00:05:30.408>loads <00:05:30.535>a <00:05:30.663>model <00:05:30.790>from <00:05:30.917>the <00:05:31.044>cache,

116
00:05:33.405 --> 00:05:36.345
<00:05:33.405>and <00:05:33.560>the <00:05:33.716>inference <00:05:33.871>is <00:05:34.027>working <00:05:34.182>capital <00:05:34.338>of <00:05:34.493>Germany <00:05:34.649>is <00:05:34.804>Berlin.

117
00:05:36.655 --> 00:05:39.225
<00:05:36.655>Awesome. <00:05:36.794>We <00:05:36.934>couldn't <00:05:37.075>do <00:05:37.215>anything <00:05:37.354>else <00:05:37.494>that <00:05:37.635>we <00:05:37.775>want <00:05:37.914>to <00:05:38.054>do

118
00:05:39.225 --> 00:05:40.585
<00:05:39.225>with, <00:05:39.531>uh, <00:05:39.837>large <00:05:40.143>language <00:05:40.448>models.

119
00:05:40.775 --> 00:05:42.025
<00:05:40.775>This <00:05:41.000>is <00:05:41.224>a <00:05:41.450>small <00:05:41.674>one, <00:05:41.900>right?

120
00:05:42.045 --> 00:05:46.265
<00:05:42.045>So <00:05:42.200>we <00:05:42.356>can <00:05:42.511>say, <00:05:42.667>give <00:05:42.822>me, <00:05:42.978>uh, <00:05:43.133>a <00:05:43.289>list <00:05:43.445>of

121
00:05:46.815 --> 00:05:51.385
<00:05:46.815>oops, <00:05:47.048>of <00:05:47.281>European, <00:05:47.515>uh, <00:05:47.748>capitals <00:05:47.981>as <00:05:48.215>JSO

122
00:05:51.385 --> 00:05:54.745
<00:05:51.385>for <00:05:51.560>example, <00:05:51.735>and <00:05:51.909>then <00:05:52.085>we <00:05:52.260>should <00:05:52.435>get <00:05:52.610>here, <00:05:52.784>uh,

123
00:05:54.775 --> 00:05:56.505
<00:05:54.775>this <00:05:55.241>need <00:05:55.708>list, <00:05:56.174>right?

124
00:05:56.505 --> 00:05:59.525
<00:05:56.505>You <00:05:56.660>can <00:05:56.816>do <00:05:56.971>translation, <00:05:57.127>you <00:05:57.282>can <00:05:57.438>do <00:05:57.593>categorization <00:05:57.749>of <00:05:57.905>data,

125
00:06:00.225 --> 00:06:03.325
<00:06:00.225>um, <00:06:00.425>translation, <00:06:00.625>uh, <00:06:00.825>sorry, <00:06:01.025>I <00:06:01.225>said <00:06:01.425>that <00:06:01.625>before.

126
00:06:03.465 --> 00:06:05.885
<00:06:03.465>Uh, <00:06:03.604>so <00:06:03.744>basically <00:06:03.885>all <00:06:04.025>the <00:06:04.164>things <00:06:04.304>that <00:06:04.445>you <00:06:04.585>can <00:06:04.724>typically <00:06:04.864>do

127
00:06:05.885 --> 00:06:09.805
<00:06:05.885>with, <00:06:06.040>um, <00:06:06.196>large <00:06:06.351>language <00:06:06.507>models, <00:06:06.662>you <00:06:06.818>can, <00:06:06.973>uh, <00:06:07.129>create <00:06:07.284>code

128
00:06:09.825 --> 00:06:11.805
<00:06:09.825>for <00:06:10.000>example, <00:06:10.175>or <00:06:10.349>generate <00:06:10.525>code <00:06:10.700>in <00:06:10.875>a <00:06:11.050>certain <00:06:11.224>language.

129
00:06:12.345 --> 00:06:13.485
<00:06:12.345>All <00:06:12.601>of <00:06:12.858>that <00:06:13.114>is <00:06:13.371>possible

130
00:06:13.905 --> 00:06:15.765
<00:06:13.905>and <00:06:14.104>it <00:06:14.304>happens <00:06:14.505>right <00:06:14.705>here <00:06:14.905>in <00:06:15.104>the <00:06:15.304>browser,

131
00:06:16.015 --> 00:06:17.805
<00:06:16.015>right <00:06:16.365>on <00:06:16.715>your <00:06:17.065>device <00:06:17.414>web,

132
00:06:17.925 --> 00:06:20.885
<00:06:17.925>LLM <00:06:18.100>very <00:06:18.275>cool <00:06:18.450>uses <00:06:18.625>web <00:06:18.800>GPU <00:06:18.975>under <00:06:19.150>the <00:06:19.325>hood.

133
00:06:21.625 --> 00:06:24.685
<00:06:21.625>Web <00:06:21.800>GPU <00:06:21.975>is <00:06:22.150>available <00:06:22.325>on, <00:06:22.500>uh, <00:06:22.675>chromium <00:06:22.850>based <00:06:23.025>browsers

134
00:06:24.745 --> 00:06:28.605
<00:06:24.745>and <00:06:24.885>in <00:06:25.025>safari <00:06:25.165>with <00:06:25.305>the <00:06:25.445>next, <00:06:25.585>uh, <00:06:25.725>update <00:06:25.865>of <00:06:26.005>macros <00:06:26.145>26

135
00:06:28.905 --> 00:06:30.365
<00:06:28.905>and <00:06:29.167>iOS <00:06:29.430>26 <00:06:29.693>and <00:06:29.956>so <00:06:30.219>on.

136
00:06:32.515 --> 00:06:37.045
<00:06:32.515>Alright, <00:06:32.794>so <00:06:33.075>that <00:06:33.354>is <00:06:33.635>web <00:06:33.914>LLM.

137
00:06:38.955 --> 00:06:42.655
<00:06:38.955>If <00:06:39.110>you <00:06:39.266>want <00:06:39.421>to <00:06:39.577>integrate <00:06:39.732>web <00:06:39.888>LLM <00:06:40.043>into <00:06:40.199>your <00:06:40.354>application,

138
00:06:42.655 --> 00:06:45.895
<00:06:42.655>into <00:06:42.794>your <00:06:42.934>website, <00:06:43.075>then <00:06:43.215>uh, <00:06:43.354>you <00:06:43.494>can <00:06:43.635>simply <00:06:43.775>go <00:06:43.914>to <00:06:44.054>NPM.

139
00:06:45.895 --> 00:06:50.135
<00:06:45.895>There's <00:06:46.034>a <00:06:46.174>great, <00:06:46.315>uh, <00:06:46.455>package, <00:06:46.594>uh, <00:06:46.734>provided <00:06:46.875>by, <00:06:47.015>uh, <00:06:47.155>MLC <00:06:47.294>ai.

140
00:06:50.275 --> 00:06:52.975
<00:06:50.275>You <00:06:50.414>can <00:06:50.554>simply <00:06:50.695>add <00:06:50.835>this <00:06:50.974>to <00:06:51.114>your <00:06:51.255>website <00:06:51.395>and <00:06:51.534>run <00:06:51.674>it.

141
00:06:53.315 --> 00:06:55.215
<00:06:53.315>Um, <00:06:53.594>and <00:06:53.875>it's <00:06:54.155>actually <00:06:54.435>pretty <00:06:54.715>straightforward

142
00:06:55.755 --> 00:06:58.215
<00:06:55.755>and <00:06:55.955>you <00:06:56.155>will <00:06:56.355>be <00:06:56.555>able <00:06:56.755>to <00:06:56.955>run <00:06:57.155>LLMs

143
00:06:58.215 --> 00:07:00.655
<00:06:58.215>and <00:06:58.415>integrate <00:06:58.615>them <00:06:58.815>into <00:06:59.015>your <00:06:59.215>website <00:06:59.415>very <00:06:59.615>easily.

144
00:07:00.935 --> 00:07:03.575
<00:07:00.935>I <00:07:01.090>also <00:07:01.246>have <00:07:01.401>a <00:07:01.557>demo <00:07:01.712>for <00:07:01.868>you <00:07:02.023>to <00:07:02.179>show <00:07:02.335>later.

145
00:07:04.555 --> 00:07:05.615
<00:07:04.555>So <00:07:04.793>how <00:07:05.032>does <00:07:05.270>that <00:07:05.509>work?

146
00:07:05.615 --> 00:07:09.495
<00:07:05.615>Internally, <00:07:05.895>we <00:07:06.175>are <00:07:06.455>essentially <00:07:06.735>downloading <00:07:07.015>the

147
00:07:10.085 --> 00:07:14.775
<00:07:10.085>open <00:07:10.240>weights <00:07:10.396>model <00:07:10.551>that <00:07:10.707>you, <00:07:10.862>that <00:07:11.018>you <00:07:11.173>selected <00:07:11.329>into, <00:07:11.484>um,

148
00:07:14.995 --> 00:07:17.415
<00:07:14.995>the <00:07:15.228>so-called <00:07:15.461>cache <00:07:15.695>storage <00:07:15.928>of <00:07:16.161>your <00:07:16.395>browser.

149
00:07:17.725 --> 00:07:20.615
<00:07:17.725>This <00:07:17.958>is, <00:07:18.191>uh, <00:07:18.425>uh, <00:07:18.658>yeah, <00:07:18.891>user <00:07:19.125>programmable

150
00:07:20.635 --> 00:07:22.455
<00:07:20.635>or <00:07:21.101>developer <00:07:21.568>programmable <00:07:22.034>cache,

151
00:07:22.755 --> 00:07:25.175
<00:07:22.755>and <00:07:23.034>that <00:07:23.315>belongs <00:07:23.594>to <00:07:23.875>your <00:07:24.155>website.

152
00:07:26.035 --> 00:07:27.855
<00:07:26.035>Um, <00:07:26.268>and <00:07:26.501>then <00:07:26.735>basically <00:07:26.968>we <00:07:27.201>download <00:07:27.435>all

153
00:07:27.855 --> 00:07:29.335
<00:07:27.855>of <00:07:28.077>the <00:07:28.299>model <00:07:28.521>weights <00:07:28.743>into <00:07:28.965>that <00:07:29.187>cache,

154
00:07:29.335 --> 00:07:31.455
<00:07:29.335>and <00:07:29.510>the <00:07:29.685>next <00:07:29.859>time <00:07:30.034>we <00:07:30.210>want <00:07:30.385>to <00:07:30.560>use <00:07:30.734>them,

155
00:07:31.635 --> 00:07:33.095
<00:07:31.635>we <00:07:31.822>can <00:07:32.010>simply <00:07:32.198>load <00:07:32.385>them <00:07:32.573>from <00:07:32.761>the <00:07:32.949>cache.

156
00:07:33.155 --> 00:07:35.575
<00:07:33.155>So <00:07:33.388>we <00:07:33.621>don't <00:07:33.854>need <00:07:34.088>internet <00:07:34.321>connection <00:07:34.554>anymore.

157
00:07:35.755 --> 00:07:38.255
<00:07:35.755>We <00:07:35.955>can <00:07:36.155>directly <00:07:36.355>read <00:07:36.555>the <00:07:36.755>weights <00:07:36.955>from <00:07:37.155>there.

158
00:07:39.485 --> 00:07:41.535
<00:07:39.485>However, <00:07:39.835>there's <00:07:40.185>a <00:07:40.535>small <00:07:40.885>problem

159
00:07:42.075 --> 00:07:45.975
<00:07:42.075>and <00:07:42.202>that <00:07:42.329>is <00:07:42.456>that <00:07:42.584>by <00:07:42.711>default, <00:07:42.838>um, <00:07:42.965>the <00:07:43.093>cache <00:07:43.220>is <00:07:43.347>isolated, <00:07:43.474>uh,

160
00:07:46.425 --> 00:07:48.055
<00:07:46.425>using <00:07:46.891>the <00:07:47.358>origin, <00:07:47.825>right?

161
00:07:48.155 --> 00:07:52.175
<00:07:48.155>So <00:07:48.388>for <00:07:48.621>example, <00:07:48.854>example.com <00:07:49.088>cannot <00:07:49.321>share <00:07:49.554>data

162
00:07:52.285 --> 00:07:56.695
<00:07:52.284>with <00:07:52.424>example.org <00:07:52.564>or <00:07:52.705>example <00:07:52.844>de <00:07:52.984>and <00:07:53.124>that <00:07:53.265>might <00:07:53.405>be <00:07:53.544>a <00:07:53.684>problem.

163
00:07:58.115 --> 00:08:01.215
<00:07:58.115>Why <00:07:58.290>is <00:07:58.465>it <00:07:58.640>a <00:07:58.815>problem? <00:07:58.990>Because <00:07:59.165>large <00:07:59.340>language <00:07:59.515>models

164
00:08:01.515 --> 00:08:03.015
<00:08:01.515>are <00:08:02.865>large.

165
00:08:03.635 --> 00:08:06.135
<00:08:03.635>Here's <00:08:03.868>a <00:08:04.101>selection <00:08:04.335>of <00:08:04.568>some, <00:08:04.801>um, <00:08:05.034>yeah,

166
00:08:06.395 --> 00:08:08.575
<00:08:06.395>of <00:08:06.628>various <00:08:06.861>large <00:08:07.094>language <00:08:07.328>models <00:08:07.561>like <00:08:07.794>five

167
00:08:08.655 --> 00:08:09.735
<00:08:08.655>three <00:08:09.140>by <00:08:09.627>Microsoft.

168
00:08:10.605 --> 00:08:13.055
<00:08:10.605>It's <00:08:10.805>a <00:08:11.005>small <00:08:11.205>model, <00:08:11.405>uh, <00:08:11.605>3 <00:08:11.805>billion <00:08:12.005>parameters,

169
00:08:13.395 --> 00:08:15.735
<00:08:13.395>but <00:08:13.628>it's <00:08:13.861>already <00:08:14.094>2.2 <00:08:14.328>gigabytes <00:08:14.561>in <00:08:14.794>size.

170
00:08:16.195 --> 00:08:18.415
<00:08:16.195>And <00:08:16.370>as <00:08:16.545>you <00:08:16.719>know, <00:08:16.895>the <00:08:17.070>bigger <00:08:17.245>models <00:08:17.420>are <00:08:17.594>better

171
00:08:18.555 --> 00:08:20.735
<00:08:18.555>and <00:08:18.835>deliver <00:08:19.115>better, <00:08:19.395>uh, <00:08:19.675>response <00:08:19.955>quality.

172
00:08:21.235 --> 00:08:23.775
<00:08:21.235>Uh, <00:08:21.375>so <00:08:21.515>if <00:08:21.655>you <00:08:21.795>would <00:08:21.935>decide <00:08:22.075>for <00:08:22.215>LAMA <00:08:22.355>three <00:08:22.495>with <00:08:22.635>uh,

173
00:08:23.775 --> 00:08:25.975
<00:08:23.775>70 <00:08:24.054>billion <00:08:24.335>parameters, <00:08:24.614>you <00:08:24.895>would <00:08:25.174>have

174
00:08:25.975 --> 00:08:29.255
<00:08:25.975>to <00:08:26.175>download <00:08:26.375>40 <00:08:26.575>gigabytes <00:08:26.775>and <00:08:26.975>again, <00:08:27.175>per <00:08:27.375>origin.

175
00:08:30.035 --> 00:08:32.295
<00:08:30.035>So <00:08:30.735>if <00:08:31.435>google.com

176
00:08:32.295 --> 00:08:34.975
<00:08:32.294>and <00:08:32.469>Google <00:08:32.645>EE <00:08:32.819>both <00:08:32.995>wanted <00:08:33.169>to <00:08:33.344>download <00:08:33.520>LAMA <00:08:33.694>three,

177
00:08:35.555 --> 00:08:38.015
<00:08:35.554>we <00:08:35.834>would <00:08:36.114>basically <00:08:36.395>occupy <00:08:36.674>80 <00:08:36.954>gigabytes

178
00:08:38.075 --> 00:08:39.375
<00:08:38.075>of <00:08:38.367>storage <00:08:38.660>on <00:08:38.952>your <00:08:39.245>device.

179
00:08:39.755 --> 00:08:41.975
<00:08:39.755>So <00:08:40.034>that <00:08:40.314>doesn't <00:08:40.595>sound <00:08:40.875>too <00:08:41.155>great.

180
00:08:42.745 --> 00:08:45.655
<00:08:42.745>There <00:08:42.885>might <00:08:43.025>be <00:08:43.164>a <00:08:43.304>potential <00:08:43.445>solution <00:08:43.585>for <00:08:43.725>this <00:08:43.865>now, <00:08:44.005>we'll, <00:08:44.145>uh,

181
00:08:45.815 --> 00:08:47.335
<00:08:45.815>talk <00:08:46.088>about <00:08:46.362>that <00:08:46.635>in <00:08:46.909>a <00:08:47.183>bit.

182
00:08:49.565 --> 00:08:52.695
<00:08:49.565>Next <00:08:49.740>approach. <00:08:49.915>Uh, <00:08:50.090>web <00:08:50.265>LLM <00:08:50.440>is <00:08:50.615>a <00:08:50.790>nice <00:08:50.965>library

183
00:08:52.835 --> 00:08:53.855
<00:08:52.835>for <00:08:53.294>running <00:08:53.753>LLMs,

184
00:08:53.855 --> 00:08:56.485
<00:08:53.855>but <00:08:54.088>there's <00:08:54.321>also <00:08:54.555>more <00:08:54.788>workloads <00:08:55.021>than <00:08:55.255>just

185
00:08:56.875 --> 00:08:58.325
<00:08:56.875>LLMs <00:08:57.527>and <00:08:58.180>Transformers.

186
00:08:58.465 --> 00:09:02.125
<00:08:58.465>JS <00:08:58.640>is <00:08:58.815>a <00:08:58.990>nice <00:08:59.165>library <00:08:59.340>to <00:08:59.515>run <00:08:59.690>additional, <00:08:59.865>um,

187
00:09:03.685 --> 00:09:05.525
<00:09:03.685>ML <00:09:03.964>workloads <00:09:04.244>right <00:09:04.525>inside <00:09:04.805>your <00:09:05.084>browser.

188
00:09:06.115 --> 00:09:09.085
<00:09:06.115>Also <00:09:06.270>currently <00:09:06.426>using <00:09:06.581>Web <00:09:06.737>GPU <00:09:06.892>for <00:09:07.048>most <00:09:07.203>of <00:09:07.359>the <00:09:07.515>time.

189
00:09:10.865 --> 00:09:12.265
<00:09:10.865>Alrighty, <00:09:11.075>I <00:09:11.285>need <00:09:11.495>to <00:09:11.705>go <00:09:11.915>back <00:09:12.125>online.

190
00:09:12.825 --> 00:09:15.425
<00:09:12.825>'cause <00:09:13.105>accessing <00:09:13.385>the <00:09:13.665>site <00:09:13.945>unfortunately <00:09:14.225>needs,

191
00:09:16.325 --> 00:09:18.425
<00:09:16.325>um, <00:09:16.791>needs <00:09:17.258>a <00:09:17.725>connection.

192
00:09:18.485 --> 00:09:20.865
<00:09:18.485>And <00:09:18.612>here <00:09:18.739>you <00:09:18.866>can <00:09:18.994>see <00:09:19.121>what <00:09:19.248>you <00:09:19.375>can, <00:09:19.503>uh, <00:09:19.630>do <00:09:19.757>with <00:09:19.885>it,

193
00:09:21.015 --> 00:09:23.465
<00:09:21.015>like <00:09:21.295>natural <00:09:21.574>language <00:09:21.855>processing, <00:09:22.135>computer <00:09:22.415>vision,

194
00:09:23.515 --> 00:09:25.025
<00:09:23.515>audio <00:09:24.194>multimodal <00:09:24.874>stuff.

195
00:09:25.525 --> 00:09:27.905
<00:09:25.525>And <00:09:25.665>there's <00:09:25.805>a <00:09:25.944>neat <00:09:26.084>little <00:09:26.225>demo <00:09:26.365>that <00:09:26.505>I <00:09:26.645>wanna <00:09:26.785>show <00:09:26.925>you,

196
00:09:27.995 --> 00:09:30.105
<00:09:27.995>which <00:09:28.275>is <00:09:28.555>called <00:09:28.835>a <00:09:29.115>doodle <00:09:29.395>dash.

197
00:09:30.415 --> 00:09:33.385
<00:09:30.415>It's <00:09:30.648>a <00:09:30.881>real <00:09:31.115>time <00:09:31.348>sketch, <00:09:31.581>uh, <00:09:31.814>game.

198
00:09:33.845 --> 00:09:36.505
<00:09:33.845>And <00:09:34.020>basically <00:09:34.195>the <00:09:34.370>eye <00:09:34.545>has <00:09:34.720>to <00:09:34.895>guess <00:09:35.070>my <00:09:35.245>sketches.

199
00:09:36.685 --> 00:09:40.065
<00:09:36.685>So <00:09:36.859>let's <00:09:37.035>try <00:09:37.209>that <00:09:37.385>out. <00:09:37.560>So <00:09:37.734>3, <00:09:37.910>2, <00:09:38.084>1.

200
00:09:40.065 --> 00:09:42.945
<00:09:40.065>Let's <00:09:40.181>see <00:09:40.298>how <00:09:40.415>good <00:09:40.531>I <00:09:40.648>can <00:09:40.765>draw. <00:09:40.881>So <00:09:40.998>I <00:09:41.115>should <00:09:41.231>draw <00:09:41.348>a <00:09:41.465>leaf.

201
00:09:43.455 --> 00:09:46.225
<00:09:43.455>Awesome. <00:09:43.805>So <00:09:44.155>maybe <00:09:44.505>like <00:09:44.855>this.

202
00:09:47.825 --> 00:09:51.585
<00:09:47.825>Hmm, <00:09:47.980>okay, <00:09:48.136>let's <00:09:48.291>skip <00:09:48.447>that. <00:09:48.602>Uh, <00:09:48.758>a <00:09:48.913>fireplace. <00:09:49.069>Ooh, <00:09:49.225>okay.

203
00:09:51.635 --> 00:09:55.545
<00:09:51.635>Maybe <00:09:51.915>something <00:09:52.194>like <00:09:52.475>this. <00:09:52.755>Uh, <00:09:53.035>snowflake.

204
00:09:55.545 --> 00:09:59.385
<00:09:55.545>Yeah, <00:09:55.685>too <00:09:55.824>bad <00:09:55.964>a <00:09:56.104>moon. <00:09:56.245>Let's <00:09:56.385>see. <00:09:56.525>Ah, <00:09:56.665>okay, <00:09:56.805>that <00:09:56.944>worked.

205
00:10:00.165 --> 00:10:02.905
<00:10:00.165>Uh, <00:10:00.339>a <00:10:00.515>can. <00:10:00.689>Okay, <00:10:00.865>that's <00:10:01.040>something <00:10:01.214>like <00:10:01.390>this <00:10:01.564>here.

206
00:10:03.545 --> 00:10:08.335
<00:10:03.545>I <00:10:03.824>don't <00:10:04.104>know. <00:10:04.385>Okay, <00:10:04.665>so <00:10:04.944>sometimes,

207
00:10:08.335 --> 00:10:10.135
<00:10:08.335>sometimes <00:10:08.615>I'm <00:10:08.895>a <00:10:09.175>little <00:10:09.455>better, <00:10:09.735>right?

208
00:10:10.835 --> 00:10:15.375
<00:10:10.835>So <00:10:11.010>this <00:10:11.185>is <00:10:11.360>not, <00:10:11.535>uh, <00:10:11.710>let's <00:10:11.885>see. <00:10:12.060>Okay. <00:10:12.235>Right.

209
00:10:15.375 --> 00:10:18.215
<00:10:15.375>And <00:10:15.515>this <00:10:15.655>is <00:10:15.795>basically <00:10:15.935>a <00:10:16.075>fun <00:10:16.215>demo <00:10:16.355>for <00:10:16.495>something <00:10:16.635>else, <00:10:16.775>okay?

210
00:10:18.215 --> 00:10:21.895
<00:10:18.215>It's <00:10:18.370>a <00:10:18.526>jail. <00:10:18.681>Awesome. <00:10:18.837>Uh, <00:10:18.992>for <00:10:19.148>something, <00:10:19.303>for <00:10:19.459>something <00:10:19.615>else,

211
00:10:21.925 --> 00:10:24.695
<00:10:21.925>like <00:10:22.080>besides, <00:10:22.236>uh, <00:10:22.391>large <00:10:22.547>language <00:10:22.702>models, <00:10:22.858>and <00:10:23.013>it's <00:10:23.169>also <00:10:23.324>fun.

212
00:10:24.955 --> 00:10:27.135
<00:10:24.955>Use <00:10:25.155>a <00:10:25.355>neural <00:10:25.555>network <00:10:25.755>that <00:10:25.955>runs <00:10:26.155>on <00:10:26.355>device.

213
00:10:27.675 --> 00:10:31.735
<00:10:27.675>And <00:10:27.814>so <00:10:27.954>basically <00:10:28.094>you <00:10:28.234>play <00:10:28.375>that <00:10:28.515>game, <00:10:28.655>uh, <00:10:28.795>regardless <00:10:28.935>of <00:10:29.074>your,

214
00:10:32.435 --> 00:10:34.495
<00:10:32.435>um, <00:10:32.785>of <00:10:33.135>your <00:10:33.484>internet <00:10:33.834>connection.

215
00:10:37.375 --> 00:10:39.055
<00:10:37.375>Alrighty, <00:10:37.725>up <00:10:38.075>until <00:10:38.425>now, <00:10:38.775>all

216
00:10:39.055 --> 00:10:41.975
<00:10:39.055>of <00:10:39.288>those <00:10:39.521>demos <00:10:39.755>used <00:10:39.988>web <00:10:40.221>GPU, <00:10:40.454>why?

217
00:10:41.975 --> 00:10:44.495
<00:10:41.975>Because <00:10:42.208>that <00:10:42.441>is <00:10:42.675>much <00:10:42.908>more <00:10:43.141>supported, <00:10:43.375>uh,

218
00:10:44.495 --> 00:10:47.495
<00:10:44.495>currently <00:10:44.650>on <00:10:44.806>the <00:10:44.961>web, <00:10:45.117>but <00:10:45.272>there <00:10:45.428>is <00:10:45.583>a <00:10:45.739>new <00:10:45.895>API

219
00:10:47.495 --> 00:10:50.535
<00:10:47.495>that <00:10:47.670>is <00:10:47.845>very <00:10:48.020>interesting <00:10:48.195>and <00:10:48.370>that's <00:10:48.545>upcoming <00:10:48.720>called <00:10:48.895>Web

220
00:10:50.635 --> 00:10:53.695
<00:10:50.635>and <00:10:50.835>n <00:10:51.035>an <00:10:51.235>N <00:10:51.435>stands <00:10:51.635>for <00:10:51.835>Neural <00:10:52.035>Network.

221
00:10:54.155 --> 00:10:57.975
<00:10:54.155>And <00:10:54.282>the <00:10:54.409>idea <00:10:54.536>here <00:10:54.664>is <00:10:54.791>that <00:10:54.918>we <00:10:55.045>cannot <00:10:55.173>only <00:10:55.300>access <00:10:55.427>your, <00:10:55.555>uh,

222
00:10:58.215 --> 00:11:00.735
<00:10:58.215>GPU, <00:10:58.355>what <00:10:58.495>we <00:10:58.635>could <00:10:58.775>do <00:10:58.915>with <00:10:59.055>like <00:10:59.195>JavaScript <00:10:59.335>and <00:10:59.475>web <00:10:59.615>assembly,

223
00:11:01.155 --> 00:11:05.175
<00:11:01.155>and <00:11:01.282>not <00:11:01.409>only <00:11:01.536>your <00:11:01.664>GPU, <00:11:01.791>which <00:11:01.918>we <00:11:02.045>could <00:11:02.173>access <00:11:02.300>via <00:11:02.427>web <00:11:02.555>GPU,

224
00:11:05.395 --> 00:11:07.855
<00:11:05.395>but <00:11:05.745>also <00:11:06.095>the <00:11:06.444>so-called <00:11:06.795>NPU

225
00:11:07.955 --> 00:11:10.775
<00:11:07.955>or <00:11:08.305>TPU <00:11:08.655>Neural <00:11:09.005>Processing <00:11:09.355>Unit,

226
00:11:11.075 --> 00:11:13.415
<00:11:11.075>or <00:11:11.275>tens <00:11:11.475>of <00:11:11.675>processing <00:11:11.875>unit <00:11:12.075>of <00:11:12.275>your <00:11:12.475>device.

227
00:11:13.715 --> 00:11:16.495
<00:11:13.715>And <00:11:13.915>this <00:11:14.115>is <00:11:14.315>hardware <00:11:14.515>that <00:11:14.715>is <00:11:14.915>basically <00:11:15.115>accelerated

228
00:11:16.755 --> 00:11:20.215
<00:11:16.755>for <00:11:16.895>running, <00:11:17.035>uh, <00:11:17.175>AI <00:11:17.314>or <00:11:17.455>ML <00:11:17.595>workloads <00:11:17.735>on, <00:11:17.875>on <00:11:18.015>your <00:11:18.155>device.

229
00:11:21.155 --> 00:11:25.055
<00:11:21.155>So, <00:11:21.310>uh, <00:11:21.466>this <00:11:21.621>API <00:11:21.777>will <00:11:21.932>grant <00:11:22.088>you <00:11:22.243>access <00:11:22.399>to <00:11:22.555>all

230
00:11:25.055 --> 00:11:28.615
<00:11:25.055>of <00:11:25.182>those <00:11:25.309>processing <00:11:25.436>units <00:11:25.564>to <00:11:25.691>pick <00:11:25.818>the <00:11:25.945>best <00:11:26.073>one <00:11:26.200>for <00:11:26.327>the <00:11:26.454>AI

231
00:11:28.615 --> 00:11:31.895
<00:11:28.615>or <00:11:28.770>ML <00:11:28.926>workload <00:11:29.081>that <00:11:29.237>you <00:11:29.392>wanna <00:11:29.548>run <00:11:29.703>currently <00:11:29.859>in <00:11:30.015>specification

232
00:11:31.895 --> 00:11:33.415
<00:11:31.895>at <00:11:32.168>the <00:11:32.442>web <00:11:32.715>ML <00:11:32.989>working <00:11:33.262>group.

233
00:11:33.515 --> 00:11:36.735
<00:11:33.515>So <00:11:33.715>this <00:11:33.915>could <00:11:34.115>eventually <00:11:34.314>then <00:11:34.515>become <00:11:34.715>a <00:11:34.915>recommendation,

234
00:11:36.735 --> 00:11:39.455
<00:11:36.735>a <00:11:36.968>so-called <00:11:37.201>standard, <00:11:37.435>and <00:11:37.668>then, <00:11:37.901>uh, <00:11:38.135>yeah,

235
00:11:39.455 --> 00:11:41.735
<00:11:39.455>this <00:11:39.805>is <00:11:40.155>currently <00:11:40.505>implemented, <00:11:40.855>um,

236
00:11:41.995 --> 00:11:44.255
<00:11:41.995>in <00:11:42.275>chromium <00:11:42.555>is <00:11:42.835>behind <00:11:43.115>the <00:11:43.395>flex.

237
00:11:44.255 --> 00:11:46.055
<00:11:44.255>So <00:11:44.488>you <00:11:44.721>need <00:11:44.955>to <00:11:45.188>enable <00:11:45.421>that, <00:11:45.655>uh,

238
00:11:46.115 --> 00:11:49.495
<00:11:46.115>and <00:11:46.270>it <00:11:46.426>gives <00:11:46.581>us <00:11:46.737>a <00:11:46.892>great <00:11:47.048>performance <00:11:47.203>for <00:11:47.359>specific <00:11:47.515>workloads.

239
00:11:51.725 --> 00:11:55.565
<00:11:51.725>Okay, <00:11:51.900>so <00:11:52.075>let's <00:11:52.250>have <00:11:52.425>a <00:11:52.600>demo <00:11:52.775>of <00:11:52.950>Web <00:11:53.125>andm.

240
00:11:57.395 --> 00:12:00.975
<00:11:57.395>The <00:11:57.535>web <00:11:57.675>and <00:11:57.814>n <00:11:57.954>website <00:11:58.095>just <00:11:58.235>launched <00:11:58.375>a <00:11:58.515>few <00:11:58.655>weeks <00:11:58.795>back.

241
00:12:01.445 --> 00:12:04.935
<00:12:01.445>It's <00:12:01.795>uh, <00:12:02.145>called <00:12:02.495>uh, <00:12:02.845>web.io.

242
00:12:05.435 --> 00:12:08.495
<00:12:05.435>Uh, <00:12:05.574>so <00:12:05.714>if <00:12:05.854>you <00:12:05.994>wanna <00:12:06.135>learn <00:12:06.275>more <00:12:06.415>about <00:12:06.555>web, <00:12:06.694>just <00:12:06.834>go

243
00:12:08.495 --> 00:12:10.415
<00:12:08.495>to <00:12:08.845>this, <00:12:09.195>to <00:12:09.545>this <00:12:09.895>website.

244
00:12:11.715 --> 00:12:16.415
<00:12:11.715>Um, <00:12:11.870>and <00:12:12.026>here <00:12:12.181>we <00:12:12.337>have <00:12:12.492>a, <00:12:12.648>so <00:12:12.803>the <00:12:12.959>playground, <00:12:13.115>no,

245
00:12:16.435 --> 00:12:18.335
<00:12:16.435>the <00:12:16.785>showcase <00:12:17.135>I <00:12:17.484>guess, <00:12:17.834>right?

246
00:12:18.835 --> 00:12:22.615
<00:12:18.835>Uh, <00:12:19.115>and <00:12:19.395>here <00:12:19.675>there <00:12:19.955>is, <00:12:20.235>yeah,

247
00:12:22.705 --> 00:12:25.455
<00:12:22.705>maybe, <00:12:22.938>let's <00:12:23.171>see, <00:12:23.405>what <00:12:23.638>should <00:12:23.871>we <00:12:24.105>do?

248
00:12:25.455 --> 00:12:28.575
<00:12:25.455>Image <00:12:25.688>classification, <00:12:25.921>that's, <00:12:26.155>uh, <00:12:26.388>always <00:12:26.621>quite <00:12:26.855>nice.

249
00:12:29.035 --> 00:12:32.775
<00:12:29.035>And <00:12:29.175>then <00:12:29.314>we <00:12:29.454>can <00:12:29.594>also <00:12:29.735>compare, <00:12:29.875>uh, <00:12:30.015>between <00:12:30.155>like <00:12:30.295>CPU, <00:12:30.435>um,

250
00:12:33.325 --> 00:12:37.095
<00:12:33.325>performance <00:12:33.675>and, <00:12:34.025>um, <00:12:34.375>NPU <00:12:34.725>performance.

251
00:12:37.515 --> 00:12:40.575
<00:12:37.515>So <00:12:37.670>here <00:12:37.826>I'm <00:12:37.981>just <00:12:38.137>downloading <00:12:38.292>the, <00:12:38.448>the <00:12:38.603>model <00:12:38.759>that <00:12:38.915>takes

252
00:12:41.465 --> 00:12:42.755
<00:12:41.465>hopefully <00:12:41.852>not <00:12:42.239>too <00:12:42.626>long.

253
00:12:43.335 --> 00:12:45.475
<00:12:43.335>Um, <00:12:43.510>and <00:12:43.685>basically <00:12:43.860>this <00:12:44.035>uses <00:12:44.210>mobile <00:12:44.385>net <00:12:44.560>V <00:12:44.735>two,

254
00:12:45.475 --> 00:12:48.435
<00:12:45.475>which <00:12:45.675>is <00:12:45.875>the <00:12:46.075>image <00:12:46.275>recognition <00:12:46.475>or <00:12:46.675>classification <00:12:46.875>model,

255
00:12:48.935 --> 00:12:51.875
<00:12:48.935>and <00:12:49.090>hopefully <00:12:49.246>can <00:12:49.401>be <00:12:49.557>used <00:12:49.712>together <00:12:49.868>with <00:12:50.023>my <00:12:50.179>camera <00:12:50.334>feed.

256
00:12:52.375 --> 00:12:54.955
<00:12:52.375>Um, <00:12:52.530>and <00:12:52.686>then <00:12:52.841>I <00:12:52.997>could <00:12:53.152>hold <00:12:53.308>something <00:12:53.463>into <00:12:53.619>the <00:12:53.775>camera

257
00:12:55.335 --> 00:12:58.275
<00:12:55.335>and <00:12:55.615>hopefully, <00:12:55.895>um, <00:12:56.175>it <00:12:56.455>would <00:12:56.735>recognize

258
00:12:58.375 --> 00:13:01.475
<00:12:58.375>or <00:12:58.575>detect <00:12:58.775>stuff <00:12:58.975>that <00:12:59.175>is <00:12:59.375>inside <00:12:59.575>the <00:12:59.775>camera.

259
00:13:02.135 --> 00:13:03.995
<00:13:02.135>So <00:13:02.290>just <00:13:02.446>to <00:13:02.601>be <00:13:02.757>sure, <00:13:02.912>I <00:13:03.068>just <00:13:03.223>duplicate <00:13:03.379>that <00:13:03.535>tap

260
00:13:03.995 --> 00:13:06.675
<00:13:03.995>and <00:13:04.170>also <00:13:04.345>do <00:13:04.520>the <00:13:04.695>same <00:13:04.870>for, <00:13:05.045>uh, <00:13:05.220>the <00:13:05.395>NPU.

261
00:13:08.455 --> 00:13:10.235
<00:13:08.455>So <00:13:09.155>let's <00:13:09.855>see.

262
00:13:13.265 --> 00:13:15.755
<00:13:13.265>Okay, <00:13:13.465>looks <00:13:13.665>good. <00:13:13.865>So <00:13:14.064>this <00:13:14.265>is <00:13:14.465>me, <00:13:14.665>CPU.

263
00:13:15.775 --> 00:13:18.235
<00:13:15.775>So <00:13:16.008>we <00:13:16.241>see <00:13:16.475>120 <00:13:16.708>frames <00:13:16.941>per <00:13:17.175>second.

264
00:13:18.735 --> 00:13:21.075
<00:13:18.735>And <00:13:18.890>now <00:13:19.046>let's <00:13:19.201>see <00:13:19.357>if <00:13:19.512>it <00:13:19.668>recognizes <00:13:19.823>this <00:13:19.979>water <00:13:20.135>bottle.

265
00:13:22.055 --> 00:13:24.995
<00:13:22.055>Yes, <00:13:22.255>right? <00:13:22.454>That <00:13:22.655>is <00:13:22.854>the <00:13:23.055>water <00:13:23.255>bottle. <00:13:23.454>Awesome.

266
00:13:26.135 --> 00:13:30.115
<00:13:26.135>Um, <00:13:26.290>and <00:13:26.446>we <00:13:26.601>can <00:13:26.757>see <00:13:26.912>120 <00:13:27.068>frames <00:13:27.223>per <00:13:27.379>second, <00:13:27.535>CPU.

267
00:13:30.535 --> 00:13:32.355
<00:13:30.535>Now <00:13:30.735>let's <00:13:30.935>do <00:13:31.135>the <00:13:31.334>same <00:13:31.535>thing <00:13:31.735>with <00:13:31.935>NPU,

268
00:13:32.415 --> 00:13:34.075
<00:13:32.415>and <00:13:32.648>maybe <00:13:32.881>you <00:13:33.115>can <00:13:33.348>already <00:13:33.581>spot <00:13:33.814>the

269
00:13:34.075 --> 00:13:36.115
<00:13:34.075>difference <00:13:34.541>apart <00:13:35.008>from <00:13:35.475>that.

270
00:13:36.115 --> 00:13:38.515
<00:13:36.115>This <00:13:36.290>is, <00:13:36.465>yeah, <00:13:36.640>a <00:13:36.815>pop, <00:13:36.990>a <00:13:37.165>solar <00:13:37.340>bottle, <00:13:37.515>awesome.

271
00:13:39.495 --> 00:13:43.755
<00:13:39.495>The <00:13:39.650>frames, <00:13:39.806>um, <00:13:39.961>yeah, <00:13:40.117>basically <00:13:40.272>are <00:13:40.428>10 <00:13:40.583>times <00:13:40.739>higher, <00:13:40.895>right?

272
00:13:43.755 --> 00:13:47.555
<00:13:43.755>So <00:13:43.988>we, <00:13:44.221>uh, <00:13:44.455>do <00:13:44.688>approximately <00:13:44.921>120, <00:13:45.155>sorry,

273
00:13:47.695 --> 00:13:49.675
<00:13:47.695>1,200 <00:13:48.161>frames <00:13:48.628>a <00:13:49.095>second.

274
00:13:49.735 --> 00:13:52.195
<00:13:49.735>So <00:13:50.015>significantly <00:13:50.295>better, <00:13:50.575>uh, <00:13:50.855>than <00:13:51.135>before.

275
00:13:53.055 --> 00:13:55.915
<00:13:53.055>And <00:13:53.255>that <00:13:53.454>is <00:13:53.655>possible, <00:13:53.854>uh, <00:13:54.055>thanks <00:13:54.255>to <00:13:54.454>webinar.

276
00:13:56.785 --> 00:13:58.675
<00:13:56.785>There's <00:13:57.251>also <00:13:57.718>more <00:13:58.185>demos.

277
00:13:58.695 --> 00:14:01.355
<00:13:58.695>So <00:13:58.895>this <00:13:59.095>is <00:13:59.295>not <00:13:59.495>only <00:13:59.695>for, <00:13:59.895>um, <00:14:00.095>yeah,

278
00:14:01.415 --> 00:14:02.875
<00:14:01.415>for <00:14:01.743>image <00:14:02.072>classification <00:14:02.400>and <00:14:02.729>stuff.

279
00:14:03.135 --> 00:14:05.675
<00:14:03.135>You <00:14:03.368>could <00:14:03.601>also <00:14:03.835>do, <00:14:04.068>uh, <00:14:04.301>digit <00:14:04.535>classification.

280
00:14:06.215 --> 00:14:09.635
<00:14:06.215>Um, <00:14:06.448>very <00:14:06.681>traditional, <00:14:06.915>uh, <00:14:07.148>demo, <00:14:07.381>uh, <00:14:07.615>for,

281
00:14:10.335 --> 00:14:11.555
<00:14:10.335>uh, <00:14:10.701>yeah, <00:14:11.067>machine <00:14:11.433>learning.

282
00:14:12.815 --> 00:14:14.635
<00:14:12.815>Um, <00:14:13.015>yeah, <00:14:13.215>which <00:14:13.415>you <00:14:13.615>can <00:14:13.815>also <00:14:14.015>do <00:14:14.215>together

283
00:14:14.655 --> 00:14:15.955
<00:14:14.655>or <00:14:14.947>in <00:14:15.240>combination <00:14:15.532>with <00:14:15.825>webinar.

284
00:14:17.345 --> 00:14:19.525
<00:14:17.345>How <00:14:17.485>do <00:14:17.625>you <00:14:17.765>enable <00:14:17.905>webinar <00:14:18.045>in <00:14:18.185>your <00:14:18.325>browser <00:14:18.465>if <00:14:18.605>you <00:14:18.745>want

285
00:14:19.525 --> 00:14:22.965
<00:14:19.525>to <00:14:19.652>try <00:14:19.779>it <00:14:19.906>out, <00:14:20.034>it <00:14:20.161>is <00:14:20.288>super <00:14:20.415>simple <00:14:20.543>in <00:14:20.670>your <00:14:20.797>chromium <00:14:20.925>based

286
00:14:22.965 --> 00:14:25.525
<00:14:22.965>browser, <00:14:23.245>simply <00:14:23.525>go <00:14:23.805>to <00:14:24.085>about <00:14:24.365>flags

287
00:14:25.665 --> 00:14:28.285
<00:14:25.665>and <00:14:25.820>then <00:14:25.976>just, <00:14:26.131>uh, <00:14:26.287>just <00:14:26.442>um, <00:14:26.598>flip <00:14:26.753>on <00:14:26.909>the <00:14:27.064>flags

288
00:14:28.385 --> 00:14:30.485
<00:14:28.385>for <00:14:28.735>enabled <00:14:29.085>weapon <00:14:29.435>and <00:14:29.785>API

289
00:14:30.785 --> 00:14:33.845
<00:14:30.785>and <00:14:30.985>for <00:14:31.185>enabled <00:14:31.385>experimental <00:14:31.584>weapon <00:14:31.785>and <00:14:31.985>API <00:14:32.185>features.

290
00:14:34.025 --> 00:14:36.365
<00:14:34.025>And <00:14:34.225>then <00:14:34.425>you <00:14:34.625>can <00:14:34.824>use <00:14:35.025>this <00:14:35.225>API, <00:14:35.425>um,

291
00:14:36.615 --> 00:14:39.845
<00:14:36.615>about <00:14:36.815>flags <00:14:37.015>works <00:14:37.215>in <00:14:37.415>every <00:14:37.615>chromium <00:14:37.815>based <00:14:38.015>browser,

292
00:14:40.025 --> 00:14:41.125
<00:14:40.025>uh, <00:14:40.355>chromium <00:14:40.685>based <00:14:41.015>browser.

293
00:14:41.145 --> 00:14:42.365
<00:14:41.145>So <00:14:41.328>it <00:14:41.511>doesn't <00:14:41.694>matter <00:14:41.877>if <00:14:42.060>it's <00:14:42.243>chrome

294
00:14:42.365 --> 00:14:45.805
<00:14:42.365>or <00:14:42.492>edge, <00:14:42.619>just <00:14:42.746>open <00:14:42.874>that <00:14:43.001>site, <00:14:43.128>enable <00:14:43.255>to <00:14:43.383>flag, <00:14:43.510>uh, <00:14:43.637>to <00:14:43.765>flags,

295
00:14:45.805 --> 00:14:49.045
<00:14:45.805>and <00:14:45.944>then <00:14:46.084>you <00:14:46.224>are <00:14:46.364>able <00:14:46.505>to <00:14:46.645>access, <00:14:46.785>uh, <00:14:46.925>this <00:14:47.064>new <00:14:47.204>API.

296
00:14:51.605 --> 00:14:54.125
<00:14:51.605>I <00:14:51.760>also <00:14:51.916>wanna <00:14:52.071>be <00:14:52.227>honest <00:14:52.382>and <00:14:52.538>highlight <00:14:52.693>like <00:14:52.849>the <00:14:53.005>drawbacks

297
00:14:54.125 --> 00:14:57.845
<00:14:54.125>of <00:14:54.300>the <00:14:54.475>local, <00:14:54.650>um, <00:14:54.825>approaches <00:14:55.000>webinar <00:14:55.175>or <00:14:55.350>web <00:14:55.525>review.

298
00:14:57.845 --> 00:14:59.365
<00:14:57.845>The <00:14:58.040>other <00:14:58.235>local <00:14:58.431>approach <00:14:58.626>that <00:14:58.822>we <00:14:59.017>have <00:14:59.213>seen,

299
00:14:59.465 --> 00:15:02.045
<00:14:59.465>of <00:14:59.698>course <00:14:59.931>also <00:15:00.165>have <00:15:00.398>some, <00:15:00.631>uh, <00:15:00.865>drawbacks.

300
00:15:02.265 --> 00:15:05.165
<00:15:02.265>And <00:15:02.439>that <00:15:02.615>is <00:15:02.790>that <00:15:02.965>we <00:15:03.140>cannot <00:15:03.314>share <00:15:03.490>models <00:15:03.665>across

301
00:15:05.275 --> 00:15:06.285
<00:15:05.275>origins, <00:15:06.184>right?

302
00:15:06.285 --> 00:15:08.165
<00:15:06.285>We <00:15:06.518>have <00:15:06.751>to <00:15:06.985>download <00:15:07.218>them <00:15:07.451>multiple <00:15:07.685>times

303
00:15:09.185 --> 00:15:11.245
<00:15:09.185>and <00:15:09.464>the <00:15:09.744>inference <00:15:10.025>is <00:15:10.305>quite <00:15:10.584>fast,

304
00:15:11.665 --> 00:15:14.045
<00:15:11.665>but <00:15:11.944>it's <00:15:12.224>not <00:15:12.505>full <00:15:12.785>native <00:15:13.064>speed

305
00:15:14.045 --> 00:15:16.005
<00:15:14.045>because <00:15:14.395>it's <00:15:14.745>an <00:15:15.094>abstraction, <00:15:15.444>right?

306
00:15:16.005 --> 00:15:19.365
<00:15:16.005>An <00:15:16.180>abstraction, <00:15:16.355>all <00:15:16.530>waste <00:15:16.705>costs, <00:15:16.880>a <00:15:17.055>little <00:15:17.230>bit <00:15:17.405>performance.

307
00:15:19.705 --> 00:15:21.725
<00:15:19.705>So <00:15:19.905>we <00:15:20.105>don't <00:15:20.305>achieve <00:15:20.505>a <00:15:20.705>hundred <00:15:20.905>percent <00:15:21.105>performance.

308
00:15:22.425 --> 00:15:24.805
<00:15:22.425>The <00:15:22.599>cool <00:15:22.775>thing <00:15:22.949>is <00:15:23.125>there <00:15:23.300>are <00:15:23.474>solutions <00:15:23.650>for <00:15:23.824>both

309
00:15:25.345 --> 00:15:26.925
<00:15:25.345>of <00:15:25.811>these, <00:15:26.278>uh, <00:15:26.745>drawbacks.

310
00:15:27.465 --> 00:15:29.725
<00:15:27.465>Um, <00:15:27.592>yeah, <00:15:27.719>and <00:15:27.846>we <00:15:27.974>want <00:15:28.101>to <00:15:28.228>have <00:15:28.355>a <00:15:28.483>look <00:15:28.610>at <00:15:28.737>them. <00:15:28.865>Next.

311
00:15:31.105 --> 00:15:33.645
<00:15:31.105>The <00:15:31.305>first <00:15:31.505>potential <00:15:31.705>solution <00:15:31.905>is, <00:15:32.105>uh, <00:15:32.305>the, <00:15:32.505>so-called

312
00:15:33.785 --> 00:15:37.525
<00:15:33.785>for <00:15:33.940>the <00:15:34.096>first <00:15:34.251>case <00:15:34.407>for <00:15:34.562>the, <00:15:34.718>um, <00:15:34.873>uh, <00:15:35.029>storing, <00:15:35.185>uh,

313
00:15:37.885 --> 00:15:41.005
<00:15:37.885>multiple <00:15:38.085>models <00:15:38.285>or <00:15:38.485>storing <00:15:38.685>one <00:15:38.885>model <00:15:39.085>multiple <00:15:39.285>times

314
00:15:41.665 --> 00:15:44.005
<00:15:41.665>is <00:15:41.944>the <00:15:42.224>so-called <00:15:42.505>cross <00:15:42.785>origin <00:15:43.064>storage.

315
00:15:44.205 --> 00:15:45.845
<00:15:44.205>API. <00:15:44.905>Very <00:15:45.605>important.

316
00:15:46.395 --> 00:15:50.005
<00:15:46.395>This <00:15:46.628>is <00:15:46.861>not, <00:15:47.095>there's <00:15:47.328>no <00:15:47.561>implementation <00:15:47.795>commitment.

317
00:15:50.235 --> 00:15:51.885
<00:15:50.235>It's <00:15:50.468>not <00:15:50.701>guaranteed <00:15:50.935>that <00:15:51.168>this <00:15:51.401>will <00:15:51.635>come,

318
00:15:52.265 --> 00:15:54.445
<00:15:52.265>but <00:15:52.465>this <00:15:52.665>is, <00:15:52.865>uh, <00:15:53.064>a <00:15:53.265>proposal <00:15:53.465>by <00:15:53.665>me

319
00:15:54.505 --> 00:15:59.405
<00:15:54.505>and <00:15:54.660>to <00:15:54.816>Googlers <00:15:54.971>where <00:15:55.127>we <00:15:55.282>like <00:15:55.438>would <00:15:55.593>like <00:15:55.749>browsers, <00:15:55.905>um,

320
00:15:59.465 --> 00:16:03.805
<00:15:59.465>to <00:15:59.605>relax <00:15:59.745>the <00:15:59.885>same <00:16:00.025>origin, <00:16:00.165>uh, <00:16:00.305>policy <00:16:00.445>for <00:16:00.585>such <00:16:00.725>large <00:16:00.865>files.

321
00:16:04.385 --> 00:16:08.045
<00:16:04.385>And <00:16:04.525>the <00:16:04.665>idea <00:16:04.805>is <00:16:04.944>that <00:16:05.085>basically <00:16:05.225>you <00:16:05.365>could, <00:16:05.505>uh, <00:16:05.645>store, <00:16:05.785>um,

322
00:16:08.855 --> 00:16:13.285
<00:16:08.855>files <00:16:09.010>along, <00:16:09.166>along <00:16:09.321>with <00:16:09.477>their <00:16:09.632>hash <00:16:09.788>in <00:16:09.943>a <00:16:10.099>storage <00:16:10.255>mechanism

323
00:16:13.475 --> 00:16:15.005
<00:16:13.475>that <00:16:13.934>works <00:16:14.393>across <00:16:14.852>origins.

324
00:16:15.185 --> 00:16:17.405
<00:16:15.185>And <00:16:15.385>this <00:16:15.584>would <00:16:15.785>solve <00:16:15.984>like <00:16:16.185>this <00:16:16.385>first <00:16:16.584>problem.

325
00:16:17.935 --> 00:16:19.845
<00:16:17.935>Again, <00:16:18.401>no <00:16:18.868>implementation <00:16:19.334>commitment.

326
00:16:19.845 --> 00:16:21.725
<00:16:19.845>This <00:16:20.045>is <00:16:20.245>super <00:16:20.445>early, <00:16:20.645>but <00:16:20.845>this <00:16:21.045>would <00:16:21.245>solve

327
00:16:21.955 --> 00:16:23.165
<00:16:21.955>like <00:16:22.318>the <00:16:22.681>first <00:16:23.044>problem.

328
00:16:23.665 --> 00:16:27.485
<00:16:23.665>So <00:16:23.805>have, <00:16:23.944>uh, <00:16:24.084>keep <00:16:24.224>an <00:16:24.365>eye <00:16:24.505>on <00:16:24.645>cross <00:16:24.785>origin <00:16:24.925>storage, <00:16:25.064>API

329
00:16:27.705 --> 00:16:30.405
<00:16:27.705>and <00:16:27.821>if <00:16:27.938>you <00:16:28.055>have <00:16:28.171>a <00:16:28.288>use <00:16:28.405>case <00:16:28.521>where <00:16:28.638>you <00:16:28.755>could <00:16:28.871>use <00:16:28.988>this <00:16:29.105>API,

330
00:16:30.625 --> 00:16:33.845
<00:16:30.625>please <00:16:30.765>join <00:16:30.905>me <00:16:31.045>here <00:16:31.185>after, <00:16:31.325>uh, <00:16:31.465>my <00:16:31.605>talk <00:16:31.745>and <00:16:31.885>tell <00:16:32.025>me

331
00:16:33.875 --> 00:16:36.325
<00:16:33.875>because <00:16:34.108>we <00:16:34.341>wanna <00:16:34.575>learn <00:16:34.808>more <00:16:35.041>about <00:16:35.275>that.

332
00:16:36.955 --> 00:16:41.205
<00:16:36.955>This <00:16:37.155>could <00:16:37.355>solve <00:16:37.555>the <00:16:37.755>first <00:16:37.955>problem <00:16:38.155>storing, <00:16:38.355>um,

333
00:16:41.945 --> 00:16:43.125
<00:16:41.945>models <00:16:42.476>multiple <00:16:43.007>times.

334
00:16:44.025 --> 00:16:46.045
<00:16:44.025>Now <00:16:44.225>what <00:16:44.425>about <00:16:44.625>a <00:16:44.824>second <00:16:45.025>problem <00:16:45.225>not <00:16:45.425>running

335
00:16:46.075 --> 00:16:47.805
<00:16:46.075>with <00:16:46.425>a <00:16:46.775>full <00:16:47.125>native <00:16:47.475>speech?

336
00:16:48.175 --> 00:16:49.925
<00:16:48.175>There <00:16:48.525>is <00:16:48.875>an <00:16:49.224>alternative <00:16:49.574>proposal.

337
00:16:50.225 --> 00:16:51.965
<00:16:50.225>So <00:16:50.458>that's <00:16:50.691>the <00:16:50.925>right <00:16:51.158>column <00:16:51.391>now, <00:16:51.625>right?

338
00:16:52.425 --> 00:16:54.885
<00:16:52.425>Uh, <00:16:52.625>and <00:16:52.824>that's <00:16:53.025>a <00:16:53.224>so-called <00:16:53.425>built <00:16:53.625>in <00:16:53.824>AI

339
00:16:55.235 --> 00:16:56.885
<00:16:55.235>APIs <00:16:55.701>that <00:16:56.168>solves <00:16:56.635>both.

340
00:16:57.835 --> 00:17:00.165
<00:16:57.835>This <00:16:58.035>is <00:16:58.235>an <00:16:58.435>init <00:16:58.635>initiative <00:16:58.835>by <00:16:59.035>Google <00:16:59.235>Chrome

341
00:17:00.865 --> 00:17:04.765
<00:17:00.865>and <00:17:01.040>they <00:17:01.215>have <00:17:01.390>some <00:17:01.565>exploratory <00:17:01.740>APIs <00:17:01.915>for <00:17:02.090>local <00:17:02.265>experiments.

342
00:17:05.355 --> 00:17:09.005
<00:17:05.355>What <00:17:05.495>this <00:17:05.635>does <00:17:05.775>is <00:17:05.915>it <00:17:06.055>downloads <00:17:06.194>AI <00:17:06.335>models <00:17:06.474>into <00:17:06.615>Google <00:17:06.755>Chrome,

343
00:17:09.115 --> 00:17:10.685
<00:17:09.115>including <00:17:09.815>Gemini <00:17:10.515>Nano,

344
00:17:11.105 --> 00:17:13.005
<00:17:11.105>and <00:17:11.385>then <00:17:11.665>your <00:17:11.944>website <00:17:12.224>talks <00:17:12.505>to

345
00:17:13.005 --> 00:17:14.565
<00:17:13.005>that <00:17:13.471>locally <00:17:13.938>downloaded <00:17:14.405>version.

346
00:17:14.985 --> 00:17:16.565
<00:17:14.984>And <00:17:15.218>this <00:17:15.451>way <00:17:15.685>we <00:17:15.918>solve <00:17:16.151>both <00:17:16.385>things

347
00:17:16.565 --> 00:17:18.525
<00:17:16.565>because <00:17:16.798>we <00:17:17.031>have <00:17:17.265>the <00:17:17.498>model <00:17:17.731>downloaded <00:17:17.965>once

348
00:17:19.105 --> 00:17:20.565
<00:17:19.105>and <00:17:19.367>we <00:17:19.630>have <00:17:19.893>the <00:17:20.156>full <00:17:20.419>performance

349
00:17:20.565 --> 00:17:23.325
<00:17:20.565>because <00:17:20.705>we <00:17:20.845>can <00:17:20.985>simply <00:17:21.125>run <00:17:21.265>it <00:17:21.405>directly <00:17:21.545>on, <00:17:21.685>on <00:17:21.825>bare <00:17:21.965>metal.

350
00:17:25.195 --> 00:17:26.365
<00:17:25.194>Also, <00:17:25.546>this <00:17:25.896>has <00:17:26.248>drawbacks

351
00:17:26.365 --> 00:17:28.445
<00:17:26.365>because <00:17:26.520>you <00:17:26.676>have <00:17:26.831>to <00:17:26.987>take <00:17:27.142>whatever <00:17:27.298>the <00:17:27.453>browser <00:17:27.609>gives <00:17:27.765>you.

352
00:17:28.505 --> 00:17:30.485
<00:17:28.505>So <00:17:28.660>in <00:17:28.816>this <00:17:28.971>case, <00:17:29.127>you <00:17:29.282>cannot <00:17:29.438>bring <00:17:29.593>your <00:17:29.749>own <00:17:29.905>model

353
00:17:30.545 --> 00:17:31.765
<00:17:30.545>or <00:17:30.819>specify <00:17:31.094>your <00:17:31.368>own <00:17:31.643>model.

354
00:17:31.905 --> 00:17:36.065
<00:17:31.905>You <00:17:32.060>have <00:17:32.216>to <00:17:32.371>use <00:17:32.527>whatever <00:17:32.682>the <00:17:32.838>browser <00:17:32.993>gives <00:17:33.149>you. <00:17:33.305>Alright?

355
00:17:36.605 --> 00:17:39.825
<00:17:36.605>And <00:17:36.745>these <00:17:36.885>are <00:17:37.025>the <00:17:37.165>three <00:17:37.305>categories <00:17:37.445>of <00:17:37.585>APIs <00:17:37.725>that <00:17:37.865>I've <00:17:38.005>talked

356
00:17:39.825 --> 00:17:41.225
<00:17:39.825>before <00:17:40.140>or <00:17:40.455>talked <00:17:40.770>about <00:17:41.085>before.

357
00:17:41.725 --> 00:17:45.265
<00:17:41.725>Um, <00:17:41.958>translation, <00:17:42.191>writing <00:17:42.425>assistance, <00:17:42.658>and <00:17:42.891>prompt <00:17:43.125>API.

358
00:17:45.565 --> 00:17:47.385
<00:17:45.565>So <00:17:45.798>let's <00:17:46.031>have <00:17:46.265>a <00:17:46.498>look <00:17:46.731>at <00:17:46.965>that.

359
00:17:50.125 --> 00:17:51.925
<00:17:50.125>I <00:17:50.358>am <00:17:50.591>using <00:17:50.825>chrome <00:17:51.058>cannery <00:17:51.291>here <00:17:51.525>also.

360
00:17:51.925 --> 00:17:53.845
<00:17:51.925>That's <00:17:52.274>all <00:17:52.625>super <00:17:52.975>bleeding <00:17:53.325>edge.

361
00:17:54.465 --> 00:17:57.725
<00:17:54.465>Um, <00:17:54.605>yeah, <00:17:54.745>in <00:17:54.885>order <00:17:55.024>to <00:17:55.165>use <00:17:55.304>the <00:17:55.445>APIs, <00:17:55.584>we <00:17:55.725>first, <00:17:55.865>uh,

362
00:17:57.725 --> 00:17:59.645
<00:17:57.725>can <00:17:58.004>create <00:17:58.284>let's <00:17:58.564>say <00:17:58.844>a <00:17:59.125>translator

363
00:17:59.705 --> 00:18:03.325
<00:17:59.705>and <00:17:59.879>we <00:18:00.054>wanna <00:18:00.230>translate, <00:18:00.405>um, <00:18:00.580>yeah, <00:18:00.754>let's <00:18:00.929>say <00:18:01.105>from

364
00:18:04.225 --> 00:18:05.915
<00:18:04.225>English <00:18:04.925>to <00:18:05.625>Spanish.

365
00:18:06.015 --> 00:18:08.595
<00:18:06.015>Let <00:18:06.190>me <00:18:06.365>see <00:18:06.540>if <00:18:06.715>that <00:18:06.890>works. <00:18:07.065>Okay, <00:18:07.240>no, <00:18:07.415>sorry,

366
00:18:08.595 --> 00:18:09.835
<00:18:08.595>that's <00:18:08.967>not <00:18:09.339>not <00:18:09.711>working.

367
00:18:09.845 --> 00:18:11.115
<00:18:09.845>Let's <00:18:10.226>not <00:18:10.607>do <00:18:10.988>translator

368
00:18:11.115 --> 00:18:13.115
<00:18:11.115>because <00:18:11.348>it's <00:18:11.581>currently <00:18:11.815>restricted <00:18:12.048>to <00:18:12.281>a <00:18:12.515>certain,

369
00:18:13.615 --> 00:18:15.115
<00:18:13.615>um, <00:18:14.065>set <00:18:14.515>of <00:18:14.965>languages.

370
00:18:15.325 --> 00:18:18.395
<00:18:15.325>Let's <00:18:15.525>use <00:18:15.725>a <00:18:15.925>summarizer, <00:18:16.125>for <00:18:16.325>example, <00:18:16.525>con <00:18:16.725>summarizer.

371
00:18:19.055 --> 00:18:20.955
<00:18:19.055>And <00:18:19.288>the <00:18:19.521>APIs <00:18:19.755>are <00:18:19.988>always <00:18:20.221>super <00:18:20.455>straightforward.

372
00:18:21.215 --> 00:18:23.995
<00:18:21.215>All <00:18:21.370>you <00:18:21.526>say <00:18:21.681>is <00:18:21.837>like <00:18:21.992>summarize <00:18:22.148>it, <00:18:22.303>dot <00:18:22.459>create <00:18:22.615>writer,

373
00:18:24.095 --> 00:18:25.475
<00:18:24.095>do <00:18:24.716>create <00:18:25.337>translator

374
00:18:25.495 --> 00:18:27.395
<00:18:25.495>or <00:18:25.695>create <00:18:25.895>language <00:18:26.094>technic <00:18:26.294>or <00:18:26.495>create <00:18:26.695>and <00:18:26.895>stuff.

375
00:18:28.015 --> 00:18:30.755
<00:18:28.015>And <00:18:28.190>then, <00:18:28.365>uh, <00:18:28.540>you <00:18:28.715>can <00:18:28.890>use <00:18:29.065>the <00:18:29.240>summarizer, <00:18:29.415>uh,

376
00:18:30.755 --> 00:18:32.915
<00:18:30.755>to <00:18:31.035>summarize <00:18:31.315>large <00:18:31.595>chunks <00:18:31.875>of <00:18:32.155>text.

377
00:18:33.455 --> 00:18:38.035
<00:18:33.455>So <00:18:33.629>I've <00:18:33.804>prepared <00:18:33.980>this <00:18:34.155>here. <00:18:34.330>Await, <00:18:34.504>uh, <00:18:34.679>summarizer, <00:18:34.855>right?

378
00:18:38.385 --> 00:18:41.955
<00:18:38.385>This <00:18:38.585>is, <00:18:38.785>um, <00:18:38.985>the <00:18:39.185>text <00:18:39.385>of <00:18:39.585>the <00:18:39.785>local

379
00:18:42.695 --> 00:18:45.475
<00:18:42.695>of <00:18:42.870>across <00:18:43.044>origin <00:18:43.220>storage, <00:18:43.395>API <00:18:43.570>that <00:18:43.745>I've <00:18:43.919>shown <00:18:44.095>before.

380
00:18:45.815 --> 00:18:50.475
<00:18:45.815>And <00:18:45.942>if <00:18:46.069>we <00:18:46.196>run, <00:18:46.324>run <00:18:46.451>this, <00:18:46.578>we <00:18:46.705>now <00:18:46.833>get <00:18:46.960>a <00:18:47.087>neat, <00:18:47.215>uh,

381
00:18:50.475 --> 00:18:54.795
<00:18:50.475>little <00:18:50.615>summary, <00:18:50.754>um, <00:18:50.895>in <00:18:51.034>I <00:18:51.175>think <00:18:51.314>three <00:18:51.455>bullet <00:18:51.594>points <00:18:51.735>or <00:18:51.875>yeah,

382
00:18:54.855 --> 00:18:57.875
<00:18:54.855>and <00:18:55.010>exactly <00:18:55.166>three <00:18:55.321>bullet <00:18:55.477>points <00:18:55.632>again, <00:18:55.788>right <00:18:55.943>in <00:18:56.099>the <00:18:56.255>browser,

383
00:18:57.985 --> 00:19:00.435
<00:18:57.985>offline <00:18:58.185>capable <00:18:58.385>and <00:18:58.584>no <00:18:58.784>data <00:18:58.985>leaves <00:18:59.185>the <00:18:59.385>browser.

384
00:19:00.655 --> 00:19:03.275
<00:19:00.655>It <00:19:00.855>works <00:19:01.055>like <00:19:01.254>exactly <00:19:01.455>here <00:19:01.655>in <00:19:01.855>the <00:19:02.055>browser.

385
00:19:03.975 --> 00:19:08.755
<00:19:03.975>So, <00:19:04.102>uh, <00:19:04.229>we <00:19:04.356>can <00:19:04.484>also <00:19:04.611>do <00:19:04.738>this <00:19:04.865>for, <00:19:04.993>uh, <00:19:05.120>language <00:19:05.247>detector <00:19:05.375>also,

386
00:19:08.755 --> 00:19:11.275
<00:19:08.755>again, <00:19:08.988>super <00:19:09.221>straightforward <00:19:09.455>await <00:19:09.688>language <00:19:09.921>detector <00:19:10.155>dot

387
00:19:11.275 --> 00:19:16.115
<00:19:11.275>create, <00:19:11.430>and <00:19:11.586>then <00:19:11.741>we <00:19:11.897>say <00:19:12.052>await <00:19:12.208>language <00:19:12.363>detector <00:19:12.519>detect, <00:19:12.675>uh,

388
00:19:16.175 --> 00:19:17.555
<00:19:16.175>bo <00:19:17.417>baguette.

389
00:19:17.555 --> 00:19:20.315
<00:19:17.555>That's <00:19:17.710>probably <00:19:17.866>the <00:19:18.021>level <00:19:18.177>of <00:19:18.332>French <00:19:18.488>that <00:19:18.643>I <00:19:18.799>can <00:19:18.955>talk.

390
00:19:20.855 --> 00:19:25.155
<00:19:20.855>And <00:19:20.995>then <00:19:21.135>it <00:19:21.275>tells <00:19:21.415>us <00:19:21.555>that <00:19:21.695>it's <00:19:21.835>a <00:19:21.975>99%, <00:19:22.115>uh, <00:19:22.255>French.

391
00:19:25.345 --> 00:19:28.815
<00:19:25.345>Perfect, <00:19:25.625>that's <00:19:25.905>correct, <00:19:26.185>right? <00:19:26.465>There's <00:19:26.745>more.

392
00:19:28.875 --> 00:19:30.335
<00:19:28.875>We <00:19:29.137>also <00:19:29.400>have <00:19:29.663>the <00:19:29.926>prompt <00:19:30.189>API.

393
00:19:31.155 --> 00:19:36.005
<00:19:31.155>Um, <00:19:31.310>so <00:19:31.466>that's <00:19:31.621>also <00:19:31.777>just <00:19:31.932>a <00:19:32.088>wait <00:19:32.243>language, <00:19:32.399>uh, <00:19:32.555>sorry,

394
00:19:36.015 --> 00:19:37.045
<00:19:36.015>let's <00:19:36.246>call <00:19:36.478>it <00:19:36.710>language <00:19:36.942>model.

395
00:19:37.785 --> 00:19:40.125
<00:19:37.785>Uh, <00:19:38.065>just <00:19:38.345>language <00:19:38.625>model <00:19:38.905>that <00:19:39.185>create.

396
00:19:40.625 --> 00:19:43.365
<00:19:40.625>And <00:19:40.741>now <00:19:40.858>we <00:19:40.975>can <00:19:41.091>do <00:19:41.208>the <00:19:41.325>exact <00:19:41.441>same <00:19:41.558>thing <00:19:41.675>that <00:19:41.791>we <00:19:41.908>could <00:19:42.025>do

397
00:19:43.365 --> 00:19:45.525
<00:19:43.365>with, <00:19:44.065>um, <00:19:44.765>web.

398
00:19:45.745 --> 00:19:50.685
<00:19:45.745>And <00:19:45.872>before <00:19:45.999>we <00:19:46.126>can <00:19:46.254>simply <00:19:46.381>say <00:19:46.508>stuff <00:19:46.635>like, <00:19:46.763>give <00:19:46.890>me <00:19:47.017>a <00:19:47.145>list

399
00:19:50.685 --> 00:19:54.205
<00:19:50.685>of <00:19:50.885>German, <00:19:51.085>uh, <00:19:51.284>yeah, <00:19:51.485>big <00:19:51.685>cities <00:19:51.885>as <00:19:52.085>JSO.

400
00:19:54.545 --> 00:19:58.365
<00:19:54.545>And <00:19:54.720>then <00:19:54.895>basically <00:19:55.070>it <00:19:55.245>gives <00:19:55.420>us <00:19:55.595>this <00:19:55.770>list, <00:19:55.945>uh,

401
00:19:58.365 --> 00:19:59.885
<00:19:58.365>of <00:19:58.821>Jason <00:19:59.277>back, <00:19:59.733>right?

402
00:20:00.265 --> 00:20:03.805
<00:20:00.265>So <00:20:00.405>this <00:20:00.545>is <00:20:00.685>now <00:20:00.825>also <00:20:00.965>Gemini <00:20:01.105>Nel <00:20:01.245>running <00:20:01.385>on <00:20:01.525>device <00:20:01.665>right

403
00:20:03.805 --> 00:20:04.845
<00:20:03.805>here <00:20:04.117>on <00:20:04.429>the <00:20:04.741>browser.

404
00:20:05.465 --> 00:20:07.965
<00:20:05.465>Um, <00:20:05.814>no <00:20:06.165>extra <00:20:06.514>stuff <00:20:06.865>needed.

405
00:20:08.225 --> 00:20:09.725
<00:20:08.225>The <00:20:08.495>browser <00:20:08.764>gives <00:20:09.034>us <00:20:09.304>this <00:20:09.574>capability

406
00:20:10.675 --> 00:20:15.255
<00:20:10.675>and <00:20:10.830>that's <00:20:10.986>basically <00:20:11.141>the <00:20:11.297>three <00:20:11.452>new <00:20:11.608>built-in <00:20:11.763>AI <00:20:11.919>APIs, <00:20:12.075>uh,

407
00:20:15.255 --> 00:20:16.975
<00:20:15.255>that, <00:20:15.535>uh, <00:20:15.815>Chrome <00:20:16.095>is <00:20:16.375>currently <00:20:16.655>building.

408
00:20:17.825 --> 00:20:21.295
<00:20:17.825>Apart <00:20:17.980>from <00:20:18.136>that, <00:20:18.291>there's <00:20:18.447>also <00:20:18.602>a <00:20:18.758>proofread <00:20:18.913>API <00:20:19.069>coming, <00:20:19.225>uh,

409
00:20:21.295 --> 00:20:25.375
<00:20:21.295>that <00:20:21.495>allows <00:20:21.695>to <00:20:21.895>proofread, <00:20:22.095>uh, <00:20:22.295>certain <00:20:22.495>text, <00:20:22.695>uh,

410
00:20:25.375 --> 00:20:28.215
<00:20:25.375>super <00:20:25.575>new <00:20:25.775>implemented <00:20:25.975>in <00:20:26.175>current <00:20:26.375>versions <00:20:26.575>of <00:20:26.775>chromium.

411
00:20:28.695 --> 00:20:29.815
<00:20:28.695>Microsoft <00:20:28.896>Edge <00:20:29.098>is <00:20:29.299>also <00:20:29.501>on <00:20:29.703>board.

412
00:20:29.815 --> 00:20:32.375
<00:20:29.815>They <00:20:29.970>use <00:20:30.126>their <00:20:30.281>fire <00:20:30.437>model <00:20:30.592>series <00:20:30.748>to <00:20:30.903>make <00:20:31.059>this <00:20:31.215>happen.

413
00:20:34.675 --> 00:20:39.415
<00:20:34.675>And <00:20:34.830>then <00:20:34.986>there's <00:20:35.141>new, <00:20:35.297>um, <00:20:35.452>yeah, <00:20:35.608>inve, <00:20:35.763>uh, <00:20:35.919>not <00:20:36.075>inventions,

414
00:20:39.515 --> 00:20:41.415
<00:20:39.515>uh, <00:20:39.748>but <00:20:39.981>there's <00:20:40.215>innovation <00:20:40.448>happening <00:20:40.681>in <00:20:40.915>ai.

415
00:20:41.475 --> 00:20:45.055
<00:20:41.475>So <00:20:41.602>we <00:20:41.729>now <00:20:41.856>also <00:20:41.984>have <00:20:42.111>multimodal <00:20:42.238>models <00:20:42.365>where <00:20:42.493>we <00:20:42.620>can <00:20:42.747>mix <00:20:42.875>text

416
00:20:45.075 --> 00:20:47.325
<00:20:45.075>and <00:20:45.250>images <00:20:45.425>and <00:20:45.600>video <00:20:45.775>and <00:20:45.950>speech <00:20:46.125>and <00:20:46.300>so <00:20:46.475>on.

417
00:20:47.665 --> 00:20:49.045
<00:20:47.665>And <00:20:47.913>of <00:20:48.161>course <00:20:48.410>this <00:20:48.658>should <00:20:48.907>also

418
00:20:49.045 --> 00:20:50.325
<00:20:49.045>be <00:20:49.275>possible <00:20:49.505>from <00:20:49.736>within <00:20:49.966>the <00:20:50.197>web.

419
00:20:50.585 --> 00:20:53.925
<00:20:50.585>And <00:20:50.725>the <00:20:50.865>cool <00:20:51.005>thing <00:20:51.145>is <00:20:51.285>that <00:20:51.425>prompt <00:20:51.565>API <00:20:51.705>also <00:20:51.845>supports <00:20:51.985>those

420
00:20:53.935 --> 00:20:55.085
<00:20:53.935>multimodal <00:20:54.970>capabilities.

421
00:20:55.475 --> 00:20:57.685
<00:20:55.475>They <00:20:55.754>currently <00:20:56.034>support <00:20:56.314>images <00:20:56.594>as <00:20:56.875>input.

422
00:20:57.825 --> 00:21:01.245
<00:20:57.825>And <00:20:57.965>so <00:20:58.105>you <00:20:58.245>can <00:20:58.385>also <00:20:58.525>do <00:20:58.665>multimodal <00:20:58.805>stuff <00:20:58.945>with <00:20:59.085>prompt <00:20:59.225>API

423
00:21:01.785 --> 00:21:06.165
<00:21:01.785>that's <00:21:01.985>currently <00:21:02.185>happening <00:21:02.385>in <00:21:02.585>contrast, <00:21:02.785>uh, <00:21:02.985>to <00:21:03.185>uh,

424
00:21:06.165 --> 00:21:08.045
<00:21:06.165>build <00:21:06.631>in <00:21:07.098>AI <00:21:07.565>APIs.

425
00:21:08.195 --> 00:21:10.885
<00:21:08.195>This <00:21:08.370>time <00:21:08.544>the <00:21:08.720>model <00:21:08.895>is <00:21:09.070>stored <00:21:09.245>on <00:21:09.419>browser <00:21:09.595>level,

426
00:21:11.025 --> 00:21:13.445
<00:21:11.025>so <00:21:11.200>we <00:21:11.375>only <00:21:11.550>have <00:21:11.725>to <00:21:11.900>download <00:21:12.075>it <00:21:12.250>exactly <00:21:12.425>once.

427
00:21:13.785 --> 00:21:15.765
<00:21:13.785>And <00:21:14.135>the <00:21:14.485>API <00:21:14.835>in <00:21:15.185>theory

428
00:21:15.905 --> 00:21:19.005
<00:21:15.905>and <00:21:16.060>future <00:21:16.216>could <00:21:16.371>also <00:21:16.527>allow <00:21:16.682>to <00:21:16.838>talk <00:21:16.993>to <00:21:17.149>a <00:21:17.305>model

429
00:21:19.005 --> 00:21:20.765
<00:21:19.005>that <00:21:19.238>is <00:21:19.471>already <00:21:19.705>installed <00:21:19.938>on <00:21:20.171>your <00:21:20.405>system.

430
00:21:21.265 --> 00:21:24.125
<00:21:21.265>So <00:21:21.465>Gemini <00:21:21.665>Nano <00:21:21.865>is <00:21:22.065>already <00:21:22.265>shipped <00:21:22.465>with <00:21:22.665>Android

431
00:21:24.465 --> 00:21:27.125
<00:21:24.465>and <00:21:24.698>iOS <00:21:24.931>already <00:21:25.165>ships <00:21:25.398>with <00:21:25.631>Apple <00:21:25.865>intelligence.

432
00:21:27.225 --> 00:21:30.045
<00:21:27.225>So <00:21:27.458>it <00:21:27.691>may <00:21:27.925>sound <00:21:28.158>just <00:21:28.391>obvious, <00:21:28.625>right?

433
00:21:30.145 --> 00:21:33.285
<00:21:30.145>To, <00:21:30.272>to <00:21:30.399>use <00:21:30.526>a <00:21:30.654>model <00:21:30.781>that <00:21:30.908>is <00:21:31.035>already <00:21:31.163>on <00:21:31.290>on <00:21:31.417>your <00:21:31.545>system.

434
00:21:33.705 --> 00:21:37.525
<00:21:33.705>And <00:21:33.860>that's <00:21:34.016>also <00:21:34.171>possible, <00:21:34.327>uh, <00:21:34.482>from <00:21:34.638>within, <00:21:34.793>uh, <00:21:34.949>prompt <00:21:35.105>API

435
00:21:39.385 --> 00:21:41.165
<00:21:39.385>if <00:21:39.618>you <00:21:39.851>want <00:21:40.085>to <00:21:40.318>use <00:21:40.551>those <00:21:40.785>APIs.

436
00:21:41.715 --> 00:21:43.165
<00:21:41.715>Also, <00:21:41.932>you <00:21:42.149>need <00:21:42.367>to <00:21:42.585>enable <00:21:42.802>a <00:21:43.020>flag.

437
00:21:43.625 --> 00:21:46.525
<00:21:43.625>Uh, <00:21:43.825>it's <00:21:44.025>in <00:21:44.225>about <00:21:44.425>flags, <00:21:44.625>uh, <00:21:44.825>this <00:21:45.025>time.

438
00:21:46.585 --> 00:21:47.685
<00:21:46.585>And <00:21:46.783>then <00:21:46.981>you <00:21:47.179>need <00:21:47.377>to <00:21:47.575>enable,

439
00:21:48.155 --> 00:21:50.245
<00:21:48.155>enables <00:21:48.504>optimization <00:21:48.855>guide <00:21:49.205>on <00:21:49.555>device

440
00:21:50.865 --> 00:21:54.125
<00:21:50.865>and <00:21:51.065>then <00:21:51.265>the <00:21:51.465>particular <00:21:51.665>APIs <00:21:51.865>for <00:21:52.065>Gemini <00:21:52.265>nanos

441
00:21:54.125 --> 00:21:56.485
<00:21:54.125>or <00:21:54.475>Prompt <00:21:54.825>API, <00:21:55.175>uh, <00:21:55.525>proofreader,

442
00:21:56.525 --> 00:21:58.565
<00:21:56.525>API <00:21:56.758>language <00:21:56.991>detector <00:21:57.225>translator <00:21:57.458>and <00:21:57.691>so <00:21:57.925>on.

443
00:21:59.385 --> 00:22:01.605
<00:21:59.385>Uh, <00:21:59.540>and <00:21:59.696>if <00:21:59.851>you <00:22:00.007>wanna <00:22:00.162>learn <00:22:00.318>more <00:22:00.473>about <00:22:00.629>the <00:22:00.785>model

444
00:22:01.605 --> 00:22:04.805
<00:22:01.605>that <00:22:01.745>is <00:22:01.885>installed <00:22:02.025>locally <00:22:02.165>on <00:22:02.305>your <00:22:02.445>system, <00:22:02.585>you <00:22:02.725>can <00:22:02.865>use <00:22:03.005>uh,

445
00:22:04.865 --> 00:22:08.605
<00:22:04.865>the <00:22:04.981>uh, <00:22:05.098>URL <00:22:05.215>at <00:22:05.331>the <00:22:05.448>very <00:22:05.565>top <00:22:05.681>that <00:22:05.798>shows <00:22:05.915>you <00:22:06.031>if <00:22:06.148>your, <00:22:06.265>um,

446
00:22:09.025 --> 00:22:11.645
<00:22:09.025>device <00:22:09.375>is, <00:22:09.725>has <00:22:10.075>enough <00:22:10.425>performance

447
00:22:11.645 --> 00:22:13.365
<00:22:11.645>to <00:22:11.878>run <00:22:12.111>those <00:22:12.345>models <00:22:12.578>if <00:22:12.811>it's <00:22:13.045>installed,

448
00:22:13.785 --> 00:22:15.365
<00:22:13.785>how <00:22:14.018>big <00:22:14.251>it <00:22:14.485>is, <00:22:14.718>and <00:22:14.951>so <00:22:15.185>on.

449
00:22:15.825 --> 00:22:18.245
<00:22:15.825>Um, <00:22:16.025>yeah, <00:22:16.225>these <00:22:16.425>are <00:22:16.625>the <00:22:16.825>URLs <00:22:17.025>for <00:22:17.225>you

450
00:22:21.185 --> 00:22:24.565
<00:22:21.185>if <00:22:21.340>you <00:22:21.496>want <00:22:21.651>to <00:22:21.807>integrate <00:22:21.962>those <00:22:22.118>APIs <00:22:22.273>into <00:22:22.429>your <00:22:22.585>application.

451
00:22:24.775 --> 00:22:27.565
<00:22:24.775>We've <00:22:24.975>built <00:22:25.175>this <00:22:25.375>neat <00:22:25.575>little <00:22:25.775>set <00:22:25.975>of, <00:22:26.175>um,

452
00:22:27.655 --> 00:22:28.885
<00:22:27.655>TypeScript <00:22:28.762>definitions.

453
00:22:29.385 --> 00:22:32.965
<00:22:29.385>Uh, <00:22:29.540>so <00:22:29.696>simply <00:22:29.851>in, <00:22:30.007>uh, <00:22:30.162>edge <00:22:30.318>types <00:22:30.473>slash <00:22:30.629>don <00:22:30.785>dash,

454
00:22:32.965 --> 00:22:34.445
<00:22:32.965>chromium <00:22:33.408>dash <00:22:33.852>ai, <00:22:34.297>uh,

455
00:22:34.445 --> 00:22:35.805
<00:22:34.445>we <00:22:34.751>built <00:22:35.057>some <00:22:35.363>great <00:22:35.669>TypeScript

456
00:22:35.805 --> 00:22:37.165
<00:22:35.805>definitions <00:22:36.049>that <00:22:36.294>are <00:22:36.539>ready <00:22:36.784>to <00:22:37.029>use.

457
00:22:37.185 --> 00:22:39.085
<00:22:37.185>You <00:22:37.418>can <00:22:37.651>simply <00:22:37.885>pull <00:22:38.118>them <00:22:38.351>from <00:22:38.585>NPM

458
00:22:39.145 --> 00:22:41.965
<00:22:39.145>and <00:22:39.320>then <00:22:39.495>start <00:22:39.670>using <00:22:39.845>those <00:22:40.020>APIs <00:22:40.195>in <00:22:40.370>your <00:22:40.545>application.

459
00:22:44.435 --> 00:22:48.165
<00:22:44.435>Alright, <00:22:44.590>so <00:22:44.746>as <00:22:44.901>a <00:22:45.057>web <00:22:45.212>developer, <00:22:45.368>why <00:22:45.523>should <00:22:45.679>you <00:22:45.835>care?

460
00:22:48.905 --> 00:22:51.045
<00:22:48.905>So <00:22:49.045>why <00:22:49.185>do <00:22:49.325>we <00:22:49.465>need <00:22:49.605>that <00:22:49.745>stuff <00:22:49.885>in <00:22:50.024>the <00:22:50.165>first <00:22:50.305>place?

461
00:22:51.625 --> 00:22:53.325
<00:22:51.625>Is <00:22:51.905>that <00:22:52.185>basically <00:22:52.465>a <00:22:52.745>scam, <00:22:53.025>right?

462
00:22:53.345 --> 00:22:55.245
<00:22:53.345>Or <00:22:53.695>is <00:22:54.045>it, <00:22:54.395>is <00:22:54.745>everybody

463
00:22:55.795 --> 00:22:58.045
<00:22:55.795>just <00:22:55.995>doing <00:22:56.195>AI <00:22:56.395>now <00:22:56.595>because <00:22:56.795>they <00:22:56.995>have <00:22:57.195>to?

464
00:22:58.625 --> 00:23:02.165
<00:22:58.625>The <00:22:58.800>thing <00:22:58.975>is <00:22:59.150>that <00:22:59.325>AI <00:22:59.500>unlocks <00:22:59.675>new <00:22:59.850>use <00:23:00.025>cases

465
00:23:02.825 --> 00:23:05.365
<00:23:02.825>and <00:23:03.175>traditional <00:23:03.525>rule-based <00:23:03.875>algorithms <00:23:04.225>are

466
00:23:05.435 --> 00:23:06.925
<00:23:05.435>limited <00:23:05.882>in <00:23:06.329>their <00:23:06.775>capabilities.

467
00:23:07.265 --> 00:23:09.365
<00:23:07.265>It <00:23:07.545>is <00:23:07.825>hard <00:23:08.105>or <00:23:08.385>maybe <00:23:08.665>impossible

468
00:23:09.365 --> 00:23:11.285
<00:23:09.365>to <00:23:09.645>do <00:23:09.925>a <00:23:10.205>natural <00:23:10.485>language <00:23:10.765>understanding

469
00:23:11.585 --> 00:23:14.165
<00:23:11.585>or <00:23:11.818>image <00:23:12.051>recognition <00:23:12.285>using <00:23:12.518>a <00:23:12.751>traditional <00:23:12.985>algorithm.

470
00:23:14.355 --> 00:23:18.205
<00:23:14.355>This <00:23:14.510>is <00:23:14.666>really <00:23:14.821>where <00:23:14.977>machine <00:23:15.132>learning <00:23:15.288>and <00:23:15.443>AI <00:23:15.599>shines, <00:23:15.755>right?

471
00:23:18.585 --> 00:23:22.365
<00:23:18.585>And <00:23:18.740>so <00:23:18.896>you <00:23:19.051>can <00:23:19.207>use <00:23:19.362>those <00:23:19.518>APIs <00:23:19.673>to <00:23:19.829>extend, <00:23:19.985>um,

472
00:23:22.665 --> 00:23:25.525
<00:23:22.665>the <00:23:22.898>capabilities <00:23:23.131>of <00:23:23.365>your <00:23:23.598>application, <00:23:23.831>be <00:23:24.065>beyond

473
00:23:25.525 --> 00:23:28.325
<00:23:25.525>what <00:23:25.758>is <00:23:25.991>possible <00:23:26.225>with <00:23:26.458>rule-based, <00:23:26.691>uh, <00:23:26.925>algorithms

474
00:23:28.785 --> 00:23:31.125
<00:23:28.785>and <00:23:28.960>do <00:23:29.135>exactly <00:23:29.310>that <00:23:29.485>stuff <00:23:29.660>that <00:23:29.835>will <00:23:30.010>be <00:23:30.185>hard

475
00:23:31.185 --> 00:23:35.245
<00:23:31.185>or <00:23:31.360>even <00:23:31.534>impossible <00:23:31.710>to <00:23:31.885>do <00:23:32.060>using <00:23:32.235>those <00:23:32.409>rule-based <00:23:32.585>algorithms.

476
00:23:35.345 --> 00:23:37.525
<00:23:35.345>So <00:23:35.500>that <00:23:35.656>is <00:23:35.811>why <00:23:35.967>you <00:23:36.122>as <00:23:36.278>a <00:23:36.433>developer <00:23:36.589>should <00:23:36.745>care.

477
00:23:37.625 --> 00:23:40.285
<00:23:37.625>And <00:23:37.741>you <00:23:37.858>may <00:23:37.975>want <00:23:38.091>to <00:23:38.208>have <00:23:38.325>a <00:23:38.441>look <00:23:38.558>at, <00:23:38.675>uh, <00:23:38.791>the <00:23:38.908>different <00:23:39.025>APIs.

478
00:23:42.125 --> 00:23:44.485
<00:23:42.125>I <00:23:42.280>have <00:23:42.436>some <00:23:42.591>demos <00:23:42.747>for <00:23:42.902>you, <00:23:43.058>uh, <00:23:43.213>to <00:23:43.369>show <00:23:43.525>you

479
00:23:44.485 --> 00:23:47.085
<00:23:44.485>how <00:23:44.601>you <00:23:44.718>can <00:23:44.834>use <00:23:44.951>this <00:23:45.068>in <00:23:45.185>order <00:23:45.301>to <00:23:45.418>make <00:23:45.534>your <00:23:45.651>web <00:23:45.768>app <00:23:45.885>better.

480
00:23:47.665 --> 00:23:51.125
<00:23:47.665>Um, <00:23:47.792>and <00:23:47.919>the <00:23:48.046>first <00:23:48.174>one <00:23:48.301>is <00:23:48.428>a <00:23:48.555>traditional <00:23:48.683>chat <00:23:48.810>bot <00:23:48.937>in <00:23:49.065>an

481
00:23:51.365 --> 00:23:54.445
<00:23:51.365>angular <00:23:51.540>application <00:23:51.715>that <00:23:51.890>uses <00:23:52.065>web <00:23:52.240>LLM <00:23:52.415>under <00:23:52.590>the <00:23:52.765>hood.

482
00:23:54.885 --> 00:23:57.245
<00:23:54.885>API <00:23:55.085>is <00:23:55.285>already, <00:23:55.485>uh, <00:23:55.685>app <00:23:55.885>is <00:23:56.085>already <00:23:56.285>started.

483
00:23:57.555 --> 00:23:59.085
<00:23:57.555>This <00:23:57.784>is <00:23:58.014>a <00:23:58.243>to-do <00:23:58.473>list <00:23:58.702>app, <00:23:58.932>right?

484
00:23:59.565 --> 00:24:01.125
<00:23:59.565>I <00:23:59.798>have <00:24:00.031>three <00:24:00.265>to-dos, <00:24:00.498>two <00:24:00.731>are <00:24:00.965>done.

485
00:24:01.225 --> 00:24:05.165
<00:24:01.225>Now <00:24:01.365>I <00:24:01.504>can <00:24:01.645>ask <00:24:01.784>how <00:24:01.925>many <00:24:02.064>open <00:24:02.205>todos <00:24:02.344>do <00:24:02.485>I <00:24:02.625>have?

486
00:24:05.385 --> 00:24:06.805
<00:24:05.385>And <00:24:05.704>hopefully <00:24:06.024>it <00:24:06.343>says <00:24:06.663>two.

487
00:24:07.345 --> 00:24:10.685
<00:24:07.345>So <00:24:07.578>this <00:24:07.811>uses, <00:24:08.045>uh, <00:24:08.278>one, <00:24:08.511>sorry, <00:24:08.745>yeah.

488
00:24:12.105 --> 00:24:15.485
<00:24:12.105>Um, <00:24:12.232>this <00:24:12.359>uses <00:24:12.486>web <00:24:12.614>LLM <00:24:12.741>under <00:24:12.868>the <00:24:12.995>hood, <00:24:13.123>uh, <00:24:13.250>uses <00:24:13.377>uh, <00:24:13.505>um,

489
00:24:15.485 --> 00:24:17.005
<00:24:15.485>large <00:24:15.713>language <00:24:15.941>model <00:24:16.169>to <00:24:16.397>make <00:24:16.625>this <00:24:16.853>happen.

490
00:24:17.425 --> 00:24:20.285
<00:24:17.425>Um, <00:24:17.705>translate <00:24:17.985>my <00:24:18.264>todos <00:24:18.544>to <00:24:18.825>Japanese.

491
00:24:20.515 --> 00:24:22.045
<00:24:20.515>It's <00:24:20.790>a <00:24:21.065>small <00:24:21.341>model, <00:24:21.616>so <00:24:21.892>maybe

492
00:24:22.045 --> 00:24:23.845
<00:24:22.045>that <00:24:22.245>may <00:24:22.445>be <00:24:22.645>a <00:24:22.845>little <00:24:23.045>bit <00:24:23.245>too <00:24:23.445>much.

493
00:24:24.075 --> 00:24:27.965
<00:24:24.075>Yeah, <00:24:24.215>so <00:24:24.355>it <00:24:24.495>basically <00:24:24.635>kept <00:24:24.775>the <00:24:24.915>homa <00:24:25.055>so <00:24:25.195>to <00:24:25.335>say, <00:24:25.475>um,

494
00:24:29.265 --> 00:24:30.405
<00:24:29.265>to <00:24:29.778>JSO, <00:24:30.291>right?

495
00:24:30.585 --> 00:24:33.845
<00:24:30.585>So <00:24:30.740>all <00:24:30.896>of <00:24:31.051>that <00:24:31.207>is <00:24:31.362>possible <00:24:31.518>in <00:24:31.673>this, <00:24:31.829>um, <00:24:31.985>yeah,

496
00:24:33.915 --> 00:24:35.365
<00:24:33.915>chat <00:24:34.350>bot <00:24:34.785>style <00:24:35.220>interface.

497
00:24:35.635 --> 00:24:38.485
<00:24:35.635>However, <00:24:35.835>I <00:24:36.035>don't <00:24:36.235>like <00:24:36.435>chat <00:24:36.635>bot <00:24:36.835>style <00:24:37.035>interfaces

498
00:24:38.485 --> 00:24:40.045
<00:24:38.485>because <00:24:38.659>you <00:24:38.834>see <00:24:39.010>them <00:24:39.185>all <00:24:39.360>over <00:24:39.534>the <00:24:39.709>place <00:24:39.885>now

499
00:24:40.185 --> 00:24:42.645
<00:24:40.185>and <00:24:40.325>you <00:24:40.465>can <00:24:40.605>do <00:24:40.745>better <00:24:40.885>stuff <00:24:41.024>with <00:24:41.165>the <00:24:41.304>help <00:24:41.445>of <00:24:41.585>ai.

500
00:24:43.065 --> 00:24:46.645
<00:24:43.065>So <00:24:43.192>this <00:24:43.319>is <00:24:43.446>a <00:24:43.574>chatbot <00:24:43.701>in <00:24:43.828>a <00:24:43.955>to-do <00:24:44.083>list, <00:24:44.210>a <00:24:44.337>use <00:24:44.465>case.

501
00:24:46.875 --> 00:24:50.165
<00:24:46.875>What <00:24:47.050>else <00:24:47.225>do <00:24:47.400>we <00:24:47.575>have? <00:24:47.750>This <00:24:47.925>is <00:24:48.100>data <00:24:48.275>categorization,

502
00:24:50.405 --> 00:24:53.525
<00:24:50.405>a <00:24:50.545>smart <00:24:50.685>form <00:24:50.825>filler <00:24:50.965>that <00:24:51.105>just <00:24:51.245>takes <00:24:51.385>a <00:24:51.524>chunk <00:24:51.665>of <00:24:51.805>text

503
00:24:53.625 --> 00:24:55.645
<00:24:53.625>and <00:24:53.825>automatically <00:24:54.025>fills <00:24:54.225>in <00:24:54.425>the <00:24:54.625>form <00:24:54.825>for <00:24:55.025>you.

504
00:24:56.065 --> 00:24:59.005
<00:24:56.065>So <00:24:56.220>I <00:24:56.376>will <00:24:56.531>just <00:24:56.687>stop <00:24:56.842>that <00:24:56.998>switch <00:24:57.153>to <00:24:57.309>this <00:24:57.465>repository.

505
00:24:59.985 --> 00:25:01.605
<00:24:59.985>Uh, <00:25:00.451>yeah, <00:25:00.918>NPM <00:25:01.385>start

506
00:25:02.905 --> 00:25:06.685
<00:25:02.905>and <00:25:03.138>uh, <00:25:03.371>this <00:25:03.605>uses <00:25:03.838>prompt <00:25:04.071>API <00:25:04.305>now,

507
00:25:06.685 --> 00:25:07.925
<00:25:06.685>so <00:25:06.870>I <00:25:07.057>need <00:25:07.243>to <00:25:07.428>switch <00:25:07.615>to <00:25:07.801>cannery.

508
00:25:07.925 --> 00:25:09.565
<00:25:07.925>We <00:25:08.274>have <00:25:08.625>enabled <00:25:08.975>that. <00:25:09.325>Um,

509
00:25:09.665 --> 00:25:13.045
<00:25:09.665>and <00:25:09.820>here, <00:25:09.976>uh, <00:25:10.131>we <00:25:10.287>can <00:25:10.442>copy <00:25:10.598>a <00:25:10.753>chunk <00:25:10.909>of <00:25:11.065>text

510
00:25:13.385 --> 00:25:15.405
<00:25:13.385>and <00:25:13.540>now <00:25:13.696>let's <00:25:13.851>imagine <00:25:14.007>this <00:25:14.162>would <00:25:14.318>be <00:25:14.473>like <00:25:14.629>the <00:25:14.785>website

511
00:25:15.425 --> 00:25:17.005
<00:25:15.425>for <00:25:15.774>your, <00:25:16.125>uh, <00:25:16.475>postal <00:25:16.825>service

512
00:25:17.295 --> 00:25:19.965
<00:25:17.295>where <00:25:17.470>you <00:25:17.645>don't <00:25:17.820>wanna <00:25:17.995>fill <00:25:18.170>in <00:25:18.345>like <00:25:18.520>the <00:25:18.695>same

513
00:25:20.595 --> 00:25:22.125
<00:25:20.595>data <00:25:20.870>over <00:25:21.145>and <00:25:21.421>over <00:25:21.696>again, <00:25:21.972>right?

514
00:25:22.145 --> 00:25:23.445
<00:25:22.145>And <00:25:22.340>put <00:25:22.534>it <00:25:22.730>in <00:25:22.925>the <00:25:23.120>right <00:25:23.315>fields.

515
00:25:23.705 --> 00:25:27.765
<00:25:23.705>So <00:25:23.845>here <00:25:23.985>just <00:25:24.125>copied, <00:25:24.264>uh, <00:25:24.405>the, <00:25:24.544>the <00:25:24.685>address <00:25:24.824>and <00:25:24.965>pasted <00:25:25.105>it

516
00:25:27.905 --> 00:25:30.885
<00:25:27.905>and <00:25:28.105>it's <00:25:28.305>hopefully <00:25:28.504>more <00:25:28.705>or <00:25:28.905>less <00:25:29.105>correctly <00:25:29.305>identified.

517
00:25:31.185 --> 00:25:33.405
<00:25:31.185>Uh, <00:25:31.385>where, <00:25:31.585>which, <00:25:31.784>um, <00:25:31.985>data <00:25:32.185>should <00:25:32.385>go <00:25:32.585>to.

518
00:25:33.615 --> 00:25:37.205
<00:25:33.615>Again, <00:25:33.790>these <00:25:33.965>are <00:25:34.140>small <00:25:34.315>models, <00:25:34.490>so <00:25:34.665>the <00:25:34.840>quality <00:25:35.015>depends.

519
00:25:37.255 --> 00:25:39.765
<00:25:37.255>Cloud <00:25:37.430>models <00:25:37.605>are <00:25:37.780>of <00:25:37.955>course <00:25:38.130>a <00:25:38.305>little <00:25:38.480>bit <00:25:38.655>better.

520
00:25:40.235 --> 00:25:44.005
<00:25:40.235>This <00:25:40.390>is <00:25:40.546>a <00:25:40.701>gen <00:25:40.857>AI <00:25:41.012>use <00:25:41.168>case <00:25:41.323>beyond <00:25:41.479>chat <00:25:41.635>boxes

521
00:25:44.355 --> 00:25:46.325
<00:25:44.355>that <00:25:44.821>also <00:25:45.288>significantly <00:25:45.755>improves.

522
00:25:46.745 --> 00:25:49.605
<00:25:46.745>Um, <00:25:46.945>yeah, <00:25:47.145>the <00:25:47.344>user <00:25:47.544>experience <00:25:47.745>of <00:25:47.945>your <00:25:48.145>application.

523
00:25:50.305 --> 00:25:53.925
<00:25:50.305>So <00:25:50.505>that <00:25:50.705>is <00:25:50.905>data <00:25:51.105>classification <00:25:51.305>or <00:25:51.505>extraction <00:25:51.705>categorization.

524
00:25:55.865 --> 00:25:57.525
<00:25:55.865>So, <00:25:56.215>uh, <00:25:56.565>that <00:25:56.915>is <00:25:57.265>cool,

525
00:25:57.665 --> 00:26:00.605
<00:25:57.665>but <00:25:57.792>it <00:25:57.919>goes <00:25:58.046>even, <00:25:58.174>it <00:25:58.301>is <00:25:58.428>possible <00:25:58.555>to <00:25:58.683>do <00:25:58.810>it <00:25:58.937>even <00:25:59.065>better.

526
00:26:00.945 --> 00:26:02.885
<00:26:00.945>Uh, <00:26:01.178>and <00:26:01.411>this <00:26:01.645>demo <00:26:01.878>shows <00:26:02.111>us <00:26:02.345>how

527
00:26:02.885 --> 00:26:05.725
<00:26:02.885>to <00:26:03.085>do <00:26:03.285>it <00:26:03.485>using <00:26:03.685>real <00:26:03.885>time <00:26:04.085>models, <00:26:04.285>right?

528
00:26:05.745 --> 00:26:07.165
<00:26:05.745>So <00:26:05.957>I <00:26:06.170>can <00:26:06.384>talk <00:26:06.597>to <00:26:06.810>my <00:26:07.023>app.

529
00:26:08.385 --> 00:26:10.525
<00:26:08.385>That's <00:26:08.585>a <00:26:08.785>little <00:26:08.985>bit, <00:26:09.185>uh, <00:26:09.385>challenging <00:26:09.585>now, <00:26:09.785>right?

530
00:26:10.525 --> 00:26:12.525
<00:26:10.525>Because <00:26:10.805>we <00:26:11.085>have <00:26:11.365>this <00:26:11.645>background <00:26:11.925>noise.

531
00:26:12.525 --> 00:26:14.245
<00:26:12.525>So <00:26:12.758>let's <00:26:12.991>see <00:26:13.225>how <00:26:13.458>well <00:26:13.691>it <00:26:13.925>goes.

532
00:26:15.185 --> 00:26:18.245
<00:26:15.185>Um, <00:26:15.360>so <00:26:15.534>that's <00:26:15.710>this <00:26:15.885>demo <00:26:16.060>here <00:26:16.235>and <00:26:16.409>PM <00:26:16.585>start.

533
00:26:19.235 --> 00:26:21.335
<00:26:19.235>And <00:26:19.375>I <00:26:19.514>hope <00:26:19.655>we <00:26:19.794>can <00:26:19.935>also <00:26:20.074>like <00:26:20.215>hear <00:26:20.354>the <00:26:20.495>model <00:26:20.635>respond.

534
00:26:24.045 --> 00:26:25.655
<00:26:24.045>Alright, <00:26:24.325>this <00:26:24.605>is <00:26:24.885>an <00:26:25.165>insurance <00:26:25.445>form

535
00:26:25.875 --> 00:26:27.055
<00:26:25.875>and <00:26:26.052>I <00:26:26.229>can <00:26:26.406>talk <00:26:26.583>to <00:26:26.760>my <00:26:26.937>form.

536
00:26:31.225 --> 00:26:32.225
<00:26:31.225>Hi, <00:26:31.524>how <00:26:31.824>are <00:26:32.125>you?

537
00:26:34.225 --> 00:26:35.765
<00:26:34.225>Hi <00:26:34.571>there. <00:26:34.918>I'm <00:26:35.264>doing <00:26:35.611>great.

538
00:26:35.945 --> 00:26:37.845
<00:26:35.945>Thanks <00:26:36.225>for <00:26:36.504>asking. <00:26:36.784>How <00:26:37.064>about <00:26:37.345>you?

539
00:26:38.505 --> 00:26:40.205
<00:26:38.505>I'm <00:26:38.660>fine. <00:26:38.816>I <00:26:38.971>would <00:26:39.127>like <00:26:39.282>to <00:26:39.438>fill <00:26:39.593>in <00:26:39.749>this <00:26:39.905>form.

540
00:26:40.665 --> 00:26:41.685
<00:26:40.665>My <00:26:40.894>first <00:26:41.124>name <00:26:41.353>is <00:26:41.582>Chris

541
00:26:44.305 --> 00:26:46.245
<00:26:44.305>and <00:26:44.585>my <00:26:44.865>last <00:26:45.145>name <00:26:45.425>is <00:26:45.705>libel

542
00:26:48.665 --> 00:26:51.845
<00:26:48.665>and <00:26:48.945>I <00:26:49.225>live <00:26:49.504>in <00:26:49.784>post <00:26:50.065>in,

543
00:26:55.095 --> 00:26:57.185
<00:26:55.095>unfortunately, <00:26:55.445>I <00:26:55.795>forgot <00:26:56.145>the <00:26:56.495>postcode.

544
00:26:57.245 --> 00:26:58.185
<00:26:57.245>Can <00:26:57.386>you <00:26:57.526>find <00:26:57.668>that <00:26:57.809>out <00:26:57.950>for <00:26:58.091>me?

545
00:27:02.435 --> 00:27:05.885
<00:27:02.435>Alright. <00:27:02.562>That's <00:27:02.689>correct. <00:27:02.816>Uh, <00:27:02.944>what <00:27:03.071>else <00:27:03.198>do <00:27:03.325>I <00:27:03.453>need <00:27:03.580>to <00:27:03.707>fill <00:27:03.835>in?

546
00:27:09.525 --> 00:27:12.025
<00:27:09.525>So <00:27:09.758>far <00:27:09.991>we've <00:27:10.225>got <00:27:10.458>your <00:27:10.691>name, <00:27:10.925>address,

547
00:27:12.205 --> 00:27:13.705
<00:27:12.205>and <00:27:12.542>zip <00:27:12.879>code <00:27:13.217>filled <00:27:13.554>in.

548
00:27:14.005 --> 00:27:15.705
<00:27:14.005>We <00:27:14.285>still <00:27:14.565>need <00:27:14.845>your <00:27:15.125>insurance <00:27:15.405>id.

549
00:27:15.855 --> 00:27:18.785
<00:27:15.855>Date <00:27:16.030>of <00:27:16.205>birth, <00:27:16.380>telephone <00:27:16.555>number, <00:27:16.730>email <00:27:16.905>and <00:27:17.080>license. <00:27:17.255>All

550
00:27:18.785 --> 00:27:19.785
<00:27:18.785>Right. <00:27:18.935>Please <00:27:19.085>go <00:27:19.235>to <00:27:19.385>the <00:27:19.535>site <00:27:19.685>vehicle

551
00:27:19.785 --> 00:27:20.505
damage.

552
00:27:24.045 --> 00:27:27.545
<00:27:24.045>All <00:27:24.200>right, <00:27:24.356>I've <00:27:24.511>added <00:27:24.667>your <00:27:24.822>email <00:27:24.978>address <00:27:25.133>as <00:27:25.289>LeBel <00:27:25.445>Chris.

553
00:27:27.545 --> 00:27:29.145
<00:27:27.545>Okay, <00:27:27.700>that <00:27:27.856>didn't <00:27:28.011>quite <00:27:28.167>work. <00:27:28.322>No, <00:27:28.478>please <00:27:28.633>go <00:27:28.789>to <00:27:28.945>the,

554
00:27:29.165 --> 00:27:30.345
<00:27:29.165>oh, <00:27:29.430>sorry, <00:27:29.696>here's <00:27:29.961>the <00:27:30.227>microphone.

555
00:27:30.645 --> 00:27:32.785
<00:27:30.645>Please <00:27:30.878>go <00:27:31.111>to <00:27:31.345>the <00:27:31.578>site. <00:27:31.811>Vehicle <00:27:32.045>damage.

556
00:27:35.525 --> 00:27:36.545
<00:27:35.525>So <00:27:35.831>it's <00:27:36.137>also <00:27:36.443>possible

557
00:27:36.545 --> 00:27:38.825
<00:27:36.545>to <00:27:36.778>navigate <00:27:37.011>right <00:27:37.245>from <00:27:37.478>within <00:27:37.711>the <00:27:37.945>application.

558
00:27:38.845 --> 00:27:42.825
<00:27:38.845>It <00:27:39.000>is <00:27:39.156>multimodal. <00:27:39.311>Uh, <00:27:39.467>so <00:27:39.622>it <00:27:39.778>also <00:27:39.933>has <00:27:40.089>vision <00:27:40.245>capabilities.

559
00:27:43.125 --> 00:27:47.065
<00:27:43.125>If <00:27:43.252>we <00:27:43.379>upload <00:27:43.506>like <00:27:43.634>an <00:27:43.761>image <00:27:43.888>with <00:27:44.015>from <00:27:44.143>a <00:27:44.270>car <00:27:44.397>crash, <00:27:44.525>right?

560
00:27:47.685 --> 00:27:51.265
<00:27:47.685>Um, <00:27:47.825>then <00:27:47.965>it <00:27:48.105>can <00:27:48.245>identify <00:27:48.385>which <00:27:48.524>pieces <00:27:48.665>of <00:27:48.804>the <00:27:48.945>car, <00:27:49.085>uh,

561
00:27:51.265 --> 00:27:52.545
<00:27:51.265>have <00:27:51.495>been <00:27:51.725>destroyed <00:27:51.956>and <00:27:52.186>so <00:27:52.417>on.

562
00:27:52.645 --> 00:27:53.865
<00:27:52.645>And <00:27:53.011>that's <00:27:53.377>all <00:27:53.743>possible.

563
00:27:54.245 --> 00:27:56.105
<00:27:54.245>But <00:27:54.445>again, <00:27:54.645>this <00:27:54.844>is <00:27:55.044>a <00:27:55.245>cloud-based, <00:27:55.445>uh, <00:27:55.645>model.

564
00:27:56.105 --> 00:27:58.225
<00:27:56.105>So <00:27:56.305>that's <00:27:56.505>of <00:27:56.705>course <00:27:56.905>much <00:27:57.105>more <00:27:57.305>powerful, <00:27:57.505>uh,

565
00:27:58.225 --> 00:27:59.665
<00:27:58.225>and <00:27:58.549>delivers <00:27:58.873>these <00:27:59.197>great <00:27:59.521>results.

566
00:28:00.485 --> 00:28:01.865
<00:28:00.485>Um, <00:28:01.727>yeah,

567
00:28:11.785 --> 00:28:14.045
<00:28:11.785>And <00:28:11.985>it <00:28:12.185>of <00:28:12.385>course <00:28:12.585>also <00:28:12.785>speaks <00:28:12.985>multiple <00:28:13.185>languages.

568
00:28:14.115 --> 00:28:15.645
<00:28:14.115>It's <00:28:14.390>a <00:28:14.665>language <00:28:14.941>model <00:28:15.216>after <00:28:15.492>all.

569
00:28:16.435 --> 00:28:18.445
<00:28:16.435>Alright, <00:28:16.668>this <00:28:16.901>was <00:28:17.135>a <00:28:17.368>cloud <00:28:17.601>demo, <00:28:17.835>right?

570
00:28:18.445 --> 00:28:21.085
<00:28:18.445>To <00:28:18.620>be <00:28:18.794>fair, <00:28:18.970>however, <00:28:19.145>there's <00:28:19.320>also <00:28:19.495>like <00:28:19.669>the, <00:28:19.845>well,

571
00:28:21.085 --> 00:28:22.965
<00:28:21.085>there's <00:28:21.260>a <00:28:21.435>recording <00:28:21.610>in <00:28:21.785>case <00:28:21.960>it <00:28:22.135>wouldn't <00:28:22.310>have <00:28:22.485>worked.

572
00:28:23.505 --> 00:28:28.435
<00:28:23.505>Um, <00:28:23.680>but <00:28:23.855>we <00:28:24.030>can <00:28:24.205>also <00:28:24.380>do <00:28:24.555>some <00:28:24.730>sort <00:28:24.905>of

573
00:28:28.585 --> 00:28:30.595
<00:28:28.585>that, <00:28:28.818>uh, <00:28:29.051>on <00:28:29.285>in <00:28:29.518>the <00:28:29.751>browser <00:28:29.985>already.

574
00:28:30.815 --> 00:28:32.235
<00:28:30.815>Uh, <00:28:30.997>so <00:28:31.180>this <00:28:31.362>is <00:28:31.545>a <00:28:31.727>real <00:28:31.910>time <00:28:32.092>demo,

575
00:28:32.345 --> 00:28:34.675
<00:28:32.345>however, <00:28:32.578>it <00:28:32.811>uses <00:28:33.045>a <00:28:33.278>small <00:28:33.511>LLM <00:28:33.745>tool.

576
00:28:34.675 --> 00:28:36.235
<00:28:34.675>Calling <00:28:35.024>is <00:28:35.375>not <00:28:35.725>working <00:28:36.075>properly,

577
00:28:36.455 --> 00:28:38.595
<00:28:36.455>so <00:28:36.655>we <00:28:36.855>can <00:28:37.054>really <00:28:37.254>only <00:28:37.455>do <00:28:37.655>the <00:28:37.855>conversation

578
00:28:38.615 --> 00:28:40.395
<00:28:38.615>and <00:28:38.895>not <00:28:39.175>stuff <00:28:39.455>like <00:28:39.735>form <00:28:40.015>filling,

579
00:28:40.665 --> 00:28:42.595
<00:28:40.665>finding <00:28:40.945>out <00:28:41.225>postcodes <00:28:41.504>and <00:28:41.784>so <00:28:42.065>on.

580
00:28:43.035 --> 00:28:47.835
<00:28:43.035>'cause <00:28:43.190>that <00:28:43.346>model <00:28:43.501>is <00:28:43.657>not <00:28:43.812>capable <00:28:43.968>enough. <00:28:44.123>So <00:28:44.279>switching <00:28:44.435>demos.

581
00:28:50.875 --> 00:28:54.995
<00:28:50.875>Alrighty, <00:28:51.050>so <00:28:51.225>that's <00:28:51.400>now <00:28:51.575>on <00:28:51.750>device, <00:28:51.925>offline <00:28:52.100>capable, <00:28:52.275>uh,

582
00:28:54.995 --> 00:28:56.035
<00:28:54.995>conversational <00:28:55.931>demo.

583
00:28:57.575 --> 00:29:00.875
<00:28:57.575>Hey <00:28:57.702>there, <00:28:57.829>my <00:28:57.956>name <00:28:58.084>is <00:28:58.211>Hart. <00:28:58.338>How <00:28:58.465>can <00:28:58.593>I <00:28:58.720>help <00:28:58.847>you <00:28:58.975>today?

584
00:29:01.375 --> 00:29:02.915
<00:29:01.375>Hi <00:29:01.573>Har, <00:29:01.771>can <00:29:01.969>you <00:29:02.167>tell <00:29:02.365>us <00:29:02.562>a <00:29:02.761>joke?

585
00:29:04.645 --> 00:29:05.775
<00:29:04.645>Sure. <00:29:04.899>Here's <00:29:05.153>one <00:29:05.407>for <00:29:05.662>you.

586
00:29:06.075 --> 00:29:07.775
<00:29:06.075>Why <00:29:06.425>don't <00:29:06.775>scientists <00:29:07.125>trust <00:29:07.475>atoms?

587
00:29:08.185 --> 00:29:09.955
<00:29:08.185>Because <00:29:08.534>they <00:29:08.885>make <00:29:09.235>up <00:29:09.585>everything.

588
00:29:11.335 --> 00:29:12.435
<00:29:11.335>Ha <00:29:11.830>ha <00:29:12.325>ha.

589
00:29:13.185 --> 00:29:17.595
<00:29:13.185>Very <00:29:13.360>funny <00:29:13.534>but <00:29:13.710>everything <00:29:13.885>local, <00:29:14.060>uh, <00:29:14.235>and <00:29:14.409>on <00:29:14.585>device.

590
00:29:18.405 --> 00:29:21.735
<00:29:18.405>Alright, <00:29:18.560>let's <00:29:18.716>wrap <00:29:18.871>it <00:29:19.027>up. <00:29:19.182>What <00:29:19.338>have <00:29:19.493>you <00:29:19.649>seen <00:29:19.805>today?

591
00:29:22.445 --> 00:29:23.815
<00:29:22.445>Pros <00:29:22.691>and <00:29:22.938>cons <00:29:23.184>of <00:29:23.431>on-device <00:29:23.678>models?

592
00:29:24.395 --> 00:29:27.175
<00:29:24.395>Pro <00:29:24.570>data <00:29:24.745>never <00:29:24.920>leaves <00:29:25.095>your <00:29:25.270>browser <00:29:25.445>great <00:29:25.620>for <00:29:25.795>privacy.

593
00:29:27.685 --> 00:29:30.375
<00:29:27.685>High <00:29:27.885>availability <00:29:28.085>even <00:29:28.284>works <00:29:28.485>when <00:29:28.685>you <00:29:28.885>are <00:29:29.085>offline.

594
00:29:30.725 --> 00:29:32.095
<00:29:30.725>Latency <00:29:31.341>super <00:29:31.958>low.

595
00:29:32.435 --> 00:29:36.055
<00:29:32.435>The <00:29:32.575>real <00:29:32.715>time, <00:29:32.855>uh, <00:29:32.995>demo <00:29:33.135>is <00:29:33.274>faster <00:29:33.415>than <00:29:33.554>the <00:29:33.695>cloud <00:29:33.835>actually.

596
00:29:36.835 --> 00:29:40.295
<00:29:36.835>Um, <00:29:37.010>then <00:29:37.185>the <00:29:37.360>stability, <00:29:37.535>the <00:29:37.710>models <00:29:37.885>don't <00:29:38.060>change, <00:29:38.235>right?

597
00:29:40.315 --> 00:29:42.845
<00:29:40.315>Or <00:29:40.490>if <00:29:40.665>they <00:29:40.840>change <00:29:41.015>the <00:29:41.190>API <00:29:41.365>stays <00:29:41.540>the <00:29:41.715>same.

598
00:29:42.905 --> 00:29:47.365
<00:29:42.905>You <00:29:43.021>can <00:29:43.138>um, <00:29:43.254>keep <00:29:43.371>a <00:29:43.488>copy. <00:29:43.605>Uh, <00:29:43.721>it's <00:29:43.838>basically <00:29:43.955>all <00:29:44.071>up <00:29:44.188>to <00:29:44.305>you.

599
00:29:47.835 --> 00:29:51.525
<00:29:47.835>Cost <00:29:47.990>is <00:29:48.146>low <00:29:48.301>because <00:29:48.457>basically <00:29:48.612>your <00:29:48.768>user <00:29:48.923>runs <00:29:49.079>the <00:29:49.235>inference

600
00:29:51.665 --> 00:29:53.245
<00:29:51.665>and <00:29:51.945>no <00:29:52.225>longer <00:29:52.504>a <00:29:52.784>cloud <00:29:53.065>provider.

601
00:29:53.865 --> 00:29:56.685
<00:29:53.865>Um, <00:29:54.005>response <00:29:54.145>quality <00:29:54.285>to <00:29:54.425>be <00:29:54.565>fair, <00:29:54.705>is <00:29:54.845>a <00:29:54.985>little <00:29:55.125>bit <00:29:55.265>lower

602
00:29:56.985 --> 00:29:58.645
<00:29:56.985>or <00:29:57.264>depends <00:29:57.544>on <00:29:57.824>the <00:29:58.104>model, <00:29:58.385>right?

603
00:29:58.645 --> 00:30:01.125
<00:29:58.645>Maybe <00:29:58.845>even <00:29:59.045>significantly <00:29:59.245>lower <00:29:59.445>than <00:29:59.645>on <00:29:59.845>the <00:30:00.045>cloud.

604
00:30:01.515 --> 00:30:02.965
<00:30:01.515>They <00:30:01.950>are <00:30:02.385>less <00:30:02.820>capable.

605
00:30:03.425 --> 00:30:05.925
<00:30:03.425>The <00:30:03.565>real <00:30:03.705>time <00:30:03.845>demo <00:30:03.985>at <00:30:04.125>the <00:30:04.264>end <00:30:04.405>would <00:30:04.544>not <00:30:04.685>support <00:30:04.825>two.

606
00:30:05.925 --> 00:30:07.685
<00:30:05.925>Calling <00:30:06.391>or <00:30:06.858>not <00:30:07.325>reliably.

607
00:30:08.025 --> 00:30:12.125
<00:30:08.025>System <00:30:08.200>requirements <00:30:08.375>are <00:30:08.550>pretty <00:30:08.725>high. <00:30:08.900>Uh, <00:30:09.075>models <00:30:09.250>are <00:30:09.425>large.

608
00:30:12.185 --> 00:30:13.765
<00:30:12.185>We <00:30:12.465>cannot <00:30:12.745>always, <00:30:13.024>uh, <00:30:13.304>share <00:30:13.585>them.

609
00:30:14.145 --> 00:30:15.645
<00:30:14.145>And, <00:30:14.595>uh, <00:30:15.045>model <00:30:15.495>initialization

610
00:30:15.645 --> 00:30:19.045
<00:30:15.645>and <00:30:15.925>inference <00:30:16.205>can <00:30:16.485>be <00:30:16.764>relatively <00:30:17.045>slow.

611
00:30:19.375 --> 00:30:20.885
<00:30:19.375>Lemme <00:30:19.569>see. <00:30:19.763>Well <00:30:19.957>this <00:30:20.151>is <00:30:20.345>the <00:30:20.539>last <00:30:20.734>point.

612
00:30:20.985 --> 00:30:25.885
<00:30:20.985>Ah, <00:30:21.140>and <00:30:21.296>APIs <00:30:21.451>are <00:30:21.607>experimental, <00:30:21.762>but <00:30:21.918>everything <00:30:22.073>is <00:30:22.229>super <00:30:22.385>cool.

613
00:30:26.465 --> 00:30:29.845
<00:30:26.465>So <00:30:26.605>try <00:30:26.745>it <00:30:26.885>out <00:30:27.024>and, <00:30:27.165>uh, <00:30:27.304>play <00:30:27.445>with <00:30:27.584>the <00:30:27.725>APIs <00:30:27.865>yourself.

614
00:30:29.865 --> 00:30:32.165
<00:30:29.865>Thanks <00:30:30.040>for <00:30:30.215>joining <00:30:30.390>today <00:30:30.565>and <00:30:30.740>for <00:30:30.915>your <00:30:31.090>kind <00:30:31.265>attention.