WEBVTT

1
00:00:18.345 --> 00:00:18.645
<00:00:18.345>All <00:00:18.615>right.

2
00:00:18.665 --> 00:00:22.165
<00:00:18.665>So <00:00:18.805>thank <00:00:18.945>you <00:00:19.085>very <00:00:19.224>much, <00:00:19.365>uh, <00:00:19.505>for <00:00:19.645>the <00:00:19.785>introduction <00:00:19.924>again, <00:00:20.064>uh,

3
00:00:22.465 --> 00:00:24.925
<00:00:22.465>my <00:00:22.665>name <00:00:22.865>is <00:00:23.065>Margan, <00:00:23.265>my, <00:00:23.465>my <00:00:23.665>talk <00:00:23.865>today

4
00:00:25.065 --> 00:00:27.885
<00:00:25.065>or <00:00:25.265>the, <00:00:25.465>the <00:00:25.665>next <00:00:25.865>30 <00:00:26.065>to <00:00:26.265>35 <00:00:26.465>minutes.

5
00:00:28.205 --> 00:00:32.765
<00:00:28.205>I <00:00:28.321>would <00:00:28.438>like <00:00:28.555>to <00:00:28.671>talk <00:00:28.788>about, <00:00:28.904>uh, <00:00:29.021>how, <00:00:29.138>uh, <00:00:29.255>we <00:00:29.371>at <00:00:29.488>Slido <00:00:29.604>managed

6
00:00:32.765 --> 00:00:34.205
<00:00:32.765>to <00:00:33.089>do <00:00:33.413>some <00:00:33.737>serverless <00:00:34.061>deployment

7
00:00:34.385 --> 00:00:36.645
<00:00:34.385>of <00:00:34.665>pretty <00:00:34.945>large <00:00:35.224>and <00:00:35.504>LP <00:00:35.785>models.

8
00:00:37.265 --> 00:00:40.325
<00:00:37.265>And, <00:00:37.372>uh, <00:00:37.480>we <00:00:37.588>might <00:00:37.695>tell <00:00:37.803>you <00:00:37.911>a <00:00:38.018>bit <00:00:38.126>of, <00:00:38.234>of <00:00:38.341>the <00:00:38.449>slide <00:00:38.557>of <00:00:38.665>story

9
00:00:40.345 --> 00:00:41.605
<00:00:40.345>and, <00:00:40.571>and <00:00:40.798>history <00:00:41.025>in <00:00:41.252>the <00:00:41.479>process.

10
00:00:42.435 --> 00:00:47.005
<00:00:42.435>What <00:00:42.551>I'm <00:00:42.668>gonna <00:00:42.785>talk <00:00:42.901>about, <00:00:43.018>uh, <00:00:43.135>is, <00:00:43.251>is, <00:00:43.368>uh, <00:00:43.485>not <00:00:43.601>my <00:00:43.718>work <00:00:43.835>in,

11
00:00:47.425 --> 00:00:48.685
<00:00:47.425>in, <00:00:47.803>in <00:00:48.181>the <00:00:48.559>slightest.

12
00:00:48.685 --> 00:00:50.205
<00:00:48.685>It <00:00:48.913>was <00:00:49.141>very <00:00:49.369>much <00:00:49.597>a <00:00:49.825>team <00:00:50.053>effort.

13
00:00:50.305 --> 00:00:53.525
<00:00:50.305>So <00:00:50.421>you <00:00:50.538>can <00:00:50.655>see <00:00:50.771>the <00:00:50.888>real <00:00:51.005>heroes <00:00:51.121>on <00:00:51.238>the, <00:00:51.355>on <00:00:51.471>the <00:00:51.588>bottom <00:00:51.705>there.

14
00:00:53.925 --> 00:00:57.085
<00:00:53.925>I <00:00:54.125>am, <00:00:54.324>uh, <00:00:54.525>mostly, <00:00:54.724>mostly <00:00:54.925>a <00:00:55.125>messenger <00:00:55.324>here.

15
00:00:58.495 --> 00:01:02.985
<00:00:58.495>Okay, <00:00:58.635>cool. <00:00:58.775>So <00:00:58.915>I <00:00:59.055>guess <00:00:59.195>at <00:00:59.334>this <00:00:59.474>point, <00:00:59.614>by <00:00:59.754>this <00:00:59.894>point,

16
00:01:03.005 --> 00:01:05.865
<00:01:03.005>you <00:01:03.238>are <00:01:03.471>probably <00:01:03.705>fairly <00:01:03.938>familiar <00:01:04.171>with <00:01:04.405>Slido.

17
00:01:05.885 --> 00:01:09.545
<00:01:05.885>Is <00:01:06.001>that <00:01:06.118>the <00:01:06.235>little <00:01:06.351>thing <00:01:06.468>you <00:01:06.585>see <00:01:06.701>on <00:01:06.818>the, <00:01:06.935>on <00:01:07.051>the <00:01:07.168>right <00:01:07.285>next

18
00:01:09.545 --> 00:01:13.225
<00:01:09.545>to <00:01:09.745>the <00:01:09.945>next, <00:01:10.145>to <00:01:10.345>the, <00:01:10.545>uh, <00:01:10.745>um, <00:01:10.945>stream?

19
00:01:13.805 --> 00:01:15.505
<00:01:13.805>At <00:01:14.005>least? <00:01:14.205>I, <00:01:14.405>at <00:01:14.605>least <00:01:14.805>I <00:01:15.005>hope <00:01:15.205>so.

20
00:01:15.965 --> 00:01:18.545
<00:01:15.965>Um, <00:01:16.245>and, <00:01:16.525>uh, <00:01:16.805>STO <00:01:17.085>is <00:01:17.365>an,

21
00:01:18.685 --> 00:01:20.785
<00:01:18.685>is <00:01:18.965>an <00:01:19.245>audience <00:01:19.525>interaction <00:01:19.805>platform, <00:01:20.085>right?

22
00:01:20.815 --> 00:01:23.905
<00:01:20.815>That <00:01:20.955>essentially <00:01:21.095>means <00:01:21.235>that <00:01:21.375>a <00:01:21.515>Slido <00:01:21.655>can <00:01:21.795>be <00:01:21.935>used <00:01:22.075>to, <00:01:22.215>um,

23
00:01:24.135 --> 00:01:28.345
<00:01:24.135>help <00:01:24.310>you <00:01:24.485>interact <00:01:24.660>with <00:01:24.835>audiences <00:01:25.010>by, <00:01:25.185>uh, <00:01:25.360>helping <00:01:25.535>you

24
00:01:28.345 --> 00:01:29.665
<00:01:28.345>to <00:01:28.741>interact <00:01:29.137>with <00:01:29.532>audiences.

25
00:01:30.165 --> 00:01:33.545
<00:01:30.164>Um, <00:01:30.339>uh, <00:01:30.514>we <00:01:30.690>mean <00:01:30.865>that <00:01:31.039>it <00:01:31.214>allows <00:01:31.389>you <00:01:31.565>to,

26
00:01:34.005 --> 00:01:36.905
<00:01:34.005>to <00:01:34.179>gather <00:01:34.354>questions <00:01:34.530>in <00:01:34.705>advance <00:01:34.880>or, <00:01:35.054>or <00:01:35.229>live <00:01:35.405>by

27
00:01:37.165 --> 00:01:42.025
<00:01:37.164>or <00:01:37.292>event <00:01:37.419>allows <00:01:37.546>you <00:01:37.674>to, <00:01:37.801>to, <00:01:37.928>um, <00:01:38.055>create <00:01:38.183>polls, <00:01:38.310>um, <00:01:38.437>of, <00:01:38.565>of,

28
00:01:42.045 --> 00:01:43.265
<00:01:42.045>of <00:01:42.411>various <00:01:42.777>types <00:01:43.143>and,

29
00:01:43.265 --> 00:01:45.305
<00:01:43.265>and <00:01:43.731>gather, <00:01:44.198>um, <00:01:44.665>um,

30
00:01:45.565 --> 00:01:47.945
<00:01:45.565>the <00:01:45.798>information <00:01:46.031>from <00:01:46.265>your <00:01:46.498>audience <00:01:46.731>that <00:01:46.965>way.

31
00:01:48.245 --> 00:01:51.265
<00:01:48.245>And <00:01:48.400>so <00:01:48.556>there, <00:01:48.711>there <00:01:48.867>is <00:01:49.022>a <00:01:49.178>ton <00:01:49.333>of <00:01:49.489>audience <00:01:49.645>interaction,

32
00:01:51.445 --> 00:01:53.745
<00:01:51.445>at <00:01:51.678>least <00:01:51.911>in <00:01:52.145>the, <00:01:52.378>in <00:01:52.611>the, <00:01:52.845>uh,

33
00:01:53.815 --> 00:01:55.465
<00:01:53.815>current <00:01:54.164>version <00:01:54.515>of <00:01:54.865>the <00:01:55.215>platform.

34
00:01:55.495 --> 00:01:57.105
<00:01:55.495>There's <00:01:55.775>quite <00:01:56.055>a <00:01:56.335>lot <00:01:56.615>of <00:01:56.895>texts.

35
00:01:57.365 --> 00:02:00.505
<00:01:57.365>Um, <00:01:57.540>that's <00:01:57.715>how, <00:01:57.890>that's <00:01:58.065>how <00:01:58.240>you've <00:01:58.415>been <00:01:58.590>sending <00:01:58.765>questions

36
00:02:00.505 --> 00:02:03.465
<00:02:00.505>and <00:02:00.621>the <00:02:00.738>pretty <00:02:00.854>good <00:02:00.971>ones, <00:02:01.088>if <00:02:01.205>my, <00:02:01.321>if <00:02:01.438>I <00:02:01.554>may <00:02:01.671>say <00:02:01.788>so, <00:02:01.905>uh,

37
00:02:03.465 --> 00:02:04.745
<00:02:03.465>throughout <00:02:03.753>the <00:02:04.041>day <00:02:04.329>to <00:02:04.617>day

38
00:02:05.245 --> 00:02:07.905
<00:02:05.245>and, <00:02:05.400>uh, <00:02:05.556>where <00:02:05.711>there's <00:02:05.867>a <00:02:06.022>ton <00:02:06.178>of <00:02:06.333>text <00:02:06.489>at <00:02:06.645>least.

39
00:02:08.005 --> 00:02:10.105
<00:02:08.005>So, <00:02:08.354>uh, <00:02:08.704>at <00:02:09.055>least <00:02:09.405>it's

40
00:02:10.125 --> 00:02:12.065
<00:02:10.125>how <00:02:10.280>we <00:02:10.436>see <00:02:10.591>it <00:02:10.747>in <00:02:10.902>the <00:02:11.058>data <00:02:11.213>team <00:02:11.369>with <00:02:11.525>Slido.

41
00:02:12.155 --> 00:02:13.865
<00:02:12.155>There <00:02:12.388>is <00:02:12.621>a <00:02:12.855>lot <00:02:13.088>of <00:02:13.321>potential <00:02:13.555>to,

42
00:02:14.125 --> 00:02:16.105
<00:02:14.125>to <00:02:14.475>do <00:02:14.825>interesting <00:02:15.175>stuff, <00:02:15.525>right?

43
00:02:16.705 --> 00:02:20.865
<00:02:16.704>Interesting <00:02:16.860>stuff <00:02:17.016>in, <00:02:17.171>in, <00:02:17.327>in <00:02:17.482>various, <00:02:17.638>uh, <00:02:17.793>various <00:02:17.949>ways <00:02:18.105>as,

44
00:02:20.885 --> 00:02:23.345
<00:02:20.885>as, <00:02:21.060>as <00:02:21.234>we <00:02:21.410>saw <00:02:21.584>even <00:02:21.760>in, <00:02:21.935>in <00:02:22.109>today's <00:02:22.285>presentations.

45
00:02:23.765 --> 00:02:27.585
<00:02:23.765>And <00:02:23.920>then <00:02:24.076>while <00:02:24.231>that <00:02:24.387>today <00:02:24.542>basically <00:02:24.698>implies <00:02:24.853>in <00:02:25.009>a <00:02:25.165>fairly

46
00:02:27.945 --> 00:02:30.545
<00:02:27.945>straightforward <00:02:28.225>manner <00:02:28.505>doing <00:02:28.785>some <00:02:29.065>machine <00:02:29.345>learning.

47
00:02:31.605 --> 00:02:35.145
<00:02:31.605>Now, <00:02:31.760>the, <00:02:31.916>the <00:02:32.071>thing <00:02:32.227>about <00:02:32.382>doing <00:02:32.538>machine <00:02:32.693>learning <00:02:32.849>is <00:02:33.005>that,

48
00:02:35.245 --> 00:02:38.225
<00:02:35.245>uh, <00:02:35.595>the, <00:02:35.945>the, <00:02:36.295>uh, <00:02:36.645>um,

49
00:02:39.295 --> 00:02:41.105
<00:02:39.295>ways <00:02:39.495>in <00:02:39.695>which <00:02:39.895>you <00:02:40.095>can <00:02:40.295>utilize <00:02:40.495>it <00:02:40.695>are,

50
00:02:41.165 --> 00:02:43.065
<00:02:41.165>are <00:02:41.445>multiple <00:02:41.725>and <00:02:42.005>not <00:02:42.285>so <00:02:42.565>obvious.

51
00:02:43.085 --> 00:02:46.665
<00:02:43.085>So <00:02:43.225>let <00:02:43.365>me, <00:02:43.505>let <00:02:43.645>me, <00:02:43.785>um, <00:02:43.925>uh, <00:02:44.065>give <00:02:44.205>you <00:02:44.345>a <00:02:44.485>bit

52
00:02:46.665 --> 00:02:50.025
<00:02:46.665>of <00:02:46.804>a <00:02:46.945>rundown <00:02:47.084>very <00:02:47.225>quickly <00:02:47.364>of <00:02:47.505>where <00:02:47.644>we <00:02:47.785>found <00:02:47.924>machine <00:02:48.065>learning

53
00:02:50.025 --> 00:02:53.785
<00:02:50.025>to <00:02:50.180>be <00:02:50.336>useful <00:02:50.491>inside <00:02:50.647>a, <00:02:50.802>inside <00:02:50.958>a, <00:02:51.113>uh, <00:02:51.269>Slido <00:02:51.425>platform.

54
00:02:53.965 --> 00:02:55.225
<00:02:53.965>So <00:02:54.154>the <00:02:54.343>first <00:02:54.532>thing <00:02:54.721>I <00:02:54.910>would <00:02:55.099>like

55
00:02:55.225 --> 00:02:57.225
<00:02:55.225>to <00:02:55.424>talk <00:02:55.625>about <00:02:55.825>is <00:02:56.025>called <00:02:56.225>key <00:02:56.424>phrase <00:02:56.625>extraction.

56
00:02:57.605 --> 00:02:59.025
<00:02:57.605>The, <00:02:57.860>the <00:02:58.116>concept <00:02:58.371>is <00:02:58.627>very <00:02:58.883>simple.

57
00:02:59.155 --> 00:03:03.845
<00:02:59.155>Suppose <00:02:59.295>you <00:02:59.435>have <00:02:59.575>a <00:02:59.715>large <00:02:59.855>event, <00:02:59.995>a <00:03:00.135>large, <00:03:00.275>um, <00:03:00.415>large <00:03:00.555>gathering

58
00:03:03.845 --> 00:03:07.245
<00:03:03.845>of <00:03:04.045>people, <00:03:04.245>large <00:03:04.445>conference, <00:03:04.645>for <00:03:04.845>instance, <00:03:05.045>money <00:03:05.245>2020.

59
00:03:07.395 --> 00:03:09.845
<00:03:07.395>It's <00:03:07.595>a, <00:03:07.795>it's <00:03:07.995>a <00:03:08.195>large, <00:03:08.395>uh, <00:03:08.595>FinTech <00:03:08.795>conference

60
00:03:10.025 --> 00:03:13.045
<00:03:10.025>or <00:03:10.180>used <00:03:10.336>to <00:03:10.491>be <00:03:10.647>a <00:03:10.802>large <00:03:10.958>FinTech <00:03:11.113>con <00:03:11.269>FinTech, <00:03:11.425>uh,

61
00:03:13.045 --> 00:03:15.645
<00:03:13.045>conference <00:03:13.244>in <00:03:13.445>the, <00:03:13.644>in <00:03:13.845>the <00:03:14.045>us <00:03:14.244>And <00:03:14.445>which,

62
00:03:15.645 --> 00:03:17.405
<00:03:15.645>which <00:03:15.878>you <00:03:16.111>can <00:03:16.345>see <00:03:16.578>here <00:03:16.811>is <00:03:17.045>a,

63
00:03:17.405 --> 00:03:21.765
<00:03:17.405>it's <00:03:17.505>a <00:03:17.605>way <00:03:17.705>in <00:03:17.805>which <00:03:17.905>we <00:03:18.005>are <00:03:18.105>trying <00:03:18.205>to <00:03:18.305>kind <00:03:18.405>of <00:03:18.505>give <00:03:18.605>you <00:03:18.705>a <00:03:18.805>bit

64
00:03:21.765 --> 00:03:23.605
<00:03:21.765>of <00:03:21.964>a <00:03:22.165>perspective <00:03:22.364>of <00:03:22.565>what <00:03:22.765>was <00:03:22.964>it <00:03:23.165>about.

65
00:03:24.025 --> 00:03:25.525
<00:03:24.025>So <00:03:24.250>on <00:03:24.475>the, <00:03:24.700>on <00:03:24.925>the <00:03:25.150>left <00:03:25.375>side,

66
00:03:25.635 --> 00:03:29.565
<00:03:25.635>what <00:03:25.774>we <00:03:25.915>see <00:03:26.054>is <00:03:26.195>a <00:03:26.334>standard <00:03:26.475>T-F-I-D-F <00:03:26.614>kind <00:03:26.755>of, <00:03:26.894>uh, <00:03:27.035>gathering

67
00:03:29.585 --> 00:03:31.205
<00:03:29.585>of, <00:03:29.935>of <00:03:30.285>the, <00:03:30.635>of, <00:03:30.985>of,

68
00:03:31.205 --> 00:03:33.565
<00:03:31.204>or <00:03:31.360>like <00:03:31.516>aggregation <00:03:31.671>of, <00:03:31.827>of <00:03:31.982>the <00:03:32.138>data, <00:03:32.293>which <00:03:32.449>shows <00:03:32.605>you

69
00:03:33.565 --> 00:03:35.325
<00:03:33.565>that <00:03:33.845>it <00:03:34.125>was <00:03:34.405>probably <00:03:34.685>about <00:03:34.965>banks

70
00:03:35.505 --> 00:03:37.165
<00:03:35.505>as <00:03:35.785>you <00:03:36.065>would <00:03:36.345>expect <00:03:36.625>about <00:03:36.905>data

71
00:03:37.665 --> 00:03:40.605
<00:03:37.665>or <00:03:37.864>maybe <00:03:38.065>some <00:03:38.265>things <00:03:38.465>financial <00:03:38.665>about, <00:03:38.864>about <00:03:39.065>credit.

72
00:03:40.865 --> 00:03:43.205
<00:03:40.865>But <00:03:40.981>what <00:03:41.098>we <00:03:41.215>can <00:03:41.331>do <00:03:41.448>if <00:03:41.565>we <00:03:41.681>applied <00:03:41.798>a <00:03:41.915>bit <00:03:42.031>of <00:03:42.148>a <00:03:42.265>bit

73
00:03:43.205 --> 00:03:44.325
<00:03:43.204>of <00:03:43.541>machine <00:03:43.876>learning <00:03:44.213>and,

74
00:03:44.345 --> 00:03:48.885
<00:03:44.345>and <00:03:44.520>some, <00:03:44.695>some, <00:03:44.870>uh, <00:03:45.045>uh, <00:03:45.220>some, <00:03:45.395>some <00:03:45.570>other <00:03:45.745>techniques,

75
00:03:49.375 --> 00:03:51.965
<00:03:49.375>especially <00:03:49.608>pre-processing <00:03:49.841>techniques, <00:03:50.075>you <00:03:50.308>can <00:03:50.541>get, <00:03:50.775>uh,

76
00:03:52.285 --> 00:03:53.445
<00:03:52.285>a <00:03:52.459>a <00:03:52.632>bit <00:03:52.807>of <00:03:52.981>a <00:03:53.155>different <00:03:53.329>picture.

77
00:03:53.585 --> 00:03:55.925
<00:03:53.585>So <00:03:53.760>data <00:03:53.935>is <00:03:54.110>still <00:03:54.285>there, <00:03:54.460>bank <00:03:54.635>is <00:03:54.810>still <00:03:54.985>there.

78
00:03:56.605 --> 00:04:00.445
<00:03:56.605>FinTech, <00:03:56.744>uh, <00:03:56.885>just <00:03:57.024>became <00:03:57.165>a, <00:03:57.304>an <00:03:57.445>an <00:03:57.584>important <00:03:57.725>thing <00:03:57.864>as <00:03:58.005>well.

79
00:04:00.785 --> 00:04:03.965
<00:04:00.785>But <00:04:00.901>there <00:04:01.018>are <00:04:01.135>other <00:04:01.251>things <00:04:01.368>that <00:04:01.484>give <00:04:01.601>you <00:04:01.718>a <00:04:01.835>bit <00:04:01.951>of <00:04:02.068>a <00:04:02.185>slightly

80
00:04:04.765 --> 00:04:06.565
<00:04:04.765>slightly <00:04:05.231>greater, <00:04:05.698>uh, <00:04:06.165>detail.

81
00:04:06.865 --> 00:04:09.205
<00:04:06.865>Uh, <00:04:07.005>so <00:04:07.145>as <00:04:07.285>to <00:04:07.425>what <00:04:07.565>was, <00:04:07.705>what <00:04:07.845>was <00:04:07.985>the <00:04:08.125>conference <00:04:08.265>about?

82
00:04:09.205 --> 00:04:12.245
<00:04:09.205>So <00:04:09.345>like <00:04:09.485>there <00:04:09.625>is <00:04:09.765>a <00:04:09.905>higher <00:04:10.045>risk <00:04:10.185>here, <00:04:10.325>for <00:04:10.465>instance, <00:04:10.605>or,

83
00:04:12.245 --> 00:04:16.485
<00:04:12.245>or <00:04:12.400>regular <00:04:12.556>marketing <00:04:12.711>even, <00:04:12.867>or <00:04:13.022>credit <00:04:13.178>decisions <00:04:13.333>or, <00:04:13.489>or, <00:04:13.645>uh,

84
00:04:16.625 --> 00:04:17.685
<00:04:16.625>or, <00:04:16.863>or <00:04:17.101>things <00:04:17.340>like <00:04:17.579>that.

85
00:04:17.905 --> 00:04:19.525
<00:04:17.904>So <00:04:18.138>that, <00:04:18.371>that <00:04:18.604>would <00:04:18.838>be <00:04:19.071>one <00:04:19.304>thing.

86
00:04:19.525 --> 00:04:20.845
<00:04:19.524>Key <00:04:19.822>first <00:04:20.119>extraction, <00:04:20.416>for <00:04:20.713>instance.

87
00:04:20.995 --> 00:04:24.685
<00:04:20.995>Then <00:04:21.111>another <00:04:21.228>one, <00:04:21.345>and <00:04:21.461>one <00:04:21.578>we <00:04:21.695>we'll <00:04:21.811>talk <00:04:21.928>about <00:04:22.045>today, <00:04:22.161>a <00:04:22.278>in <00:04:22.395>a,

88
00:04:24.685 --> 00:04:26.165
<00:04:24.685>in <00:04:24.907>a, <00:04:25.129>in <00:04:25.351>a <00:04:25.573>bit <00:04:25.795>more <00:04:26.017>detail

89
00:04:26.295 --> 00:04:27.565
<00:04:26.295>would <00:04:26.580>be <00:04:26.866>called <00:04:27.152>sentiment <00:04:27.438>analysis.

90
00:04:27.595 --> 00:04:30.365
<00:04:27.595>It's <00:04:27.770>a <00:04:27.945>very, <00:04:28.120>again, <00:04:28.295>very, <00:04:28.470>a <00:04:28.645>fairly <00:04:28.820>straightforward <00:04:28.995>approach

91
00:04:30.425 --> 00:04:34.245
<00:04:30.425>and <00:04:30.600>like <00:04:30.775>a <00:04:30.950>fairly <00:04:31.125>straightforward, <00:04:31.300>um, <00:04:31.475>uh, <00:04:31.650>use <00:04:31.825>case,

92
00:04:34.545 --> 00:04:38.285
<00:04:34.545>but <00:04:34.685>still <00:04:34.825>a <00:04:34.965>very <00:04:35.105>powerful <00:04:35.245>one <00:04:35.385>in <00:04:35.525>which <00:04:35.665>we <00:04:35.805>allow <00:04:35.945>you

93
00:04:38.305 --> 00:04:40.405
<00:04:38.305>to <00:04:38.445>take <00:04:38.585>a <00:04:38.725>look <00:04:38.865>at <00:04:39.005>the <00:04:39.145>questions <00:04:39.285>you <00:04:39.425>got <00:04:39.565>at <00:04:39.705>your,

94
00:04:40.425 --> 00:04:43.485
<00:04:40.425>at <00:04:40.600>your <00:04:40.775>event, <00:04:40.950>especially <00:04:41.125>po <00:04:41.300>after <00:04:41.475>the <00:04:41.650>event <00:04:41.825>finishes,

95
00:04:43.865 --> 00:04:47.525
<00:04:43.865>and <00:04:44.020>see, <00:04:44.176>uh, <00:04:44.331>what <00:04:44.487>sort <00:04:44.642>of <00:04:44.798>sentiment <00:04:44.953>might <00:04:45.109>they <00:04:45.265>kind

96
00:04:47.525 --> 00:04:48.805
<00:04:47.525>of <00:04:48.101>entice, <00:04:48.677>right?

97
00:04:48.805 --> 00:04:51.845
<00:04:48.805>So <00:04:48.945>like <00:04:49.085>you <00:04:49.225>can, <00:04:49.365>you <00:04:49.505>can <00:04:49.645>probably, <00:04:49.785>um, <00:04:49.925>get <00:04:50.065>a <00:04:50.205>bit

98
00:04:51.845 --> 00:04:53.805
<00:04:51.845>of <00:04:52.020>a <00:04:52.195>picture <00:04:52.370>of <00:04:52.545>what <00:04:52.720>was <00:04:52.895>the <00:04:53.070>meeting <00:04:53.245>about,

99
00:04:54.075 --> 00:04:56.725
<00:04:54.075>just <00:04:54.230>from <00:04:54.386>looking <00:04:54.541>at <00:04:54.697>how <00:04:54.852>many <00:04:55.008>of <00:04:55.163>these <00:04:55.319>pictures, <00:04:55.474>uh,

100
00:04:56.725 --> 00:04:58.805
<00:04:56.725>how <00:04:56.925>many <00:04:57.125>of <00:04:57.325>the, <00:04:57.525>of <00:04:57.725>the <00:04:57.925>questions <00:04:58.125>were

101
00:04:59.085 --> 00:05:00.245
<00:04:59.085>positive, <00:04:59.607>negative, <00:05:00.129>neutral.

102
00:05:00.265 --> 00:05:03.165
<00:05:00.265>And <00:05:00.440>we <00:05:00.615>obviously <00:05:00.789>allow <00:05:00.965>you <00:05:01.140>to <00:05:01.315>change <00:05:01.490>the, <00:05:01.664>um,

103
00:05:03.665 --> 00:05:07.525
<00:05:03.665>change <00:05:03.792>the <00:05:03.919>sentiment <00:05:04.046>if <00:05:04.174>we <00:05:04.301>mess <00:05:04.428>up, <00:05:04.555>which <00:05:04.683>we, <00:05:04.810>which <00:05:04.937>we, <00:05:05.065>uh,

104
00:05:07.635 --> 00:05:12.005
<00:05:07.635>well, <00:05:07.835>our <00:05:08.034>models <00:05:08.235>sometimes, <00:05:08.435>sometimes <00:05:08.635>obviously <00:05:08.835>do <00:05:09.034>further.

105
00:05:12.385 --> 00:05:14.845
<00:05:12.385>We <00:05:12.540>have <00:05:12.696>a, <00:05:12.851>uh, <00:05:13.007>we <00:05:13.162>have <00:05:13.318>a <00:05:13.473>thing <00:05:13.629>called, <00:05:13.784>uh,

106
00:05:14.845 --> 00:05:16.085
<00:05:14.845>similar <00:05:15.403>question <00:05:15.961>detection.

107
00:05:16.425 --> 00:05:17.645
<00:05:16.425>And <00:05:16.699>the <00:05:16.974>principle <00:05:17.248>there <00:05:17.522>is

108
00:05:17.645 --> 00:05:20.925
<00:05:17.645>that <00:05:17.800>if <00:05:17.956>you <00:05:18.111>have <00:05:18.267>a <00:05:18.422>fairly <00:05:18.578>large <00:05:18.733>conference <00:05:18.889>thing, <00:05:19.044>hundreds

109
00:05:20.925 --> 00:05:24.685
<00:05:20.925>of <00:05:21.100>hundreds <00:05:21.275>of <00:05:21.450>people, <00:05:21.625>um, <00:05:21.800>sending <00:05:21.975>tens <00:05:22.150>of <00:05:22.325>questions

110
00:05:24.715 --> 00:05:27.325
<00:05:24.715>that <00:05:24.948>basically <00:05:25.181>amounts <00:05:25.414>to <00:05:25.648>thousands <00:05:25.881>of <00:05:26.114>questions,

111
00:05:27.465 --> 00:05:28.485
<00:05:27.465>how <00:05:27.648>do <00:05:27.832>you <00:05:28.015>make <00:05:28.199>it <00:05:28.383>so

112
00:05:28.485 --> 00:05:31.605
<00:05:28.485>that <00:05:28.660>your <00:05:28.835>question <00:05:29.010>actually <00:05:29.185>makes <00:05:29.360>sense <00:05:29.535>in <00:05:29.710>a <00:05:29.885>sense?

113
00:05:31.665 --> 00:05:35.725
<00:05:31.665>How <00:05:31.781>do <00:05:31.898>you <00:05:32.015>make <00:05:32.131>it <00:05:32.248>so <00:05:32.365>that <00:05:32.481>what <00:05:32.598>you <00:05:32.715>want <00:05:32.831>to <00:05:32.948>ask, <00:05:33.065>essentially

114
00:05:35.795 --> 00:05:38.525
<00:05:35.795>what <00:05:35.935>you, <00:05:36.075>what <00:05:36.215>you <00:05:36.355>want <00:05:36.495>to <00:05:36.635>learn <00:05:36.775>from <00:05:36.915>the <00:05:37.055>speaker <00:05:37.195>there,

115
00:05:38.705 --> 00:05:40.685
<00:05:38.705>how <00:05:38.860>do <00:05:39.016>you <00:05:39.171>make <00:05:39.327>it <00:05:39.482>so <00:05:39.638>that <00:05:39.793>this <00:05:39.949>actually <00:05:40.104>gets,

116
00:05:40.865 --> 00:05:41.885
<00:05:40.865>uh, <00:05:41.324>gets <00:05:41.783>answered?

117
00:05:41.885 --> 00:05:43.205
<00:05:41.885>Well, <00:05:42.054>if <00:05:42.224>you <00:05:42.394>have <00:05:42.563>a <00:05:42.733>ton <00:05:42.903>of <00:05:43.073>questions,

118
00:05:43.205 --> 00:05:45.565
<00:05:43.205>there's <00:05:43.360>pretty <00:05:43.516>much <00:05:43.671>no <00:05:43.827>way <00:05:43.982>you <00:05:44.138>can <00:05:44.293>fit <00:05:44.449>this <00:05:44.604>in,

119
00:05:45.565 --> 00:05:47.765
<00:05:45.565>in <00:05:45.740>like <00:05:45.915>15 <00:05:46.090>minutes <00:05:46.265>of <00:05:46.440>a <00:05:46.615>q <00:05:46.790>and <00:05:46.965>a

120
00:05:48.185 --> 00:05:49.525
<00:05:48.185>or, <00:05:48.426>uh, <00:05:48.667>or <00:05:48.908>something <00:05:49.149>like <00:05:49.390>that.

121
00:05:49.785 --> 00:05:52.885
<00:05:49.784>And <00:05:49.878>so <00:05:49.971>we <00:05:50.064>built <00:05:50.158>a <00:05:50.251>bit <00:05:50.344>of <00:05:50.438>a <00:05:50.531>model <00:05:50.624>on <00:05:50.718>like <00:05:50.811>in <00:05:50.905>a, <00:05:50.998>in <00:05:51.091>a <00:05:51.184>UI

122
00:05:52.885 --> 00:05:56.165
<00:05:52.885>around, <00:05:53.085>um, <00:05:53.284>uh, <00:05:53.485>through <00:05:53.685>which <00:05:53.885>you <00:05:54.085>can <00:05:54.284>find

123
00:05:56.195 --> 00:05:58.125
<00:05:56.195>that <00:05:56.428>there <00:05:56.661>are <00:05:56.895>similar <00:05:57.128>questions <00:05:57.361>to <00:05:57.594>that,

124
00:05:58.265 --> 00:06:02.045
<00:05:58.265>to <00:05:58.392>the <00:05:58.519>one <00:05:58.646>you <00:05:58.774>are <00:05:58.901>typing <00:05:59.028>even, <00:05:59.155>uh, <00:05:59.283>as <00:05:59.410>you <00:05:59.537>are <00:05:59.664>already,

125
00:06:02.145 --> 00:06:03.325
<00:06:02.145>as <00:06:02.410>you're <00:06:02.676>already <00:06:02.941>typing <00:06:03.207>it.

126
00:06:03.705 --> 00:06:06.725
<00:06:03.705>So <00:06:03.832>current, <00:06:03.959>what <00:06:04.086>we <00:06:04.214>are <00:06:04.341>looking <00:06:04.468>at <00:06:04.595>is <00:06:04.723>an <00:06:04.850>example <00:06:04.977>of <00:06:05.104>from,

127
00:06:06.745 --> 00:06:10.925
<00:06:06.745>uh, <00:06:06.900>from <00:06:07.056>a, <00:06:07.211>uh, <00:06:07.367>the <00:06:07.522>boring <00:06:07.678>companies <00:06:07.833>meeting <00:06:07.989>in <00:06:08.145>which,

128
00:06:12.205 --> 00:06:17.105
<00:06:12.205>in <00:06:12.321>which <00:06:12.438>there <00:06:12.555>was <00:06:12.671>a, <00:06:12.788>um, <00:06:12.905>uh, <00:06:13.021>uh, <00:06:13.138>the, <00:06:13.255>the <00:06:13.371>question <00:06:13.488>of <00:06:13.604>of,

129
00:06:17.165 --> 00:06:20.785
<00:06:17.165>uh, <00:06:17.365>tunnel <00:06:17.565>costs <00:06:17.765>was <00:06:17.965>basically <00:06:18.165>associated <00:06:18.365>with <00:06:18.565>bunch

130
00:06:20.805 --> 00:06:22.625
<00:06:20.805>of <00:06:21.271>other, <00:06:21.738>uh, <00:06:22.205>bunch

131
00:06:22.625 --> 00:06:24.585
<00:06:22.625>of <00:06:22.905>other <00:06:23.185>questions <00:06:23.465>about, <00:06:23.745>about <00:06:24.025>tunneling.

132
00:06:26.115 --> 00:06:30.335
<00:06:26.115>We <00:06:26.255>also <00:06:26.395>have <00:06:26.535>a, <00:06:26.675>a <00:06:26.815>kind <00:06:26.955>varied <00:06:27.095>approaches <00:06:27.235>of, <00:06:27.375>of, <00:06:27.515>uh,

133
00:06:30.335 --> 00:06:31.455
<00:06:30.335>visualizing <00:06:30.839>the <00:06:31.342>data

134
00:06:31.515 --> 00:06:36.175
<00:06:31.515>or <00:06:31.642>like <00:06:31.769>making, <00:06:31.896>making, <00:06:32.024>um, <00:06:32.151>more <00:06:32.278>sense <00:06:32.405>of <00:06:32.533>the, <00:06:32.660>of <00:06:32.787>the <00:06:32.914>data,

135
00:06:36.595 --> 00:06:39.535
<00:06:36.595>uh, <00:06:36.795>that, <00:06:36.995>uh, <00:06:37.195>that <00:06:37.395>goes <00:06:37.595>through <00:06:37.795>our <00:06:37.995>platform.

136
00:06:39.835 --> 00:06:43.575
<00:06:39.835>In <00:06:39.951>the <00:06:40.068>slide <00:06:40.185>of <00:06:40.301>recap, <00:06:40.418>we <00:06:40.534>are <00:06:40.651>trying <00:06:40.768>to <00:06:40.885>get <00:06:41.001>a, <00:06:41.118>a <00:06:41.234>kind

137
00:06:43.575 --> 00:06:45.775
<00:06:43.575>of <00:06:43.808>a <00:06:44.041>single, <00:06:44.275>uh, <00:06:44.508>single <00:06:44.741>way <00:06:44.974>of,

138
00:06:45.835 --> 00:06:48.815
<00:06:45.835>or <00:06:45.974>like <00:06:46.114>give, <00:06:46.255>give <00:06:46.395>our, <00:06:46.534>our <00:06:46.674>customers <00:06:46.815>a <00:06:46.955>single <00:06:47.094>way <00:06:47.234>of,

139
00:06:48.815 --> 00:06:52.135
<00:06:48.815>of <00:06:48.970>seeing <00:06:49.126>both <00:06:49.281>the <00:06:49.437>recording <00:06:49.592>of <00:06:49.748>a <00:06:49.903>meeting, <00:06:50.059>something <00:06:50.215>like,

140
00:06:52.515 --> 00:06:55.455
<00:06:52.515>uh, <00:06:52.670>something <00:06:52.826>like <00:06:52.981>the, <00:06:53.137>the <00:06:53.292>recording <00:06:53.448>that <00:06:53.603>will <00:06:53.759>come <00:06:53.914>from,

141
00:06:55.485 --> 00:06:57.775
<00:06:55.485>from <00:06:55.718>this <00:06:55.951>meeting <00:06:56.185>along <00:06:56.418>with <00:06:56.651>the <00:06:56.885>questions

142
00:06:57.775 --> 00:06:59.815
<00:06:57.775>that <00:06:57.974>have <00:06:58.174>been <00:06:58.375>asked <00:06:58.575>in <00:06:58.775>this <00:06:58.974>particular <00:06:59.174>meeting.

143
00:07:00.115 --> 00:07:03.455
<00:07:00.115>And <00:07:00.231>so <00:07:00.348>what <00:07:00.465>we <00:07:00.581>are <00:07:00.698>allowing <00:07:00.815>them <00:07:00.931>in <00:07:01.048>here <00:07:01.165>is <00:07:01.281>to <00:07:01.398>directly <00:07:01.515>jump

144
00:07:03.515 --> 00:07:05.095
<00:07:03.515>to <00:07:03.715>the, <00:07:03.914>to <00:07:04.115>the <00:07:04.315>part <00:07:04.515>of <00:07:04.715>the <00:07:04.914>video

145
00:07:05.305 --> 00:07:07.335
<00:07:05.305>where <00:07:05.585>these <00:07:05.865>questions <00:07:06.145>were <00:07:06.425>actually <00:07:06.705>asked.

146
00:07:07.755 --> 00:07:11.495
<00:07:07.755>And <00:07:07.871>the <00:07:07.988>big, <00:07:08.105>the <00:07:08.221>big <00:07:08.338>thing <00:07:08.455>in <00:07:08.571>there <00:07:08.688>is <00:07:08.805>that <00:07:08.921>this <00:07:09.038>allows <00:07:09.155>you

147
00:07:11.615 --> 00:07:13.775
<00:07:11.615>to <00:07:11.770>basically <00:07:11.926>only <00:07:12.081>go <00:07:12.237>to <00:07:12.392>that <00:07:12.548>part <00:07:12.703>of <00:07:12.859>the <00:07:13.015>video

148
00:07:13.845 --> 00:07:15.695
<00:07:13.845>that <00:07:14.195>actually <00:07:14.545>makes <00:07:14.895>sense, <00:07:15.245>uh,

149
00:07:15.715 --> 00:07:18.295
<00:07:15.715>or <00:07:15.914>like <00:07:16.114>that <00:07:16.315>you <00:07:16.515>are <00:07:16.715>actually <00:07:16.914>interested <00:07:17.114>in.

150
00:07:18.715 --> 00:07:21.215
<00:07:18.715>Not <00:07:18.870>that <00:07:19.026>the <00:07:19.181>whole <00:07:19.337>content <00:07:19.492>part <00:07:19.648>of <00:07:19.803>would, <00:07:19.959>wouldn't <00:07:20.114>be

151
00:07:21.215 --> 00:07:23.775
<00:07:21.215>that <00:07:21.390>interesting, <00:07:21.565>but <00:07:21.739>what <00:07:21.914>we <00:07:22.090>found <00:07:22.265>is <00:07:22.440>that, <00:07:22.614>uh,

152
00:07:23.775 --> 00:07:26.135
<00:07:23.775>people <00:07:24.054>generally <00:07:24.335>go <00:07:24.614>after <00:07:24.895>the <00:07:25.174>questions

153
00:07:26.135 --> 00:07:28.175
<00:07:26.135>because <00:07:26.335>that's <00:07:26.534>what, <00:07:26.735>that's <00:07:26.935>what <00:07:27.135>they <00:07:27.335>are, <00:07:27.534>uh,

154
00:07:28.175 --> 00:07:30.215
<00:07:28.175>mostly <00:07:28.525>interested <00:07:28.875>in <00:07:29.225>the <00:07:29.575>presentation.

155
00:07:30.295 --> 00:07:33.175
<00:07:30.295>They <00:07:30.450>can <00:07:30.606>probably, <00:07:30.761>uh, <00:07:30.917>drive <00:07:31.072>through <00:07:31.228>on <00:07:31.383>their, <00:07:31.539>on <00:07:31.695>their,

156
00:07:33.315 --> 00:07:37.015
<00:07:33.315>on <00:07:33.455>their <00:07:33.594>own, <00:07:33.735>um, <00:07:33.875>with, <00:07:34.015>with <00:07:34.155>the <00:07:34.295>slides <00:07:34.435>and, <00:07:34.575>and <00:07:34.715>whatnot.

157
00:07:37.525 --> 00:07:40.575
<00:07:37.525>Okay. <00:07:37.680>And <00:07:37.836>then <00:07:37.991>the <00:07:38.147>one <00:07:38.302>last <00:07:38.458>thing, <00:07:38.613>one <00:07:38.769>last <00:07:38.924>bit

158
00:07:40.575 --> 00:07:44.295
<00:07:40.575>of <00:07:40.750>a <00:07:40.925>crazy <00:07:41.099>example, <00:07:41.275>uh, <00:07:41.450>something <00:07:41.625>we've <00:07:41.800>released, <00:07:41.974>uh,

159
00:07:44.525 --> 00:07:47.775
<00:07:44.525>very <00:07:44.680>fittingly <00:07:44.836>on <00:07:44.991>the <00:07:45.147>1st <00:07:45.302>of <00:07:45.458>April <00:07:45.613>is <00:07:45.769>the <00:07:45.924>following.

160
00:07:47.915 --> 00:07:50.215
<00:07:47.915>Um, <00:07:48.115>when <00:07:48.315>you, <00:07:48.515>when <00:07:48.715>you <00:07:48.915>ask <00:07:49.115>a <00:07:49.315>question,

161
00:07:50.245 --> 00:07:52.855
<00:07:50.245>when <00:07:50.385>you <00:07:50.525>create <00:07:50.665>a <00:07:50.805>quiz, <00:07:50.945>uh, <00:07:51.085>in, <00:07:51.225>in <00:07:51.365>a <00:07:51.505>s <00:07:51.645>slide,

162
00:07:53.315 --> 00:07:55.095
<00:07:53.315>and <00:07:53.594>suppose <00:07:53.875>the <00:07:54.155>question <00:07:54.435>is <00:07:54.715>who,

163
00:07:55.155 --> 00:07:56.775
<00:07:55.155>who <00:07:55.434>was <00:07:55.715>the <00:07:55.994>original <00:07:56.275>creator <00:07:56.554>of,

164
00:07:56.775 --> 00:07:59.095
<00:07:56.775>of <00:07:56.974>mini <00:07:57.174>You <00:07:57.375>probably <00:07:57.575>know <00:07:57.775>the <00:07:57.974>answer, <00:07:58.174>right?

165
00:07:59.095 --> 00:08:01.655
<00:07:59.095>Like <00:07:59.235>that, <00:07:59.375>that's <00:07:59.515>why <00:07:59.655>you <00:07:59.795>are <00:07:59.935>creating <00:08:00.075>that, <00:08:00.215>that, <00:08:00.355>that, <00:08:00.495>uh,

166
00:08:01.925 --> 00:08:03.455
<00:08:01.925>that, <00:08:02.269>that, <00:08:02.613>uh, <00:08:02.957>quiz <00:08:03.301>question.

167
00:08:03.515 --> 00:08:06.095
<00:08:03.515>But <00:08:03.715>do <00:08:03.914>you <00:08:04.115>know <00:08:04.315>the <00:08:04.515>wrong <00:08:04.715>answers, <00:08:04.914>right?

168
00:08:06.155 --> 00:08:09.255
<00:08:06.155>And <00:08:06.294>like <00:08:06.434>in <00:08:06.575>in, <00:08:06.715>in <00:08:06.854>that <00:08:06.994>sense, <00:08:07.135>uh, <00:08:07.275>the, <00:08:07.414>this, <00:08:07.554>uh,

169
00:08:09.255 --> 00:08:13.135
<00:08:09.255>little <00:08:09.371>magic <00:08:09.488>one <00:08:09.605>on <00:08:09.721>the <00:08:09.838>right <00:08:09.955>is <00:08:10.071>trying <00:08:10.188>to <00:08:10.305>help <00:08:10.421>you <00:08:10.538>come <00:08:10.655>up

170
00:08:13.205 --> 00:08:17.055
<00:08:13.205>with <00:08:13.484>basically <00:08:13.765>wrong <00:08:14.044>answers, <00:08:14.325>random <00:08:14.604>answers

171
00:08:17.245 --> 00:08:20.695
<00:08:17.245>that <00:08:17.372>might <00:08:17.499>not <00:08:17.626>be <00:08:17.754>correct, <00:08:17.881>but <00:08:18.008>might <00:08:18.135>help <00:08:18.263>you <00:08:18.390>or <00:08:18.517>fill <00:08:18.645>in

172
00:08:20.695 --> 00:08:24.055
<00:08:20.695>or <00:08:20.811>like <00:08:20.928>create <00:08:21.045>a, <00:08:21.161>a <00:08:21.278>bit <00:08:21.395>of <00:08:21.511>a <00:08:21.628>quiz <00:08:21.745>much <00:08:21.861>faster <00:08:21.978>than, <00:08:22.094>as,

173
00:08:24.285 --> 00:08:28.015
<00:08:24.285>than <00:08:24.412>you <00:08:24.539>would <00:08:24.666>have <00:08:24.794>if <00:08:24.921>you <00:08:25.048>had <00:08:25.175>to <00:08:25.303>say, <00:08:25.430>look <00:08:25.557>up <00:08:25.685>a,

174
00:08:28.165 --> 00:08:30.895
<00:08:28.165>some <00:08:28.398>inappropriate <00:08:28.631>answers <00:08:28.865>or <00:08:29.098>something <00:08:29.331>like <00:08:29.565>that.

175
00:08:31.275 --> 00:08:32.455
<00:08:31.275>Uh, <00:08:31.540>was <00:08:31.806>nice <00:08:32.071>in <00:08:32.337>here.

176
00:08:32.765 --> 00:08:35.735
<00:08:32.765>Well, <00:08:32.892>or <00:08:33.019>like <00:08:33.146>in, <00:08:33.274>in <00:08:33.401>this <00:08:33.528>approach <00:08:33.655>is <00:08:33.783>that <00:08:33.910>you <00:08:34.037>don't <00:08:34.164>have

177
00:08:35.735 --> 00:08:37.935
<00:08:35.735>to, <00:08:35.909>uh, <00:08:36.085>our <00:08:36.260>model <00:08:36.435>doesn't <00:08:36.610>have <00:08:36.784>to <00:08:36.960>be <00:08:37.135>perfect.

178
00:08:38.435 --> 00:08:40.575
<00:08:38.434>In <00:08:38.668>fact, <00:08:38.901>when <00:08:39.135>it's <00:08:39.368>not <00:08:39.601>not <00:08:39.834>correct,

179
00:08:41.085 --> 00:08:43.055
<00:08:41.085>it's <00:08:41.365>probably, <00:08:41.645>probably <00:08:41.925>for <00:08:42.205>the <00:08:42.485>best.

180
00:08:43.695 --> 00:08:47.295
<00:08:43.695>Although <00:08:43.870>answering <00:08:44.045>Vienna <00:08:44.220>to <00:08:44.395>who <00:08:44.570>was <00:08:44.745>the <00:08:44.920>original <00:08:45.095>creator

181
00:08:47.315 --> 00:08:50.095
<00:08:47.315>of <00:08:47.470>Mini <00:08:47.626>probably <00:08:47.781>wouldn't <00:08:47.937>be, <00:08:48.092>wouldn't <00:08:48.248>be <00:08:48.403>all <00:08:48.559>that <00:08:48.715>good.

182
00:08:50.525 --> 00:08:53.655
<00:08:50.525>Okay. <00:08:50.665>So <00:08:50.805>there <00:08:50.944>are, <00:08:51.084>were, <00:08:51.225>there <00:08:51.365>are <00:08:51.505>quite <00:08:51.645>a <00:08:51.785>few <00:08:51.925>places

183
00:08:53.785 --> 00:08:56.085
<00:08:53.785>where <00:08:53.985>we <00:08:54.185>can <00:08:54.385>see <00:08:54.584>machine <00:08:54.785>learning <00:08:54.985>being <00:08:55.185>useful

184
00:08:56.185 --> 00:08:57.565
<00:08:56.185>in, <00:08:56.598>in, <00:08:57.013>in <00:08:57.427>Slido.

185
00:08:57.945 --> 00:09:01.165
<00:08:57.945>And <00:08:58.072>if <00:08:58.199>you <00:08:58.326>go, <00:08:58.454>if <00:08:58.581>we <00:08:58.708>go <00:08:58.835>through <00:08:58.963>the, <00:08:59.090>through <00:08:59.217>the <00:08:59.345>kind

186
00:09:01.165 --> 00:09:04.205
<00:09:01.165>of <00:09:01.444>summary <00:09:01.724>slide <00:09:02.005>again, <00:09:02.285>um, <00:09:02.564>doing

187
00:09:04.205 --> 00:09:07.525
<00:09:04.205>that <00:09:04.438>machine <00:09:04.671>learning <00:09:04.905>essentially <00:09:05.138>implies <00:09:05.371>at <00:09:05.605>least,

188
00:09:07.625 --> 00:09:10.165
<00:09:07.625>at <00:09:07.780>least <00:09:07.936>today <00:09:08.091>and <00:09:08.247>at <00:09:08.402>least <00:09:08.558>in <00:09:08.713>this <00:09:08.869>current <00:09:09.025>day,

189
00:09:10.165 --> 00:09:13.805
<00:09:10.165>and <00:09:10.365>h <00:09:10.564>uh, <00:09:10.765>basically <00:09:10.964>implies <00:09:11.165>having <00:09:11.365>Python <00:09:11.564>stack.

190
00:09:14.425 --> 00:09:18.405
<00:09:14.425>By <00:09:14.564>that <00:09:14.704>we <00:09:14.844>mean, <00:09:14.984>um, <00:09:15.125>these <00:09:15.265>models <00:09:15.405>are <00:09:15.545>generally <00:09:15.685>trained, <00:09:15.824>um,

191
00:09:18.785 --> 00:09:22.765
<00:09:18.785>and <00:09:18.940>evaluated <00:09:19.096>and <00:09:19.251>then <00:09:19.407>deployed, <00:09:19.562>um, <00:09:19.718>in <00:09:19.873>something <00:09:20.029>that <00:09:20.185>can,

192
00:09:22.765 --> 00:09:23.765
<00:09:22.765>that <00:09:23.064>can <00:09:23.365>run <00:09:23.665>Python.

193
00:09:24.395 --> 00:09:28.685
<00:09:24.395>Well, <00:09:24.569>that <00:09:24.745>sadly <00:09:24.920>wasn't <00:09:25.095>the <00:09:25.270>case <00:09:25.444>with <00:09:25.620>Slido <00:09:25.795>infrastructure

194
00:09:29.225 --> 00:09:31.685
<00:09:29.225>for, <00:09:29.400>for <00:09:29.575>quite <00:09:29.750>some <00:09:29.925>time <00:09:30.100>and <00:09:30.275>still, <00:09:30.450>still <00:09:30.625>not,

195
00:09:31.685 --> 00:09:34.805
<00:09:31.685>because <00:09:31.885>Slido <00:09:32.084>is <00:09:32.285>based <00:09:32.484>on, <00:09:32.685>on, <00:09:32.885>on <00:09:33.084>types,

196
00:09:35.225 --> 00:09:36.325
<00:09:35.225>uh, <00:09:35.720>TypeScript <00:09:36.215>stack.

197
00:09:36.785 --> 00:09:40.165
<00:09:36.785>And <00:09:36.925>so <00:09:37.064>the <00:09:37.204>question <00:09:37.344>is, <00:09:37.485>does <00:09:37.625>this <00:09:37.765>basically <00:09:37.905>mean <00:09:38.045>that, <00:09:38.185>uh,

198
00:09:40.475 --> 00:09:43.965
<00:09:40.475>machine <00:09:40.650>learning <00:09:40.825>or <00:09:41.000>like <00:09:41.175>these <00:09:41.350>models <00:09:41.525>is, <00:09:41.700>are <00:09:41.875>something

199
00:09:43.965 --> 00:09:45.685
<00:09:43.965>that <00:09:44.315>we <00:09:44.665>cannot <00:09:45.015>actually <00:09:45.365>deploy?

200
00:09:46.155 --> 00:09:49.885
<00:09:46.155>Well, <00:09:46.295>it <00:09:46.435>did <00:09:46.574>look <00:09:46.714>like <00:09:46.855>that <00:09:46.995>at <00:09:47.135>first, <00:09:47.275>that's <00:09:47.415>for <00:09:47.555>sure.

201
00:09:50.385 --> 00:09:52.965
<00:09:50.385>But <00:09:50.560>then <00:09:50.735>we, <00:09:50.910>we <00:09:51.085>thought <00:09:51.260>a <00:09:51.435>little <00:09:51.610>about <00:09:51.785>it

202
00:09:53.105 --> 00:09:55.445
<00:09:53.105>and <00:09:53.338>came <00:09:53.571>to <00:09:53.805>the <00:09:54.038>conclusion <00:09:54.271>that, <00:09:54.505>well,

203
00:09:55.445 --> 00:09:58.725
<00:09:55.445>there <00:09:55.645>is <00:09:55.845>this <00:09:56.045>thing <00:09:56.245>called, <00:09:56.445>called <00:09:56.645>serverless, <00:09:56.845>right?

204
00:09:58.725 --> 00:10:02.005
<00:09:58.725>That <00:09:58.852>that, <00:09:58.979>that <00:09:59.106>there <00:09:59.234>is <00:09:59.361>this <00:09:59.488>thing <00:09:59.615>that <00:09:59.743>allows <00:09:59.870>us <00:09:59.997>to, <00:10:00.125>to,

205
00:10:02.065 --> 00:10:05.925
<00:10:02.065>um, <00:10:02.240>run <00:10:02.415>basically <00:10:02.590>anything <00:10:02.765>in <00:10:02.940>any <00:10:03.115>language <00:10:03.290>without <00:10:03.465>having

206
00:10:05.985 --> 00:10:09.685
<00:10:05.985>to <00:10:06.185>deal <00:10:06.385>with, <00:10:06.585>with <00:10:06.785>that, <00:10:06.985>um, <00:10:07.185>maintenance <00:10:07.385>overhead.

207
00:10:09.945 --> 00:10:13.045
<00:10:09.945>And <00:10:10.120>so, <00:10:10.295>uh, <00:10:10.470>that <00:10:10.645>is <00:10:10.820>also <00:10:10.995>the <00:10:11.170>answer, <00:10:11.345>like,

208
00:10:13.045 --> 00:10:15.845
<00:10:13.045>why <00:10:13.200>did <00:10:13.356>we <00:10:13.511>even <00:10:13.667>consider <00:10:13.822>something <00:10:13.978>like <00:10:14.133>something <00:10:14.289>like <00:10:14.444>the

209
00:10:15.845 --> 00:10:18.325
<00:10:15.845>serverless, <00:10:16.195>um, <00:10:16.545>serverless <00:10:16.895>approach <00:10:17.245>or,

210
00:10:18.325 --> 00:10:19.805
<00:10:18.325>or <00:10:18.658>the <00:10:18.991>serverless <00:10:19.324>en <00:10:19.656>environment?

211
00:10:19.805 --> 00:10:21.085
<00:10:19.805>And <00:10:19.997>if <00:10:20.189>we <00:10:20.381>had <00:10:20.573>to <00:10:20.765>like <00:10:20.957>go

212
00:10:21.085 --> 00:10:23.805
<00:10:21.085>through <00:10:21.240>some <00:10:21.396>real <00:10:21.551>answers, <00:10:21.707>it <00:10:21.862>would <00:10:22.018>be <00:10:22.173>something <00:10:22.329>like <00:10:22.485>this.

213
00:10:23.805 --> 00:10:25.165
<00:10:23.805>First <00:10:24.049>of <00:10:24.294>all, <00:10:24.539>ease <00:10:24.784>of <00:10:25.029>deployment.

214
00:10:25.585 --> 00:10:29.845
<00:10:25.585>Um, <00:10:25.785>although <00:10:25.985>it's <00:10:26.185>not <00:10:26.385>that <00:10:26.585>straightforward, <00:10:26.785>um, <00:10:26.985>deploying

215
00:10:29.865 --> 00:10:32.325
<00:10:29.865>or <00:10:30.215>basically <00:10:30.565>maintaining <00:10:30.915>serverless, <00:10:31.265>um,

216
00:10:32.855 --> 00:10:36.885
<00:10:32.855>serverless <00:10:33.055>deployments <00:10:33.255>is <00:10:33.455>way, <00:10:33.655>way <00:10:33.855>cheaper <00:10:34.055>than, <00:10:34.255>uh,

217
00:10:36.885 --> 00:10:40.845
<00:10:36.885>having <00:10:37.060>good, <00:10:37.235>having <00:10:37.410>our <00:10:37.585>good <00:10:37.760>DevOps <00:10:37.935>friends, <00:10:38.110>uh, <00:10:38.285>deploy

218
00:10:40.865 --> 00:10:44.245
<00:10:40.865>as <00:10:41.005>a <00:10:41.145>server <00:10:41.285>somewhere <00:10:41.425>than <00:10:41.565>hard <00:10:41.705>on <00:10:41.845>it <00:10:41.985>than <00:10:42.125>maintain <00:10:42.265>it.

219
00:10:44.715 --> 00:10:48.045
<00:10:44.715>Then <00:10:44.855>make <00:10:44.995>sure <00:10:45.135>that <00:10:45.275>it, <00:10:45.415>it <00:10:45.555>is <00:10:45.695>corrected <00:10:45.835>to <00:10:45.975>the <00:10:46.115>connected

220
00:10:48.045 --> 00:10:51.125
<00:10:48.045>to <00:10:48.172>the <00:10:48.299>right <00:10:48.426>stuff, <00:10:48.554>then <00:10:48.681>make <00:10:48.808>sure <00:10:48.935>that <00:10:49.063>it's <00:10:49.190>up <00:10:49.317>updated <00:10:49.444>and,

221
00:10:51.185 --> 00:10:52.325
<00:10:51.185>and <00:10:51.390>so <00:10:51.595>on <00:10:51.800>and <00:10:52.005>so <00:10:52.211>forth.

222
00:10:52.465 --> 00:10:53.485
<00:10:52.465>So <00:10:52.648>that, <00:10:52.832>that's <00:10:53.015>the <00:10:53.199>first <00:10:53.383>thing.

223
00:10:53.485 --> 00:10:56.925
<00:10:53.485>It's <00:10:53.625>very, <00:10:53.765>it's, <00:10:53.905>it's, <00:10:54.045>it's <00:10:54.185>much <00:10:54.325>simpler <00:10:54.465>for <00:10:54.605>us <00:10:54.745>to, <00:10:54.885>to,

224
00:10:56.985 --> 00:11:00.845
<00:10:56.985>to <00:10:57.125>deploy, <00:10:57.265>um, <00:10:57.405>in, <00:10:57.545>in <00:10:57.685>this <00:10:57.825>particular, <00:10:57.965>uh, <00:10:58.105>kind <00:10:58.245>of <00:10:58.385>way.

225
00:11:01.075 --> 00:11:03.205
<00:11:01.075>There's <00:11:01.355>minimal <00:11:01.635>maintenance, <00:11:01.915>which <00:11:02.195>was <00:11:02.475>one

226
00:11:03.205 --> 00:11:06.125
<00:11:03.205>of <00:11:03.321>the <00:11:03.438>big <00:11:03.555>reasons <00:11:03.671>why <00:11:03.788>we, <00:11:03.905>why <00:11:04.021>we <00:11:04.138>actually, <00:11:04.255>uh, <00:11:04.371>went <00:11:04.488>for <00:11:04.605>it.

227
00:11:06.125 --> 00:11:07.885
<00:11:06.125>Minimal <00:11:06.325>maintenance, <00:11:06.525>not <00:11:06.725>in <00:11:06.925>the <00:11:07.125>case <00:11:07.325>that <00:11:07.525>you,

228
00:11:08.025 --> 00:11:09.925
<00:11:08.025>you <00:11:08.199>ha <00:11:08.375>don't <00:11:08.550>have <00:11:08.725>to <00:11:08.900>take <00:11:09.074>care <00:11:09.250>of <00:11:09.425>it.

229
00:11:10.235 --> 00:11:11.565
<00:11:10.235>More <00:11:10.474>of, <00:11:10.713>uh, <00:11:10.953>you <00:11:11.192>don't <00:11:11.432>have

230
00:11:11.565 --> 00:11:14.005
<00:11:11.565>to <00:11:11.845>do <00:11:12.125>the <00:11:12.405>standard <00:11:12.685>administration <00:11:12.965>tasks

231
00:11:14.095 --> 00:11:15.165
<00:11:14.095>associated <00:11:14.576>with <00:11:15.058>them.

232
00:11:15.165 --> 00:11:17.485
<00:11:15.165>There <00:11:15.339>are <00:11:15.515>some <00:11:15.689>others, <00:11:15.865>and <00:11:16.040>like <00:11:16.214>it <00:11:16.390>has, <00:11:16.564>its,

233
00:11:17.485 --> 00:11:18.485
<00:11:17.485>it <00:11:17.785>has <00:11:18.085>its <00:11:18.385>limitations,

234
00:11:18.485 --> 00:11:20.885
<00:11:18.485>but <00:11:18.685>the <00:11:18.885>standard <00:11:19.085>maintenance <00:11:19.285>is, <00:11:19.485>is, <00:11:19.685>is <00:11:19.885>minimal.

235
00:11:21.385 --> 00:11:24.125
<00:11:21.385>And, <00:11:21.665>uh, <00:11:21.944>that <00:11:22.225>basically <00:11:22.505>leads <00:11:22.785>us

236
00:11:24.125 --> 00:11:26.885
<00:11:24.125>to <00:11:24.405>smaller <00:11:24.685>operational <00:11:24.965>costs, <00:11:25.245>which <00:11:25.525>effectively,

237
00:11:26.955 --> 00:11:30.005
<00:11:26.955>effectively <00:11:27.155>means <00:11:27.355>that, <00:11:27.555>uh, <00:11:27.755>thankfully <00:11:27.955>we <00:11:28.155>don't <00:11:28.355>have

238
00:11:30.005 --> 00:11:33.485
<00:11:30.005>to <00:11:30.145>bother <00:11:30.285>our, <00:11:30.425>our <00:11:30.564>DevOps <00:11:30.705>friends <00:11:30.845>that <00:11:30.985>much <00:11:31.125>if <00:11:31.265>we <00:11:31.405>want

239
00:11:33.485 --> 00:11:35.725
<00:11:33.485>to <00:11:33.718>do <00:11:33.951>something <00:11:34.185>in <00:11:34.418>this <00:11:34.651>critical <00:11:34.885>environment.

240
00:11:36.635 --> 00:11:40.485
<00:11:36.635>Well, <00:11:36.775>that <00:11:36.915>said, <00:11:37.055>uh, <00:11:37.194>it's <00:11:37.335>not <00:11:37.475>all, <00:11:37.615>uh, <00:11:37.755>it's <00:11:37.895>all <00:11:38.035>not,

241
00:11:40.715 --> 00:11:43.165
<00:11:40.715>it's <00:11:40.915>not <00:11:41.115>all <00:11:41.315>rosy <00:11:41.515>there, <00:11:41.715>it <00:11:41.915>is <00:11:42.115>possible,

242
00:11:43.165 --> 00:11:45.245
<00:11:43.165>but <00:11:43.339>it <00:11:43.515>has <00:11:43.689>its <00:11:43.865>own <00:11:44.040>fair <00:11:44.214>share <00:11:44.390>of <00:11:44.564>trouble.

243
00:11:45.305 --> 00:11:48.165
<00:11:45.305>So <00:11:45.432>here's, <00:11:45.559>uh, <00:11:45.686>here's <00:11:45.814>Carl <00:11:45.941>j <00:11:46.068>just <00:11:46.195>just <00:11:46.323>a <00:11:46.450>couple <00:11:46.577>of <00:11:46.704>things

244
00:11:48.165 --> 00:11:49.925
<00:11:48.165>that, <00:11:48.515>that <00:11:48.865>we <00:11:49.214>ran <00:11:49.564>into

245
00:11:49.925 --> 00:11:52.245
<00:11:49.925>and <00:11:50.052>like <00:11:50.179>that, <00:11:50.306>that <00:11:50.434>that <00:11:50.561>kind <00:11:50.688>of <00:11:50.815>show <00:11:50.943>that <00:11:51.070>this <00:11:51.197>is <00:11:51.324>a,

246
00:11:52.715 --> 00:11:54.085
<00:11:52.715>that <00:11:53.023>there <00:11:53.331>is <00:11:53.639>a <00:11:53.948>limit

247
00:11:54.345 --> 00:11:56.405
<00:11:54.345>or <00:11:54.578>like <00:11:54.811>there <00:11:55.045>are <00:11:55.278>limitations <00:11:55.511>to, <00:11:55.745>to

248
00:11:56.405 --> 00:11:57.765
<00:11:56.405>what <00:11:56.649>the <00:11:56.894>serverless <00:11:57.139>environment <00:11:57.384>can <00:11:57.629>do.

249
00:11:57.945 --> 00:11:59.845
<00:11:57.945>The <00:11:58.178>first <00:11:58.411>limitation <00:11:58.645>is <00:11:58.878>something <00:11:59.111>you <00:11:59.345>will,

250
00:11:59.905 --> 00:12:02.045
<00:11:59.905>you <00:12:00.105>will <00:12:00.305>run <00:12:00.505>into <00:12:00.704>pretty <00:12:00.905>much <00:12:01.105>right <00:12:01.305>away,

251
00:12:02.135 --> 00:12:05.085
<00:12:02.135>which <00:12:02.290>you <00:12:02.446>said <00:12:02.601>there <00:12:02.757>are <00:12:02.912>these <00:12:03.068>things <00:12:03.223>called <00:12:03.379>cold <00:12:03.535>starts,

252
00:12:05.585 --> 00:12:07.685
<00:12:05.585>and, <00:12:05.725>but <00:12:05.865>what <00:12:06.005>we <00:12:06.145>mean <00:12:06.285>by <00:12:06.425>cold <00:12:06.565>start <00:12:06.705>is <00:12:06.845>that <00:12:06.985>no,

253
00:12:07.685 --> 00:12:11.325
<00:12:07.685>there <00:12:07.885>is <00:12:08.084>no <00:12:08.285>server <00:12:08.484>running <00:12:08.685>somewhere <00:12:08.885>24 <00:12:09.084>7.

254
00:12:12.305 --> 00:12:14.045
<00:12:12.305>That's <00:12:12.505>kind <00:12:12.704>of <00:12:12.905>what <00:12:13.104>the <00:12:13.305>name <00:12:13.505>implies, <00:12:13.704>right?

255
00:12:14.045 --> 00:12:17.125
<00:12:14.045>It's <00:12:14.200>serverless. <00:12:14.356>So <00:12:14.511>you <00:12:14.667>kind <00:12:14.822>of <00:12:14.978>pay <00:12:15.133>the <00:12:15.289>penalty <00:12:15.444>of,

256
00:12:17.185 --> 00:12:19.925
<00:12:17.185>of <00:12:17.324>cold <00:12:17.464>start, <00:12:17.604>of, <00:12:17.744>of <00:12:17.885>a <00:12:18.025>start <00:12:18.165>of <00:12:18.305>a <00:12:18.444>function <00:12:18.584>or,

257
00:12:19.945 --> 00:12:23.965
<00:12:19.945>or <00:12:20.072>a <00:12:20.199>piece <00:12:20.326>of <00:12:20.454>code <00:12:20.581>that <00:12:20.708>hasn't <00:12:20.835>been <00:12:20.963>kind <00:12:21.090>of <00:12:21.217>started <00:12:21.345>before.

258
00:12:24.425 --> 00:12:28.565
<00:12:24.425>And <00:12:24.564>that <00:12:24.704>can <00:12:24.844>take <00:12:24.984>seconds <00:12:25.125>even, <00:12:25.265>um, <00:12:25.405>in, <00:12:25.545>in <00:12:25.685>some <00:12:25.824>cases.

259
00:12:28.665 --> 00:12:31.565
<00:12:28.665>And <00:12:28.820>that, <00:12:28.976>that, <00:12:29.131>that <00:12:29.287>really <00:12:29.442>is, <00:12:29.598>that <00:12:29.753>really <00:12:29.909>is <00:12:30.064>problematic

260
00:12:31.585 --> 00:12:34.205
<00:12:31.585>and <00:12:31.712>you <00:12:31.839>have <00:12:31.966>to <00:12:32.094>find <00:12:32.221>clever <00:12:32.348>ways <00:12:32.475>of, <00:12:32.603>of <00:12:32.730>working <00:12:32.857>around <00:12:32.985>that.

261
00:12:34.545 --> 00:12:38.085
<00:12:34.545>Not <00:12:34.672>to <00:12:34.799>mention <00:12:34.926>that, <00:12:35.054>uh, <00:12:35.181>the, <00:12:35.308>the <00:12:35.435>pricing <00:12:35.563>is <00:12:35.690>not <00:12:35.817>that, <00:12:35.944>uh,

262
00:12:38.585 --> 00:12:42.245
<00:12:38.585>um, <00:12:38.725>not <00:12:38.865>that <00:12:39.005>obvious <00:12:39.145>or <00:12:39.285>might <00:12:39.425>not <00:12:39.565>be, <00:12:39.705>uh, <00:12:39.845>the <00:12:39.985>obvious.

263
00:12:42.245 --> 00:12:44.885
<00:12:42.245>What <00:12:42.420>you're <00:12:42.595>paying <00:12:42.770>for <00:12:42.945>is <00:12:43.120>actually <00:12:43.295>a <00:12:43.470>millisecond, <00:12:43.645>kind

264
00:12:44.885 --> 00:12:46.245
<00:12:44.885>of <00:12:45.191>the <00:12:45.497>millisecond <00:12:45.803>of <00:12:46.109>execution,

265
00:12:46.535 --> 00:12:50.525
<00:12:46.535>which <00:12:46.690>is <00:12:46.846>a <00:12:47.001>different <00:12:47.157>thing <00:12:47.312>from <00:12:47.468>whole <00:12:47.623>renting <00:12:47.779>a <00:12:47.935>server

266
00:12:50.665 --> 00:12:53.725
<00:12:50.665>for <00:12:50.781>a <00:12:50.898>month, <00:12:51.015>which <00:12:51.131>is <00:12:51.248>like, <00:12:51.365>gives <00:12:51.481>you <00:12:51.598>a <00:12:51.714>bit <00:12:51.831>of <00:12:51.948>a <00:12:52.064>more

267
00:12:53.725 --> 00:12:56.885
<00:12:53.725>of <00:12:53.841>a <00:12:53.958>like, <00:12:54.075>well, <00:12:54.191>well, <00:12:54.308>you <00:12:54.425>know, <00:12:54.541>what, <00:12:54.658>you <00:12:54.775>know <00:12:54.891>a <00:12:55.008>bit <00:12:55.125>better

268
00:12:56.885 --> 00:12:58.205
<00:12:56.885>what <00:12:57.182>the <00:12:57.479>expected <00:12:57.776>costs <00:12:58.073>are.

269
00:12:58.665 --> 00:13:00.125
<00:12:58.665>What's <00:12:59.322>particularly <00:12:59.979>relevant

270
00:13:00.185 --> 00:13:02.485
<00:13:00.185>for <00:13:00.418>machine <00:13:00.651>learning <00:13:00.885>deployments <00:13:01.118>is <00:13:01.351>the <00:13:01.584>fact

271
00:13:02.485 --> 00:13:05.565
<00:13:02.485>that <00:13:02.625>there <00:13:02.765>are <00:13:02.905>no, <00:13:03.045>or <00:13:03.185>the <00:13:03.325>very, <00:13:03.465>uh, <00:13:03.605>that, <00:13:03.745>that <00:13:03.885>there,

272
00:13:05.565 --> 00:13:08.885
<00:13:05.565>there <00:13:05.740>is <00:13:05.915>no, <00:13:06.090>uh, <00:13:06.265>acceleration <00:13:06.440>in <00:13:06.615>terms <00:13:06.790>of, <00:13:06.965>uh,

273
00:13:08.885 --> 00:13:10.885
<00:13:08.885>having <00:13:09.165>some <00:13:09.444>GPU <00:13:09.725>or, <00:13:10.005>or <00:13:10.285>tpu.

274
00:13:11.625 --> 00:13:14.885
<00:13:11.625>And <00:13:11.800>that, <00:13:11.975>that <00:13:12.150>that's <00:13:12.325>a <00:13:12.500>pretty, <00:13:12.675>pretty <00:13:12.850>significant <00:13:13.025>impact

275
00:13:14.995 --> 00:13:16.725
<00:13:14.995>that <00:13:15.228>has <00:13:15.461>a <00:13:15.695>pretty <00:13:15.928>significant <00:13:16.161>impact <00:13:16.395>on,

276
00:13:16.785 --> 00:13:18.485
<00:13:16.785>on <00:13:17.135>especially <00:13:17.485>machine <00:13:17.834>learning <00:13:18.185>models.

277
00:13:18.545 --> 00:13:22.005
<00:13:18.545>And <00:13:18.672>there <00:13:18.799>are <00:13:18.926>other, <00:13:19.054>uh, <00:13:19.181>uh, <00:13:19.308>a <00:13:19.435>few, <00:13:19.563>a <00:13:19.690>few <00:13:19.817>more <00:13:19.944>limitations,

278
00:13:22.005 --> 00:13:24.885
<00:13:22.005>which <00:13:22.145>you <00:13:22.285>can <00:13:22.425>see <00:13:22.564>on <00:13:22.705>the <00:13:22.845>table <00:13:22.985>on <00:13:23.125>the <00:13:23.265>right, <00:13:23.405>that,

279
00:13:24.885 --> 00:13:29.085
<00:13:24.885>that <00:13:25.040>the <00:13:25.196>most <00:13:25.351>fundamental <00:13:25.507>one <00:13:25.662>is <00:13:25.818>the <00:13:25.973>function <00:13:26.129>size, <00:13:26.285>which,

280
00:13:29.305 --> 00:13:33.125
<00:13:29.305>um, <00:13:29.538>which <00:13:29.771>basically <00:13:30.005>makes <00:13:30.238>it <00:13:30.471>so <00:13:30.704>that

281
00:13:33.155 --> 00:13:36.445
<00:13:33.155>that <00:13:33.388>only <00:13:33.621>roughly <00:13:33.855>hundreds <00:13:34.088>of <00:13:34.321>megabytes <00:13:34.555>of,

282
00:13:36.445 --> 00:13:39.445
<00:13:36.445>of <00:13:36.600>data <00:13:36.756>can <00:13:36.911>be <00:13:37.067>deployed <00:13:37.222>in, <00:13:37.378>in, <00:13:37.533>in <00:13:37.689>this <00:13:37.845>way.

283
00:13:39.665 --> 00:13:43.365
<00:13:39.665>And <00:13:39.792>we'll <00:13:39.919>see <00:13:40.046>how, <00:13:40.174>how <00:13:40.301>this <00:13:40.428>kind <00:13:40.555>of <00:13:40.683>limitation, <00:13:40.810>um, <00:13:40.937>uh, <00:13:41.064>is,

284
00:13:44.145 --> 00:13:48.365
<00:13:44.145>is <00:13:44.285>the, <00:13:44.425>the <00:13:44.564>principle <00:13:44.704>reason <00:13:44.845>why <00:13:44.985>we <00:13:45.125>even <00:13:45.265>went <00:13:45.405>through <00:13:45.545>the,

285
00:13:48.385 --> 00:13:51.685
<00:13:48.385>the <00:13:48.512>trouble <00:13:48.639>of, <00:13:48.766>of <00:13:48.894>doing <00:13:49.021>what <00:13:49.148>the <00:13:49.275>stock, <00:13:49.403>uh, <00:13:49.530>will <00:13:49.657>be <00:13:49.785>about.

286
00:13:52.305 --> 00:13:57.165
<00:13:52.305>So, <00:13:52.412>um, <00:13:52.520>we <00:13:52.628>kind <00:13:52.735>of <00:13:52.843>played <00:13:52.951>a <00:13:53.058>bit <00:13:53.166>about <00:13:53.274>it <00:13:53.381>played <00:13:53.489>a <00:13:53.597>bit <00:13:53.704>around

287
00:13:57.165 --> 00:13:59.845
<00:13:57.165>with <00:13:57.339>this, <00:13:57.515>and <00:13:57.689>the, <00:13:57.865>the <00:13:58.040>result <00:13:58.214>is <00:13:58.390>a, <00:13:58.564>um,

288
00:14:00.305 --> 00:14:01.645
<00:14:00.305>as <00:14:00.606>something <00:14:00.908>we <00:14:01.209>wrote <00:14:01.511>up

289
00:14:01.985 --> 00:14:03.285
<00:14:01.985>and <00:14:02.180>in <00:14:02.375>this <00:14:02.569>kind <00:14:02.765>of <00:14:02.960>a <00:14:03.155>paper,

290
00:14:03.655 --> 00:14:05.845
<00:14:03.655>which <00:14:03.935>has <00:14:04.214>a <00:14:04.495>massively <00:14:04.775>academic <00:14:05.055>name,

291
00:14:05.905 --> 00:14:09.325
<00:14:05.905>but <00:14:06.079>in <00:14:06.255>principle <00:14:06.430>it <00:14:06.605>gives <00:14:06.780>you <00:14:06.954>the <00:14:07.130>written <00:14:07.305>narrative

292
00:14:09.325 --> 00:14:12.445
<00:14:09.325>and <00:14:09.480>written <00:14:09.636>version <00:14:09.791>of <00:14:09.947>of, <00:14:10.102>of <00:14:10.258>what, <00:14:10.413>what <00:14:10.569>I'm <00:14:10.725>gonna,

293
00:14:12.465 --> 00:14:14.685
<00:14:12.465>I'm <00:14:12.581>gonna <00:14:12.698>talk, <00:14:12.815>talk <00:14:12.931>to <00:14:13.048>you <00:14:13.165>about <00:14:13.281>in <00:14:13.398>the, <00:14:13.515>in <00:14:13.631>the <00:14:13.748>next <00:14:13.865>couple

294
00:14:14.685 --> 00:14:16.685
<00:14:14.685>of <00:14:14.859>minutes <00:14:15.035>if <00:14:15.209>you <00:14:15.385>want <00:14:15.560>to <00:14:15.734>look <00:14:15.910>it <00:14:16.084>up.

295
00:14:16.795 --> 00:14:19.605
<00:14:16.795>Just, <00:14:16.969>just <00:14:17.145>look <00:14:17.319>up <00:14:17.495>a <00:14:17.670>bird <00:14:17.844>and <00:14:18.020>serverless <00:14:18.194>environment

296
00:14:19.625 --> 00:14:20.645
<00:14:19.625>and <00:14:20.084>maybe <00:14:20.543>deployment,

297
00:14:20.905 --> 00:14:22.645
<00:14:20.905>and <00:14:21.138>you <00:14:21.371>should, <00:14:21.605>you <00:14:21.838>should <00:14:22.071>find, <00:14:22.305>uh,

298
00:14:22.705 --> 00:14:24.045
<00:14:22.705>all <00:14:23.006>the <00:14:23.308>details <00:14:23.609>in <00:14:23.911>there.

299
00:14:24.555 --> 00:14:26.885
<00:14:24.555>Alright? <00:14:24.694>So <00:14:24.834>what <00:14:24.974>I'm <00:14:25.114>gonna <00:14:25.255>do <00:14:25.395>in, <00:14:25.535>in <00:14:25.675>the <00:14:25.814>next <00:14:25.954>couple

300
00:14:26.885 --> 00:14:29.285
<00:14:26.885>of <00:14:27.118>minutes, <00:14:27.351>uh, <00:14:27.585>will <00:14:27.818>be, <00:14:28.051>um, <00:14:28.285>um,

301
00:14:29.475 --> 00:14:30.645
<00:14:29.475>something <00:14:30.001>very <00:14:30.528>straightforward.

302
00:14:30.775 --> 00:14:32.725
<00:14:30.775>We'll <00:14:31.125>take <00:14:31.475>two <00:14:31.824>specific <00:14:32.175>tasks

303
00:14:32.865 --> 00:14:34.525
<00:14:32.865>or <00:14:33.145>two <00:14:33.425>specific <00:14:33.705>machine <00:14:33.985>learning <00:14:34.265>models,

304
00:14:34.745 --> 00:14:36.525
<00:14:34.745>and <00:14:34.945>we'll <00:14:35.145>see <00:14:35.345>how <00:14:35.545>deploying <00:14:35.745>them <00:14:35.945>in <00:14:36.145>a,

305
00:14:36.785 --> 00:14:39.205
<00:14:36.785>in <00:14:36.985>a <00:14:37.185>serverless <00:14:37.385>environment <00:14:37.584>might <00:14:37.785>look <00:14:37.985>like <00:14:38.185>or,

306
00:14:39.205 --> 00:14:40.285
<00:14:39.205>or <00:14:39.448>what <00:14:39.691>would <00:14:39.934>it <00:14:40.177>take

307
00:14:40.285 --> 00:14:42.885
<00:14:40.285>to <00:14:40.485>even <00:14:40.685>deploy <00:14:40.885>them <00:14:41.084>in <00:14:41.285>a <00:14:41.485>serverless <00:14:41.685>environment.

308
00:14:43.385 --> 00:14:45.845
<00:14:43.385>So <00:14:43.560>the <00:14:43.735>first <00:14:43.910>task <00:14:44.085>will <00:14:44.260>be <00:14:44.435>very <00:14:44.610>straightforward, <00:14:44.785>mostly

309
00:14:45.845 --> 00:14:48.285
<00:14:45.845>because <00:14:46.000>it's <00:14:46.156>a, <00:14:46.311>it's <00:14:46.467>a <00:14:46.622>kind <00:14:46.778>of <00:14:46.933>a <00:14:47.089>normal <00:14:47.245>standard,

310
00:14:48.745 --> 00:14:50.285
<00:14:48.745>uh, <00:14:49.207>national <00:14:49.669>processing <00:14:50.131>task.

311
00:14:50.285 --> 00:14:53.245
<00:14:50.285>It's <00:14:50.485>a, <00:14:50.685>it's <00:14:50.885>a <00:14:51.084>classification <00:14:51.285>essentially <00:14:51.485>into <00:14:51.685>three

312
00:14:53.245 --> 00:14:54.285
<00:14:53.245>colo <00:14:53.557>in <00:14:53.869>our <00:14:54.180>case.

313
00:14:54.825 --> 00:14:58.045
<00:14:54.825>And, <00:14:55.025>uh, <00:14:55.225>and <00:14:55.425>so <00:14:55.625>we'll <00:14:55.825>do <00:14:56.025>sentiment <00:14:56.225>analysis.

314
00:14:58.505 --> 00:14:59.805
<00:14:58.505>Now, <00:14:58.797>what <00:14:59.089>we'll <00:14:59.382>use, <00:14:59.675>uh,

315
00:14:59.805 --> 00:15:02.205
<00:14:59.805>for <00:15:00.005>sentiment <00:15:00.204>analysis <00:15:00.405>is <00:15:00.604>this <00:15:00.805>thing <00:15:01.005>called <00:15:01.204>birds,

316
00:15:02.255 --> 00:15:05.125
<00:15:02.255>which <00:15:02.455>you <00:15:02.655>most <00:15:02.855>probably <00:15:03.055>most <00:15:03.255>probably <00:15:03.455>heard <00:15:03.655>about.

317
00:15:05.425 --> 00:15:09.565
<00:15:05.425>But, <00:15:05.532>um, <00:15:05.640>just <00:15:05.748>to, <00:15:05.855>just <00:15:05.963>to <00:15:06.071>get <00:15:06.178>a, <00:15:06.286>give <00:15:06.394>a <00:15:06.501>bit <00:15:06.609>of <00:15:06.717>a <00:15:06.824>refresher,

318
00:15:09.565 --> 00:15:10.845
<00:15:09.565>what <00:15:09.853>does <00:15:10.141>this <00:15:10.429>birthing <00:15:10.717>do?

319
00:15:11.225 --> 00:15:14.125
<00:15:11.225>I'd <00:15:11.365>say <00:15:11.505>fairly, <00:15:11.645>it <00:15:11.785>is <00:15:11.925>a <00:15:12.065>fairly <00:15:12.205>simple, <00:15:12.345>uh, <00:15:12.485>thing <00:15:12.625>really.

320
00:15:14.505 --> 00:15:18.925
<00:15:14.505>So, <00:15:14.645>um, <00:15:14.785>as <00:15:14.925>an <00:15:15.064>input, <00:15:15.205>you <00:15:15.345>give <00:15:15.485>it, <00:15:15.625>uh, <00:15:15.765>a, <00:15:15.905>uh,

321
00:15:19.525 --> 00:15:23.725
<00:15:19.525>a <00:15:19.652>your <00:15:19.779>text, <00:15:19.906>a <00:15:20.034>text <00:15:20.161>of <00:15:20.288>say <00:15:20.415>a <00:15:20.543>slide <00:15:20.670>of <00:15:20.797>question, <00:15:20.925>um,

322
00:15:23.935 --> 00:15:27.485
<00:15:23.935>which <00:15:24.062>you <00:15:24.189>can <00:15:24.316>see <00:15:24.444>on <00:15:24.571>the, <00:15:24.698>on <00:15:24.825>the, <00:15:24.953>on <00:15:25.080>the <00:15:25.207>bottom <00:15:25.334>here.

323
00:15:27.865 --> 00:15:31.405
<00:15:27.865>And <00:15:28.005>that, <00:15:28.145>that <00:15:28.285>slide, <00:15:28.425>that, <00:15:28.565>that, <00:15:28.705>that <00:15:28.845>question <00:15:28.985>in <00:15:29.125>our <00:15:29.265>case,

324
00:15:31.405 --> 00:15:34.925
<00:15:31.405>the, <00:15:31.579>the, <00:15:31.755>the <00:15:31.930>Slido <00:15:32.105>question <00:15:32.280>will <00:15:32.454>be, <00:15:32.630>um, <00:15:32.805>kind

325
00:15:34.925 --> 00:15:38.165
<00:15:34.925>of <00:15:35.064>tokenized <00:15:35.204>in <00:15:35.344>a, <00:15:35.484>in <00:15:35.625>a, <00:15:35.765>uh, <00:15:35.905>in <00:15:36.045>an <00:15:36.185>interesting <00:15:36.324>manner.

326
00:15:38.385 --> 00:15:40.125
<00:15:38.385>That's <00:15:38.665>a, <00:15:38.944>that's <00:15:39.225>a <00:15:39.505>separate <00:15:39.785>talk,

327
00:15:40.225 --> 00:15:42.725
<00:15:40.225>but <00:15:40.365>in <00:15:40.505>principle, <00:15:40.645>we, <00:15:40.785>we, <00:15:40.925>we <00:15:41.065>give <00:15:41.205>it <00:15:41.345>that, <00:15:41.485>that <00:15:41.625>text,

328
00:15:43.055 --> 00:15:46.845
<00:15:43.055>it'll <00:15:43.255>create <00:15:43.454>ins <00:15:43.655>own <00:15:43.854>representation, <00:15:44.055>and <00:15:44.255>that's <00:15:44.454>it.

329
00:15:47.005 --> 00:15:49.685
<00:15:47.005>That, <00:15:47.180>that's <00:15:47.355>where <00:15:47.530>it's, <00:15:47.705>that's, <00:15:47.880>uh, <00:15:48.055>where <00:15:48.230>it's <00:15:48.405>task.

330
00:15:49.865 --> 00:15:51.845
<00:15:49.865>And <00:15:50.065>from <00:15:50.265>there <00:15:50.465>on, <00:15:50.665>we <00:15:50.865>take <00:15:51.065>that <00:15:51.265>representation,

331
00:15:52.275 --> 00:15:54.325
<00:15:52.275>basically <00:15:52.508>fine <00:15:52.741>tune <00:15:52.975>a <00:15:53.208>very <00:15:53.441>smaller, <00:15:53.675>like,

332
00:15:54.605 --> 00:15:57.725
<00:15:54.605>training <00:15:54.780>very <00:15:54.955>small, <00:15:55.130>even <00:15:55.305>something <00:15:55.480>like <00:15:55.655>a <00:15:55.830>linear <00:15:56.005>logistic

333
00:15:57.725 --> 00:16:02.365
<00:15:57.725>regression <00:15:57.865>and <00:15:58.005>get <00:15:58.145>a, <00:15:58.285>uh, <00:15:58.425>um, <00:15:58.565>get, <00:15:58.705>get, <00:15:58.845>get <00:15:58.985>an <00:15:59.125>output

334
00:16:02.425 --> 00:16:03.565
<00:16:02.425>for <00:16:02.938>our <00:16:03.451>classification.

335
00:16:03.825 --> 00:16:05.885
<00:16:03.825>In <00:16:04.000>the <00:16:04.175>case <00:16:04.350>of <00:16:04.525>this <00:16:04.700>example <00:16:04.875>here, <00:16:05.050>it's <00:16:05.225>a,

336
00:16:05.885 --> 00:16:07.765
<00:16:05.885>it's <00:16:06.235>a <00:16:06.585>binary <00:16:06.935>classification <00:16:07.285>between,

337
00:16:07.785 --> 00:16:09.005
<00:16:07.785>uh, <00:16:08.151>negative <00:16:08.516>and <00:16:08.883>positive.

338
00:16:09.225 --> 00:16:11.685
<00:16:09.225>So <00:16:09.380>in <00:16:09.536>other <00:16:09.691>words, <00:16:09.847>what <00:16:10.002>what <00:16:10.158>that <00:16:10.313>bird <00:16:10.469>is <00:16:10.625>capable

339
00:16:11.865 --> 00:16:16.125
<00:16:11.865>of <00:16:11.992>doing <00:16:12.119>is <00:16:12.246>something <00:16:12.374>like <00:16:12.501>this, <00:16:12.628>you <00:16:12.755>give <00:16:12.883>it <00:16:13.010>a <00:16:13.137>sentence <00:16:13.265>in,

340
00:16:16.145 --> 00:16:18.965
<00:16:16.145>in <00:16:16.425>text, <00:16:16.704>it, <00:16:16.985>it, <00:16:17.265>uh, <00:16:17.545>replies

341
00:16:18.965 --> 00:16:21.805
<00:16:18.965>or <00:16:19.092>like, <00:16:19.219>it, <00:16:19.346>it's <00:16:19.474>output <00:16:19.601>is <00:16:19.728>a, <00:16:19.855>is <00:16:19.983>a, <00:16:20.110>is <00:16:20.237>a <00:16:20.365>vector

342
00:16:22.115 --> 00:16:24.605
<00:16:22.115>that <00:16:22.395>basically <00:16:22.675>kind <00:16:22.955>of <00:16:23.235>summarizes <00:16:23.515>what

343
00:16:24.605 --> 00:16:25.965
<00:16:24.605>that <00:16:24.911>sentence <00:16:25.217>might <00:16:25.523>be <00:16:25.829>about.

344
00:16:26.585 --> 00:16:29.605
<00:16:26.585>And, <00:16:26.740>um, <00:16:26.896>you <00:16:27.051>then <00:16:27.207>you <00:16:27.362>then, <00:16:27.518>uh, <00:16:27.673>take <00:16:27.829>this <00:16:27.985>vector

345
00:16:29.705 --> 00:16:33.645
<00:16:29.705>and <00:16:29.832>train <00:16:29.959>the <00:16:30.086>model <00:16:30.214>of <00:16:30.341>your <00:16:30.468>choice, <00:16:30.595>uh, <00:16:30.723>to <00:16:30.850>best <00:16:30.977>fit <00:16:31.105>this,

346
00:16:33.665 --> 00:16:34.965
<00:16:33.665>uh, <00:16:34.250>this <00:16:34.835>dataset.

347
00:16:34.965 --> 00:16:36.045
<00:16:34.965>You, <00:16:35.159>you, <00:16:35.353>you <00:16:35.548>got <00:16:35.742>this <00:16:35.937>way.

348
00:16:37.615 --> 00:16:41.555
<00:16:37.615>Now <00:16:37.742>we <00:16:37.869>heard, <00:16:37.996>um, <00:16:38.124>a <00:16:38.251>lot <00:16:38.378>about <00:16:38.505>how, <00:16:38.633>how <00:16:38.760>word, <00:16:38.887>uh, <00:16:39.015>is,

349
00:16:41.655 --> 00:16:43.595
<00:16:41.655>is <00:16:42.005>basically <00:16:42.355>eating <00:16:42.704>the <00:16:43.055>world

350
00:16:43.595 --> 00:16:46.155
<00:16:43.595>of <00:16:43.750>natural <00:16:43.906>language <00:16:44.061>processing, <00:16:44.217>and <00:16:44.372>it's <00:16:44.528>very <00:16:44.683>much <00:16:44.839>the <00:16:44.995>case,

351
00:16:46.215 --> 00:16:49.195
<00:16:46.215>but <00:16:46.415>what <00:16:46.615>does <00:16:46.815>Bird <00:16:47.015>know <00:16:47.215>about, <00:16:47.415>about <00:16:47.615>Slido?

352
00:16:49.355 --> 00:16:50.915
<00:16:49.355>Questions <00:16:49.705>about <00:16:50.055>the <00:16:50.405>particular <00:16:50.755>language

353
00:16:50.935 --> 00:16:53.515
<00:16:50.935>of <00:16:51.074>questions <00:16:51.214>we <00:16:51.354>can <00:16:51.494>be, <00:16:51.635>which <00:16:51.775>can <00:16:51.915>be <00:16:52.055>at, <00:16:52.194>at <00:16:52.334>the,

354
00:16:53.655 --> 00:16:55.955
<00:16:53.655>at <00:16:53.888>the <00:16:54.121>most <00:16:54.355>300 <00:16:54.588>characters <00:16:54.821>inside, <00:16:55.055>right?

355
00:16:56.025 --> 00:16:57.035
<00:16:56.025>It's, <00:16:56.328>it's <00:16:56.631>not <00:16:56.934>even,

356
00:16:57.305 --> 00:17:00.155
<00:16:57.305>it's <00:16:57.505>probably <00:16:57.704>even <00:16:57.905>different <00:16:58.104>from <00:16:58.305>say <00:16:58.505>the <00:16:58.704>language

357
00:17:00.155 --> 00:17:03.595
<00:17:00.155>that <00:17:00.295>you <00:17:00.435>can <00:17:00.574>see <00:17:00.714>in <00:17:00.855>Twitter <00:17:00.995>and, <00:17:01.135>uh, <00:17:01.275>and <00:17:01.415>so <00:17:01.555>on.

358
00:17:04.415 --> 00:17:07.275
<00:17:04.415>And <00:17:04.555>so <00:17:04.694>the <00:17:04.835>answer <00:17:04.974>is <00:17:05.115>exactly <00:17:05.254>what <00:17:05.395>the <00:17:05.534>slide <00:17:05.675>looked <00:17:05.815>like.

359
00:17:07.345 --> 00:17:10.675
<00:17:07.345>Well, <00:17:07.520>not <00:17:07.694>much, <00:17:07.870>not <00:17:08.045>not <00:17:08.220>really <00:17:08.395>nothing, <00:17:08.569>but, <00:17:08.745>but,

360
00:17:11.015 --> 00:17:12.115
<00:17:11.015>but, <00:17:11.345>uh, <00:17:11.675>not <00:17:12.005>much.

361
00:17:12.455 --> 00:17:15.235
<00:17:12.454>And <00:17:12.571>so <00:17:12.688>to, <00:17:12.804>to <00:17:12.921>give <00:17:13.038>it <00:17:13.155>a <00:17:13.271>bit <00:17:13.388>of, <00:17:13.504>bit <00:17:13.621>of <00:17:13.738>knowledge <00:17:13.855>about,

362
00:17:15.235 --> 00:17:20.195
<00:17:15.234>about <00:17:15.409>slider <00:17:15.584>questions, <00:17:15.760>we, <00:17:15.935>um, <00:17:16.109>we <00:17:16.284>attempt <00:17:16.459>a, <00:17:16.635>a,

363
00:17:20.255 --> 00:17:23.955
<00:17:20.255>uh, <00:17:20.382>a <00:17:20.509>process <00:17:20.636>called, <00:17:20.764>called <00:17:20.891>fine <00:17:21.018>tuning <00:17:21.145>in <00:17:21.273>which <00:17:21.400>we <00:17:21.527>take <00:17:21.655>a,

364
00:17:23.975 --> 00:17:27.395
<00:17:23.974>uh, <00:17:24.208>take <00:17:24.441>a <00:17:24.675>bird <00:17:24.908>model, <00:17:25.141>um, <00:17:25.375>the,

365
00:17:27.395 --> 00:17:31.515
<00:17:27.395>the <00:17:27.569>standard <00:17:27.744>bird <00:17:27.920>base <00:17:28.095>model, <00:17:28.270>use <00:17:28.444>about <00:17:28.620>70,000 <00:17:28.795>questions

366
00:17:31.515 --> 00:17:35.115
<00:17:31.515>that <00:17:31.670>we <00:17:31.826>have <00:17:31.981>with <00:17:32.137>their, <00:17:32.292>with <00:17:32.448>their <00:17:32.603>appropriate, <00:17:32.759>uh, <00:17:32.915>labels.

367
00:17:35.375 --> 00:17:38.395
<00:17:35.375>And <00:17:35.575>basically <00:17:35.775>fine <00:17:35.975>tune <00:17:36.175>the <00:17:36.375>fine <00:17:36.575>tune <00:17:36.775>the,

368
00:17:38.535 --> 00:17:39.675
<00:17:38.535>the <00:17:38.877>bird <00:17:39.219>based <00:17:39.561>model.

369
00:17:40.175 --> 00:17:41.755
<00:17:40.175>Now, <00:17:40.455>with <00:17:40.735>this <00:17:41.014>kind <00:17:41.294>of <00:17:41.575>model,

370
00:17:41.895 --> 00:17:43.555
<00:17:41.895>we <00:17:42.175>can <00:17:42.455>already <00:17:42.735>do <00:17:43.014>interesting <00:17:43.295>things,

371
00:17:44.215 --> 00:17:47.795
<00:17:44.215>but, <00:17:44.355>uh, <00:17:44.495>there <00:17:44.635>will <00:17:44.774>be <00:17:44.915>that <00:17:45.054>turns <00:17:45.195>out <00:17:45.334>there <00:17:45.475>is <00:17:45.615>a,

372
00:17:47.805 --> 00:17:50.405
<00:17:47.805>there <00:17:47.960>is <00:17:48.116>a <00:17:48.271>trouble, <00:17:48.427>a <00:17:48.582>bit <00:17:48.738>of <00:17:48.893>a <00:17:49.049>trouble <00:17:49.205>ahead.

373
00:17:50.715 --> 00:17:53.885
<00:17:50.715>Well, <00:17:50.855>the, <00:17:50.995>the <00:17:51.135>model <00:17:51.274>size <00:17:51.415>on <00:17:51.554>its <00:17:51.695>own, <00:17:51.834>they <00:17:51.975>just, <00:17:52.115>just,

374
00:17:54.235 --> 00:17:58.325
<00:17:54.235>bird <00:17:54.409>base <00:17:54.584>is <00:17:54.760>about <00:17:54.935>400 <00:17:55.110>megabytes <00:17:55.284>in, <00:17:55.459>in <00:17:55.635>size.

375
00:17:58.785 --> 00:18:01.805
<00:17:58.785>And <00:17:58.985>the <00:17:59.185>Pieter <00:17:59.385>library <00:17:59.585>itself, <00:17:59.785>which <00:17:59.985>we <00:18:00.185>need

376
00:18:01.865 --> 00:18:04.965
<00:18:01.865>for <00:18:02.098>four <00:18:02.331>inference <00:18:02.565>is <00:18:02.798>another <00:18:03.031>400 <00:18:03.265>megabytes.

377
00:18:05.105 --> 00:18:07.245
<00:18:05.105>So, <00:18:05.385>um, <00:18:05.665>essentially <00:18:05.945>just <00:18:06.225>on <00:18:06.505>the,

378
00:18:07.475 --> 00:18:10.045
<00:18:07.475>just <00:18:07.630>on <00:18:07.786>the <00:18:07.941>limitations <00:18:08.097>level, <00:18:08.252>this <00:18:08.408>is <00:18:08.563>a <00:18:08.719>no <00:18:08.875>go.

379
00:18:10.425 --> 00:18:12.405
<00:18:10.425>So <00:18:10.580>what <00:18:10.736>do <00:18:10.891>we, <00:18:11.047>what <00:18:11.202>do <00:18:11.358>we <00:18:11.513>do <00:18:11.669>about <00:18:11.825>that?

380
00:18:12.595 --> 00:18:16.285
<00:18:12.595>Well, <00:18:12.722>um, <00:18:12.849>if <00:18:12.976>the <00:18:13.104>model <00:18:13.231>is <00:18:13.358>large, <00:18:13.485>we <00:18:13.613>can <00:18:13.740>probably, <00:18:13.867>uh, <00:18:13.995>go

381
00:18:16.285 --> 00:18:18.245
<00:18:16.285>and <00:18:16.460>see <00:18:16.635>if <00:18:16.810>we <00:18:16.985>can <00:18:17.160>train <00:18:17.335>a <00:18:17.510>smaller <00:18:17.685>one.

382
00:18:18.245 --> 00:18:21.165
<00:18:18.245>And <00:18:18.419>that's <00:18:18.594>exactly, <00:18:18.770>that's <00:18:18.945>exactly <00:18:19.120>what, <00:18:19.294>what <00:18:19.469>we'll <00:18:19.645>do,

383
00:18:21.165 --> 00:18:24.445
<00:18:21.165>because <00:18:21.305>otherwise <00:18:21.445>we <00:18:21.585>won't <00:18:21.725>be <00:18:21.865>able <00:18:22.004>to <00:18:22.145>fit <00:18:22.284>within <00:18:22.425>this, <00:18:22.565>uh,

384
00:18:24.445 --> 00:18:27.365
<00:18:24.445>limit <00:18:24.600>of <00:18:24.756>the <00:18:24.911>land, <00:18:25.067>which <00:18:25.222>is, <00:18:25.378>which <00:18:25.533>is <00:18:25.689>250 <00:18:25.845>megabytes.

385
00:18:27.665 --> 00:18:29.125
<00:18:27.665>And <00:18:27.884>so <00:18:28.103>what <00:18:28.322>you'll, <00:18:28.541>what <00:18:28.760>you'll, <00:18:28.979>uh,

386
00:18:29.155 --> 00:18:31.725
<00:18:29.155>what <00:18:29.355>you'll <00:18:29.555>use <00:18:29.754>is <00:18:29.955>a <00:18:30.155>concept <00:18:30.355>called, <00:18:30.555>called,

387
00:18:31.825 --> 00:18:32.965
<00:18:31.825>uh, <00:18:32.338>knowledge <00:18:32.851>distillation.

388
00:18:32.965 --> 00:18:34.645
<00:18:32.965>In, <00:18:33.198>in <00:18:33.431>which <00:18:33.665>we'll <00:18:33.898>have <00:18:34.131>two <00:18:34.365>models.

389
00:18:34.865 --> 00:18:37.205
<00:18:34.865>One <00:18:35.020>will <00:18:35.176>be <00:18:35.331>the <00:18:35.487>teacher, <00:18:35.642>the <00:18:35.798>other <00:18:35.953>one <00:18:36.109>will <00:18:36.265>be,

390
00:18:37.355 --> 00:18:38.845
<00:18:37.355>will <00:18:37.802>be <00:18:38.249>a <00:18:38.696>student.

391
00:18:39.185 --> 00:18:43.485
<00:18:39.185>And <00:18:39.312>so <00:18:39.439>we'll <00:18:39.566>use <00:18:39.694>this <00:18:39.821>large <00:18:39.948>model <00:18:40.075>of <00:18:40.203>ours, <00:18:40.330>we'll <00:18:40.457>call <00:18:40.585>it,

392
00:18:43.895 --> 00:18:45.005
<00:18:43.895>we'll <00:18:44.144>call <00:18:44.394>it <00:18:44.644>the <00:18:44.894>teacher.

393
00:18:45.465 --> 00:18:48.405
<00:18:45.465>And <00:18:45.620>the <00:18:45.776>teacher <00:18:45.931>model <00:18:46.087>will <00:18:46.242>then <00:18:46.398>take <00:18:46.553>a <00:18:46.709>whole <00:18:46.865>bunch

394
00:18:48.425 --> 00:18:52.525
<00:18:48.425>of <00:18:48.580>unlabeled <00:18:48.736>examples, <00:18:48.891>which <00:18:49.047>which <00:18:49.202>we <00:18:49.358>have <00:18:49.513>plenty <00:18:49.669>of, <00:18:49.825>if,

395
00:18:52.585 --> 00:18:53.845
<00:18:52.585>if, <00:18:52.811>if <00:18:53.038>we <00:18:53.265>really <00:18:53.492>want <00:18:53.719>to,

396
00:18:54.785 --> 00:18:57.445
<00:18:54.785>and <00:18:54.960>use <00:18:55.135>the <00:18:55.310>predictions <00:18:55.485>of <00:18:55.660>the, <00:18:55.835>of <00:18:56.010>the <00:18:56.185>teacher

397
00:18:57.985 --> 00:18:59.165
<00:18:57.985>to <00:18:58.339>train <00:18:58.693>the <00:18:59.047>student.

398
00:18:59.385 --> 00:19:04.005
<00:18:59.385>So <00:18:59.540>the <00:18:59.696>student <00:18:59.851>will <00:19:00.007>see <00:19:00.162>both <00:19:00.318>the, <00:19:00.473>the <00:19:00.629>70,000, <00:19:00.785>um,

399
00:19:04.805 --> 00:19:07.525
<00:19:04.805>examples <00:19:04.960>we <00:19:05.116>saw <00:19:05.271>in <00:19:05.427>the, <00:19:05.582>in <00:19:05.738>the, <00:19:05.893>in <00:19:06.049>the, <00:19:06.205>uh,

400
00:19:07.745 --> 00:19:08.885
<00:19:07.745>in <00:19:08.087>the <00:19:08.428>previous <00:19:08.771>example.

401
00:19:09.425 --> 00:19:13.885
<00:19:09.425>And, <00:19:09.552>uh, <00:19:09.679>we'll <00:19:09.806>also <00:19:09.934>see <00:19:10.061>a <00:19:10.188>huge <00:19:10.315>bunch <00:19:10.443>of, <00:19:10.570>bunch <00:19:10.697>of, <00:19:10.825>uh,

402
00:19:14.095 --> 00:19:17.645
<00:19:14.095>label <00:19:14.270>data <00:19:14.445>that <00:19:14.620>the <00:19:14.795>teacher, <00:19:14.970>uh, <00:19:15.145>will <00:19:15.320>pre <00:19:15.495>label,

403
00:19:17.865 --> 00:19:18.965
<00:19:17.865>uh, <00:19:18.112>pre <00:19:18.360>label <00:19:18.607>for <00:19:18.855>it.

404
00:19:19.505 --> 00:19:22.845
<00:19:19.505>And <00:19:19.632>now <00:19:19.759>in <00:19:19.886>this <00:19:20.014>way, <00:19:20.141>we <00:19:20.268>are, <00:19:20.395>we <00:19:20.523>are <00:19:20.650>kind <00:19:20.777>of <00:19:20.905>trying

405
00:19:22.945 --> 00:19:24.565
<00:19:22.945>to <00:19:23.225>get <00:19:23.504>the <00:19:23.784>student <00:19:24.064>to <00:19:24.345>mimic

406
00:19:24.995 --> 00:19:27.205
<00:19:24.995>what <00:19:25.228>the <00:19:25.461>teacher <00:19:25.695>would <00:19:25.928>do <00:19:26.161>on <00:19:26.395>examples.

407
00:19:27.955 --> 00:19:31.445
<00:19:27.955>Neither <00:19:28.155>of <00:19:28.355>these <00:19:28.554>saw <00:19:28.754>like <00:19:28.955>ni <00:19:29.155>on <00:19:29.355>examples,

408
00:19:31.465 --> 00:19:34.645
<00:19:31.465>we <00:19:31.620>don't <00:19:31.776>really <00:19:31.931>know, <00:19:32.087>uh, <00:19:32.242>the, <00:19:32.398>the <00:19:32.553>ground <00:19:32.709>truth <00:19:32.865>of,

409
00:19:34.945 --> 00:19:37.485
<00:19:34.945>but <00:19:35.100>this <00:19:35.256>way <00:19:35.411>we <00:19:35.567>are <00:19:35.722>trying <00:19:35.878>to <00:19:36.033>distill <00:19:36.189>the <00:19:36.345>knowledge

410
00:19:37.825 --> 00:19:39.605
<00:19:37.825>of <00:19:38.105>the <00:19:38.385>teacher <00:19:38.665>into <00:19:38.945>the <00:19:39.225>student.

411
00:19:40.465 --> 00:19:44.155
<00:19:40.465>And <00:19:40.605>so, <00:19:40.745>so <00:19:40.885>when <00:19:41.024>we, <00:19:41.165>when <00:19:41.304>we <00:19:41.445>do <00:19:41.584>something <00:19:41.725>like <00:19:41.865>this,

412
00:19:44.335 --> 00:19:46.795
<00:19:44.335>we <00:19:44.490>can <00:19:44.646>finally <00:19:44.801>answer, <00:19:44.957>yes, <00:19:45.112>we <00:19:45.268>can <00:19:45.423>make <00:19:45.579>the <00:19:45.735>bird,

413
00:19:46.975 --> 00:19:48.115
<00:19:46.975>the <00:19:47.317>bird <00:19:47.658>model <00:19:48.001>smaller.

414
00:19:48.415 --> 00:19:51.875
<00:19:48.415>And <00:19:48.531>the <00:19:48.648>way <00:19:48.764>we <00:19:48.881>do <00:19:48.998>it <00:19:49.115>is <00:19:49.231>by <00:19:49.348>fine <00:19:49.465>tuning <00:19:49.581>the, <00:19:49.698>the, <00:19:49.815>uh,

415
00:19:51.945 --> 00:19:53.955
<00:19:51.945>bird <00:19:52.178>ba, <00:19:52.411>uh, <00:19:52.645>again, <00:19:52.878>like, <00:19:53.111>like <00:19:53.345>by,

416
00:19:54.015 --> 00:19:56.075
<00:19:54.015>by <00:19:54.215>using <00:19:54.415>the <00:19:54.615>fine <00:19:54.815>tune <00:19:55.015>bird <00:19:55.215>based <00:19:55.415>model

417
00:19:57.175 --> 00:20:00.335
<00:19:57.175>labeling <00:19:57.350>a <00:19:57.524>whole <00:19:57.700>bunch <00:19:57.875>of <00:19:58.050>examples, <00:19:58.225>uh, <00:19:58.399>with <00:19:58.575>it,

418
00:20:00.335 --> 00:20:03.775
<00:20:00.335>in <00:20:00.490>this <00:20:00.646>case <00:20:00.801>it <00:20:00.957>was <00:20:01.112>almost, <00:20:01.268>almost <00:20:01.423>a <00:20:01.579>a <00:20:01.735>million,

419
00:20:04.045 --> 00:20:05.495
<00:20:04.045>million <00:20:04.697>other <00:20:05.350>questions.

420
00:20:05.915 --> 00:20:09.015
<00:20:05.915>And <00:20:06.070>using <00:20:06.226>a <00:20:06.381>smaller <00:20:06.537>version <00:20:06.692>of <00:20:06.848>bird <00:20:07.003>called <00:20:07.159>tiny <00:20:07.315>bird,

421
00:20:09.275 --> 00:20:12.775
<00:20:09.275>we <00:20:09.402>have <00:20:09.529>been <00:20:09.656>able <00:20:09.784>to <00:20:09.911>fine <00:20:10.038>tune <00:20:10.165>the, <00:20:10.293>the <00:20:10.420>tiny <00:20:10.547>bird <00:20:10.675>such

422
00:20:12.775 --> 00:20:17.415
<00:20:12.775>that <00:20:12.915>its <00:20:13.055>final <00:20:13.195>size <00:20:13.335>was <00:20:13.475>56 <00:20:13.615>megabytes <00:20:13.755>with <00:20:13.895>smaller <00:20:14.035>than <00:20:14.175>400.

423
00:20:18.195 --> 00:20:21.815
<00:20:18.195>And <00:20:18.322>as <00:20:18.449>we <00:20:18.576>can <00:20:18.704>see <00:20:18.831>in <00:20:18.958>the, <00:20:19.085>in <00:20:19.213>the <00:20:19.340>next <00:20:19.467>example, <00:20:19.595>the,

424
00:20:21.995 --> 00:20:24.095
<00:20:21.995>the <00:20:22.344>accuracy <00:20:22.695>or <00:20:23.044>the <00:20:23.395>performance

425
00:20:24.095 --> 00:20:27.215
<00:20:24.095>of <00:20:24.270>the <00:20:24.445>model <00:20:24.620>didn't <00:20:24.795>really <00:20:24.970>go <00:20:25.145>down <00:20:25.320>that <00:20:25.495>much.

426
00:20:27.495 --> 00:20:31.255
<00:20:27.495>I <00:20:27.594>mean, <00:20:27.695>it <00:20:27.794>went <00:20:27.895>down <00:20:27.995>and <00:20:28.094>we <00:20:28.195>had <00:20:28.294>to <00:20:28.395>hand <00:20:28.495>to, <00:20:28.594>had <00:20:28.695>to <00:20:28.794>kind <00:20:28.895>of,

427
00:20:31.595 --> 00:20:33.975
<00:20:31.595>uh, <00:20:31.795>resort <00:20:31.995>to <00:20:32.195>a <00:20:32.395>different <00:20:32.595>kind <00:20:32.795>of <00:20:32.995>model,

428
00:20:34.215 --> 00:20:37.975
<00:20:34.215>a <00:20:34.370>slightly <00:20:34.526>larger <00:20:34.681>mobile <00:20:34.837>bird, <00:20:34.992>which <00:20:35.148>is <00:20:35.303>98 <00:20:35.459>megabytes <00:20:35.615>inside

429
00:20:38.245 --> 00:20:42.855
<00:20:38.245>that <00:20:38.372>to <00:20:38.499>get <00:20:38.626>to <00:20:38.754>the, <00:20:38.881>to <00:20:39.008>the, <00:20:39.135>um, <00:20:39.263>uh, <00:20:39.390>to <00:20:39.517>the <00:20:39.645>performance

430
00:20:42.855 --> 00:20:45.975
<00:20:42.855>of <00:20:42.982>the, <00:20:43.109>of <00:20:43.236>the, <00:20:43.364>of <00:20:43.491>the <00:20:43.618>bird <00:20:43.745>base, <00:20:43.873>uh, <00:20:44.000>bird <00:20:44.127>base <00:20:44.255>model.

431
00:20:46.355 --> 00:20:50.045
<00:20:46.355>But <00:20:46.555>still, <00:20:46.755>the, <00:20:46.955>the <00:20:47.155>performance <00:20:47.355>is <00:20:47.555>relatively <00:20:47.755>comparable

432
00:20:50.585 --> 00:20:53.605
<00:20:50.585>and <00:20:50.865>the <00:20:51.145>the <00:20:51.425>size, <00:20:51.705>um, <00:20:51.985>uh,

433
00:20:53.875 --> 00:20:55.565
<00:20:53.875>size <00:20:54.225>reduction <00:20:54.575>is <00:20:54.925>really <00:20:55.275>significant.

434
00:20:55.625 --> 00:21:00.085
<00:20:55.625>And <00:20:55.765>so <00:20:55.905>the, <00:20:56.045>so <00:20:56.185>the, <00:20:56.325>the, <00:20:56.465>uh, <00:20:56.605>the <00:20:56.745>accuracy <00:20:56.885>drop <00:20:57.025>we,

435
00:21:00.085 --> 00:21:02.325
<00:21:00.085>we've <00:21:00.435>observed <00:21:00.785>was <00:21:01.135>relatively, <00:21:01.485>um,

436
00:21:02.835 --> 00:21:04.805
<00:21:02.835>very <00:21:03.185>relatively <00:21:03.535>acceptable <00:21:03.885>for <00:21:04.235>us,

437
00:21:05.305 --> 00:21:07.005
<00:21:05.305>um, <00:21:05.585>in <00:21:05.865>this <00:21:06.145>kind <00:21:06.425>of <00:21:06.705>scenario.

438
00:21:07.825 --> 00:21:11.165
<00:21:07.825>So <00:21:07.952>it'll <00:21:08.079>be <00:21:08.206>one <00:21:08.334>thing, <00:21:08.461>uh, <00:21:08.588>that <00:21:08.715>would <00:21:08.843>be, <00:21:08.970>that <00:21:09.097>would <00:21:09.225>be

439
00:21:11.185 --> 00:21:14.125
<00:21:11.185>how <00:21:11.325>we <00:21:11.465>can <00:21:11.605>go <00:21:11.745>from, <00:21:11.885>from <00:21:12.024>a <00:21:12.165>large <00:21:12.304>model <00:21:12.445>to <00:21:12.585>a,

440
00:21:14.185 --> 00:21:16.765
<00:21:14.185>to <00:21:14.385>a <00:21:14.585>smaller <00:21:14.784>one <00:21:14.985>using <00:21:15.185>this <00:21:15.385>concept <00:21:15.585>of,

441
00:21:16.785 --> 00:21:18.085
<00:21:16.785>of <00:21:17.370>knowledge <00:21:17.955>distillation.

442
00:21:18.505 --> 00:21:22.405
<00:21:18.505>Um, <00:21:18.632>here <00:21:18.759>we <00:21:18.886>have <00:21:19.014>it <00:21:19.141>again <00:21:19.268>in, <00:21:19.395>in, <00:21:19.523>in <00:21:19.650>a <00:21:19.777>nice <00:21:19.905>picture.

443
00:21:22.665 --> 00:21:23.885
<00:21:22.665>So <00:21:22.884>let <00:21:23.104>me, <00:21:23.323>let <00:21:23.543>me <00:21:23.763>go

444
00:21:23.885 --> 00:21:25.845
<00:21:23.885>through <00:21:24.118>the <00:21:24.351>whole <00:21:24.585>process <00:21:24.818>one <00:21:25.051>more <00:21:25.285>time.

445
00:21:26.305 --> 00:21:29.725
<00:21:26.305>We <00:21:26.480>have <00:21:26.655>a <00:21:26.830>gold <00:21:27.005>dataset <00:21:27.180>that's <00:21:27.355>a <00:21:27.530>bit <00:21:27.705>smaller,

446
00:21:30.105 --> 00:21:33.485
<00:21:30.105>but <00:21:30.280>thanks <00:21:30.455>to, <00:21:30.630>uh, <00:21:30.805>thanks <00:21:30.980>to <00:21:31.155>this <00:21:31.330>particular <00:21:31.505>dataset,

447
00:21:33.485 --> 00:21:35.125
<00:21:33.485>which <00:21:33.764>is <00:21:34.044>very <00:21:34.324>much <00:21:34.604>domain <00:21:34.885>specific,

448
00:21:35.505 --> 00:21:37.445
<00:21:35.505>we <00:21:35.705>can <00:21:35.905>fine <00:21:36.105>tune <00:21:36.305>the <00:21:36.505>bird <00:21:36.705>based <00:21:36.905>model.

449
00:21:38.075 --> 00:21:42.245
<00:21:38.075>From <00:21:38.202>there, <00:21:38.329>we <00:21:38.456>can <00:21:38.584>take <00:21:38.711>a <00:21:38.838>whole <00:21:38.965>bunch <00:21:39.093>of <00:21:39.220>unlabeled <00:21:39.347>data, <00:21:39.475>uh,

450
00:21:42.345 --> 00:21:46.565
<00:21:42.345>use <00:21:42.472>bird <00:21:42.599>based <00:21:42.726>model, <00:21:42.854>this <00:21:42.981>fine <00:21:43.108>tuned <00:21:43.235>model <00:21:43.363>to, <00:21:43.490>to <00:21:43.617>label <00:21:43.745>it,

451
00:21:46.625 --> 00:21:49.805
<00:21:46.625>to, <00:21:46.780>to <00:21:46.936>label <00:21:47.091>this, <00:21:47.247>this, <00:21:47.402>uh, <00:21:47.558>this <00:21:47.713>larger <00:21:47.869>data <00:21:48.025>set,

452
00:21:49.805 --> 00:21:53.085
<00:21:49.805>these <00:21:49.945>large <00:21:50.085>data <00:21:50.225>set, <00:21:50.365>which <00:21:50.505>we <00:21:50.645>call <00:21:50.785>kind <00:21:50.925>of <00:21:51.065>silver <00:21:51.205>set,

453
00:21:53.085 --> 00:21:55.085
<00:21:53.085>meaning <00:21:53.285>that <00:21:53.485>the <00:21:53.685>data <00:21:53.885>is <00:21:54.085>not <00:21:54.285>really <00:21:54.485>golden,

454
00:21:55.225 --> 00:21:57.885
<00:21:55.225>but <00:21:55.380>we, <00:21:55.536>we <00:21:55.691>kind <00:21:55.847>of <00:21:56.002>assume <00:21:56.158>that <00:21:56.313>the <00:21:56.469>what <00:21:56.625>the,

455
00:21:58.515 --> 00:22:00.045
<00:21:58.515>what <00:21:58.974>the <00:21:59.433>teacher <00:21:59.892>model,

456
00:22:00.045 --> 00:22:02.365
<00:22:00.045>this <00:22:00.245>larger <00:22:00.445>model <00:22:00.645>learned <00:22:00.845>is <00:22:01.045>of <00:22:01.245>some <00:22:01.445>value.

457
00:22:02.625 --> 00:22:06.725
<00:22:02.625>And <00:22:02.765>then <00:22:02.905>we <00:22:03.045>use <00:22:03.185>this <00:22:03.325>la, <00:22:03.465>these, <00:22:03.605>uh, <00:22:03.745>larger <00:22:03.885>silver <00:22:04.025>dataset

458
00:22:06.745 --> 00:22:08.205
<00:22:06.745>to <00:22:06.964>fine <00:22:07.183>tune <00:22:07.401>the <00:22:07.620>tiny <00:22:07.840>bird <00:22:08.059>model.

459
00:22:08.665 --> 00:22:13.365
<00:22:08.665>And <00:22:08.781>the <00:22:08.898>tiny <00:22:09.014>bird <00:22:09.131>model <00:22:09.248>is, <00:22:09.365>uh, <00:22:09.481>is <00:22:09.598>what <00:22:09.715>we <00:22:09.831>can <00:22:09.948>then <00:22:10.065>use

460
00:22:14.085 --> 00:22:17.045
<00:22:14.085>directly <00:22:14.285>in, <00:22:14.485>in, <00:22:14.685>in <00:22:14.885>some <00:22:15.085>deploy <00:22:15.285>serverless <00:22:15.485>deployment

461
00:22:17.045 --> 00:22:20.125
<00:22:17.045>environment, <00:22:17.200>which <00:22:17.356>we'll <00:22:17.511>talk <00:22:17.667>about, <00:22:17.822>uh, <00:22:17.978>next <00:22:18.133>in <00:22:18.289>a <00:22:18.445>bit.

462
00:22:21.355 --> 00:22:24.205
<00:22:21.355>Cool, <00:22:21.588>um, <00:22:21.821>in <00:22:22.055>a <00:22:22.288>very <00:22:22.521>similar <00:22:22.755>manner.

463
00:22:24.665 --> 00:22:29.405
<00:22:24.665>Uh, <00:22:24.792>we <00:22:24.919>can <00:22:25.046>run <00:22:25.174>into <00:22:25.301>a <00:22:25.428>similar <00:22:25.555>problem <00:22:25.683>in, <00:22:25.810>in <00:22:25.937>this <00:22:26.065>context

464
00:22:29.585 --> 00:22:31.605
<00:22:29.585>of, <00:22:29.760>of <00:22:29.935>a <00:22:30.110>second <00:22:30.285>model, <00:22:30.460>which <00:22:30.635>I <00:22:30.810>would <00:22:30.985>like

465
00:22:31.605 --> 00:22:33.605
<00:22:31.605>to <00:22:31.760>talk <00:22:31.916>about <00:22:32.071>next, <00:22:32.227>which <00:22:32.382>is <00:22:32.538>called <00:22:32.693>the <00:22:32.849>similar <00:22:33.005>question.

466
00:22:34.025 --> 00:22:37.445
<00:22:34.025>Um, <00:22:34.305>the, <00:22:34.585>the <00:22:34.865>similar <00:22:35.145>question <00:22:35.425>detection,

467
00:22:37.665 --> 00:22:39.125
<00:22:37.665>um, <00:22:38.322>detection <00:22:38.979>feature.

468
00:22:39.785 --> 00:22:44.605
<00:22:39.785>And <00:22:39.925>so, <00:22:40.065>um, <00:22:40.205>in <00:22:40.345>there, <00:22:40.485>we, <00:22:40.625>we <00:22:40.765>basically <00:22:40.905>are, <00:22:41.045>are <00:22:41.185>trying

469
00:22:44.625 --> 00:22:47.405
<00:22:44.625>to <00:22:44.780>figure <00:22:44.936>out, <00:22:45.091>uh, <00:22:45.247>the <00:22:45.402>answer <00:22:45.558>to <00:22:45.713>the <00:22:45.869>following <00:22:46.025>question.

470
00:22:47.755 --> 00:22:50.085
<00:22:47.755>Suppose <00:22:47.988>we <00:22:48.221>have <00:22:48.455>two <00:22:48.688>questions, <00:22:48.921>question <00:22:49.155>A

471
00:22:50.105 --> 00:22:53.005
<00:22:50.105>and <00:22:50.338>question <00:22:50.571>B, <00:22:50.805>can <00:22:51.038>we <00:22:51.271>somehow <00:22:51.505>automatically

472
00:22:53.755 --> 00:22:56.805
<00:22:53.755>find <00:22:53.910>out <00:22:54.066>if <00:22:54.221>they <00:22:54.377>are <00:22:54.532>talking <00:22:54.688>about <00:22:54.843>the <00:22:54.999>same <00:22:55.155>thing?

473
00:22:57.325 --> 00:22:59.045
<00:22:57.325>In <00:22:57.525>other <00:22:57.725>words, <00:22:57.925>if <00:22:58.125>we <00:22:58.325>have <00:22:58.525>question <00:22:58.725>A

474
00:22:59.045 --> 00:23:03.765
<00:22:59.045>and <00:22:59.200>question <00:22:59.356>B, <00:22:59.511>can <00:22:59.667>we <00:22:59.822>find <00:22:59.978>out <00:23:00.133>if, <00:23:00.289>if, <00:23:00.445>uh,

475
00:23:03.875 --> 00:23:06.765
<00:23:03.875>answering <00:23:04.075>any <00:23:04.275>of <00:23:04.475>those <00:23:04.675>would <00:23:04.875>provide <00:23:05.075>the <00:23:05.275>same

476
00:23:06.785 --> 00:23:07.885
<00:23:06.785>amount <00:23:07.280>of <00:23:07.775>information?

477
00:23:08.315 --> 00:23:11.525
<00:23:08.315>What <00:23:08.431>that <00:23:08.548>would <00:23:08.665>don't <00:23:08.781>allow <00:23:08.898>us <00:23:09.015>to <00:23:09.131>do <00:23:09.248>would <00:23:09.365>be <00:23:09.481>to, <00:23:09.598>to, <00:23:09.715>um,

478
00:23:11.715 --> 00:23:16.445
<00:23:11.715>essentially <00:23:11.915>give <00:23:12.115>the, <00:23:12.314>give <00:23:12.514>the, <00:23:12.715>give <00:23:12.915>the <00:23:13.115>participants

479
00:23:16.585 --> 00:23:20.325
<00:23:16.585>or, <00:23:16.725>or <00:23:16.865>even <00:23:17.005>the, <00:23:17.145>the <00:23:17.285>organizers <00:23:17.425>of <00:23:17.565>the <00:23:17.705>meeting, <00:23:17.845>a <00:23:17.985>way

480
00:23:20.345 --> 00:23:22.485
<00:23:20.345>of <00:23:20.578>going <00:23:20.811>through <00:23:21.045>the <00:23:21.278>list <00:23:21.511>of <00:23:21.745>questions

481
00:23:22.865 --> 00:23:26.125
<00:23:22.865>and <00:23:23.005>then, <00:23:23.145>uh, <00:23:23.285>limiting <00:23:23.425>the <00:23:23.565>number <00:23:23.705>of <00:23:23.845>questions <00:23:23.985>we <00:23:24.125>would, <00:23:24.265>uh,

482
00:23:26.425 --> 00:23:27.725
<00:23:26.425>uh, <00:23:26.658>they <00:23:26.893>would <00:23:27.127>need <00:23:27.360>to <00:23:27.594>ask

483
00:23:27.725 --> 00:23:28.805
<00:23:27.725>because <00:23:28.049>we <00:23:28.373>would <00:23:28.697>know

484
00:23:28.805 --> 00:23:31.845
<00:23:28.805>that <00:23:29.038>answering <00:23:29.271>one <00:23:29.505>would <00:23:29.738>probably <00:23:29.971>ask <00:23:30.205>multiple.

485
00:23:33.235 --> 00:23:36.215
<00:23:33.235>And <00:23:33.409>so, <00:23:33.584>um, <00:23:33.760>this <00:23:33.935>kind <00:23:34.110>of <00:23:34.284>problem, <00:23:34.459>um, <00:23:34.635>is,

486
00:23:36.455 --> 00:23:39.415
<00:23:36.455>WW <00:23:36.735>is <00:23:37.014>what's <00:23:37.294>called <00:23:37.574>semantic <00:23:37.855>similarity.

487
00:23:39.875 --> 00:23:43.335
<00:23:39.875>And <00:23:40.002>the <00:23:40.129>birth, <00:23:40.256>birth <00:23:40.384>can <00:23:40.511>be <00:23:40.638>used <00:23:40.765>for <00:23:40.893>this <00:23:41.020>kind <00:23:41.147>of <00:23:41.275>problem.

488
00:23:43.835 --> 00:23:47.925
<00:23:43.835>The <00:23:43.962>way <00:23:44.089>we <00:23:44.216>would <00:23:44.344>use <00:23:44.471>it <00:23:44.598>is, <00:23:44.725>um, <00:23:44.853>is <00:23:44.980>nicely <00:23:45.107>outlined, <00:23:45.235>uh,

489
00:23:48.345 --> 00:23:50.685
<00:23:48.345>in <00:23:48.520>here <00:23:48.695>on <00:23:48.870>the, <00:23:49.045>uh, <00:23:49.220>on <00:23:49.395>the <00:23:49.570>left <00:23:49.745>side.

490
00:23:50.865 --> 00:23:53.605
<00:23:50.865>So <00:23:51.040>we <00:23:51.215>would <00:23:51.390>have <00:23:51.565>the <00:23:51.740>first <00:23:51.915>sentence <00:23:52.090>as <00:23:52.265>tokens.

491
00:23:53.905 --> 00:23:56.645
<00:23:53.905>Uh, <00:23:54.045>we <00:23:54.185>would <00:23:54.325>separate, <00:23:54.465>put <00:23:54.605>a <00:23:54.745>bit <00:23:54.885>of <00:23:55.024>a <00:23:55.165>separator <00:23:55.305>there,

492
00:23:56.865 --> 00:23:59.325
<00:23:56.865>we <00:23:57.020>would <00:23:57.176>put <00:23:57.331>the <00:23:57.487>second <00:23:57.642>sentence <00:23:57.798>as <00:23:57.953>tokens <00:23:58.109>in <00:23:58.265>there.

493
00:23:59.345 --> 00:24:03.205
<00:23:59.345>And <00:23:59.472>we, <00:23:59.599>it <00:23:59.726>would <00:23:59.854>again, <00:23:59.981>be <00:24:00.108>a <00:24:00.235>kind <00:24:00.363>of <00:24:00.490>a, <00:24:00.617>a, <00:24:00.745>um,

494
00:24:03.885 --> 00:24:06.445
<00:24:03.885>a <00:24:04.118>classification <00:24:04.351>problem <00:24:04.585>in <00:24:04.818>which <00:24:05.051>we <00:24:05.285>would

495
00:24:06.445 --> 00:24:07.725
<00:24:06.445>say, <00:24:06.829>is <00:24:07.213>this <00:24:07.597>similar?

496
00:24:08.105 --> 00:24:11.245
<00:24:08.105>Is, <00:24:08.260>is <00:24:08.416>sentence <00:24:08.571>one <00:24:08.727>similar <00:24:08.882>to <00:24:09.038>sentence <00:24:09.193>two <00:24:09.349>or <00:24:09.505>not?

497
00:24:11.865 --> 00:24:13.725
<00:24:11.865>The <00:24:12.065>problem <00:24:12.265>with <00:24:12.465>this <00:24:12.665>kind <00:24:12.865>of <00:24:13.065>approach <00:24:13.265>is

498
00:24:13.725 --> 00:24:15.165
<00:24:13.725>that <00:24:14.049>it <00:24:14.373>could <00:24:14.697>be <00:24:15.021>used,

499
00:24:15.165 --> 00:24:18.165
<00:24:15.165>but <00:24:15.320>it's <00:24:15.476>not <00:24:15.631>really <00:24:15.787>efficient <00:24:15.942>enough <00:24:16.098>using <00:24:16.253>this, <00:24:16.409>this <00:24:16.565>kind

500
00:24:18.165 --> 00:24:22.805
<00:24:18.165>of <00:24:18.365>approach, <00:24:18.565>um, <00:24:18.764>has, <00:24:18.965>uh, <00:24:19.165>uh, <00:24:19.365>quadr <00:24:19.565>complexity,

501
00:24:22.895 --> 00:24:27.245
<00:24:22.895>especially <00:24:23.022>in, <00:24:23.149>in, <00:24:23.276>in <00:24:23.404>terms <00:24:23.531>of <00:24:23.658>terms <00:24:23.785>of, <00:24:23.913>uh, <00:24:24.040>in <00:24:24.167>terms <00:24:24.295>of,

502
00:24:27.345 --> 00:24:29.525
<00:24:27.345>uh, <00:24:27.520>number <00:24:27.695>of <00:24:27.870>operations <00:24:28.045>we <00:24:28.220>would <00:24:28.395>need <00:24:28.570>to <00:24:28.745>do.

503
00:24:29.745 --> 00:24:32.645
<00:24:29.745>And <00:24:29.978>so <00:24:30.211>for, <00:24:30.445>uh, <00:24:30.678>a <00:24:30.911>hundred <00:24:31.145>questions,

504
00:24:32.745 --> 00:24:37.205
<00:24:32.745>we <00:24:32.919>are <00:24:33.094>essentially <00:24:33.270>looking <00:24:33.445>at, <00:24:33.620>uh, <00:24:33.794>5,000 <00:24:33.969>model <00:24:34.145>inferences,

505
00:24:37.235 --> 00:24:39.805
<00:24:37.235>5,000 <00:24:37.409>computations <00:24:37.584>we <00:24:37.760>would, <00:24:37.935>we <00:24:38.110>would <00:24:38.284>have <00:24:38.459>to <00:24:38.635>do.

506
00:24:40.225 --> 00:24:43.005
<00:24:40.225>And <00:24:40.399>so <00:24:40.574>with <00:24:40.750>any <00:24:40.925>any <00:24:41.100>further <00:24:41.274>question, <00:24:41.449>the <00:24:41.625>number,

507
00:24:43.545 --> 00:24:45.565
<00:24:43.545>uh, <00:24:44.245>rises <00:24:44.945>exponentially.

508
00:24:45.945 --> 00:24:48.485
<00:24:45.945>And <00:24:46.100>so <00:24:46.256>something <00:24:46.411>like <00:24:46.567>this <00:24:46.722>is <00:24:46.878>not <00:24:47.033>really <00:24:47.189>efficient <00:24:47.345>enough

509
00:24:48.585 --> 00:24:51.845
<00:24:48.585>for <00:24:48.740>our <00:24:48.896>real <00:24:49.051>time <00:24:49.207>and <00:24:49.362>real, <00:24:49.518>real <00:24:49.673>life <00:24:49.829>use <00:24:49.985>case.

510
00:24:52.185 --> 00:24:55.365
<00:24:52.185>And <00:24:52.312>so <00:24:52.439>we, <00:24:52.566>what, <00:24:52.694>what <00:24:52.821>the, <00:24:52.948>the <00:24:53.075>approach <00:24:53.203>we <00:24:53.330>would <00:24:53.457>need <00:24:53.585>to,

511
00:24:55.745 --> 00:24:59.005
<00:24:55.745>uh, <00:24:55.945>go <00:24:56.145>after <00:24:56.344>is <00:24:56.544>what's <00:24:56.745>called, <00:24:56.945>uh, <00:24:57.145>berg.

512
00:24:59.395 --> 00:25:01.605
<00:24:59.395>What <00:24:59.595>burg <00:24:59.795>does <00:24:59.995>is <00:25:00.195>that <00:25:00.395>it <00:25:00.595>take, <00:25:00.795>it,

513
00:25:01.605 --> 00:25:04.605
<00:25:01.605>it <00:25:01.805>uses <00:25:02.005>basically <00:25:02.205>the <00:25:02.405>very <00:25:02.605>same, <00:25:02.805>uh, <00:25:03.005>kind

514
00:25:04.605 --> 00:25:08.205
<00:25:04.605>of <00:25:04.780>approaches <00:25:04.955>we <00:25:05.130>saw <00:25:05.305>previously, <00:25:05.480>only <00:25:05.655>in <00:25:05.830>a <00:25:06.005>bit

515
00:25:08.205 --> 00:25:10.525
<00:25:08.205>of <00:25:08.405>a <00:25:08.605>different <00:25:08.804>way <00:25:09.004>in <00:25:09.205>which <00:25:09.405>sentence <00:25:09.605>A

516
00:25:10.625 --> 00:25:14.045
<00:25:10.625>and <00:25:10.780>sentence <00:25:10.936>B <00:25:11.091>go <00:25:11.247>through <00:25:11.402>through <00:25:11.558>the <00:25:11.713>bird <00:25:11.869>model <00:25:12.025>separately,

517
00:25:14.945 --> 00:25:17.805
<00:25:14.945>the <00:25:15.178>information <00:25:15.411>from <00:25:15.645>the <00:25:15.878>bird <00:25:16.111>model, <00:25:16.345>which,

518
00:25:17.805 --> 00:25:20.085
<00:25:17.805>which <00:25:18.005>bird <00:25:18.205>model <00:25:18.405>outputs <00:25:18.605>is <00:25:18.805>then <00:25:19.005>pulled <00:25:19.205>together.

519
00:25:20.905 --> 00:25:25.045
<00:25:20.905>And <00:25:21.032>the, <00:25:21.159>the, <00:25:21.286>the <00:25:21.414>final <00:25:21.541>result <00:25:21.668>is <00:25:21.795>a, <00:25:21.923>is <00:25:22.050>a <00:25:22.177>single <00:25:22.305>vector

520
00:25:25.315 --> 00:25:28.245
<00:25:25.315>that <00:25:25.548>represents <00:25:25.781>the <00:25:26.015>particular, <00:25:26.248>the <00:25:26.481>particular <00:25:26.715>sentence.

521
00:25:29.465 --> 00:25:32.525
<00:25:29.465>In <00:25:29.639>here <00:25:29.814>we <00:25:29.990>have <00:25:30.165>sentence <00:25:30.340>vectors, <00:25:30.514>U <00:25:30.689>and <00:25:30.865>V,

522
00:25:32.525 --> 00:25:34.685
<00:25:32.525>and <00:25:32.725>we <00:25:32.925>can <00:25:33.125>see <00:25:33.325>that <00:25:33.525>using <00:25:33.725>cosign <00:25:33.925>similarity,

523
00:25:34.685 --> 00:25:36.285
<00:25:34.685>we <00:25:34.965>can <00:25:35.245>then <00:25:35.524>compare <00:25:35.804>these <00:25:36.085>sentences

524
00:25:36.705 --> 00:25:40.925
<00:25:36.705>and, <00:25:36.821>uh, <00:25:36.938>uh, <00:25:37.054>uh, <00:25:37.171>we <00:25:37.288>get <00:25:37.405>a <00:25:37.521>kind <00:25:37.638>of <00:25:37.754>a <00:25:37.871>similarity <00:25:37.988>score <00:25:38.105>in

525
00:25:40.925 --> 00:25:43.685
<00:25:40.925>between, <00:25:41.158>in <00:25:41.391>between <00:25:41.625>these <00:25:41.858>two, <00:25:42.091>these <00:25:42.325>two,

526
00:25:43.685 --> 00:25:44.725
<00:25:43.685>uh, <00:25:43.996>these <00:25:44.309>two <00:25:44.620>sentences.

527
00:25:45.185 --> 00:25:47.165
<00:25:45.185>Oh, <00:25:45.360>and <00:25:45.534>what, <00:25:45.710>what <00:25:45.885>that <00:25:46.060>allows <00:25:46.235>us <00:25:46.409>to <00:25:46.585>do,

528
00:25:47.485 --> 00:25:49.365
<00:25:47.485>provided <00:25:47.718>that <00:25:47.951>we <00:25:48.185>have <00:25:48.418>some <00:25:48.651>nice, <00:25:48.885>uh,

529
00:25:49.525 --> 00:25:51.325
<00:25:49.525>indexing <00:25:49.991>infrastructure, <00:25:50.458>prepare <00:25:50.925>some,

530
00:25:51.325 --> 00:25:53.685
<00:25:51.325>some <00:25:51.500>nice <00:25:51.675>index <00:25:51.850>in <00:25:52.025>which <00:25:52.200>we <00:25:52.375>can <00:25:52.550>index <00:25:52.725>this,

531
00:25:54.185 --> 00:25:56.925
<00:25:54.185>the <00:25:54.340>in <00:25:54.496>which <00:25:54.651>we <00:25:54.807>can <00:25:54.962>put <00:25:55.118>these, <00:25:55.273>um, <00:25:55.429>these <00:25:55.585>vectors.

532
00:25:57.905 --> 00:26:01.995
<00:25:57.905>This <00:25:58.060>allows <00:25:58.216>us <00:25:58.371>to, <00:25:58.527>uh, <00:25:58.682>basically <00:25:58.838>massively <00:25:58.993>limit <00:25:59.149>the <00:25:59.305>number

533
00:26:01.995 --> 00:26:05.635
<00:26:01.995>of <00:26:02.150>computations <00:26:02.306>we <00:26:02.461>need <00:26:02.617>to <00:26:02.772>the, <00:26:02.928>to, <00:26:03.083>to <00:26:03.239>the <00:26:03.395>point

534
00:26:05.635 --> 00:26:08.355
<00:26:05.635>where <00:26:05.835>we <00:26:06.035>can <00:26:06.235>talk <00:26:06.435>about, <00:26:06.635>uh, <00:26:06.835>a <00:26:07.035>kind

535
00:26:08.355 --> 00:26:10.835
<00:26:08.355>of <00:26:08.530>just <00:26:08.705>linear <00:26:08.880>complexity <00:26:09.055>in, <00:26:09.230>in <00:26:09.405>terms <00:26:09.580>of <00:26:09.755>questions,

536
00:26:10.835 --> 00:26:14.395
<00:26:10.835>which <00:26:10.975>is <00:26:11.115>already <00:26:11.255>something, <00:26:11.395>uh, <00:26:11.535>we <00:26:11.675>can <00:26:11.815>work <00:26:11.955>with <00:26:12.095>even <00:26:12.235>in,

537
00:26:14.495 --> 00:26:16.755
<00:26:14.495>in, <00:26:14.774>uh, <00:26:15.054>in <00:26:15.334>a <00:26:15.614>real, <00:26:15.895>uh,

538
00:26:16.895 --> 00:26:19.435
<00:26:16.895>or <00:26:17.070>like <00:26:17.245>real <00:26:17.420>world <00:26:17.595>environment, <00:26:17.770>even <00:26:17.945>real <00:26:18.120>time <00:26:18.295>environment.

539
00:26:20.425 --> 00:26:22.475
<00:26:20.425>Alright? <00:26:20.658>There <00:26:20.891>is <00:26:21.125>still <00:26:21.358>a <00:26:21.591>problem <00:26:21.825>though.

540
00:26:22.935 --> 00:26:25.995
<00:26:22.935>The <00:26:23.110>pre-trained <00:26:23.284>s <00:26:23.460>bird <00:26:23.635>models <00:26:23.810>are <00:26:23.985>really <00:26:24.159>too <00:26:24.335>large

541
00:26:26.255 --> 00:26:27.395
<00:26:26.255>for, <00:26:26.511>for <00:26:26.768>our <00:26:27.024>use <00:26:27.281>cases.

542
00:26:27.395 --> 00:26:30.235
<00:26:27.395>Again, <00:26:27.535>we <00:26:27.675>can <00:26:27.815>see <00:26:27.955>that <00:26:28.095>the <00:26:28.235>breach <00:26:28.375>model <00:26:28.514>will, <00:26:28.655>will <00:26:28.795>find,

543
00:26:30.695 --> 00:26:33.915
<00:26:30.695>not <00:26:30.850>only <00:26:31.006>do <00:26:31.161>they <00:26:31.317>not <00:26:31.472>know <00:26:31.628>much <00:26:31.783>about <00:26:31.939>Slido <00:26:32.095>content

544
00:26:34.055 --> 00:26:36.515
<00:26:34.055>or <00:26:34.230>like <00:26:34.405>the, <00:26:34.580>the, <00:26:34.755>the <00:26:34.930>language <00:26:35.105>uses <00:26:35.280>Slido, <00:26:35.455>um,

545
00:26:36.695 --> 00:26:38.595
<00:26:36.695>and <00:26:36.928>for, <00:26:37.161>for, <00:26:37.395>for <00:26:37.628>Slido <00:26:37.861>type <00:26:38.095>events,

546
00:26:38.745 --> 00:26:41.875
<00:26:38.745>they <00:26:38.900>are <00:26:39.056>also <00:26:39.211>much <00:26:39.367>larger <00:26:39.522>than <00:26:39.678>the <00:26:39.833>limits <00:26:39.989>we, <00:26:40.145>we,

547
00:26:42.015 --> 00:26:45.045
<00:26:42.015>we <00:26:42.215>saw <00:26:42.415>already, <00:26:42.615>which <00:26:42.815>are <00:26:43.015>about <00:26:43.215>215 <00:26:43.415>megabytes

548
00:26:45.045 --> 00:26:46.525
<00:26:45.045>or <00:26:45.489>even <00:26:45.933>500 <00:26:46.377>megabytes.

549
00:26:47.305 --> 00:26:49.845
<00:26:47.305>And <00:26:47.445>so <00:26:47.585>what <00:26:47.725>we, <00:26:47.865>what <00:26:48.005>we <00:26:48.145>need <00:26:48.285>to <00:26:48.425>do, <00:26:48.565>uh, <00:26:48.705>is

550
00:26:49.845 --> 00:26:53.885
<00:26:49.845>to <00:26:49.985>basically <00:26:50.125>train <00:26:50.265>our <00:26:50.405>own <00:26:50.545>our <00:26:50.685>own <00:26:50.825>models, <00:26:50.965>which <00:26:51.105>with <00:26:51.245>the,

551
00:26:53.885 --> 00:26:56.925
<00:26:53.885>with <00:26:54.012>the <00:26:54.139>intent <00:26:54.266>for <00:26:54.394>them <00:26:54.521>to <00:26:54.648>be <00:26:54.775>at <00:26:54.903>least <00:26:55.030>a <00:26:55.157>bit <00:26:55.285>smaller.

552
00:26:57.305 --> 00:27:01.405
<00:26:57.305>And <00:26:57.432>so <00:26:57.559>how <00:26:57.686>we <00:26:57.814>could <00:26:57.941>go <00:26:58.068>about <00:26:58.195>doing <00:26:58.323>that, <00:26:58.450>uh, <00:26:58.577>is, <00:26:58.705>uh,

553
00:27:01.585 --> 00:27:05.325
<00:27:01.585>to <00:27:01.760>again, <00:27:01.935>try <00:27:02.110>take <00:27:02.285>these, <00:27:02.460>uh, <00:27:02.635>mobile <00:27:02.810>bird <00:27:02.985>and,

554
00:27:05.325 --> 00:27:07.725
<00:27:05.325>and <00:27:05.500>tiny <00:27:05.675>bird <00:27:05.850>kind <00:27:06.025>of <00:27:06.200>models, <00:27:06.375>these <00:27:06.550>smaller <00:27:06.725>models

555
00:27:08.065 --> 00:27:11.125
<00:27:08.065>and <00:27:08.240>see <00:27:08.415>we <00:27:08.590>can <00:27:08.765>try <00:27:08.940>train <00:27:09.115>those <00:27:09.290>from <00:27:09.465>scratch.

556
00:27:12.385 --> 00:27:15.565
<00:27:12.385>Not <00:27:12.525>only <00:27:12.665>can <00:27:12.805>we, <00:27:12.945>can <00:27:13.085>we, <00:27:13.225>uh, <00:27:13.365>try <00:27:13.504>them <00:27:13.645>from <00:27:13.785>scratch,

557
00:27:15.585 --> 00:27:18.245
<00:27:15.585>but <00:27:15.785>we <00:27:15.985>can <00:27:16.185>actually <00:27:16.385>use <00:27:16.585>a <00:27:16.785>very <00:27:16.985>same

558
00:27:18.665 --> 00:27:22.885
<00:27:18.665>or <00:27:18.865>like <00:27:19.065>very <00:27:19.264>similar <00:27:19.465>knowledge <00:27:19.665>distillation <00:27:19.865>approach, <00:27:20.065>um,

559
00:27:23.395 --> 00:27:25.285
<00:27:23.395>that, <00:27:23.628>that <00:27:23.861>we <00:27:24.095>used <00:27:24.328>in <00:27:24.561>the <00:27:24.795>previous,

560
00:27:25.425 --> 00:27:29.365
<00:27:25.425>in <00:27:25.552>the <00:27:25.679>previous <00:27:25.806>model <00:27:25.934>in <00:27:26.061>which <00:27:26.188>we <00:27:26.315>would <00:27:26.443>use <00:27:26.570>the, <00:27:26.697>the, <00:27:26.825>uh,

561
00:27:29.985 --> 00:27:34.325
<00:27:29.985>the <00:27:30.112>crossing <00:27:30.239>code <00:27:30.366>of <00:27:30.494>the <00:27:30.621>per <00:27:30.748>model, <00:27:30.875>which <00:27:31.003>we <00:27:31.130>got <00:27:31.257>both, <00:27:31.385>uh,

562
00:27:34.845 --> 00:27:37.965
<00:27:34.845>sentence <00:27:35.020>in <00:27:35.195>and <00:27:35.370>sentence <00:27:35.545>be <00:27:35.720>in <00:27:35.895>the <00:27:36.070>same <00:27:36.245>input.

563
00:27:38.305 --> 00:27:42.605
<00:27:38.305>We <00:27:38.421>can <00:27:38.538>use <00:27:38.655>this <00:27:38.771>kind <00:27:38.888>of, <00:27:39.005>uh, <00:27:39.121>this <00:27:39.238>kind <00:27:39.355>of <00:27:39.471>model, <00:27:39.588>uh, <00:27:39.705>to,

564
00:27:43.145 --> 00:27:47.525
<00:27:43.145>to <00:27:43.272>create <00:27:43.399>or <00:27:43.526>like <00:27:43.654>to, <00:27:43.781>to, <00:27:43.908>to <00:27:44.035>go <00:27:44.163>through <00:27:44.290>a <00:27:44.417>whole <00:27:44.545>bunch

565
00:27:47.545 --> 00:27:50.725
<00:27:47.545>of <00:27:47.778>question <00:27:48.011>pairs, <00:27:48.245>in <00:27:48.478>this <00:27:48.711>case <00:27:48.945>500,000,

566
00:27:50.985 --> 00:27:52.605
<00:27:50.985>uh, <00:27:51.685>thousand <00:27:52.385>pairs.

567
00:27:52.985 --> 00:27:56.245
<00:27:52.985>And, <00:27:53.159>uh, <00:27:53.334>by <00:27:53.510>doing <00:27:53.685>so, <00:27:53.860>it <00:27:54.034>can <00:27:54.209>prepare <00:27:54.385>kind

568
00:27:56.245 --> 00:28:00.485
<00:27:56.245>of <00:27:56.372>a <00:27:56.499>silver <00:27:56.626>data <00:27:56.754>set, <00:27:56.881>um, <00:27:57.008>which <00:27:57.135>is <00:27:57.263>say, <00:27:57.390>which <00:27:57.517>is, <00:27:57.645>um,

569
00:28:01.185 --> 00:28:03.125
<00:28:01.185>uh, <00:28:01.418>a, <00:28:01.651>a <00:28:01.885>data <00:28:02.118>set <00:28:02.351>of <00:28:02.585>questions,

570
00:28:03.175 --> 00:28:04.685
<00:28:03.175>which <00:28:03.446>we <00:28:03.718>don't <00:28:03.990>know <00:28:04.262>much <00:28:04.533>about,

571
00:28:05.145 --> 00:28:07.925
<00:28:05.145>but <00:28:05.345>we <00:28:05.545>assume <00:28:05.745>that <00:28:05.945>the, <00:28:06.145>the <00:28:06.345>ion <00:28:06.545>coder,

572
00:28:08.015 --> 00:28:11.885
<00:28:08.015>which <00:28:08.190>essentially <00:28:08.365>is <00:28:08.540>doing <00:28:08.715>a <00:28:08.890>simpler, <00:28:09.065>like, <00:28:09.240>uh, <00:28:09.415>fighting

573
00:28:11.885 --> 00:28:16.165
<00:28:11.885>with <00:28:12.012>the <00:28:12.139>simpler <00:28:12.266>task <00:28:12.394>in <00:28:12.521>which <00:28:12.648>you <00:28:12.775>get <00:28:12.903>the, <00:28:13.030>get <00:28:13.157>the, <00:28:13.285>uh,

574
00:28:16.165 --> 00:28:19.005
<00:28:16.165>contents <00:28:16.365>of <00:28:16.565>both <00:28:16.764>first <00:28:16.965>and <00:28:17.165>the <00:28:17.365>second <00:28:17.565>sentence.

575
00:28:19.065 --> 00:28:23.205
<00:28:19.065>And <00:28:19.205>then <00:28:19.345>you <00:28:19.485>only <00:28:19.625>need <00:28:19.765>to <00:28:19.905>need <00:28:20.045>to, <00:28:20.185>uh, <00:28:20.325>say <00:28:20.465>to

576
00:28:23.205 --> 00:28:25.765
<00:28:23.205>what <00:28:23.345>extent <00:28:23.485>are <00:28:23.625>we, <00:28:23.764>uh, <00:28:23.905>are, <00:28:24.044>are <00:28:24.185>these, <00:28:24.324>are <00:28:24.465>these <00:28:24.605>similar

577
00:28:25.905 --> 00:28:30.565
<00:28:25.905>or <00:28:26.032>not, <00:28:26.159>we <00:28:26.286>can <00:28:26.414>use <00:28:26.541>the <00:28:26.668>output, <00:28:26.795>uh, <00:28:26.923>from, <00:28:27.050>from <00:28:27.177>this <00:28:27.305>kind

578
00:28:30.565 --> 00:28:32.445
<00:28:30.565>of <00:28:30.845>model <00:28:31.125>as <00:28:31.405>the <00:28:31.685>silver <00:28:31.965>dataset.

579
00:28:32.825 --> 00:28:35.205
<00:28:32.825>And <00:28:33.025>we <00:28:33.225>can <00:28:33.425>then <00:28:33.625>use <00:28:33.825>the <00:28:34.025>same, <00:28:34.225>um,

580
00:28:35.235 --> 00:28:37.165
<00:28:35.235>knowledge <00:28:35.584>distillation <00:28:35.935>approach <00:28:36.284>as <00:28:36.635>we,

581
00:28:37.465 --> 00:28:39.325
<00:28:37.465>as <00:28:37.745>we <00:28:38.024>had <00:28:38.304>an <00:28:38.584>outlined <00:28:38.865>before.

582
00:28:39.625 --> 00:28:42.685
<00:28:39.625>So <00:28:39.752>in <00:28:39.879>principle, <00:28:40.006>what <00:28:40.134>we, <00:28:40.261>what <00:28:40.388>we <00:28:40.515>have <00:28:40.643>here <00:28:40.770>is <00:28:40.897>that <00:28:41.025>we'll,

583
00:28:42.685 --> 00:28:45.725
<00:28:42.685>uh, <00:28:42.885>we'll <00:28:43.085>fine <00:28:43.284>tune <00:28:43.485>the <00:28:43.685>large <00:28:43.885>bird <00:28:44.085>model,

584
00:28:45.725 --> 00:28:46.965
<00:28:45.725>which <00:28:46.004>we <00:28:46.283>cannot <00:28:46.562>really <00:28:46.841>use

585
00:28:46.965 --> 00:28:48.885
<00:28:46.965>because <00:28:47.165>that <00:28:47.365>would <00:28:47.564>be <00:28:47.764>all <00:28:47.965>too <00:28:48.165>expensive <00:28:48.365>in,

586
00:28:48.945 --> 00:28:51.005
<00:28:48.945>in <00:28:49.294>real <00:28:49.645>life <00:28:49.995>production <00:28:50.345>environment,

587
00:28:51.185 --> 00:28:52.445
<00:28:51.185>but <00:28:51.374>we <00:28:51.562>can <00:28:51.752>use <00:28:51.941>that <00:28:52.129>in <00:28:52.319>training.

588
00:28:53.065 --> 00:28:55.965
<00:28:53.065>We <00:28:53.240>use <00:28:53.415>this <00:28:53.590>large <00:28:53.765>model <00:28:53.940>to <00:28:54.115>create, <00:28:54.290>again, <00:28:54.465>kind

589
00:28:55.965 --> 00:28:57.125
<00:28:55.965>of <00:28:56.312>a <00:28:56.661>silver <00:28:57.009>dataset

590
00:28:57.385 --> 00:29:00.285
<00:28:57.385>and <00:28:57.618>using <00:28:57.851>the <00:28:58.085>silver <00:28:58.318>dataset, <00:28:58.551>uh, <00:28:58.785>we,

591
00:29:00.905 --> 00:29:03.805
<00:29:00.905>we <00:29:01.138>then <00:29:01.371>fine <00:29:01.605>tune <00:29:01.838>these <00:29:02.071>smaller <00:29:02.305>models

592
00:29:04.495 --> 00:29:07.805
<00:29:04.495>which <00:29:04.669>work <00:29:04.844>in <00:29:05.020>the <00:29:05.195>sentence <00:29:05.370>bird, <00:29:05.544>kind <00:29:05.719>of, <00:29:05.895>kind

593
00:29:07.805 --> 00:29:12.005
<00:29:07.805>of <00:29:07.932>a <00:29:08.059>way <00:29:08.186>which <00:29:08.314>only <00:29:08.441>have, <00:29:08.568>uh, <00:29:08.695>the, <00:29:08.823>the, <00:29:08.950>a <00:29:09.077>single <00:29:09.205>vector

594
00:29:12.505 --> 00:29:13.645
<00:29:12.505>as <00:29:12.847>as <00:29:13.189>their <00:29:13.531>output.

595
00:29:14.865 --> 00:29:17.605
<00:29:14.865>And <00:29:15.005>so, <00:29:15.145>uh, <00:29:15.285>this <00:29:15.425>is <00:29:15.565>what <00:29:15.705>it <00:29:15.845>looks <00:29:15.985>like <00:29:16.125>in <00:29:16.265>in,

596
00:29:17.605 --> 00:29:21.885
<00:29:17.605>in <00:29:17.745>pretty <00:29:17.885>pictures <00:29:18.025>again, <00:29:18.165>we, <00:29:18.305>uh, <00:29:18.445>first <00:29:18.585>do <00:29:18.725>the, <00:29:18.865>the <00:29:19.005>generic,

597
00:29:22.505 --> 00:29:25.885
<00:29:22.505>uh, <00:29:22.680>training <00:29:22.855>of <00:29:23.030>a, <00:29:23.205>of <00:29:23.380>a, <00:29:23.555>uh, <00:29:23.730>sentence <00:29:23.905>of,

598
00:29:25.885 --> 00:29:28.685
<00:29:25.885>of <00:29:26.040>a <00:29:26.196>sentence <00:29:26.351>bird <00:29:26.507>on, <00:29:26.662>on <00:29:26.818>the <00:29:26.973>standard <00:29:27.129>data <00:29:27.285>sets.

599
00:29:28.865 --> 00:29:30.485
<00:29:28.865>And <00:29:29.065>then <00:29:29.265>we <00:29:29.465>fine <00:29:29.665>tune <00:29:29.865>it <00:29:30.065>a <00:29:30.265>bit.

600
00:29:30.745 --> 00:29:33.085
<00:29:30.745>And <00:29:30.945>again, <00:29:31.145>exactly <00:29:31.344>as <00:29:31.544>we <00:29:31.745>saw <00:29:31.945>in <00:29:32.145>the,

601
00:29:33.085 --> 00:29:36.885
<00:29:33.085>in <00:29:33.225>the <00:29:33.365>previous <00:29:33.505>picture, <00:29:33.645>we <00:29:33.785>then <00:29:33.925>we <00:29:34.065>then, <00:29:34.205>uh, <00:29:34.345>deploy <00:29:34.485>this.

602
00:29:37.585 --> 00:29:40.045
<00:29:37.585>We <00:29:37.725>then <00:29:37.865>get <00:29:38.005>a <00:29:38.145>smaller <00:29:38.285>model, <00:29:38.425>which <00:29:38.565>we <00:29:38.705>can <00:29:38.845>then <00:29:38.985>deploy

603
00:29:40.425 --> 00:29:42.125
<00:29:40.425>to <00:29:40.774>some, <00:29:41.125>uh, <00:29:41.475>serverless <00:29:41.825>environment.

604
00:29:44.185 --> 00:29:45.885
<00:29:44.185>The <00:29:44.465>nice <00:29:44.745>thing <00:29:45.024>about <00:29:45.304>this <00:29:45.585>is

605
00:29:45.885 --> 00:29:48.765
<00:29:45.885>that <00:29:46.040>if <00:29:46.196>we <00:29:46.351>do <00:29:46.507>it <00:29:46.662>in <00:29:46.818>this <00:29:46.973>augmented <00:29:47.129>way, <00:29:47.285>in,

606
00:29:48.785 --> 00:29:51.365
<00:29:48.785>in <00:29:49.018>this <00:29:49.251>knowledge <00:29:49.485>distillation <00:29:49.718>way, <00:29:49.951>uh, <00:29:50.185>we,

607
00:29:51.545 --> 00:29:55.165
<00:29:51.545>we <00:29:51.685>also <00:29:51.825>get <00:29:51.965>a <00:29:52.105>bit <00:29:52.245>of <00:29:52.385>a <00:29:52.525>performance <00:29:52.665>boost <00:29:52.805>in <00:29:52.945>terms

608
00:29:55.165 --> 00:29:57.885
<00:29:55.165>of <00:29:55.292>a <00:29:55.419>metric, <00:29:55.546>which <00:29:55.674>we <00:29:55.801>don't <00:29:55.928>need <00:29:56.055>to <00:29:56.183>talk <00:29:56.310>talk <00:29:56.437>much <00:29:56.565>about.

609
00:29:58.385 --> 00:30:02.685
<00:29:58.385>But <00:29:58.512>if <00:29:58.639>we <00:29:58.766>compare <00:29:58.894>the, <00:29:59.021>the, <00:29:59.148>the, <00:29:59.275>uh, <00:29:59.403>the <00:29:59.530>bolded <00:29:59.657>line <00:29:59.785>here

610
00:30:02.985 --> 00:30:07.045
<00:30:02.985>and <00:30:03.112>the, <00:30:03.239>the, <00:30:03.366>all <00:30:03.494>the <00:30:03.621>other <00:30:03.748>lines, <00:30:03.875>uh, <00:30:04.003>other <00:30:04.130>lines <00:30:04.257>about <00:30:04.385>we,

611
00:30:07.185 --> 00:30:09.085
<00:30:07.185>we, <00:30:07.418>we <00:30:07.651>see <00:30:07.885>kind <00:30:08.118>of <00:30:08.351>an <00:30:08.585>improvement.

612
00:30:09.505 --> 00:30:13.285
<00:30:09.505>And <00:30:09.632>let <00:30:09.759>me <00:30:09.886>tell <00:30:10.014>you <00:30:10.141>that <00:30:10.268>improvement <00:30:10.395>is, <00:30:10.523>uh, <00:30:10.650>uh, <00:30:10.777>kind <00:30:10.905>of,

613
00:30:13.665 --> 00:30:16.565
<00:30:13.665>it <00:30:13.805>kind <00:30:13.945>of <00:30:14.085>shows <00:30:14.225>when <00:30:14.365>you <00:30:14.504>compare <00:30:14.645>those <00:30:14.784>two <00:30:14.925>models <00:30:15.065>on,

614
00:30:16.785 --> 00:30:21.285
<00:30:16.785>on <00:30:16.960>real, <00:30:17.135>um, <00:30:17.310>real <00:30:17.485>data <00:30:17.660>in, <00:30:17.835>in <00:30:18.010>real <00:30:18.185>environment.

615
00:30:21.995 --> 00:30:25.165
<00:30:21.995>Okay, <00:30:22.135>so <00:30:22.274>we <00:30:22.415>talked <00:30:22.554>a <00:30:22.695>bit <00:30:22.834>about <00:30:22.975>the <00:30:23.114>deployment <00:30:23.254>and <00:30:23.395>uh,

616
00:30:25.425 --> 00:30:27.845
<00:30:25.425>and <00:30:25.658>that's <00:30:25.891>probably, <00:30:26.125>uh, <00:30:26.358>that's <00:30:26.591>probably <00:30:26.825>one

617
00:30:27.845 --> 00:30:31.125
<00:30:27.845>of <00:30:27.985>the <00:30:28.125>most <00:30:28.265>important <00:30:28.405>things <00:30:28.545>we, <00:30:28.685>we <00:30:28.825>should <00:30:28.965>discuss <00:30:29.105>in <00:30:29.245>here.

618
00:30:32.215 --> 00:30:33.315
<00:30:32.215>And <00:30:32.413>so <00:30:32.610>let's <00:30:32.809>get <00:30:33.007>back <00:30:33.205>to,

619
00:30:33.445 --> 00:30:34.955
<00:30:33.445>let's <00:30:33.639>get <00:30:33.833>back <00:30:34.027>to <00:30:34.221>what <00:30:34.415>it <00:30:34.609>looked <00:30:34.803>like.

620
00:30:34.975 --> 00:30:38.475
<00:30:34.975>So <00:30:35.324>the, <00:30:35.675>the, <00:30:36.024>uh, <00:30:36.375>uh,

621
00:30:39.855 --> 00:30:42.395
<00:30:39.855>the <00:30:40.135>deployment <00:30:40.415>kind <00:30:40.695>of, <00:30:40.975>uh, <00:30:41.255>kind

622
00:30:42.395 --> 00:30:45.515
<00:30:42.395>of <00:30:42.535>environment <00:30:42.675>we <00:30:42.815>would <00:30:42.955>like <00:30:43.095>to <00:30:43.235>use <00:30:43.375>will <00:30:43.514>be <00:30:43.655>AWS <00:30:43.795>Lambda,

623
00:30:45.695 --> 00:30:49.595
<00:30:45.695>mostly <00:30:45.895>because, <00:30:46.095>uh, <00:30:46.294>Slido <00:30:46.495>stack <00:30:46.695>is, <00:30:46.895>is <00:30:47.095>on,

624
00:30:49.655 --> 00:30:51.315
<00:30:49.655>is <00:30:50.121>on <00:30:50.588>uses <00:30:51.055>AWS

625
00:30:51.495 --> 00:30:54.675
<00:30:51.495>and <00:30:51.695>AWS <00:30:51.895>Lambda <00:30:52.094>in <00:30:52.294>principle <00:30:52.495>is <00:30:52.695>a, <00:30:52.895>um,

626
00:30:55.215 --> 00:30:57.515
<00:30:55.215>and <00:30:55.448>is <00:30:55.681>a <00:30:55.915>nice <00:30:56.148>example <00:30:56.381>of <00:30:56.615>what,

627
00:30:57.545 --> 00:30:59.515
<00:30:57.545>what <00:30:57.825>serverless <00:30:58.105>environment <00:30:58.385>might <00:30:58.665>look <00:30:58.945>like,

628
00:31:00.235 --> 00:31:03.755
<00:31:00.235>although <00:31:00.435>we've <00:31:00.635>also <00:31:00.834>done <00:31:01.034>experiments <00:31:01.235>in, <00:31:01.435>in, <00:31:01.635>uh,

629
00:31:05.055 --> 00:31:07.795
<00:31:05.055>in, <00:31:05.335>in, <00:31:05.615>uh, <00:31:05.895>Google <00:31:06.175>Cloud <00:31:06.455>platform.

630
00:31:08.815 --> 00:31:13.035
<00:31:08.815>And <00:31:08.990>so <00:31:09.165>for <00:31:09.340>the, <00:31:09.515>for, <00:31:09.690>uh, <00:31:09.865>for <00:31:10.040>the <00:31:10.215>sake

631
00:31:13.035 --> 00:31:15.515
<00:31:13.035>of <00:31:13.190>having <00:31:13.346>only <00:31:13.501>only <00:31:13.657>single <00:31:13.812>platform <00:31:13.968>to, <00:31:14.123>to <00:31:14.279>talk <00:31:14.435>about,

632
00:31:15.725 --> 00:31:18.555
<00:31:15.725>let's, <00:31:15.925>let's <00:31:16.125>take <00:31:16.324>AWS <00:31:16.524>Lambda, <00:31:16.725>which <00:31:16.925>has <00:31:17.125>25

633
00:31:18.655 --> 00:31:21.435
<00:31:18.655>to <00:31:18.888>250 <00:31:19.121>megabyte <00:31:19.355>limit <00:31:19.588>for <00:31:19.821>the <00:31:20.055>size

634
00:31:21.435 --> 00:31:22.755
<00:31:21.435>of <00:31:21.633>the, <00:31:21.831>of <00:31:22.029>the, <00:31:22.227>of <00:31:22.425>the <00:31:22.623>package.

635
00:31:23.455 --> 00:31:26.755
<00:31:23.455>Now <00:31:23.629>we've <00:31:23.804>managed <00:31:23.980>to <00:31:24.155>go <00:31:24.330>down <00:31:24.504>with <00:31:24.679>model <00:31:24.855>sizes

636
00:31:26.755 --> 00:31:28.915
<00:31:26.755>to <00:31:26.988>roughly <00:31:27.221>60 <00:31:27.455>megabytes, <00:31:27.688>which <00:31:27.921>is <00:31:28.155>great.

637
00:31:29.295 --> 00:31:32.635
<00:31:29.295>But <00:31:29.470>then <00:31:29.645>again, <00:31:29.820>there <00:31:29.995>iSpy, <00:31:30.170>which <00:31:30.345>we <00:31:30.520>need <00:31:30.695>for,

638
00:31:32.735 --> 00:31:35.595
<00:31:32.735>for <00:31:33.014>inference, <00:31:33.294>that's <00:31:33.574>like <00:31:33.854>400 <00:31:34.135>megabytes.

639
00:31:35.695 --> 00:31:37.355
<00:31:35.695>And <00:31:35.895>then <00:31:36.095>there <00:31:36.294>are <00:31:36.495>other <00:31:36.695>packages, <00:31:36.895>you <00:31:37.095>know,

640
00:31:37.355 --> 00:31:38.435
<00:31:37.355>like <00:31:37.841>utility <00:31:38.327>packages

641
00:31:38.435 --> 00:31:41.395
<00:31:38.435>and <00:31:38.575>whatnot, <00:31:38.715>which, <00:31:38.855>which <00:31:38.995>we <00:31:39.135>need <00:31:39.274>for <00:31:39.415>that <00:31:39.554>to, <00:31:39.695>to <00:31:39.835>kind

642
00:31:41.395 --> 00:31:45.155
<00:31:41.395>of <00:31:41.522>clean <00:31:41.649>up <00:31:41.776>the, <00:31:41.904>uh, <00:31:42.031>clean <00:31:42.158>up <00:31:42.285>the <00:31:42.413>environment, <00:31:42.540>um, <00:31:42.667>or, <00:31:42.795>uh,

643
00:31:45.255 --> 00:31:47.915
<00:31:45.255>or <00:31:45.382>basically <00:31:45.509>take, <00:31:45.636>take <00:31:45.764>care <00:31:45.891>of, <00:31:46.018>of <00:31:46.145>the <00:31:46.273>inputs <00:31:46.400>and <00:31:46.527>so <00:31:46.655>on.

644
00:31:48.095 --> 00:31:49.275
<00:31:48.095>So <00:31:48.272>what <00:31:48.449>do <00:31:48.626>we <00:31:48.803>do <00:31:48.980>about <00:31:49.157>that?

645
00:31:49.425 --> 00:31:53.955
<00:31:49.425>Well, <00:31:49.552>thankfully <00:31:49.679>it <00:31:49.806>turns <00:31:49.934>out <00:31:50.061>there <00:31:50.188>is <00:31:50.315>a <00:31:50.443>way <00:31:50.570>of, <00:31:50.697>of, <00:31:50.825>uh,

646
00:31:54.185 --> 00:31:57.635
<00:31:54.185>essentially <00:31:54.340>not <00:31:54.496>using <00:31:54.651>PyTorch, <00:31:54.807>which <00:31:54.962>we <00:31:55.118>do <00:31:55.273>not <00:31:55.429>need, <00:31:55.585>well,

647
00:31:57.635 --> 00:31:59.155
<00:31:57.635>needs <00:31:57.908>to <00:31:58.182>or <00:31:58.455>want <00:31:58.729>to <00:31:59.003>mostly

648
00:31:59.155 --> 00:32:01.475
<00:31:59.155>because <00:31:59.621>PyTorch <00:32:00.088>is <00:32:00.555>a,

649
00:32:01.535 --> 00:32:04.355
<00:32:01.535>is <00:32:01.735>literally <00:32:01.935>a <00:32:02.135>full <00:32:02.335>fledged <00:32:02.535>deep <00:32:02.735>learning <00:32:02.935>framework,

650
00:32:04.365 --> 00:32:07.075
<00:32:04.365>which <00:32:04.492>is <00:32:04.619>all <00:32:04.746>we, <00:32:04.874>uh, <00:32:05.001>which <00:32:05.128>is <00:32:05.255>kind <00:32:05.383>of <00:32:05.510>different <00:32:05.637>thing <00:32:05.765>from

651
00:32:07.075 --> 00:32:08.275
<00:32:07.075>what <00:32:07.291>we <00:32:07.507>need <00:32:07.723>right <00:32:07.939>now, <00:32:08.155>right?

652
00:32:08.345 --> 00:32:11.315
<00:32:08.345>Like, <00:32:08.545>what <00:32:08.745>do <00:32:08.945>we <00:32:09.145>need <00:32:09.345>essentially <00:32:09.545>is <00:32:09.745>just

653
00:32:11.375 --> 00:32:13.995
<00:32:11.375>to <00:32:11.550>do <00:32:11.725>very <00:32:11.900>quick <00:32:12.075>inference, <00:32:12.250>and <00:32:12.425>that's <00:32:12.600>about <00:32:12.775>it.

654
00:32:14.535 --> 00:32:16.975
<00:32:14.535>And <00:32:14.885>so, <00:32:15.235>uh, <00:32:15.585>the, <00:32:15.935>the,

655
00:32:17.115 --> 00:32:20.215
<00:32:17.115>the <00:32:17.290>model <00:32:17.465>inference <00:32:17.640>engine <00:32:17.815>we've <00:32:17.990>used <00:32:18.165>is <00:32:18.340>called <00:32:18.515>the

656
00:32:21.065 --> 00:32:22.785
<00:32:21.065>ONNX <00:32:21.765>runtime <00:32:22.465>Library.

657
00:32:23.425 --> 00:32:27.505
<00:32:23.425>O-N-N-X-I <00:32:23.625>believe <00:32:23.825>stands <00:32:24.024>for <00:32:24.225>Open <00:32:24.425>Neural <00:32:24.625>Network <00:32:24.825>Exchange,

658
00:32:28.005 --> 00:32:32.745
<00:32:28.005>um, <00:32:28.160>which <00:32:28.316>is <00:32:28.471>an, <00:32:28.627>an <00:32:28.782>initiative <00:32:28.938>spearheaded <00:32:29.093>by, <00:32:29.249>by <00:32:29.405>Microsoft.

659
00:32:33.045 --> 00:32:35.185
<00:32:33.045>The <00:32:33.395>models <00:32:33.745>are <00:32:34.095>essentially <00:32:34.445>profiles.

660
00:32:35.285 --> 00:32:39.765
<00:32:35.285>So <00:32:35.412>they <00:32:35.539>are <00:32:35.666>very, <00:32:35.794>very, <00:32:35.921>uh, <00:32:36.048>very <00:32:36.175>fast <00:32:36.303>to <00:32:36.430>load <00:32:36.557>and, <00:32:36.685>and,

661
00:32:39.765 --> 00:32:43.005
<00:32:39.765>and <00:32:39.940>work <00:32:40.115>with, <00:32:40.290>and <00:32:40.465>also <00:32:40.640>a <00:32:40.815>tiny <00:32:40.990>bit <00:32:41.165>smaller.

662
00:32:43.185 --> 00:32:44.965
<00:32:43.185>But <00:32:43.418>what's <00:32:43.651>most <00:32:43.885>important <00:32:44.118>about <00:32:44.351>this <00:32:44.585>is

663
00:32:44.965 --> 00:32:48.405
<00:32:44.965>that <00:32:45.139>the <00:32:45.314>whole <00:32:45.490>ONNX <00:32:45.665>library <00:32:45.840>is <00:32:46.014>about <00:32:46.189>14 <00:32:46.365>megabytes,

664
00:32:48.735 --> 00:32:50.685
<00:32:48.735>which <00:32:48.935>is <00:32:49.135>very <00:32:49.334>nice <00:32:49.534>for <00:32:49.735>our <00:32:49.935>use <00:32:50.135>case

665
00:32:50.685 --> 00:32:51.965
<00:32:50.685>because <00:32:50.915>that's <00:32:51.145>exactly <00:32:51.376>what <00:32:51.606>we <00:32:51.837>need.

666
00:32:51.965 --> 00:32:54.765
<00:32:51.965>We <00:32:52.105>need <00:32:52.245>the, <00:32:52.385>the, <00:32:52.524>the, <00:32:52.665>the <00:32:52.804>kind <00:32:52.945>of <00:32:53.084>utilities <00:32:53.225>and, <00:32:53.365>and,

667
00:32:54.785 --> 00:32:59.205
<00:32:54.785>and <00:32:54.912>all <00:32:55.039>the <00:32:55.166>other, <00:32:55.294>all <00:32:55.421>the <00:32:55.548>other <00:32:55.675>things, <00:32:55.803>um, <00:32:55.930>to, <00:32:56.057>to, <00:32:56.185>uh,

668
00:32:59.625 --> 00:33:03.005
<00:32:59.625>to <00:32:59.752>feel <00:32:59.879>that, <00:33:00.006>uh, <00:33:00.134>or <00:33:00.261>like <00:33:00.388>to <00:33:00.515>fit <00:33:00.643>within, <00:33:00.770>within <00:33:00.897>that <00:33:01.025>limit.

669
00:33:03.345 --> 00:33:06.165
<00:33:03.345>And <00:33:03.472>the <00:33:03.599>14 <00:33:03.726>megabytes <00:33:03.854>is <00:33:03.981>something, <00:33:04.108>uh, <00:33:04.235>we <00:33:04.363>should <00:33:04.490>be <00:33:04.617>able <00:33:04.745>to,

670
00:33:07.155 --> 00:33:10.975
<00:33:07.155>we <00:33:07.295>should <00:33:07.435>be <00:33:07.575>able <00:33:07.715>to, <00:33:07.855>to, <00:33:07.995>uh, <00:33:08.135>afford <00:33:08.274>quite, <00:33:08.415>quite <00:33:08.555>nicely.

671
00:33:11.515 --> 00:33:13.375
<00:33:11.515>So <00:33:11.795>when <00:33:12.075>we <00:33:12.355>then <00:33:12.635>deploy <00:33:12.915>these,

672
00:33:13.795 --> 00:33:16.695
<00:33:13.795>and <00:33:13.950>this <00:33:14.106>is <00:33:14.261>foreign, <00:33:14.417>this <00:33:14.572>is <00:33:14.728>a, <00:33:14.883>a <00:33:15.039>graph <00:33:15.195>of,

673
00:33:16.795 --> 00:33:21.575
<00:33:16.795>of <00:33:16.935>using <00:33:17.075>tiny <00:33:17.215>bird, <00:33:17.355>uh, <00:33:17.495>for, <00:33:17.635>uh, <00:33:17.775>for <00:33:17.915>sentiment <00:33:18.055>analysis <00:33:18.195>and,

674
00:33:21.915 --> 00:33:25.335
<00:33:21.915>and, <00:33:22.070>uh, <00:33:22.226>uh, <00:33:22.381>and <00:33:22.537>also <00:33:22.692>mobile <00:33:22.848>bird <00:33:23.003>for <00:33:23.159>sentiment <00:33:23.315>analysis.

675
00:33:25.335 --> 00:33:28.615
<00:33:25.335>In, <00:33:25.475>in, <00:33:25.615>in <00:33:25.755>AWS <00:33:25.895>Lambda, <00:33:26.035>you <00:33:26.175>can <00:33:26.315>see <00:33:26.455>an <00:33:26.595>interesting <00:33:26.735>thing,

676
00:33:28.715 --> 00:33:29.815
<00:33:28.715>uh, <00:33:29.045>happening <00:33:29.375>in <00:33:29.705>here.

677
00:33:29.875 --> 00:33:32.575
<00:33:29.875>So <00:33:30.030>one <00:33:30.186>of <00:33:30.341>the <00:33:30.497>few <00:33:30.652>parameters <00:33:30.808>you <00:33:30.963>can <00:33:31.119>actually <00:33:31.275>set

678
00:33:32.575 --> 00:33:33.935
<00:33:32.575>for <00:33:32.983>your <00:33:33.391>Lambda <00:33:33.799>function,

679
00:33:34.315 --> 00:33:36.615
<00:33:34.315>or <00:33:34.595>like <00:33:34.875>serverless, <00:33:35.155>serverless <00:33:35.435>function <00:33:35.715>generally,

680
00:33:36.915 --> 00:33:40.695
<00:33:36.915>is <00:33:37.070>the <00:33:37.226>amount <00:33:37.381>of <00:33:37.537>allocated <00:33:37.692>ram <00:33:37.848>That's <00:33:38.003>particularly <00:33:38.159>the <00:33:38.315>case

681
00:33:40.915 --> 00:33:43.895
<00:33:40.915>in, <00:33:41.090>in <00:33:41.264>case <00:33:41.440>of, <00:33:41.615>uh, <00:33:41.790>AWS <00:33:41.965>as <00:33:42.139>well <00:33:42.315>as,

682
00:33:43.915 --> 00:33:45.095
<00:33:43.915>uh, <00:33:44.269>Google <00:33:44.623>Cloud <00:33:44.977>platform.

683
00:33:45.435 --> 00:33:47.455
<00:33:45.435>And <00:33:45.784>though <00:33:46.135>the <00:33:46.485>more, <00:33:46.835>uh,

684
00:33:47.915 --> 00:33:51.735
<00:33:47.915>the <00:33:48.055>more <00:33:48.195>ram <00:33:48.335>you <00:33:48.475>allocate <00:33:48.615>turns <00:33:48.754>out, <00:33:48.895>the <00:33:49.034>more <00:33:49.175>virtual <00:33:49.315>CPUs,

685
00:33:52.075 --> 00:33:54.935
<00:33:52.075>uh, <00:33:52.275>will <00:33:52.475>your <00:33:52.675>code <00:33:52.875>get <00:33:53.075>essentially <00:33:53.275>access <00:33:53.475>to.

686
00:33:55.235 --> 00:33:57.935
<00:33:55.235>And <00:33:55.362>that's <00:33:55.489>also <00:33:55.616>what <00:33:55.744>we <00:33:55.871>can <00:33:55.998>see <00:33:56.125>in <00:33:56.253>this <00:33:56.380>graph, <00:33:56.507>which <00:33:56.635>shows

687
00:33:57.965 --> 00:34:02.375
<00:33:57.965>that, <00:33:58.105>um, <00:33:58.245>the, <00:33:58.385>the, <00:33:58.524>the, <00:33:58.665>the <00:33:58.804>more, <00:33:58.945>uh, <00:33:59.084>ram <00:33:59.225>we <00:33:59.365>allocate,

688
00:34:02.795 --> 00:34:05.175
<00:34:02.795>the <00:34:03.145>lower <00:34:03.495>the, <00:34:03.845>the <00:34:04.195>median

689
00:34:05.315 --> 00:34:08.655
<00:34:05.315>or <00:34:05.595>95th <00:34:05.875>to <00:34:06.155>90, <00:34:06.435>99th <00:34:06.715>percentile

690
00:34:08.875 --> 00:34:10.895
<00:34:08.875>of <00:34:09.225>ex <00:34:09.574>execution <00:34:09.925>time <00:34:10.275>gets.

691
00:34:11.835 --> 00:34:13.935
<00:34:11.835>And, <00:34:11.990>uh, <00:34:12.146>the, <00:34:12.301>the <00:34:12.457>nice <00:34:12.612>thing <00:34:12.768>in <00:34:12.923>here, <00:34:13.079>which <00:34:13.235>is

692
00:34:13.935 --> 00:34:15.415
<00:34:13.935>what <00:34:14.101>I <00:34:14.268>mostly <00:34:14.434>want <00:34:14.601>to <00:34:14.767>say <00:34:14.933>that <00:34:15.100>is <00:34:15.266>that

693
00:34:15.435 --> 00:34:18.535
<00:34:15.435>around <00:34:15.634>the <00:34:15.835>one <00:34:16.034>gigabyte <00:34:16.235>line, <00:34:16.435>we <00:34:16.634>get <00:34:16.835>under,

694
00:34:18.745 --> 00:34:20.575
<00:34:18.745>under <00:34:19.094>a <00:34:19.444>hundred <00:34:19.795>milliseconds, <00:34:20.145>even

695
00:34:20.635 --> 00:34:24.135
<00:34:20.635>for <00:34:20.790>the <00:34:20.946>larger <00:34:21.101>mobile <00:34:21.257>bird <00:34:21.412>model, <00:34:21.568>which <00:34:21.723>basically <00:34:21.879>tells <00:34:22.035>us

696
00:34:24.135 --> 00:34:26.415
<00:34:24.135>that, <00:34:24.310>uh, <00:34:24.485>a <00:34:24.660>hundred, <00:34:24.835>a <00:34:25.010>hundred <00:34:25.185>milliseconds <00:34:25.360>is <00:34:25.535>kind

697
00:34:26.415 --> 00:34:28.415
<00:34:26.415>of <00:34:26.614>a <00:34:26.815>line, <00:34:27.014>uh, <00:34:27.215>which <00:34:27.415>we <00:34:27.614>are <00:34:27.815>willing

698
00:34:28.415 --> 00:34:31.135
<00:34:28.415>to <00:34:28.570>tolerate <00:34:28.726>in <00:34:28.881>production <00:34:29.037>at <00:34:29.192>least, <00:34:29.348>at <00:34:29.503>least <00:34:29.659>at <00:34:29.815>slide,

699
00:34:31.195 --> 00:34:32.295
<00:34:31.195>at <00:34:31.442>least <00:34:31.690>for <00:34:31.937>the <00:34:32.185>experiments.

700
00:34:32.515 --> 00:34:33.655
<00:34:32.514>We <00:34:32.685>are <00:34:32.857>running <00:34:33.028>a <00:34:33.199>s <00:34:33.370>slide <00:34:33.541>now,

701
00:34:33.955 --> 00:34:36.615
<00:34:33.955>and <00:34:34.094>this <00:34:34.235>kind <00:34:34.375>of <00:34:34.514>shows <00:34:34.654>that <00:34:34.795>we <00:34:34.935>can <00:34:35.074>get <00:34:35.215>there, <00:34:35.355>even

702
00:34:36.885 --> 00:34:40.615
<00:34:36.885>with <00:34:37.085>fairly, <00:34:37.285>uh, <00:34:37.485>fairly <00:34:37.685>limited <00:34:37.885>resources <00:34:38.085>for <00:34:38.285>the,

703
00:34:40.795 --> 00:34:43.455
<00:34:40.795>for <00:34:41.075>the <00:34:41.355>particular, <00:34:41.635>um, <00:34:41.915>serverless <00:34:42.195>deployments.

704
00:34:44.565 --> 00:34:47.695
<00:34:44.565>Similarly, <00:34:44.740>and <00:34:44.915>we <00:34:45.090>can <00:34:45.264>see <00:34:45.440>a <00:34:45.615>fairly <00:34:45.790>similar, <00:34:45.965>uh,

705
00:34:47.875 --> 00:34:52.455
<00:34:47.875>fairly <00:34:48.030>similar <00:34:48.186>example <00:34:48.341>in <00:34:48.497>the, <00:34:48.652>uh, <00:34:48.808>mobile, <00:34:48.963>in <00:34:49.119>the, <00:34:49.275>uh,

706
00:34:53.055 --> 00:34:56.535
<00:34:53.054>s <00:34:53.210>mobile <00:34:53.366>bird, <00:34:53.521>meaning <00:34:53.677>the, <00:34:53.832>the <00:34:53.988>model <00:34:54.143>that <00:34:54.299>takes <00:34:54.455>care

707
00:34:56.535 --> 00:34:58.615
<00:34:56.534>of <00:34:56.768>the <00:34:57.001>similar <00:34:57.234>questions <00:34:57.468>kind <00:34:57.701>of <00:34:57.935>problem.

708
00:34:58.915 --> 00:35:00.495
<00:34:58.915>And <00:34:59.265>in <00:34:59.615>there, <00:34:59.965>since <00:35:00.315>the,

709
00:35:00.625 --> 00:35:04.495
<00:35:00.625>since <00:35:00.800>the <00:35:00.975>modeler <00:35:01.150>is <00:35:01.325>essentially <00:35:01.500>a <00:35:01.675>bit <00:35:01.850>simpler, <00:35:02.025>uh,

710
00:35:04.675 --> 00:35:09.415
<00:35:04.675>we <00:35:04.830>can <00:35:04.986>go <00:35:05.141>even <00:35:05.297>under, <00:35:05.452>under <00:35:05.608>50, <00:35:05.763>uh, <00:35:05.919>under, <00:35:06.075>under,

711
00:35:09.415 --> 00:35:14.135
<00:35:09.415>under <00:35:09.590>50 <00:35:09.765>milliseconds <00:35:09.940>in <00:35:10.115>some, <00:35:10.290>in <00:35:10.465>some <00:35:10.640>RAM <00:35:10.815>configurations.

712
00:35:14.725 --> 00:35:16.175
<00:35:14.725>What <00:35:14.942>I <00:35:15.160>wanted <00:35:15.377>to <00:35:15.595>say <00:35:15.812>in <00:35:16.030>here,

713
00:35:16.235 --> 00:35:19.055
<00:35:16.235>or <00:35:16.375>I <00:35:16.515>would <00:35:16.655>like <00:35:16.795>to <00:35:16.935>kind <00:35:17.075>of <00:35:17.215>emphasize <00:35:17.355>in <00:35:17.495>here, <00:35:17.635>is

714
00:35:19.055 --> 00:35:21.805
<00:35:19.055>that <00:35:19.335>there <00:35:19.615>is <00:35:19.895>a <00:35:20.174>good <00:35:20.455>reason,

715
00:35:21.905 --> 00:35:26.845
<00:35:21.905>or <00:35:22.021>like <00:35:22.138>a, <00:35:22.255>a, <00:35:22.371>a, <00:35:22.488>a, <00:35:22.605>a <00:35:22.721>good <00:35:22.838>chance <00:35:22.955>that <00:35:23.071>for <00:35:23.188>some <00:35:23.305>deployments,

716
00:35:27.155 --> 00:35:31.445
<00:35:27.155>this <00:35:27.310>even <00:35:27.466>makes <00:35:27.621>the <00:35:27.777>serverless <00:35:27.932>environment <00:35:28.088>a <00:35:28.243>bit <00:35:28.399>more <00:35:28.555>cost

717
00:35:31.445 --> 00:35:33.365
<00:35:31.445>effective <00:35:31.911>than, <00:35:32.378>than, <00:35:32.845>uh,

718
00:35:33.555 --> 00:35:37.645
<00:35:33.555>than <00:35:33.730>like <00:35:33.904>renting <00:35:34.080>a <00:35:34.254>small <00:35:34.430>server <00:35:34.605>on <00:35:34.779>AWS, <00:35:34.955>uh,

719
00:35:37.645 --> 00:35:42.165
<00:35:37.645>the <00:35:37.772>smallest <00:35:37.899>one <00:35:38.026>you <00:35:38.154>can <00:35:38.281>find <00:35:38.408>currently <00:35:38.535>is <00:35:38.663>about <00:35:38.790>12, <00:35:38.917>say <00:35:39.045>12,

720
00:35:42.295 --> 00:35:47.245
<00:35:42.295>maybe, <00:35:42.435>maybe <00:35:42.575>$15, <00:35:42.715>uh, <00:35:42.855>per <00:35:42.995>month <00:35:43.135>for <00:35:43.275>one <00:35:43.415>gigabyte <00:35:43.555>of <00:35:43.695>ram.

721
00:35:47.705 --> 00:35:52.405
<00:35:47.705>Um, <00:35:47.860>if <00:35:48.016>you <00:35:48.171>do <00:35:48.327>million <00:35:48.482>executions <00:35:48.638>on <00:35:48.793>AWS <00:35:48.949>Lambda <00:35:49.105>for,

722
00:35:52.585 --> 00:35:56.125
<00:35:52.585>uh, <00:35:52.818>for, <00:35:53.051>uh, <00:35:53.285>with <00:35:53.518>Lambda <00:35:53.751>that <00:35:53.985>has

723
00:35:58.385 --> 00:36:02.525
<00:35:58.385>one <00:35:58.512>gigabyte <00:35:58.639>of <00:35:58.766>ram, <00:35:58.894>you <00:35:59.021>are <00:35:59.148>looking <00:35:59.275>at <00:35:59.403>about <00:35:59.530>eight, <00:35:59.657>$8 <00:35:59.785>of,

724
00:36:02.625 --> 00:36:03.645
<00:36:02.625>uh, <00:36:02.931>in, <00:36:03.237>in <00:36:03.543>costs.

725
00:36:04.345 --> 00:36:07.405
<00:36:04.345>So, <00:36:04.472>um, <00:36:04.599>if <00:36:04.726>I <00:36:04.854>had <00:36:04.981>to <00:36:05.108>sign <00:36:05.235>it <00:36:05.363>up, <00:36:05.490>it <00:36:05.617>would <00:36:05.745>be,

726
00:36:07.465 --> 00:36:09.605
<00:36:07.465>it <00:36:07.745>would <00:36:08.025>be <00:36:08.305>something, <00:36:08.585>something, <00:36:08.865>uh,

727
00:36:09.605 --> 00:36:10.805
<00:36:09.605>something <00:36:09.965>like <00:36:10.325>the <00:36:10.685>following.

728
00:36:11.145 --> 00:36:12.565
<00:36:11.145>Um, <00:36:11.571>in <00:36:11.997>our <00:36:12.423>experience,

729
00:36:12.625 --> 00:36:15.845
<00:36:12.625>it <00:36:12.800>does <00:36:12.975>seem <00:36:13.150>like <00:36:13.325>doing <00:36:13.500>serverless <00:36:13.675>deployment <00:36:13.850>is <00:36:14.025>kind

730
00:36:15.845 --> 00:36:19.285
<00:36:15.845>of <00:36:15.984>possible <00:36:16.125>with, <00:36:16.265>with <00:36:16.404>these <00:36:16.544>kind <00:36:16.685>of <00:36:16.825>per, <00:36:16.964>even <00:36:17.105>the <00:36:17.245>larger,

731
00:36:19.375 --> 00:36:21.525
<00:36:19.375>let's <00:36:19.655>call <00:36:19.935>them <00:36:20.215>versatile <00:36:20.495>models, <00:36:20.775>um,

732
00:36:22.015 --> 00:36:24.365
<00:36:22.015>decreasing <00:36:22.214>the <00:36:22.415>model <00:36:22.615>size <00:36:22.815>is <00:36:23.015>of <00:36:23.214>the <00:36:23.415>essence.

733
00:36:24.385 --> 00:36:26.245
<00:36:24.385>That's <00:36:24.618>the, <00:36:24.851>that's <00:36:25.085>the <00:36:25.318>most <00:36:25.551>important <00:36:25.785>thing

734
00:36:26.475 --> 00:36:28.005
<00:36:26.475>essentially <00:36:26.750>that <00:36:27.025>we <00:36:27.301>need <00:36:27.576>to <00:36:27.852>do.

735
00:36:28.305 --> 00:36:30.805
<00:36:28.305>And, <00:36:28.480>uh, <00:36:28.654>what <00:36:28.830>worked <00:36:29.004>very <00:36:29.180>nicely <00:36:29.355>for <00:36:29.529>us <00:36:29.705>was

736
00:36:30.805 --> 00:36:33.205
<00:36:30.805>to <00:36:31.154>use <00:36:31.504>knowledge <00:36:31.855>distillation, <00:36:32.205>mostly

737
00:36:33.205 --> 00:36:35.805
<00:36:33.205>because <00:36:33.485>we <00:36:33.765>have <00:36:34.045>experience <00:36:34.325>with, <00:36:34.605>with

738
00:36:36.525 --> 00:36:37.645
<00:36:36.525>training <00:36:36.861>these <00:36:37.197>larger <00:36:37.533>models.

739
00:36:37.825 --> 00:36:40.205
<00:36:37.825>And <00:36:38.058>then <00:36:38.291>we, <00:36:38.524>we <00:36:38.758>basically <00:36:38.991>have <00:36:39.225>unlimited

740
00:36:40.205 --> 00:36:44.405
<00:36:40.205>or <00:36:40.332>very <00:36:40.459>large <00:36:40.586>amount <00:36:40.714>of, <00:36:40.841>of <00:36:40.968>unlabeled <00:36:41.095>data <00:36:41.223>we <00:36:41.350>can <00:36:41.477>then <00:36:41.605>use

741
00:36:44.625 --> 00:36:48.285
<00:36:44.625>for <00:36:44.765>the <00:36:44.905>creation <00:36:45.045>of <00:36:45.185>these <00:36:45.325>si <00:36:45.465>silver <00:36:45.605>kind <00:36:45.745>of <00:36:45.885>data <00:36:46.025>sets

742
00:36:48.315 --> 00:36:51.645
<00:36:48.315>that <00:36:48.455>are <00:36:48.595>the <00:36:48.735>news <00:36:48.875>by <00:36:49.015>the, <00:36:49.155>by <00:36:49.295>the, <00:36:49.435>uh, <00:36:49.575>student <00:36:49.715>models.

743
00:36:53.055 --> 00:36:57.675
<00:36:53.055>Um, <00:36:53.182>if, <00:36:53.309>when, <00:36:53.436>if <00:36:53.564>we <00:36:53.691>then <00:36:53.818>come <00:36:53.945>to <00:36:54.073>the <00:36:54.200>actual <00:36:54.327>deployment, <00:36:54.455>uh,

744
00:36:57.835 --> 00:37:00.995
<00:36:57.835>ONX <00:36:57.975>and <00:36:58.115>its <00:36:58.255>run <00:36:58.395>town <00:36:58.535>library <00:36:58.675>is <00:36:58.815>a <00:36:58.955>very <00:36:59.095>nice <00:36:59.235>option

745
00:37:01.655 --> 00:37:06.155
<00:37:01.655>in <00:37:01.782>particular <00:37:01.909>due <00:37:02.036>to <00:37:02.164>its <00:37:02.291>size <00:37:02.418>and, <00:37:02.545>um, <00:37:02.673>um, <00:37:02.800>uh, <00:37:02.927>and, <00:37:03.055>uh,

746
00:37:06.415 --> 00:37:09.355
<00:37:06.415>and <00:37:06.648>also <00:37:06.881>the, <00:37:07.115>the <00:37:07.348>ecosystem <00:37:07.581>around <00:37:07.815>it.

747
00:37:09.775 --> 00:37:14.555
<00:37:09.775>And, <00:37:09.930>uh, <00:37:10.086>finally, <00:37:10.241>um, <00:37:10.397>it, <00:37:10.552>it <00:37:10.708>might <00:37:10.863>turn <00:37:11.019>out <00:37:11.175>that,

748
00:37:14.585 --> 00:37:18.075
<00:37:14.585>that <00:37:14.740>the, <00:37:14.896>that <00:37:15.051>the <00:37:15.207>doing, <00:37:15.362>uh, <00:37:15.518>deployment <00:37:15.673>in <00:37:15.829>this <00:37:15.985>kind

749
00:37:18.075 --> 00:37:21.635
<00:37:18.075>of <00:37:18.202>way <00:37:18.329>in <00:37:18.456>a <00:37:18.584>serverless <00:37:18.711>fashion <00:37:18.838>might <00:37:18.965>help <00:37:19.093>you <00:37:19.220>save <00:37:19.347>the <00:37:19.475>day

750
00:37:21.975 --> 00:37:24.315
<00:37:21.975>in <00:37:22.325>the, <00:37:22.674>in <00:37:23.025>the, <00:37:23.375>um,

751
00:37:26.045 --> 00:37:29.385
<00:37:26.045>in <00:37:26.161>particular <00:37:26.278>if <00:37:26.395>you, <00:37:26.511>if <00:37:26.628>you <00:37:26.745>kind <00:37:26.861>of <00:37:26.978>figure <00:37:27.095>out <00:37:27.211>how <00:37:27.328>to, <00:37:27.445>how

752
00:37:29.385 --> 00:37:31.105
<00:37:29.385>to <00:37:29.735>play <00:37:30.085>around <00:37:30.435>this <00:37:30.785>limitations.

753
00:37:31.415 --> 00:37:34.745
<00:37:31.415>What <00:37:31.531>I <00:37:31.648>mean <00:37:31.765>by <00:37:31.881>that <00:37:31.998>is <00:37:32.115>that, <00:37:32.231>um, <00:37:32.348>if <00:37:32.465>you <00:37:32.581>have <00:37:32.698>to, <00:37:32.815>uh,

754
00:37:34.745 --> 00:37:36.745
<00:37:34.745>fight <00:37:34.944>very <00:37:35.145>hard <00:37:35.345>to <00:37:35.545>get <00:37:35.745>some <00:37:35.944>different <00:37:36.145>kind

755
00:37:36.745 --> 00:37:40.265
<00:37:36.745>of <00:37:36.944>infrastructure <00:37:37.145>set <00:37:37.345>up, <00:37:37.545>uh, <00:37:37.745>for <00:37:37.944>your <00:37:38.145>small,

756
00:37:40.755 --> 00:37:43.425
<00:37:40.755>small <00:37:41.035>machine <00:37:41.315>learning <00:37:41.595>project, <00:37:41.875>that's <00:37:42.155>basically

757
00:37:43.525 --> 00:37:45.905
<00:37:43.525>how <00:37:43.680>you <00:37:43.836>make <00:37:43.991>it <00:37:44.147>so <00:37:44.302>that <00:37:44.458>it's <00:37:44.613>never <00:37:44.769>happening, <00:37:44.925>mostly

758
00:37:45.905 --> 00:37:48.705
<00:37:45.905>because <00:37:46.138>there <00:37:46.371>are <00:37:46.605>almost <00:37:46.838>always <00:37:47.071>other <00:37:47.305>priorities.

759
00:37:48.765 --> 00:37:50.345
<00:37:48.765>On <00:37:49.045>the <00:37:49.325>other <00:37:49.605>hand, <00:37:49.884>being <00:37:50.165>able

760
00:37:50.345 --> 00:37:54.745
<00:37:50.345>to <00:37:50.500>deploy <00:37:50.656>a <00:37:50.811>smallish <00:37:50.967>server <00:37:51.122>serverless <00:37:51.278>kind <00:37:51.433>of, <00:37:51.589>uh, <00:37:51.745>uh,

761
00:37:55.295 --> 00:37:58.665
<00:37:55.295>kind <00:37:55.450>of <00:37:55.606>function <00:37:55.761>somewhere <00:37:55.917>might <00:37:56.072>be, <00:37:56.228>might <00:37:56.383>be <00:37:56.539>at <00:37:56.695>least,

762
00:37:58.725 --> 00:38:01.345
<00:37:58.725>at <00:37:58.841>least <00:37:58.958>that's <00:37:59.075>what <00:37:59.191>we <00:37:59.308>find <00:37:59.424>in <00:37:59.541>our <00:37:59.658>exam, <00:37:59.775>uh, <00:37:59.891>in, <00:38:00.008>in <00:38:00.125>our,

763
00:38:01.805 --> 00:38:04.185
<00:38:01.805>uh, <00:38:02.004>in <00:38:02.205>our <00:38:02.404>experience, <00:38:02.605>it <00:38:02.805>might <00:38:03.004>be <00:38:03.205>a,

764
00:38:04.625 --> 00:38:06.665
<00:38:04.625>a <00:38:04.858>bit <00:38:05.091>more <00:38:05.325>easier, <00:38:05.558>easier <00:38:05.791>to <00:38:06.025>do.

765
00:38:07.015 --> 00:38:10.585
<00:38:07.015>Furthermore, <00:38:07.170>as <00:38:07.326>we, <00:38:07.481>as <00:38:07.637>we <00:38:07.792>talked <00:38:07.948>about, <00:38:08.103>uh, <00:38:08.259>a <00:38:08.415>couple

766
00:38:10.585 --> 00:38:14.745
<00:38:10.585>of <00:38:10.725>couple <00:38:10.865>slides <00:38:11.005>back, <00:38:11.145>it <00:38:11.285>might <00:38:11.425>even <00:38:11.565>be <00:38:11.705>especially <00:38:11.845>for, <00:38:11.985>uh,

767
00:38:15.205 --> 00:38:19.105
<00:38:15.205>for, <00:38:15.404>uh, <00:38:15.605>deployments <00:38:15.805>in <00:38:16.005>which <00:38:16.205>the, <00:38:16.404>the, <00:38:16.605>um,

768
00:38:20.005 --> 00:38:21.825
<00:38:20.005>the <00:38:20.238>kind <00:38:20.471>of <00:38:20.705>number <00:38:20.938>of <00:38:21.171>requests <00:38:21.405>or,

769
00:38:21.825 --> 00:38:25.905
<00:38:21.825>or <00:38:21.964>basically <00:38:22.105>the <00:38:22.245>load, <00:38:22.384>uh, <00:38:22.524>you <00:38:22.665>get <00:38:22.805>is <00:38:22.944>spread <00:38:23.085>very <00:38:23.225>unevenly.

770
00:38:26.645 --> 00:38:29.865
<00:38:26.645>It <00:38:26.785>might <00:38:26.925>be <00:38:27.065>that <00:38:27.205>serverless <00:38:27.345>really <00:38:27.485>is <00:38:27.625>the <00:38:27.765>better <00:38:27.905>option <00:38:28.045>in

771
00:38:29.865 --> 00:38:33.305
<00:38:29.865>particular <00:38:30.064>because <00:38:30.265>you <00:38:30.464>don't <00:38:30.665>have <00:38:30.865>one <00:38:31.064>stable <00:38:31.265>server

772
00:38:33.655 --> 00:38:35.325
<00:38:33.655>that <00:38:34.121>runs <00:38:34.588>24 <00:38:35.055>7.

773
00:38:36.265 --> 00:38:40.245
<00:38:36.265>Um, <00:38:36.381>and <00:38:36.498>with <00:38:36.615>that, <00:38:36.731>I <00:38:36.848>would <00:38:36.964>like <00:38:37.081>to, <00:38:37.198>uh, <00:38:37.315>thank <00:38:37.431>you <00:38:37.548>again <00:38:37.665>for,

774
00:38:40.305 --> 00:38:43.165
<00:38:40.305>uh, <00:38:40.460>for <00:38:40.616>spending <00:38:40.771>good <00:38:40.927>the, <00:38:41.082>this, <00:38:41.238>this <00:38:41.393>time <00:38:41.549>with <00:38:41.705>us.

775
00:38:43.665 --> 00:38:47.165
<00:38:43.665>Um, <00:38:43.865>again, <00:38:44.065>uh, <00:38:44.265>mostly <00:38:44.465>the <00:38:44.665>messenger <00:38:44.865>here, <00:38:45.065>the,

776
00:38:47.165 --> 00:38:49.885
<00:38:47.165>the <00:38:47.320>real <00:38:47.476>really <00:38:47.631>heroes <00:38:47.787>are <00:38:47.942>the <00:38:48.098>data, <00:38:48.253>which <00:38:48.409>you <00:38:48.565>can,

777
00:38:50.175 --> 00:38:53.485
<00:38:50.175>which <00:38:50.302>you <00:38:50.429>can <00:38:50.556>see <00:38:50.684>on <00:38:50.811>the, <00:38:50.938>on <00:38:51.065>the <00:38:51.193>line, <00:38:51.320>on <00:38:51.447>the <00:38:51.575>bottom.

778
00:38:54.025 --> 00:38:56.525
<00:38:54.025>And, <00:38:54.258>uh, <00:38:54.491>I'm <00:38:54.725>happy <00:38:54.958>to <00:38:55.191>take <00:38:55.425>any

779
00:38:56.545 --> 00:38:59.205
<00:38:56.545>and <00:38:56.745>all <00:38:56.945>questions, <00:38:57.145>uh, <00:38:57.345>we <00:38:57.545>might <00:38:57.745>have <00:38:57.945>received.

780
00:38:59.785 --> 00:39:00.445
<00:38:59.785>Thanks <00:39:00.379>again.