WEBVTT

1
00:00:07.895 --> 00:00:09.245
<00:00:07.895>Since <00:00:08.138>we <00:00:08.381>are <00:00:08.623>talking <00:00:08.867>about <00:00:09.110>mobile,

2
00:00:09.375 --> 00:00:10.925
<00:00:09.375>let's <00:00:09.654>take <00:00:09.933>a <00:00:10.212>selfie <00:00:10.491>all <00:00:10.770>together.

3
00:00:14.075 --> 00:00:16.485
<00:00:14.075>Cool. <00:00:14.274>So <00:00:14.475>what <00:00:14.674>a <00:00:14.875>pleasure <00:00:15.075>to <00:00:15.274>be <00:00:15.475>here.

4
00:00:17.225 --> 00:00:19.285
<00:00:17.225>So <00:00:17.458>my <00:00:17.691>name <00:00:17.925>is <00:00:18.158>John <00:00:18.391>Marco <00:00:18.625>Yadi.

5
00:00:19.545 --> 00:00:22.845
<00:00:19.545>I'm <00:00:19.720>the, <00:00:19.895>um, <00:00:20.070>generative <00:00:20.245>AI <00:00:20.420>engineer <00:00:20.595>lead <00:00:20.770>at <00:00:20.945>home.

6
00:00:23.925 --> 00:00:27.725
<00:00:23.925>I <00:00:24.065>have <00:00:24.205>been <00:00:24.345>working <00:00:24.485>for <00:00:24.625>roughly <00:00:24.765>more <00:00:24.905>than <00:00:25.045>10 <00:00:25.185>years <00:00:25.325>on

7
00:00:28.435 --> 00:00:33.405
<00:00:28.435>designing <00:00:28.668>optimizing <00:00:28.901>AI <00:00:29.134>libraries <00:00:29.368>for <00:00:29.601>mobile <00:00:29.834>deployment.

8
00:00:33.925 --> 00:00:36.725
<00:00:33.925>I <00:00:34.125>co-created <00:00:34.324>Young <00:00:34.525>Compute <00:00:34.724>Library <00:00:34.925>in <00:00:35.125>the <00:00:35.324>past

9
00:00:36.905 --> 00:00:40.565
<00:00:36.905>and <00:00:37.032>also <00:00:37.159>the <00:00:37.286>most <00:00:37.414>recent <00:00:37.541>IDE <00:00:37.668>AI <00:00:37.795>that <00:00:37.923>we, <00:00:38.050>you're <00:00:38.177>gonna <00:00:38.305>hear,

10
00:00:40.905 --> 00:00:42.005
<00:00:40.905>uh, <00:00:41.152>quite <00:00:41.400>a <00:00:41.647>lot <00:00:41.895>today.

11
00:00:42.785 --> 00:00:46.245
<00:00:42.785>Uh, <00:00:42.985>and <00:00:43.184>also <00:00:43.385>also <00:00:43.584>the <00:00:43.785>Tiny <00:00:43.985>ML <00:00:44.184>Cookbook.

12
00:00:46.915 --> 00:00:49.245
<00:00:46.915>This <00:00:47.089>just <00:00:47.265>to <00:00:47.440>say <00:00:47.615>that <00:00:47.790>I <00:00:47.964>am <00:00:48.140>a <00:00:48.315>developer,

13
00:00:49.585 --> 00:00:52.325
<00:00:49.585>and <00:00:49.865>this <00:00:50.145>presentation <00:00:50.425>is <00:00:50.705>for <00:00:50.985>developers

14
00:00:52.905 --> 00:00:54.285
<00:00:52.905>to <00:00:53.319>know <00:00:53.733>what's <00:00:54.147>happening

15
00:00:54.745 --> 00:00:58.205
<00:00:54.745>and <00:00:54.978>what's <00:00:55.211>coming <00:00:55.445>in <00:00:55.678>particular <00:00:55.911>for <00:00:56.144>those

16
00:00:58.205 --> 00:01:00.365
<00:00:58.205>that <00:00:58.555>are <00:00:58.905>developing <00:00:59.254>AI <00:00:59.605>applications

17
00:01:00.745 --> 00:01:01.965
<00:01:00.745>for <00:01:01.294>Androids <00:01:01.843>smartphones.

18
00:01:03.905 --> 00:01:05.605
<00:01:03.905>So <00:01:04.371>let's <00:01:04.838>kick <00:01:05.305>off

19
00:01:06.075 --> 00:01:10.165
<00:01:06.075>with <00:01:06.250>the <00:01:06.425>first <00:01:06.600>light <00:01:06.775>has <00:01:06.950>lied <00:01:07.125>about <00:01:07.300>generative <00:01:07.475>ai.

20
00:01:10.735 --> 00:01:13.405
<00:01:10.735>Generative <00:01:10.968>AI <00:01:11.201>is <00:01:11.435>not <00:01:11.668>a <00:01:11.901>buzz <00:01:12.135>word,

21
00:01:13.985 --> 00:01:15.725
<00:01:13.985>and <00:01:14.218>it <00:01:14.451>is <00:01:14.685>something <00:01:14.918>that <00:01:15.151>is <00:01:15.385>happening.

22
00:01:16.225 --> 00:01:17.445
<00:01:16.225>As <00:01:16.444>I <00:01:16.664>mentioned <00:01:16.883>at <00:01:17.103>the <00:01:17.323>beginning.

23
00:01:18.225 --> 00:01:20.525
<00:01:18.225>I'm <00:01:18.458>going <00:01:18.691>to <00:01:18.925>talk <00:01:19.158>about <00:01:19.391>what's <00:01:19.625>happening

24
00:01:20.905 --> 00:01:23.685
<00:01:20.905>to <00:01:21.080>also <00:01:21.255>understand <00:01:21.430>a <00:01:21.605>bit <00:01:21.780>more <00:01:21.955>about <00:01:22.130>what's <00:01:22.305>coming.

25
00:01:24.665 --> 00:01:25.685
<00:01:24.664>But <00:01:25.124>generative <00:01:25.583>AI

26
00:01:25.705 --> 00:01:29.645
<00:01:25.705>for <00:01:25.845>mobile <00:01:25.985>is <00:01:26.125>a <00:01:26.265>bit <00:01:26.405>different <00:01:26.545>from <00:01:26.685>generative <00:01:26.825>AI <00:01:26.965>in <00:01:27.105>the

27
00:01:29.645 --> 00:01:30.805
<00:01:29.645>cloud <00:01:30.689>here.

28
00:01:31.185 --> 00:01:34.565
<00:01:31.185>We <00:01:31.418>don't <00:01:31.651>rely <00:01:31.885>on <00:01:32.118>internet <00:01:32.351>connectivity <00:01:32.585>here.

29
00:01:34.695 --> 00:01:36.365
<00:01:34.695>Everything <00:01:35.395>runs <00:01:36.095>locally.

30
00:01:37.705 --> 00:01:40.565
<00:01:37.705>And <00:01:37.845>most <00:01:37.985>of <00:01:38.125>the <00:01:38.265>time <00:01:38.405>when <00:01:38.545>we <00:01:38.685>talk <00:01:38.825>about <00:01:38.965>generative <00:01:39.105>ai,

31
00:01:41.185 --> 00:01:44.165
<00:01:41.185>we <00:01:41.418>typically <00:01:41.651>refer <00:01:41.885>to <00:01:42.118>large <00:01:42.351>language <00:01:42.585>models

32
00:01:44.585 --> 00:01:48.005
<00:01:44.585>or <00:01:44.760>something <00:01:44.935>that <00:01:45.110>can <00:01:45.285>generate <00:01:45.460>text <00:01:45.635>or <00:01:45.810>images <00:01:45.985>maybe.

33
00:01:48.825 --> 00:01:51.445
<00:01:48.825>But <00:01:49.058>actually <00:01:49.291>today <00:01:49.525>is <00:01:49.758>more <00:01:49.991>than <00:01:50.225>that,

34
00:01:52.185 --> 00:01:53.885
<00:01:52.185>is <00:01:52.535>not <00:01:52.885>just <00:01:53.235>about <00:01:53.585>text.

35
00:01:54.345 --> 00:01:57.765
<00:01:54.345>And <00:01:54.545>this <00:01:54.745>slide <00:01:54.945>actually <00:01:55.145>summarizes <00:01:55.345>what <00:01:55.545>we <00:01:55.745>have

36
00:01:58.325 --> 00:02:01.125
<00:01:58.325>achieved <00:01:58.525>in <00:01:58.725>the <00:01:58.925>last <00:01:59.125>year <00:01:59.325>on <00:01:59.525>mobile <00:01:59.725>phones.

37
00:02:02.465 --> 00:02:04.845
<00:02:02.465>The <00:02:02.640>use <00:02:02.815>case, <00:02:02.990>I <00:02:03.165>really <00:02:03.340>love <00:02:03.515>it <00:02:03.690>is <00:02:03.865>the

38
00:02:04.845 --> 00:02:06.045
<00:02:04.845>group <00:02:05.385>chat <00:02:05.925>summarization.

39
00:02:07.305 --> 00:02:09.125
<00:02:07.305>Why <00:02:07.585>I <00:02:07.865>like <00:02:08.145>it. <00:02:08.425>That <00:02:08.705>is

40
00:02:09.185 --> 00:02:12.605
<00:02:09.185>so <00:02:09.384>much <00:02:09.585>generative <00:02:09.785>AI <00:02:09.985>there <00:02:10.185>you <00:02:10.384>cannot <00:02:10.585>imagine.

41
00:02:13.325 --> 00:02:15.565
<00:02:13.325>I <00:02:13.480>want, <00:02:13.636>I <00:02:13.791>want <00:02:13.947>to <00:02:14.102>give <00:02:14.258>a <00:02:14.413>very <00:02:14.569>simple <00:02:14.725>example.

42
00:02:16.385 --> 00:02:18.245
<00:02:16.385>How <00:02:16.584>many <00:02:16.785>of <00:02:16.984>you <00:02:17.185>have <00:02:17.385>a <00:02:17.584>message <00:02:17.785>app

43
00:02:18.745 --> 00:02:20.005
<00:02:18.745>and <00:02:18.934>you <00:02:19.123>are <00:02:19.312>in <00:02:19.501>a <00:02:19.690>group <00:02:19.879>chat

44
00:02:20.785 --> 00:02:24.525
<00:02:20.785>and <00:02:20.892>at <00:02:21.000>the <00:02:21.108>end <00:02:21.215>of <00:02:21.323>the <00:02:21.431>day <00:02:21.538>you <00:02:21.646>have <00:02:21.754>a <00:02:21.861>group <00:02:21.969>chat <00:02:22.077>with <00:02:22.185>hundred

45
00:02:24.825 --> 00:02:29.165
<00:02:24.825>of <00:02:25.000>unread <00:02:25.174>messages, <00:02:25.350>with <00:02:25.524>images, <00:02:25.700>voice <00:02:25.875>notes, <00:02:26.049>and <00:02:26.225>maybe

46
00:02:29.285 --> 00:02:32.005
<00:02:29.285>because <00:02:29.484>they <00:02:29.685>are <00:02:29.885>organizing <00:02:30.085>their <00:02:30.285>planning <00:02:30.484>a <00:02:30.685>birthday.

47
00:02:32.665 --> 00:02:35.085
<00:02:32.665>But <00:02:32.820>you <00:02:32.976>don't <00:02:33.131>want <00:02:33.287>to <00:02:33.442>listen <00:02:33.598>all <00:02:33.753>the <00:02:33.909>voice <00:02:34.065>notes,

48
00:02:35.345 --> 00:02:37.925
<00:02:35.345>you <00:02:35.545>don't <00:02:35.745>want <00:02:35.945>to <00:02:36.145>see <00:02:36.345>all <00:02:36.545>the <00:02:36.745>images.

49
00:02:38.505 --> 00:02:41.725
<00:02:38.505>You <00:02:38.660>want <00:02:38.816>to <00:02:38.971>know <00:02:39.127>just <00:02:39.282>what <00:02:39.438>they <00:02:39.593>have <00:02:39.749>agreed <00:02:39.905>upon.

50
00:02:42.465 --> 00:02:46.245
<00:02:42.465>And <00:02:42.640>basically, <00:02:42.815>generative <00:02:42.990>AI <00:02:43.165>can <00:02:43.340>help <00:02:43.515>you <00:02:43.690>to <00:02:43.865>understand,

51
00:02:46.385 --> 00:02:50.565
<00:02:46.385>for <00:02:46.524>instance, <00:02:46.665>what <00:02:46.804>they <00:02:46.945>have <00:02:47.084>agreed, <00:02:47.225>the <00:02:47.364>type <00:02:47.505>of, <00:02:47.644>the <00:02:47.785>type

52
00:02:50.565 --> 00:02:51.765
<00:02:50.565>of <00:02:50.835>gift <00:02:51.105>they <00:02:51.375>have <00:02:51.644>agreed

53
00:02:52.785 --> 00:02:55.005
<00:02:52.785>and <00:02:52.984>the <00:02:53.185>discussion, <00:02:53.385>for <00:02:53.585>instance, <00:02:53.785>where <00:02:53.984>they're <00:02:54.185>going

54
00:02:55.005 --> 00:02:56.085
<00:02:55.005>to <00:02:55.491>celebrate <00:02:55.977>birthday,

55
00:02:57.825 --> 00:03:01.205
<00:02:57.825>but <00:02:58.058>is <00:02:58.291>not <00:02:58.524>just <00:02:58.758>about <00:02:58.991>group <00:02:59.225>chat.

56
00:03:01.205 --> 00:03:03.125
<00:03:01.205>There <00:03:01.405>is <00:03:01.605>also, <00:03:01.805>there <00:03:02.005>are <00:03:02.205>also <00:03:02.405>use <00:03:02.605>cases

57
00:03:03.785 --> 00:03:05.885
<00:03:03.785>for <00:03:04.484>something <00:03:05.185>incredible.

58
00:03:07.075 --> 00:03:08.275
<00:03:07.075>I <00:03:07.291>love <00:03:07.507>the <00:03:07.722>next <00:03:07.939>use <00:03:08.155>case

59
00:03:08.465 --> 00:03:11.115
<00:03:08.465>because <00:03:08.640>actually <00:03:08.815>there <00:03:08.990>is <00:03:09.165>no <00:03:09.340>better <00:03:09.515>place <00:03:09.690>than <00:03:09.865>Berlin

60
00:03:11.495 --> 00:03:12.915
<00:03:11.495>to <00:03:11.750>talk <00:03:12.006>about <00:03:12.261>this <00:03:12.517>use <00:03:12.773>case.

61
00:03:14.015 --> 00:03:16.355
<00:03:14.015>It <00:03:14.295>is <00:03:14.575>audio <00:03:14.855>gen <00:03:15.135>autobi <00:03:15.415>phone.

62
00:03:18.575 --> 00:03:21.115
<00:03:18.575>So <00:03:18.730>this <00:03:18.886>is <00:03:19.041>a <00:03:19.197>video <00:03:19.352>hopefully <00:03:19.508>with <00:03:19.663>audio <00:03:19.819>as <00:03:19.975>well,

63
00:03:21.645 --> 00:03:24.515
<00:03:21.645>gonna <00:03:21.925>hear <00:03:22.205>an <00:03:22.485>amazing <00:03:22.765>audio <00:03:23.045>quality

64
00:03:24.905 --> 00:03:27.075
<00:03:24.905>generated <00:03:25.185>directly <00:03:25.465>on <00:03:25.745>the <00:03:26.025>mobile <00:03:26.305>phone.

65
00:03:38.035 --> 00:03:40.875
<00:03:38.035>I <00:03:38.174>love, <00:03:38.315>honestly, <00:03:38.454>to <00:03:38.595>host <00:03:38.734>DJ <00:03:38.875>session <00:03:39.015>Today <00:03:39.155>is <00:03:39.295>not <00:03:39.435>going

66
00:03:40.875 --> 00:03:44.835
<00:03:40.875>to <00:03:41.015>be <00:03:41.155>a <00:03:41.295>DJ <00:03:41.435>session, <00:03:41.575>but <00:03:41.715>probably <00:03:41.855>you <00:03:41.995>heard <00:03:42.135>the <00:03:42.275>quality,

67
00:03:45.455 --> 00:03:47.835
<00:03:45.454>the <00:03:45.654>bus, <00:03:45.855>the <00:03:46.054>C <00:03:46.255>Chris <00:03:46.454>is <00:03:46.654>actually <00:03:46.855>stereophonic.

68
00:03:48.145 --> 00:03:52.355
<00:03:48.145>It's <00:03:48.320>44 <00:03:48.495>kilos <00:03:48.670>simply <00:03:48.845>running <00:03:49.020>on <00:03:49.195>your <00:03:49.370>mobile <00:03:49.545>phone.

69
00:03:52.755 --> 00:03:55.235
<00:03:52.755>I <00:03:52.894>also <00:03:53.035>have <00:03:53.174>the <00:03:53.315>smartphone <00:03:53.454>with <00:03:53.595>me <00:03:53.734>in <00:03:53.875>case <00:03:54.015>you <00:03:54.155>want

70
00:03:55.235 --> 00:03:58.515
<00:03:55.235>to <00:03:55.390>connect <00:03:55.546>later <00:03:55.701>and <00:03:55.857>discover <00:03:56.012>more <00:03:56.168>about <00:03:56.323>this <00:03:56.479>use <00:03:56.635>case.

71
00:03:59.575 --> 00:04:02.395
<00:03:59.575>And <00:03:59.750>you're <00:03:59.924>gonna <00:04:00.100>also <00:04:00.274>discover <00:04:00.450>how <00:04:00.625>this <00:04:00.799>actually <00:04:00.975>runs

72
00:04:03.615 --> 00:04:04.795
<00:04:03.615>on <00:04:04.146>the <00:04:04.677>MCPU.

73
00:04:05.945 --> 00:04:09.275
<00:04:05.945>This <00:04:06.120>is <00:04:06.295>as <00:04:06.470>light <00:04:06.644>where <00:04:06.820>I'm <00:04:06.995>going <00:04:07.170>to <00:04:07.345>summarize

74
00:04:09.975 --> 00:04:13.515
<00:04:09.975>the <00:04:10.208>reasons <00:04:10.441>why <00:04:10.674>we <00:04:10.908>should <00:04:11.141>care <00:04:11.375>about

75
00:04:14.095 --> 00:04:15.355
<00:04:14.095>AI <00:04:14.472>on <00:04:14.851>the <00:04:15.228>MCPU.

76
00:04:16.055 --> 00:04:20.115
<00:04:16.055>And <00:04:16.230>there <00:04:16.405>list <00:04:16.579>three <00:04:16.755>main <00:04:16.930>reasons <00:04:17.105>for <00:04:17.280>that <00:04:17.454>scalability.

77
00:04:20.905 --> 00:04:23.515
<00:04:20.904>Well, <00:04:21.138>first <00:04:21.371>of <00:04:21.604>all, <00:04:21.838>it's <00:04:22.071>fully <00:04:22.304>programmable.

78
00:04:23.935 --> 00:04:26.795
<00:04:23.935>You <00:04:24.090>have, <00:04:24.246>you <00:04:24.401>can <00:04:24.557>imagine <00:04:24.712>all <00:04:24.868>the <00:04:25.023>different <00:04:25.179>data <00:04:25.335>types

79
00:04:27.175 --> 00:04:29.555
<00:04:27.175>to <00:04:27.455>deploy <00:04:27.735>your, <00:04:28.015>uh, <00:04:28.295>AI <00:04:28.575>applications.

80
00:04:31.055 --> 00:04:34.795
<00:04:31.055>AI <00:04:31.255>applications <00:04:31.455>for <00:04:31.655>today <00:04:31.855>and <00:04:32.055>also <00:04:32.255>for <00:04:32.455>tomorrow.

81
00:04:36.005 --> 00:04:38.795
<00:04:36.005>Audio <00:04:36.284>generation <00:04:36.565>is <00:04:36.844>just <00:04:37.125>an <00:04:37.405>example.

82
00:04:39.575 --> 00:04:41.715
<00:04:39.575>It <00:04:39.775>wasn't <00:04:39.974>a <00:04:40.175>thing <00:04:40.375>a <00:04:40.575>few <00:04:40.775>years <00:04:40.974>ago.

83
00:04:42.455 --> 00:04:44.275
<00:04:42.455>It <00:04:42.734>became <00:04:43.015>a <00:04:43.294>thing <00:04:43.575>in <00:04:43.854>May

84
00:04:44.645 --> 00:04:48.435
<00:04:44.645>after <00:04:44.844>a <00:04:45.044>very <00:04:45.245>successful <00:04:45.445>collaboration <00:04:45.645>with <00:04:45.844>stability <00:04:46.044>ai.

85
00:04:50.175 --> 00:04:51.595
<00:04:50.175>But <00:04:50.814>the <00:04:51.453>beauty

86
00:04:52.055 --> 00:04:55.955
<00:04:52.055>of <00:04:52.210>running <00:04:52.366>on <00:04:52.521>the <00:04:52.677>mobile <00:04:52.832>CPU <00:04:52.988>is <00:04:53.143>I <00:04:53.299>also <00:04:53.455>have,

87
00:04:56.015 --> 00:04:58.755
<00:04:56.015>you <00:04:56.215>can <00:04:56.414>also <00:04:56.615>mix <00:04:56.815>different <00:04:57.015>pipe <00:04:57.215>pipelines <00:04:57.414>together.

88
00:04:59.385 --> 00:05:00.635
<00:04:59.385>It's <00:04:59.666>not <00:04:59.947>just <00:05:00.228>about <00:05:00.510>ai.

89
00:05:01.385 --> 00:05:03.595
<00:05:01.385>Your <00:05:01.618>AI <00:05:01.851>can <00:05:02.085>live <00:05:02.318>in <00:05:02.551>a <00:05:02.784>context

90
00:05:03.605 --> 00:05:06.635
<00:05:03.605>where <00:05:03.838>you <00:05:04.071>need <00:05:04.305>also <00:05:04.538>image <00:05:04.771>processing <00:05:05.005>computation,

91
00:05:06.895 --> 00:05:10.235
<00:05:06.895>or <00:05:07.070>you <00:05:07.245>need <00:05:07.419>digital <00:05:07.594>signal <00:05:07.770>processing <00:05:07.945>algorithms <00:05:08.120>as <00:05:08.294>well.

92
00:05:12.055 --> 00:05:16.635
<00:05:12.055>The <00:05:12.230>other <00:05:12.405>aspect <00:05:12.580>is <00:05:12.755>crucial <00:05:12.930>and <00:05:13.105>unique <00:05:13.280>to <00:05:13.455>arm.

93
00:05:17.745 --> 00:05:22.035
<00:05:17.745>Most <00:05:17.900>of <00:05:18.056>the <00:05:18.211>time <00:05:18.367>you <00:05:18.522>read <00:05:18.678>right <00:05:18.833>once <00:05:18.989>deploy <00:05:19.145>everywhere

94
00:05:23.055 --> 00:05:24.155
<00:05:23.055>for <00:05:23.385>ARM <00:05:23.715>is <00:05:24.044>different.

95
00:05:25.475 --> 00:05:27.835
<00:05:25.475>Optimize <00:05:25.825>one <00:05:26.175>and <00:05:26.525>deploy <00:05:26.875>everywhere.

96
00:05:28.615 --> 00:05:31.835
<00:05:28.615>And <00:05:28.755>in <00:05:28.895>10 <00:05:29.035>years, <00:05:29.175>this <00:05:29.315>is <00:05:29.455>actually <00:05:29.595>not <00:05:29.735>a <00:05:29.875>marketing <00:05:30.015>statement.

97
00:05:31.835 --> 00:05:33.595
<00:05:31.835>This <00:05:32.114>is <00:05:32.395>actually <00:05:32.674>an <00:05:32.955>engineering <00:05:33.234>statement

98
00:05:33.705 --> 00:05:35.315
<00:05:33.705>because <00:05:33.984>this <00:05:34.265>is <00:05:34.544>what <00:05:34.825>I <00:05:35.104>would,

99
00:05:35.475 --> 00:05:38.595
<00:05:35.475>I <00:05:35.615>have <00:05:35.755>seen <00:05:35.895>in <00:05:36.035>this <00:05:36.175>10 <00:05:36.315>years <00:05:36.455>by <00:05:36.595>working <00:05:36.735>as <00:05:36.875>hub.

100
00:05:39.015 --> 00:05:42.355
<00:05:39.015>The <00:05:39.190>optimizations <00:05:39.365>that <00:05:39.539>we <00:05:39.715>have, <00:05:39.890>uh, <00:05:40.065>for <00:05:40.240>instance, <00:05:40.414>deploy

101
00:05:42.415 --> 00:05:46.275
<00:05:42.415>for <00:05:42.570>mobile <00:05:42.726>phone <00:05:42.881>could <00:05:43.037>scale <00:05:43.192>for <00:05:43.348>also <00:05:43.503>in <00:05:43.659>the <00:05:43.815>cloud.

102
00:05:47.025 --> 00:05:48.355
<00:05:47.025>Okay, <00:05:47.424>on <00:05:47.823>the <00:05:48.222>MCP,

103
00:05:49.055 --> 00:05:50.875
<00:05:49.055>and <00:05:49.230>this <00:05:49.405>is <00:05:49.580>a <00:05:49.755>very, <00:05:49.930>very <00:05:50.105>unique <00:05:50.280>to <00:05:50.455>arm

104
00:05:52.115 --> 00:05:53.475
<00:05:52.115>security <00:05:52.421>is <00:05:52.727>the <00:05:53.033>second <00:05:53.339>aspect

105
00:05:53.735 --> 00:05:58.205
<00:05:53.735>and <00:05:53.875>is <00:05:54.015>about <00:05:54.155>the, <00:05:54.295>um, <00:05:54.435>the <00:05:54.575>features <00:05:54.715>that <00:05:54.855>are <00:05:54.995>in <00:05:55.135>the,

106
00:05:58.345 --> 00:06:00.885
<00:05:58.345>in <00:05:58.545>the <00:05:58.745>processor <00:05:58.945>that <00:05:59.145>actually <00:05:59.345>made <00:05:59.545>the, <00:05:59.745>uh,

107
00:06:00.885 --> 00:06:01.885
<00:06:00.885>computation <00:06:01.784>secure.

108
00:06:02.985 --> 00:06:05.405
<00:06:02.985>The <00:06:03.265>third <00:06:03.545>aspect <00:06:03.825>is <00:06:04.105>about <00:06:04.385>performance.

109
00:06:06.535 --> 00:06:08.005
<00:06:06.535>Great <00:06:06.976>gen <00:06:07.417>AI <00:06:07.858>performance.

110
00:06:08.025 --> 00:06:10.205
<00:06:08.025>And <00:06:08.200>you <00:06:08.375>will <00:06:08.549>see <00:06:08.724>a <00:06:08.900>bit <00:06:09.075>more, <00:06:09.250>uh, <00:06:09.424>later

111
00:06:10.205 --> 00:06:11.285
<00:06:10.205>during <00:06:10.691>the <00:06:11.177>presentation.

112
00:06:11.825 --> 00:06:15.005
<00:06:11.825>Uh, <00:06:12.025>here <00:06:12.224>have <00:06:12.425>reported <00:06:12.625>just <00:06:12.825>a <00:06:13.025>few <00:06:13.224>example.

113
00:06:15.665 --> 00:06:17.245
<00:06:15.665>Uh, <00:06:15.865>how <00:06:16.065>long <00:06:16.265>does <00:06:16.465>it <00:06:16.665>take, <00:06:16.865>for <00:06:17.065>instance,

114
00:06:17.245 --> 00:06:19.005
<00:06:17.245>to <00:06:17.525>generate <00:06:17.805>11 <00:06:18.085>seconds <00:06:18.365>of <00:06:18.645>audio

115
00:06:20.115 --> 00:06:23.045
<00:06:20.115>with <00:06:20.315>the <00:06:20.515>technology <00:06:20.715>I'm <00:06:20.915>going <00:06:21.115>to <00:06:21.315>announce <00:06:21.515>today,

116
00:06:23.625 --> 00:06:25.085
<00:06:23.625>it <00:06:23.953>roughly <00:06:24.282>takes <00:06:24.610>two <00:06:24.938>seconds.

117
00:06:25.785 --> 00:06:28.125
<00:06:25.785>And <00:06:25.940>you <00:06:26.096>can <00:06:26.251>imagine <00:06:26.407>if <00:06:26.562>you <00:06:26.718>are <00:06:26.873>a <00:06:27.029>music <00:06:27.185>producer,

118
00:06:28.585 --> 00:06:29.685
<00:06:28.585>is <00:06:28.832>actually, <00:06:29.080>this <00:06:29.327>is <00:06:29.575>great.

119
00:06:29.905 --> 00:06:32.685
<00:06:29.905>You <00:06:30.044>don't <00:06:30.184>need <00:06:30.325>to <00:06:30.465>search <00:06:30.604>on <00:06:30.744>the <00:06:30.885>website <00:06:31.025>to <00:06:31.164>find <00:06:31.304>the,

120
00:06:32.865 --> 00:06:35.085
<00:06:32.865>the <00:06:33.098>perfect <00:06:33.331>beat <00:06:33.565>or <00:06:33.798>the <00:06:34.031>perfect <00:06:34.265>sample.

121
00:06:35.505 --> 00:06:37.565
<00:06:35.505>You <00:06:35.784>can <00:06:36.065>simply <00:06:36.344>text <00:06:36.625>it <00:06:36.905>prompted

122
00:06:38.025 --> 00:06:40.885
<00:06:38.025>and <00:06:38.258>you <00:06:38.491>generate <00:06:38.724>different <00:06:38.958>samples <00:06:39.191>every <00:06:39.424>time.

123
00:06:42.385 --> 00:06:44.605
<00:06:42.385>Low <00:06:42.735>latency. <00:06:43.085>This <00:06:43.435>is <00:06:43.784>crucial

124
00:06:44.905 --> 00:06:47.725
<00:06:44.905>for <00:06:45.184>real <00:06:45.465>time <00:06:45.744>algorithms <00:06:46.025>in <00:06:46.304>particular,

125
00:06:47.725 --> 00:06:50.445
<00:06:47.725>whether <00:06:47.900>they <00:06:48.075>are <00:06:48.250>hard <00:06:48.425>or <00:06:48.600>with <00:06:48.775>hard <00:06:48.950>or <00:06:49.125>softer

126
00:06:50.785 --> 00:06:52.525
<00:06:50.784>or <00:06:51.251>soft, <00:06:51.718>uh, <00:06:52.184>requirements.

127
00:06:54.465 --> 00:06:56.285
<00:06:54.465>And <00:06:54.745>why? <00:06:55.025>Because <00:06:55.305>you <00:06:55.585>don't <00:06:55.865>need

128
00:06:56.285 --> 00:06:59.325
<00:06:56.284>to <00:06:56.635>offload <00:06:56.984>the <00:06:57.335>computation, <00:06:57.684>right?

129
00:06:59.785 --> 00:07:01.325
<00:06:59.784>You <00:07:00.246>can <00:07:00.709>start <00:07:01.171>immediately.

130
00:07:02.025 --> 00:07:04.365
<00:07:02.025>And <00:07:02.180>this <00:07:02.336>is <00:07:02.491>actually <00:07:02.647>the, <00:07:02.802>the <00:07:02.958>beauty, <00:07:03.113>one <00:07:03.269>of <00:07:03.424>the,

131
00:07:04.545 --> 00:07:06.685
<00:07:04.545>the <00:07:04.745>interesting <00:07:04.945>aspect <00:07:05.145>of <00:07:05.345>running <00:07:05.545>on <00:07:05.745>the <00:07:05.945>CPU,

132
00:07:08.385 --> 00:07:12.525
<00:07:08.385>but <00:07:08.512>when <00:07:08.639>you <00:07:08.766>talk <00:07:08.894>about <00:07:09.021>ARM <00:07:09.148>is <00:07:09.275>not <00:07:09.403>just <00:07:09.530>about <00:07:09.657>the <00:07:09.784>processor,

133
00:07:13.265 --> 00:07:14.845
<00:07:13.265>is <00:07:13.731>the <00:07:14.198>entire <00:07:14.664>community.

134
00:07:15.585 --> 00:07:20.325
<00:07:15.585>And <00:07:15.784>this <00:07:15.984>light <00:07:16.185>summarizes <00:07:16.385>the, <00:07:16.585>the <00:07:16.784>great <00:07:16.984>aspect

135
00:07:20.385 --> 00:07:23.045
<00:07:20.385>of <00:07:20.618>working <00:07:20.851>on <00:07:21.085>an <00:07:21.318>arm, <00:07:21.551>uh, <00:07:21.784>ip.

136
00:07:23.115 --> 00:07:26.765
<00:07:23.115>Because <00:07:23.270>when <00:07:23.426>you <00:07:23.581>build <00:07:23.737>your <00:07:23.892>application <00:07:24.048>on <00:07:24.203>Arm, <00:07:24.359>you <00:07:24.515>build

137
00:07:26.765 --> 00:07:30.325
<00:07:26.765>with <00:07:26.965>a <00:07:27.164>community, <00:07:27.365>you <00:07:27.565>build <00:07:27.765>with <00:07:27.965>an <00:07:28.164>ecosystem

138
00:07:30.595 --> 00:07:31.885
<00:07:30.595>with <00:07:30.885>the <00:07:31.175>open <00:07:31.465>source <00:07:31.756>community.

139
00:07:31.885 --> 00:07:33.325
<00:07:31.885>These <00:07:32.144>are <00:07:32.403>just <00:07:32.662>a <00:07:32.921>few <00:07:33.181>numbers.

140
00:07:34.295 --> 00:07:37.725
<00:07:34.295>There <00:07:34.470>are <00:07:34.645>many, <00:07:34.820>many <00:07:34.995>open <00:07:35.170>source <00:07:35.345>projects <00:07:35.520>created <00:07:35.695>by,

141
00:07:37.905 --> 00:07:41.805
<00:07:37.905>by <00:07:38.044>arm, <00:07:38.184>but <00:07:38.325>also, <00:07:38.465>uh, <00:07:38.604>created <00:07:38.744>by <00:07:38.885>the, <00:07:39.025>uh, <00:07:39.164>the <00:07:39.304>community

142
00:07:41.855 --> 00:07:42.925
<00:07:41.855>where <00:07:42.336>we <00:07:42.818>contribute.

143
00:07:46.225 --> 00:07:49.485
<00:07:46.225>And <00:07:46.505>talking <00:07:46.785>about <00:07:47.065>open <00:07:47.345>source <00:07:47.625>contribution

144
00:07:49.785 --> 00:07:51.365
<00:07:49.784>and <00:07:50.251>talking <00:07:50.718>about <00:07:51.184>ai.

145
00:07:52.205 --> 00:07:55.395
<00:07:52.205>There <00:07:52.438>are <00:07:52.671>certainly <00:07:52.905>many <00:07:53.138>frameworks <00:07:53.371>out <00:07:53.604>there

146
00:07:55.785 --> 00:08:00.395
<00:07:55.784>that <00:07:55.940>are <00:07:56.096>capable <00:07:56.251>to <00:07:56.407>run <00:07:56.562>AI <00:07:56.718>workloads <00:07:56.873>on <00:07:57.029>mobile <00:07:57.184>phones.

147
00:08:01.215 --> 00:08:05.635
<00:08:01.215>And <00:08:01.390>this <00:08:01.565>is <00:08:01.739>just, <00:08:01.914>well, <00:08:02.090>just <00:08:02.265>a <00:08:02.440>few <00:08:02.614>examples

148
00:08:06.015 --> 00:08:10.235
<00:08:06.015>of <00:08:06.155>few <00:08:06.294>frameworks <00:08:06.435>actually <00:08:06.575>where <00:08:06.715>you <00:08:06.854>can, <00:08:06.995>uh, <00:08:07.135>run <00:08:07.275>your, <00:08:07.414>um,

149
00:08:10.895 --> 00:08:12.595
<00:08:10.895>AI <00:08:11.361>application <00:08:11.828>on <00:08:12.294>mobile.

150
00:08:14.185 --> 00:08:15.245
<00:08:14.185>What's <00:08:14.423>the <00:08:14.662>beauty <00:08:14.900>of <00:08:15.139>this?

151
00:08:15.655 --> 00:08:18.005
<00:08:15.655>Every <00:08:15.794>time <00:08:15.934>I <00:08:16.075>show <00:08:16.215>this <00:08:16.354>light, <00:08:16.494>I <00:08:16.635>say, <00:08:16.775>this <00:08:16.914>is <00:08:17.054>great,

152
00:08:18.715 --> 00:08:21.925
<00:08:18.715>this <00:08:18.994>is <00:08:19.275>great <00:08:19.554>because <00:08:19.835>each <00:08:20.114>framework,

153
00:08:22.795 --> 00:08:26.685
<00:08:22.795>whether <00:08:23.028>is <00:08:23.261>lidar <00:08:23.495>t <00:08:23.728>execute <00:08:23.961>Torch, <00:08:24.195>Tencent,

154
00:08:26.835 --> 00:08:30.805
<00:08:26.835>Huan <00:08:26.974>on <00:08:27.114>an <00:08:27.255>excellent <00:08:27.395>time, <00:08:27.534>m <00:08:27.674>and <00:08:27.815>m <00:08:27.955>Lama <00:08:28.094>do <00:08:28.234>CPP.

155
00:08:31.835 --> 00:08:33.725
<00:08:31.835>Each <00:08:32.115>one <00:08:32.395>brings <00:08:32.674>their <00:08:32.954>own <00:08:33.235>strength.

156
00:08:34.955 --> 00:08:37.685
<00:08:34.955>Each <00:08:35.235>one <00:08:35.515>has <00:08:35.795>a <00:08:36.075>particular <00:08:36.355>feature

157
00:08:38.275 --> 00:08:42.045
<00:08:38.275>that <00:08:38.430>makes <00:08:38.586>the <00:08:38.741>framework <00:08:38.897>relevant <00:08:39.052>for <00:08:39.208>a <00:08:39.363>particular <00:08:39.519>use <00:08:39.674>case.

158
00:08:42.515 --> 00:08:44.405
<00:08:42.515>Some <00:08:42.748>of <00:08:42.981>them <00:08:43.215>are <00:08:43.448>great, <00:08:43.681>for <00:08:43.914>instance,

159
00:08:44.425 --> 00:08:46.765
<00:08:44.425>for <00:08:44.704>running <00:08:44.984>particular <00:08:45.265>large <00:08:45.545>language <00:08:45.824>models.

160
00:08:47.265 --> 00:08:50.885
<00:08:47.265>For <00:08:47.420>instance, <00:08:47.576>LIDAR <00:08:47.731>t <00:08:47.887>is <00:08:48.042>great <00:08:48.198>for <00:08:48.353>the <00:08:48.509>Jamma <00:08:48.665>performance.

161
00:08:50.885 --> 00:08:54.245
<00:08:50.885>Just <00:08:51.040>to <00:08:51.196>give <00:08:51.351>an <00:08:51.507>example, <00:08:51.662>O <00:08:51.818>Execute <00:08:51.973>Torch <00:08:52.129>is <00:08:52.285>great

162
00:08:54.245 --> 00:08:56.605
<00:08:54.245>for <00:08:54.445>running <00:08:54.645>li <00:08:54.845>uh, <00:08:55.045>for <00:08:55.245>running <00:08:55.445>LAMA <00:08:55.645>models

163
00:08:57.505 --> 00:09:00.525
<00:08:57.505>or <00:08:57.632>on <00:08:57.759>an <00:08:57.886>excellent <00:08:58.014>time, <00:08:58.141>maybe <00:08:58.268>for <00:08:58.395>the <00:08:58.523>five <00:08:58.650>models <00:08:58.777>as <00:08:58.905>well,

164
00:09:01.625 --> 00:09:04.605
<00:09:01.625>or <00:09:01.780>others <00:09:01.936>might <00:09:02.091>be <00:09:02.247>better <00:09:02.402>for <00:09:02.558>running <00:09:02.713>large <00:09:02.869>language <00:09:03.025>models

165
00:09:05.305 --> 00:09:06.685
<00:09:05.305>or <00:09:05.615>others <00:09:05.925>might <00:09:06.236>be <00:09:06.546>great

166
00:09:06.985 --> 00:09:09.005
<00:09:06.985>to <00:09:07.335>run <00:09:07.685>convolutional <00:09:08.035>based <00:09:08.385>neural

167
00:09:09.005 --> 00:09:12.935
<00:09:09.005>networks, <00:09:09.705>many <00:09:10.405>solutions.

168
00:09:13.355 --> 00:09:17.295
<00:09:13.355>But <00:09:13.510>how <00:09:13.666>we <00:09:13.821>can <00:09:13.977>make <00:09:14.132>sure <00:09:14.288>that <00:09:14.443>actually <00:09:14.599>our <00:09:14.755>developers

169
00:09:17.875 --> 00:09:20.055
<00:09:17.875>can <00:09:18.108>have <00:09:18.341>the <00:09:18.575>best <00:09:18.808>performance <00:09:19.041>on <00:09:19.275>Arm

170
00:09:20.055 --> 00:09:22.975
<00:09:20.055>because <00:09:20.229>there <00:09:20.405>are <00:09:20.579>so <00:09:20.755>many <00:09:20.930>solutions <00:09:21.104>out <00:09:21.280>there, <00:09:21.454>right?

171
00:09:23.915 --> 00:09:26.815
<00:09:23.915>And <00:09:24.148>we <00:09:24.381>don't <00:09:24.615>want <00:09:24.848>to, <00:09:25.081>our <00:09:25.314>developers

172
00:09:26.835 --> 00:09:28.535
<00:09:26.835>to <00:09:27.068>suffer <00:09:27.301>from <00:09:27.535>performance <00:09:27.768>on <00:09:28.001>A <00:09:28.235>CPU.

173
00:09:28.535 --> 00:09:32.495
<00:09:28.535>And <00:09:28.709>this <00:09:28.885>is <00:09:29.060>actually <00:09:29.235>our <00:09:29.410>secret <00:09:29.584>source, <00:09:29.760>actually <00:09:29.935>one

174
00:09:32.535 --> 00:09:34.775
<00:09:32.535>of <00:09:32.709>the <00:09:32.885>two <00:09:33.060>secret <00:09:33.235>sources <00:09:33.410>I'm <00:09:33.584>gonna <00:09:33.760>mention <00:09:33.935>today.

175
00:09:35.645 --> 00:09:37.575
<00:09:35.645>This <00:09:35.878>is <00:09:36.111>the <00:09:36.345>Armed <00:09:36.578>Cloud <00:09:36.811>AI <00:09:37.045>library.

176
00:09:37.925 --> 00:09:40.815
<00:09:37.925>Something <00:09:38.158>that <00:09:38.391>we <00:09:38.625>have, <00:09:38.858>uh, <00:09:39.091>developed, <00:09:39.324>starting,

177
00:09:40.815 --> 00:09:43.295
<00:09:40.815>developing <00:09:41.095>last <00:09:41.375>year <00:09:41.655>with <00:09:41.935>a <00:09:42.215>promise

178
00:09:43.795 --> 00:09:46.655
<00:09:43.795>to <00:09:44.074>accelerate <00:09:44.354>the <00:09:44.635>AI <00:09:44.915>computation <00:09:45.194>everywhere.

179
00:09:46.875 --> 00:09:49.455
<00:09:46.875>In <00:09:47.050>a <00:09:47.225>very <00:09:47.400>simple <00:09:47.575>way, <00:09:47.750>this <00:09:47.925>is <00:09:48.100>a <00:09:48.275>library

180
00:09:49.885 --> 00:09:54.055
<00:09:49.885>that <00:09:50.085>contains <00:09:50.285>the <00:09:50.485>most <00:09:50.685>critical, <00:09:50.885>uh, <00:09:51.085>routines <00:09:51.285>optimized

181
00:09:54.055 --> 00:09:55.175
<00:09:54.055>for <00:09:54.559>the <00:09:55.063>MCPU,

182
00:09:55.515 --> 00:09:58.895
<00:09:55.515>and <00:09:55.655>it <00:09:55.795>is <00:09:55.935>already <00:09:56.074>integrated <00:09:56.215>in <00:09:56.355>all <00:09:56.495>the <00:09:56.635>frameworks <00:09:56.775>we <00:09:56.915>have

183
00:09:58.925 --> 00:10:01.335
<00:09:58.925>seen <00:09:59.204>earlier <00:09:59.484>in <00:09:59.765>the <00:10:00.045>previous <00:10:00.324>light.

184
00:10:04.175 --> 00:10:05.795
<00:10:04.175>And <00:10:04.454>this <00:10:04.734>is <00:10:05.015>the, <00:10:05.295>the <00:10:05.574>vision.

185
00:10:06.495 --> 00:10:08.555
<00:10:06.495>So <00:10:06.775>we <00:10:07.055>have <00:10:07.335>our <00:10:07.615>application <00:10:07.895>developer

186
00:10:09.415 --> 00:10:12.475
<00:10:09.415>and <00:10:09.589>they <00:10:09.765>have <00:10:09.939>to <00:10:10.115>decide <00:10:10.290>which <00:10:10.464>framework <00:10:10.640>to <00:10:10.814>use.

187
00:10:13.335 --> 00:10:14.435
<00:10:13.335>And <00:10:13.582>they <00:10:13.830>have <00:10:14.077>many <00:10:14.324>options.

188
00:10:14.435 --> 00:10:16.595
<00:10:14.435>Have <00:10:14.714>you <00:10:14.994>have <00:10:15.275>seen <00:10:15.555>before, <00:10:15.834>right?

189
00:10:18.755 --> 00:10:23.485
<00:10:18.755>Once <00:10:18.910>they <00:10:19.066>have <00:10:19.221>decided <00:10:19.377>these <00:10:19.532>must <00:10:19.688>run <00:10:19.843>well <00:10:19.999>on <00:10:20.155>arm,

190
00:10:24.105 --> 00:10:26.285
<00:10:24.105>how <00:10:24.338>through <00:10:24.571>the <00:10:24.805>arm <00:10:25.038>cloud <00:10:25.271>AI <00:10:25.505>library.

191
00:10:26.985 --> 00:10:31.285
<00:10:26.985>So <00:10:27.140>cloud <00:10:27.296>AI <00:10:27.451>is <00:10:27.607>already <00:10:27.762>integrated <00:10:27.918>many <00:10:28.073>of <00:10:28.229>these <00:10:28.385>frameworks

192
00:10:31.825 --> 00:10:33.645
<00:10:31.825>to <00:10:32.175>make <00:10:32.525>your <00:10:32.875>life <00:10:33.225>easier.

193
00:10:34.145 --> 00:10:35.565
<00:10:34.145>As <00:10:34.400>I <00:10:34.656>said, <00:10:34.911>I'm <00:10:35.167>a <00:10:35.423>developer,

194
00:10:35.905 --> 00:10:38.085
<00:10:35.905>but <00:10:36.105>I <00:10:36.305>also <00:10:36.505>want <00:10:36.704>the <00:10:36.905>flexibility <00:10:37.105>to <00:10:37.305>opt

195
00:10:38.105 --> 00:10:40.245
<00:10:38.105>for <00:10:38.385>different <00:10:38.665>frameworks <00:10:38.945>depending <00:10:39.225>on <00:10:39.505>the

196
00:10:40.245 --> 00:10:41.365
<00:10:40.245>use <00:10:40.581>case <00:10:40.917>I'm <00:10:41.253>targeting.

197
00:10:42.105 --> 00:10:43.325
<00:10:42.105>And <00:10:42.261>the <00:10:42.418>fact <00:10:42.575>that <00:10:42.732>I <00:10:42.889>have <00:10:43.046>a <00:10:43.203>library

198
00:10:43.325 --> 00:10:45.845
<00:10:43.325>that <00:10:43.558>is <00:10:43.791>already <00:10:44.025>integrated <00:10:44.258>all <00:10:44.491>these <00:10:44.725>libraries,

199
00:10:46.185 --> 00:10:49.285
<00:10:46.185>it <00:10:46.324>will <00:10:46.464>make <00:10:46.604>my <00:10:46.744>life <00:10:46.885>easier <00:10:47.025>when <00:10:47.165>I <00:10:47.305>talk <00:10:47.444>about <00:10:47.584>performance

200
00:10:49.285 --> 00:10:51.725
<00:10:49.285>because <00:10:49.564>I <00:10:49.844>always <00:10:50.125>want <00:10:50.405>better <00:10:50.685>performance.

201
00:10:55.155 --> 00:10:58.665
<00:10:55.155>These <00:10:55.355>are <00:10:55.555>some <00:10:55.755>of <00:10:55.954>the, <00:10:56.155>uh, <00:10:56.355>the <00:10:56.555>features

202
00:10:59.205 --> 00:11:00.585
<00:10:59.205>of <00:10:59.515>the <00:10:59.826>AM <00:11:00.136>Cloud <00:11:00.447>ai.

203
00:11:00.765 --> 00:11:05.265
<00:11:00.765>Um, <00:11:00.920>uh, <00:11:01.076>library <00:11:01.231>is <00:11:01.387>a <00:11:01.542>lightweight, <00:11:01.698>uh, <00:11:01.853>library, <00:11:02.009>which, <00:11:02.165>uh,

204
00:11:05.345 --> 00:11:08.185
<00:11:05.345>contains <00:11:05.578>a, <00:11:05.811>um, <00:11:06.045>a <00:11:06.278>critical <00:11:06.511>operations <00:11:06.745>for,

205
00:11:08.365 --> 00:11:09.425
<00:11:08.365>uh, <00:11:08.842>neur <00:11:09.319>networks.

206
00:11:09.515 --> 00:11:11.745
<00:11:09.515>There <00:11:09.748>are <00:11:09.981>no <00:11:10.215>dependencies <00:11:10.448>on <00:11:10.681>the <00:11:10.915>libraries.

207
00:11:11.995 --> 00:11:15.145
<00:11:11.995>There <00:11:12.195>is <00:11:12.395>no <00:11:12.595>membrane <00:11:12.795>location, <00:11:12.995>no <00:11:13.195>threading <00:11:13.395>mechanism

208
00:11:15.695 --> 00:11:18.625
<00:11:15.695>that <00:11:15.870>are <00:11:16.045>what <00:11:16.220>we <00:11:16.395>call <00:11:16.570>it, <00:11:16.745>the <00:11:16.920>micro <00:11:17.095>kernels

209
00:11:19.525 --> 00:11:22.105
<00:11:19.525>is <00:11:19.699>written <00:11:19.875>in <00:11:20.050>sea <00:11:20.225>for <00:11:20.400>having <00:11:20.574>a <00:11:20.750>compatibility <00:11:20.925>with

210
00:11:22.125 --> 00:11:23.625
<00:11:22.125>as <00:11:22.462>many <00:11:22.800>frameworks <00:11:23.137>as <00:11:23.475>possible.

211
00:11:23.815 --> 00:11:25.665
<00:11:23.815>Because <00:11:24.095>when <00:11:24.375>we <00:11:24.655>talk <00:11:24.935>about <00:11:25.215>mobile

212
00:11:25.965 --> 00:11:30.425
<00:11:25.965>and <00:11:26.092>edge <00:11:26.219>deployment, <00:11:26.346>there <00:11:26.474>is <00:11:26.601>also <00:11:26.728>the <00:11:26.855>co <00:11:26.983>the, <00:11:27.110>the, <00:11:27.237>the <00:11:27.365>fact

213
00:11:30.425 --> 00:11:31.865
<00:11:30.425>that <00:11:30.641>some <00:11:30.857>framework <00:11:31.073>have <00:11:31.289>written <00:11:31.505>in <00:11:31.721>c

214
00:11:31.865 --> 00:11:35.025
<00:11:31.865>and <00:11:32.005>not <00:11:32.145>in <00:11:32.285>c <00:11:32.425>plus <00:11:32.565>plus <00:11:32.705>is <00:11:32.845>actually, <00:11:32.985>that <00:11:33.125>is <00:11:33.265>the,

215
00:11:35.025 --> 00:11:38.185
<00:11:35.025>the <00:11:35.165>reason <00:11:35.305>why <00:11:35.444>we <00:11:35.584>decided <00:11:35.725>to <00:11:35.865>develop <00:11:36.005>a <00:11:36.145>library <00:11:36.285>in <00:11:36.425>C

216
00:11:39.765 --> 00:11:41.785
<00:11:39.765>is <00:11:39.965>a <00:11:40.165>library, <00:11:40.365>not <00:11:40.564>just <00:11:40.765>for <00:11:40.965>generative <00:11:41.165>ai,

217
00:11:42.725 --> 00:11:45.745
<00:11:42.725>but <00:11:42.925>certainly <00:11:43.125>most <00:11:43.325>of <00:11:43.525>the <00:11:43.725>optimized <00:11:43.925>routines <00:11:44.125>are

218
00:11:45.745 --> 00:11:47.265
<00:11:45.745>for <00:11:46.201>accelerating <00:11:46.657>generative <00:11:47.113>ai.

219
00:11:48.085 --> 00:11:50.905
<00:11:48.085>But <00:11:48.365>these <00:11:48.645>optimizations <00:11:48.925>are <00:11:49.205>also <00:11:49.485>applicable

220
00:11:51.005 --> 00:11:53.225
<00:11:51.005>for <00:11:51.355>classic <00:11:51.705>machine <00:11:52.055>learning <00:11:52.405>algorithms

221
00:11:53.465 --> 00:11:55.925
<00:11:53.465>or <00:11:53.698>also <00:11:53.931>for <00:11:54.165>convolution <00:11:54.398>based <00:11:54.631>neur <00:11:54.865>networks.

222
00:11:59.005 --> 00:12:01.515
<00:11:59.005>Let's <00:11:59.238>go <00:11:59.471>back <00:11:59.705>to <00:11:59.938>the <00:12:00.171>use <00:12:00.405>cases.

223
00:12:02.635 --> 00:12:05.875
<00:12:02.635>I <00:12:02.790>started <00:12:02.946>with <00:12:03.101>some <00:12:03.257>use <00:12:03.412>cases <00:12:03.568>at <00:12:03.723>the <00:12:03.879>very <00:12:04.035>beginning.

224
00:12:06.735 --> 00:12:10.675
<00:12:06.735>Now <00:12:06.875>I'm <00:12:07.015>gonna <00:12:07.155>highlight <00:12:07.295>two <00:12:07.435>use <00:12:07.575>cases <00:12:07.715>that <00:12:07.855>will <00:12:07.995>help <00:12:08.135>me

225
00:12:10.695 --> 00:12:15.115
<00:12:10.695>to <00:12:10.895>understand <00:12:11.095>why <00:12:11.295>we <00:12:11.495>have <00:12:11.695>developed <00:12:11.895>a <00:12:12.095>technology

226
00:12:15.115 --> 00:12:16.755
<00:12:15.115>that <00:12:15.465>I'm <00:12:15.815>gonna <00:12:16.165>announce <00:12:16.515>later.

227
00:12:18.005 --> 00:12:22.075
<00:12:18.005>Audio <00:12:18.132>gen, <00:12:18.259>as <00:12:18.386>we <00:12:18.514>have <00:12:18.641>seen, <00:12:18.768>we <00:12:18.895>have <00:12:19.023>it <00:12:19.150>in <00:12:19.277>input <00:12:19.405>text

228
00:12:22.745 --> 00:12:25.195
<00:12:22.745>that <00:12:22.945>describes <00:12:23.145>the <00:12:23.345>type <00:12:23.545>of <00:12:23.745>audio <00:12:23.945>they <00:12:24.145>want.

229
00:12:25.745 --> 00:12:29.155
<00:12:25.745>This <00:12:25.872>has <00:12:25.999>been <00:12:26.126>announced <00:12:26.254>in <00:12:26.381>May <00:12:26.508>20 <00:12:26.635>file, <00:12:26.763>though <00:12:26.890>we <00:12:27.017>have, <00:12:27.145>um,

230
00:12:29.675 --> 00:12:31.115
<00:12:29.675>promoted <00:12:30.323>at <00:12:30.971>MWC,

231
00:12:31.135 --> 00:12:33.715
<00:12:31.135>but <00:12:31.368>officially <00:12:31.601>the, <00:12:31.835>the <00:12:32.068>model <00:12:32.301>was, <00:12:32.535>um,

232
00:12:34.195 --> 00:12:35.875
<00:12:34.195>publicly <00:12:34.545>available <00:12:34.895>in <00:12:35.245>May <00:12:35.595>25.

233
00:12:36.785 --> 00:12:40.595
<00:12:36.785>Also <00:12:36.901>with <00:12:37.018>a <00:12:37.135>tutorial, <00:12:37.251>if <00:12:37.368>you <00:12:37.485>want <00:12:37.601>to <00:12:37.718>run <00:12:37.834>it <00:12:37.951>on <00:12:38.068>your <00:12:38.185>laptop

234
00:12:40.595 --> 00:12:41.595
<00:12:40.595>or <00:12:40.895>your <00:12:41.195>mobile <00:12:41.495>phone,

235
00:12:41.895 --> 00:12:44.555
<00:12:41.895>you <00:12:42.095>can <00:12:42.295>just <00:12:42.495>follow <00:12:42.694>tutorial <00:12:42.895>if <00:12:43.095>recall <00:12:43.295>correctly.

236
00:12:44.555 --> 00:12:45.555
<00:12:44.555>There <00:12:44.780>are <00:12:45.005>just <00:12:45.229>three <00:12:45.454>steps.

237
00:12:46.595 --> 00:12:50.595
<00:12:46.595>C <00:12:46.828>make, <00:12:47.061>do, <00:12:47.295>dot, <00:12:47.528>make, <00:12:47.761>blah <00:12:47.995>run.

238
00:12:51.275 --> 00:12:52.835
<00:12:51.275>I <00:12:51.475>think <00:12:51.675>there <00:12:51.875>are <00:12:52.074>just <00:12:52.275>three <00:12:52.475>steps <00:12:52.675>for,

239
00:12:52.835 --> 00:12:53.955
<00:12:52.835>for <00:12:53.171>running <00:12:53.507>this <00:12:53.843>example.

240
00:12:54.715 --> 00:12:55.155
<00:12:54.715>I <00:12:54.913>love <00:12:55.111>it.

241
00:13:00.485 --> 00:13:04.105
<00:13:00.485>Why <00:13:00.660>do <00:13:00.835>we <00:13:01.010>want <00:13:01.185>audio <00:13:01.360>gen <00:13:01.535>or <00:13:01.710>mobile <00:13:01.885>thing?

242
00:13:04.895 --> 00:13:09.545
<00:13:04.895>Because <00:13:05.022>all <00:13:05.149>at <00:13:05.276>the <00:13:05.404>edge, <00:13:05.531>because <00:13:05.658>if <00:13:05.785>you <00:13:05.913>are <00:13:06.040>a <00:13:06.167>music <00:13:06.295>producer

243
00:13:10.475 --> 00:13:11.815
<00:13:10.475>or <00:13:10.716>you <00:13:10.957>are, <00:13:11.198>or <00:13:11.439>you <00:13:11.681>are

244
00:13:12.395 --> 00:13:14.095
<00:13:12.395>or <00:13:12.628>you <00:13:12.861>are <00:13:13.095>an <00:13:13.328>artist, <00:13:13.561>you <00:13:13.795>know,

245
00:13:14.095 --> 00:13:15.615
<00:13:14.095>this <00:13:14.368>is <00:13:14.642>actually <00:13:14.915>any <00:13:15.189>narrative <00:13:15.463>process.

246
00:13:16.325 --> 00:13:18.775
<00:13:16.325>It's <00:13:16.525>not <00:13:16.725>like <00:13:16.925>I <00:13:17.125>text <00:13:17.325>what <00:13:17.525>I <00:13:17.725>want

247
00:13:19.035 --> 00:13:21.695
<00:13:19.035>and <00:13:19.190>for <00:13:19.346>sure <00:13:19.501>at <00:13:19.657>the <00:13:19.812>first <00:13:19.968>attempt <00:13:20.123>I'm <00:13:20.279>gonna <00:13:20.435>get

248
00:13:22.715 --> 00:13:24.375
<00:13:22.715>the <00:13:22.995>best <00:13:23.275>music <00:13:23.555>in <00:13:23.835>the <00:13:24.115>world.

249
00:13:24.795 --> 00:13:28.895
<00:13:24.795>And <00:13:24.911>we <00:13:25.028>know <00:13:25.145>that <00:13:25.261>you <00:13:25.378>have <00:13:25.495>to <00:13:25.611>experiment, <00:13:25.728>you <00:13:25.844>have <00:13:25.961>to <00:13:26.078>try <00:13:26.194>it.

250
00:13:29.715 --> 00:13:32.855
<00:13:29.715>And <00:13:29.915>with, <00:13:30.115>uh, <00:13:30.315>generative <00:13:30.515>AI <00:13:30.715>is <00:13:30.915>actually <00:13:31.115>great

251
00:13:33.045 --> 00:13:36.815
<00:13:33.045>because <00:13:33.278>with <00:13:33.511>the <00:13:33.745>same <00:13:33.978>text <00:13:34.211>every <00:13:34.444>time,

252
00:13:37.075 --> 00:13:39.855
<00:13:37.075>you <00:13:37.308>can <00:13:37.541>always <00:13:37.775>have <00:13:38.008>different <00:13:38.241>audio <00:13:38.475>samples.

253
00:13:40.285 --> 00:13:42.015
<00:13:40.285>This <00:13:40.459>is <00:13:40.635>the <00:13:40.810>reason <00:13:40.985>why <00:13:41.160>it's <00:13:41.334>called <00:13:41.510>generative <00:13:41.685>ai.

254
00:13:42.015 --> 00:13:44.135
<00:13:42.015>It's <00:13:42.248>not <00:13:42.481>like <00:13:42.715>I <00:13:42.948>have <00:13:43.181>a <00:13:43.415>text

255
00:13:44.435 --> 00:13:47.095
<00:13:44.435>and <00:13:44.668>I <00:13:44.901>always <00:13:45.135>have <00:13:45.368>the <00:13:45.601>same, <00:13:45.834>um,

256
00:13:47.665 --> 00:13:50.575
<00:13:47.665>audio <00:13:48.015>sample <00:13:48.365>by <00:13:48.714>running <00:13:49.064>locally.

257
00:13:51.565 --> 00:13:55.495
<00:13:51.565>This <00:13:51.705>means <00:13:51.845>that <00:13:51.985>I, <00:13:52.125>I <00:13:52.265>can <00:13:52.405>basically <00:13:52.545>remove <00:13:52.685>all <00:13:52.825>the, <00:13:52.965>uh,

258
00:13:55.705 --> 00:13:57.175
<00:13:55.705>cloud, <00:13:56.366>um, <00:13:57.028>instances,

259
00:13:57.395 --> 00:13:58.895
<00:13:57.395>or <00:13:57.620>I <00:13:57.845>don't <00:13:58.069>need <00:13:58.295>to <00:13:58.520>send <00:13:58.745>infinite

260
00:13:58.935 --> 00:14:00.255
<00:13:58.935>requests <00:13:59.232>to <00:13:59.529>create <00:13:59.826>my <00:14:00.123>music.

261
00:14:00.315 --> 00:14:04.575
<00:14:00.315>So <00:14:00.431>I <00:14:00.548>can <00:14:00.665>be <00:14:00.781>simply <00:14:00.898>on <00:14:01.015>my <00:14:01.131>machine, <00:14:01.248>on <00:14:01.365>my <00:14:01.481>device <00:14:01.598>to <00:14:01.715>experiment

262
00:14:04.675 --> 00:14:07.455
<00:14:04.675>and <00:14:04.875>try <00:14:05.074>as <00:14:05.275>many <00:14:05.474>times <00:14:05.675>as <00:14:05.875>I <00:14:06.074>want.

263
00:14:08.235 --> 00:14:11.535
<00:14:08.235>It <00:14:08.468>saves <00:14:08.701>times, <00:14:08.935>but <00:14:09.168>also <00:14:09.401>it <00:14:09.635>saves,

264
00:14:12.315 --> 00:14:14.095
<00:14:12.315>um, <00:14:12.665>and <00:14:13.015>cost <00:14:13.365>as <00:14:13.715>well.

265
00:14:16.485 --> 00:14:19.295
<00:14:16.485>This <00:14:16.685>is <00:14:16.885>the <00:14:17.085>pipeline <00:14:17.285>used <00:14:17.485>for <00:14:17.685>audiogenic <00:14:17.885>quite,

266
00:14:20.005 --> 00:14:21.455
<00:14:20.005>it's <00:14:20.440>not <00:14:20.875>super <00:14:21.310>complicated,

267
00:14:21.555 --> 00:14:22.975
<00:14:21.555>but <00:14:21.767>there <00:14:21.981>are <00:14:22.194>at <00:14:22.407>least <00:14:22.620>three <00:14:22.833>models

268
00:14:24.195 --> 00:14:27.215
<00:14:24.195>and <00:14:24.428>they're <00:14:24.661>also <00:14:24.895>intermediate <00:14:25.128>steps <00:14:25.361>for, <00:14:25.595>uh,

269
00:14:27.355 --> 00:14:28.455
<00:14:27.355>in <00:14:27.553>a, <00:14:27.751>in <00:14:27.949>a <00:14:28.147>blue <00:14:28.345>box.

270
00:14:28.955 --> 00:14:31.535
<00:14:28.955>The <00:14:29.095>intermediate <00:14:29.235>steps <00:14:29.375>is <00:14:29.515>what <00:14:29.655>I <00:14:29.795>call <00:14:29.935>it <00:14:30.075>the <00:14:30.215>mixed <00:14:30.355>pipeline

271
00:14:31.535 --> 00:14:35.655
<00:14:31.535>because <00:14:31.690>some <00:14:31.846>of <00:14:32.001>these <00:14:32.157>are <00:14:32.312>models, <00:14:32.468>the, <00:14:32.623>uh, <00:14:32.779>violet <00:14:32.935>ones,

272
00:14:35.835 --> 00:14:40.015
<00:14:35.835>but <00:14:36.010>the <00:14:36.185>blue <00:14:36.360>ones <00:14:36.535>are <00:14:36.710>actually <00:14:36.885>the, <00:14:37.060>um, <00:14:37.235>uh,

273
00:14:40.035 --> 00:14:41.735
<00:14:40.035>the <00:14:40.268>blue <00:14:40.501>ones <00:14:40.735>are <00:14:40.968>actually <00:14:41.201>the, <00:14:41.435>uh,

274
00:14:41.735 --> 00:14:43.535
<00:14:41.735>computation <00:14:42.085>happens <00:14:42.435>in <00:14:42.785>the <00:14:43.135>middle.

275
00:14:44.235 --> 00:14:46.015
<00:14:44.235>And <00:14:44.390>the <00:14:44.546>fact <00:14:44.701>that <00:14:44.857>we're <00:14:45.012>running <00:14:45.168>on <00:14:45.323>a <00:14:45.479>CPU <00:14:45.635>u,

276
00:14:46.165 --> 00:14:48.575
<00:14:46.165>this <00:14:46.444>makes <00:14:46.724>everything <00:14:47.005>a <00:14:47.285>lot <00:14:47.564>easier.

277
00:14:50.295 --> 00:14:53.005
<00:14:50.295>I <00:14:50.450>have <00:14:50.606>also <00:14:50.761>reported <00:14:50.917>the <00:14:51.072>data <00:14:51.228>types <00:14:51.383>for <00:14:51.539>the <00:14:51.694>models

278
00:14:53.515 --> 00:14:57.565
<00:14:53.515>because <00:14:53.689>here <00:14:53.865>we're <00:14:54.040>talking <00:14:54.215>about <00:14:54.390>audio <00:14:54.564>quality <00:14:54.740>is <00:14:54.915>everything

279
00:14:58.585 --> 00:15:01.405
<00:14:58.585>FP <00:14:58.935>32, <00:14:59.285>intake <00:14:59.635>FP <00:14:59.985>16.

280
00:15:02.265 --> 00:15:03.605
<00:15:02.265>We <00:15:02.506>need <00:15:02.747>a <00:15:02.988>bit <00:15:03.229>of <00:15:03.471>flexibility.

281
00:15:07.875 --> 00:15:10.725
<00:15:07.875>Another <00:15:08.155>use <00:15:08.435>case <00:15:08.715>is <00:15:08.995>not <00:15:09.275>new,

282
00:15:11.385 --> 00:15:13.605
<00:15:11.385>but <00:15:11.585>actually <00:15:11.785>we <00:15:11.985>think <00:15:12.185>in <00:15:12.385>a <00:15:12.585>different <00:15:12.785>way.

283
00:15:14.395 --> 00:15:15.485
<00:15:14.395>It's <00:15:14.722>the <00:15:15.049>smart <00:15:15.376>speaker.

284
00:15:16.705 --> 00:15:20.005
<00:15:16.705>If <00:15:16.832>we <00:15:16.959>think <00:15:17.086>about <00:15:17.214>the <00:15:17.341>smart <00:15:17.468>speaker <00:15:17.595>in <00:15:17.723>the <00:15:17.850>past <00:15:17.977>was <00:15:18.105>simply

285
00:15:20.585 --> 00:15:22.605
<00:15:20.585>one <00:15:20.760>aspect <00:15:20.935>of <00:15:21.110>the <00:15:21.285>smart <00:15:21.460>speaker <00:15:21.635>was <00:15:21.810>running <00:15:21.985>locally.

286
00:15:23.115 --> 00:15:25.485
<00:15:23.115>Most <00:15:23.290>of <00:15:23.465>the <00:15:23.640>computation <00:15:23.815>was <00:15:23.990>happening <00:15:24.165>in <00:15:24.340>the <00:15:24.515>cloud.

287
00:15:26.745 --> 00:15:31.285
<00:15:26.745>Now <00:15:26.900>because <00:15:27.056>of <00:15:27.211>generative <00:15:27.367>ai, <00:15:27.522>these <00:15:27.678>can <00:15:27.833>run <00:15:27.989>fully <00:15:28.145>locally,

288
00:15:32.185 --> 00:15:33.405
<00:15:32.185>it <00:15:32.459>can <00:15:32.733>be <00:15:33.008>fully <00:15:33.283>private.

289
00:15:33.945 --> 00:15:36.525
<00:15:33.945>You <00:15:34.225>don't <00:15:34.505>necessarily <00:15:34.785>need <00:15:35.065>internet <00:15:35.345>connection

290
00:15:36.705 --> 00:15:38.605
<00:15:36.705>to <00:15:36.985>control <00:15:37.265>your <00:15:37.545>devices <00:15:37.825>at <00:15:38.105>home.

291
00:15:39.425 --> 00:15:42.165
<00:15:39.425>You <00:15:39.564>can <00:15:39.704>ask <00:15:39.844>orbit, <00:15:39.984>for <00:15:40.125>instance, <00:15:40.265>this <00:15:40.405>is <00:15:40.545>just <00:15:40.685>a <00:15:40.824>name

292
00:15:42.165 --> 00:15:46.165
<00:15:42.165>that <00:15:42.292>we <00:15:42.419>have <00:15:42.546>given <00:15:42.674>to <00:15:42.801>the <00:15:42.928>smart <00:15:43.055>assistant <00:15:43.183>to <00:15:43.310>deem <00:15:43.437>the <00:15:43.564>light

293
00:15:46.165 --> 00:15:47.285
<00:15:46.165>to <00:15:47.173>50%

294
00:15:47.825 --> 00:15:51.245
<00:15:47.825>and <00:15:47.980>also <00:15:48.136>tell <00:15:48.291>as <00:15:48.447>a <00:15:48.602>bedtime <00:15:48.758>story <00:15:48.913>to <00:15:49.069>your <00:15:49.225>child

295
00:15:52.385 --> 00:15:54.885
<00:15:52.385>and <00:15:52.540>your <00:15:52.696>device <00:15:52.851>can <00:15:53.007>know <00:15:53.162>the <00:15:53.318>name <00:15:53.473>of <00:15:53.629>your <00:15:53.785>child

296
00:15:55.745 --> 00:16:00.525
<00:15:55.745>and <00:15:55.920>can <00:15:56.095>start <00:15:56.270>telling <00:15:56.445>the <00:15:56.620>story <00:15:56.795>without <00:15:56.970>internet <00:15:57.145>connection.

297
00:16:03.165 --> 00:16:04.705
<00:16:03.165>What's <00:16:03.627>the <00:16:04.089>pipeline <00:16:04.551>here?

298
00:16:05.455 --> 00:16:10.025
<00:16:05.455>Well, <00:16:05.610>there <00:16:05.766>are <00:16:05.921>mainly <00:16:06.077>excluding <00:16:06.232>the <00:16:06.388>wake <00:16:06.543>up <00:16:06.699>word, <00:16:06.855>okay,

299
00:16:10.255 --> 00:16:13.385
<00:16:10.255>keyword <00:16:10.410>spotting <00:16:10.566>what <00:16:10.721>we <00:16:10.877>usually <00:16:11.032>say <00:16:11.188>it, <00:16:11.343>there <00:16:11.499>are <00:16:11.655>main,

300
00:16:13.525 --> 00:16:16.905
<00:16:13.525>mainly <00:16:13.758>three <00:16:13.991>stages <00:16:14.225>here, <00:16:14.458>speech <00:16:14.691>to <00:16:14.925>text

301
00:16:17.375 --> 00:16:18.425
<00:16:17.375>that <00:16:17.611>you <00:16:17.847>can <00:16:18.083>use, <00:16:18.319>whisper.

302
00:16:18.965 --> 00:16:23.185
<00:16:18.965>And <00:16:19.092>this <00:16:19.219>can <00:16:19.346>be <00:16:19.474>done <00:16:19.601>with <00:16:19.728>different <00:16:19.855>data <00:16:19.983>types, <00:16:20.110>the <00:16:20.237>LLM <00:16:20.365>part

303
00:16:23.925 --> 00:16:27.215
<00:16:23.925>and <00:16:24.158>the <00:16:24.391>um, <00:16:24.625>text <00:16:24.858>to <00:16:25.091>speech <00:16:25.324>part.

304
00:16:28.515 --> 00:16:32.975
<00:16:28.515>All <00:16:28.670>of <00:16:28.826>these <00:16:28.981>can <00:16:29.137>run <00:16:29.292>today <00:16:29.448>on <00:16:29.603>device, <00:16:29.759>on <00:16:29.915>mobile.

305
00:16:33.435 --> 00:16:34.495
<00:16:33.435>On <00:16:33.911>the <00:16:34.389>MCPU,

306
00:16:42.495 --> 00:16:44.055
<00:16:42.495>I <00:16:42.695>don't <00:16:42.895>think <00:16:43.095>we <00:16:43.295>can <00:16:43.495>hear <00:16:43.695>the <00:16:43.895>audio

307
00:16:47.275 --> 00:16:48.495
<00:16:47.275>And <00:16:47.549>the <00:16:47.824>speed <00:16:48.098>of <00:16:48.373>travel.

308
00:16:49.605 --> 00:16:52.215
<00:16:49.605>Generally <00:16:49.805>it <00:16:50.005>can <00:16:50.205>take <00:16:50.405>anywhere <00:16:50.605>from <00:16:50.805>several <00:16:51.005>hours

309
00:16:52.235 --> 00:16:53.895
<00:16:52.235>to <00:16:52.585>several <00:16:52.935>days <00:16:53.285>for <00:16:53.635>spacecraft

310
00:16:53.915 --> 00:16:55.455
<00:16:53.915>to <00:16:54.192>reach <00:16:54.469>orbit <00:16:54.746>around <00:16:55.023>the <00:16:55.301>earth.

311
00:16:57.995 --> 00:17:00.975
<00:16:57.995>So <00:16:58.170>unfortunately <00:16:58.345>we <00:16:58.520>only <00:16:58.695>heard <00:16:58.870>the <00:16:59.045>last <00:16:59.220>10 <00:16:59.395>seconds,

312
00:17:01.315 --> 00:17:04.895
<00:17:01.315>but <00:17:01.515>actually <00:17:01.715>this <00:17:01.915>was <00:17:02.115>running <00:17:02.315>everything <00:17:02.515>on <00:17:02.715>device

313
00:17:05.325 --> 00:17:06.855
<00:17:05.325>without <00:17:06.013>internet <00:17:06.702>connection.

314
00:17:09.265 --> 00:17:12.705
<00:17:09.265>And <00:17:09.465>here <00:17:09.665>what <00:17:09.865>I <00:17:10.065>want <00:17:10.265>to <00:17:10.465>talk <00:17:10.665>about

315
00:17:13.325 --> 00:17:15.145
<00:17:13.325>is <00:17:13.675>the <00:17:14.025>SME <00:17:14.375>to <00:17:14.725>technology.

316
00:17:16.245 --> 00:17:19.425
<00:17:16.244>We <00:17:16.372>have <00:17:16.499>seen <00:17:16.626>that <00:17:16.754>there <00:17:16.881>are <00:17:17.008>many <00:17:17.135>ways <00:17:17.263>we <00:17:17.390>can <00:17:17.517>run <00:17:17.645>ai.

317
00:17:19.845 --> 00:17:22.145
<00:17:19.845>We <00:17:20.020>have <00:17:20.194>seen <00:17:20.370>how <00:17:20.545>flexible <00:17:20.720>we <00:17:20.895>need <00:17:21.069>to <00:17:21.245>be.

318
00:17:22.205 --> 00:17:25.025
<00:17:22.204>We <00:17:22.405>have <00:17:22.605>different <00:17:22.804>data <00:17:23.004>types <00:17:23.204>in <00:17:23.405>our <00:17:23.605>workloads

319
00:17:25.925 --> 00:17:30.105
<00:17:25.925>before <00:17:26.158>Army <00:17:26.391>introduce <00:17:26.625>S <00:17:26.858>two, <00:17:27.091>a <00:17:27.325>set

320
00:17:30.285 --> 00:17:34.145
<00:17:30.285>of <00:17:30.440>advanced <00:17:30.596>CCP <00:17:30.751>instructions <00:17:30.907>for <00:17:31.062>the <00:17:31.218>arm <00:17:31.373>V <00:17:31.529>nine <00:17:31.685>architecture

321
00:17:34.485 --> 00:17:37.385
<00:17:34.485>to <00:17:34.718>boost <00:17:34.951>the <00:17:35.185>performance <00:17:35.418>of <00:17:35.651>AI <00:17:35.885>workloads,

322
00:17:37.515 --> 00:17:40.025
<00:17:37.515>image <00:17:37.748>processing <00:17:37.981>workloads <00:17:38.215>or <00:17:38.448>computer <00:17:38.681>vision <00:17:38.915>workloads

323
00:17:40.765 --> 00:17:43.385
<00:17:40.765>or <00:17:40.940>what <00:17:41.115>I <00:17:41.290>usually <00:17:41.465>say, <00:17:41.640>if <00:17:41.815>you <00:17:41.990>have <00:17:42.165>workloads

324
00:17:43.395 --> 00:17:46.305
<00:17:43.395>where <00:17:43.570>you <00:17:43.745>have <00:17:43.920>a <00:17:44.095>lot <00:17:44.270>of <00:17:44.445>heavy <00:17:44.620>metrics <00:17:44.795>multiplication,

325
00:17:46.975 --> 00:17:49.605
<00:17:46.975>this <00:17:47.208>technology <00:17:47.441>will <00:17:47.675>help <00:17:47.908>you <00:17:48.141>a <00:17:48.375>lot.

326
00:17:50.835 --> 00:17:53.525
<00:17:50.835>This <00:17:50.975>is <00:17:51.115>built <00:17:51.255>on <00:17:51.395>top <00:17:51.535>of <00:17:51.675>the <00:17:51.815>SV <00:17:51.955>two, <00:17:52.095>the <00:17:52.235>skill

327
00:17:53.525 --> 00:17:54.805
<00:17:53.525>of <00:17:53.909>vector <00:17:54.293>extension <00:17:54.677>two.

328
00:17:55.625 --> 00:17:58.245
<00:17:55.625>Um, <00:17:55.858>so, <00:17:56.091>uh, <00:17:56.325>this <00:17:56.558>makes <00:17:56.791>the, <00:17:57.025>um,

329
00:17:58.585 --> 00:18:02.605
<00:17:58.585>and <00:17:58.725>what <00:17:58.865>you're <00:17:59.005>gonna <00:17:59.145>see <00:17:59.285>later <00:17:59.425>is <00:17:59.565>will <00:17:59.705>provide <00:17:59.845>a <00:17:59.985>lot

330
00:18:02.605 --> 00:18:05.605
<00:18:02.605>of <00:18:02.760>flexibility <00:18:02.916>in <00:18:03.071>particular <00:18:03.227>when <00:18:03.382>you're <00:18:03.538>going <00:18:03.693>to <00:18:03.849>write, <00:18:04.005>uh,

331
00:18:05.675 --> 00:18:09.645
<00:18:05.675>your <00:18:05.850>code, <00:18:06.024>uh, <00:18:06.200>in <00:18:06.375>particular <00:18:06.550>for <00:18:06.725>future, <00:18:06.899>uh, <00:18:07.075>extensions.

332
00:18:12.445 --> 00:18:16.545
<00:18:12.445>One <00:18:12.585>key <00:18:12.725>features <00:18:12.865>of <00:18:13.004>the <00:18:13.145>SME <00:18:13.284>two <00:18:13.425>technology <00:18:13.564>is <00:18:13.705>the <00:18:13.845>mpa.

333
00:18:17.125 --> 00:18:19.785
<00:18:17.125>And <00:18:17.325>this <00:18:17.525>is <00:18:17.725>the <00:18:17.925>key <00:18:18.125>behind <00:18:18.325>the <00:18:18.525>level

334
00:18:19.885 --> 00:18:22.745
<00:18:19.885>of <00:18:20.040>performance <00:18:20.196>you're <00:18:20.351>gonna <00:18:20.507>see <00:18:20.662>in <00:18:20.818>the <00:18:20.973>next <00:18:21.129>few <00:18:21.285>slides.

335
00:18:24.085 --> 00:18:28.265
<00:18:24.085>MPA <00:18:24.260>is <00:18:24.435>an <00:18:24.610>instruction <00:18:24.785>that <00:18:24.960>performs <00:18:25.135>the, <00:18:25.310>uh, <00:18:25.485>metrics,

336
00:18:28.495 --> 00:18:30.065
<00:18:28.495>auto <00:18:29.195>product <00:18:29.895>accumulate

337
00:18:30.525 --> 00:18:33.465
<00:18:30.525>to <00:18:30.805>enable <00:18:31.085>very <00:18:31.365>efficient <00:18:31.645>metrics, <00:18:31.925>multiplication.

338
00:18:34.645 --> 00:18:37.825
<00:18:34.645>And <00:18:34.785>if <00:18:34.925>you're <00:18:35.065>familiar <00:18:35.205>with <00:18:35.345>a <00:18:35.485>dot <00:18:35.625>product, <00:18:35.764>the <00:18:35.905>dot <00:18:36.045>product

339
00:18:38.335 --> 00:18:39.825
<00:18:38.335>returns <00:18:38.782>a <00:18:39.229>scaler <00:18:39.676>value.

340
00:18:40.525 --> 00:18:43.305
<00:18:40.525>The <00:18:40.758>auto <00:18:40.991>product <00:18:41.225>instead <00:18:41.458>returns <00:18:41.691>some <00:18:41.925>metrics.

341
00:18:44.375 --> 00:18:46.145
<00:18:44.375>Therefore, <00:18:44.608>if <00:18:44.841>we <00:18:45.075>put <00:18:45.308>in <00:18:45.541>the <00:18:45.775>context

342
00:18:46.365 --> 00:18:49.985
<00:18:46.365>of <00:18:46.598>metrics <00:18:46.831>multiplication, <00:18:47.065>this <00:18:47.298>is <00:18:47.531>an <00:18:47.765>example.

343
00:18:51.175 --> 00:18:53.585
<00:18:51.175>Okay? <00:18:51.375>And <00:18:51.575>then <00:18:51.774>an <00:18:51.975>example <00:18:52.175>of <00:18:52.375>metrics <00:18:52.575>multiply

344
00:18:53.585 --> 00:18:55.945
<00:18:53.585>where <00:18:53.865>the <00:18:54.145>metrics <00:18:54.425>multiplication <00:18:54.705>is <00:18:54.985>defined

345
00:18:55.965 --> 00:19:00.145
<00:18:55.965>as <00:18:56.092>the <00:18:56.219>top <00:18:56.346>product <00:18:56.474>between <00:18:56.601>a <00:18:56.728>a <00:18:56.855>specific <00:18:56.983>row <00:18:57.110>of <00:18:57.237>the <00:18:57.365>left

346
00:19:00.145 --> 00:19:01.985
<00:19:00.145>and <00:19:00.378>side <00:19:00.611>metrics <00:19:00.845>and <00:19:01.078>a <00:19:01.311>specific <00:19:01.545>column,

347
00:19:02.045 --> 00:19:03.665
<00:19:02.045>the <00:19:02.325>right <00:19:02.605>right <00:19:02.885>hand <00:19:03.165>side <00:19:03.445>metrics.

348
00:19:04.875 --> 00:19:09.455
<00:19:04.875>These <00:19:05.108>can <00:19:05.341>be <00:19:05.575>decomposed <00:19:05.808>in <00:19:06.041>auto <00:19:06.275>products.

349
00:19:10.715 --> 00:19:13.615
<00:19:10.715>And <00:19:10.948>this <00:19:11.181>is <00:19:11.415>behind <00:19:11.648>all <00:19:11.881>the <00:19:12.115>optimizations

350
00:19:13.615 --> 00:19:17.415
<00:19:13.615>that <00:19:13.770>we <00:19:13.926>have <00:19:14.081>done <00:19:14.237>already <00:19:14.392>with <00:19:14.548>the <00:19:14.703>SME <00:19:14.859>through <00:19:15.015>technology.

351
00:19:18.475 --> 00:19:22.775
<00:19:18.475>By <00:19:18.649>doing <00:19:18.824>so, <00:19:19.000>using <00:19:19.175>this <00:19:19.350>specific <00:19:19.524>construction, <00:19:19.699>we <00:19:19.875>managed

352
00:19:22.775 --> 00:19:24.175
<00:19:22.775>to <00:19:23.090>achieve <00:19:23.405>very <00:19:23.720>good <00:19:24.034>performance.

353
00:19:24.235 --> 00:19:26.735
<00:19:24.235>And <00:19:24.390>you're <00:19:24.546>gonna <00:19:24.701>see <00:19:24.857>what <00:19:25.012>level <00:19:25.168>of <00:19:25.323>performance <00:19:25.479>in <00:19:25.635>particular

354
00:19:26.755 --> 00:19:28.375
<00:19:26.755>for <00:19:27.221>generative <00:19:27.688>AI <00:19:28.155>workloads.

355
00:19:32.655 --> 00:19:35.435
<00:19:32.655>Uh, <00:19:32.795>but <00:19:32.935>let's <00:19:33.075>have <00:19:33.215>a <00:19:33.355>look <00:19:33.495>at <00:19:33.635>the <00:19:33.774>more <00:19:33.915>instruction, <00:19:34.055>uh,

356
00:19:35.495 --> 00:19:38.155
<00:19:35.495>in <00:19:35.695>particular <00:19:35.895>while <00:19:36.094>you're <00:19:36.294>having <00:19:36.495>this <00:19:36.695>light <00:19:36.895>is

357
00:19:38.175 --> 00:19:39.275
<00:19:38.175>the <00:19:38.670>floating <00:19:39.165>point.

358
00:19:39.705 --> 00:19:42.675
<00:19:39.705>Metrics, <00:19:40.054>um, <00:19:40.405>auto <00:19:40.754>product <00:19:41.105>accumulate.

359
00:19:43.775 --> 00:19:46.035
<00:19:43.775>So <00:19:44.008>there <00:19:44.241>are <00:19:44.475>four <00:19:44.708>arguments <00:19:44.941>for <00:19:45.175>this

360
00:19:46.255 --> 00:19:48.235
<00:19:46.255>and <00:19:46.535>is <00:19:46.815>the, <00:19:47.095>uh, <00:19:47.375>instruction <00:19:47.655>name.

361
00:19:49.545 --> 00:19:53.835
<00:19:49.545>What <00:19:49.700>we <00:19:49.856>have <00:19:50.011>is <00:19:50.167>the, <00:19:50.322>um, <00:19:50.478>uh, <00:19:50.633>the <00:19:50.789>destination <00:19:50.945>register,

362
00:19:53.835 --> 00:19:56.435
<00:19:53.835>which <00:19:54.010>is <00:19:54.185>a <00:19:54.360>tile, <00:19:54.535>is <00:19:54.710>not <00:19:54.885>a <00:19:55.060>vector <00:19:55.235>register.

363
00:19:56.895 --> 00:20:00.235
<00:19:56.895>And <00:19:57.050>we <00:19:57.206>also <00:19:57.361>have <00:19:57.517>the <00:19:57.672>input <00:19:57.828>vectors <00:19:57.983>together. <00:19:58.139>That's <00:19:58.295>it.

364
00:20:01.095 --> 00:20:03.035
<00:20:01.095>By <00:20:01.561>in, <00:20:02.028>by <00:20:02.495>doing,

365
00:20:03.175 --> 00:20:06.315
<00:20:03.175>by <00:20:03.350>simply <00:20:03.524>calling <00:20:03.700>this <00:20:03.875>several <00:20:04.050>times <00:20:04.225>you <00:20:04.399>perform <00:20:04.575>the

366
00:20:06.315 --> 00:20:07.355
<00:20:06.315>metrics <00:20:07.251>multiplication.

367
00:20:09.265 --> 00:20:12.755
<00:20:09.265>This <00:20:09.498>instruction <00:20:09.731>is <00:20:09.965>provided <00:20:10.198>for <00:20:10.431>different <00:20:10.665>types.

368
00:20:12.895 --> 00:20:15.915
<00:20:12.895>As <00:20:13.070>I <00:20:13.245>said, <00:20:13.420>we <00:20:13.595>need <00:20:13.770>f <00:20:13.945>flexibility <00:20:14.120>and <00:20:14.295>versatility.

369
00:20:16.335 --> 00:20:20.075
<00:20:16.335>So <00:20:16.535>this <00:20:16.735>actually <00:20:16.935>the <00:20:17.135>beauty <00:20:17.335>of <00:20:17.535>this <00:20:17.735>instruction,

370
00:20:21.935 --> 00:20:23.115
<00:20:21.935>and <00:20:22.200>these <00:20:22.466>are <00:20:22.731>the <00:20:22.997>level

371
00:20:23.175 --> 00:20:25.875
<00:20:23.175>of <00:20:23.455>performance <00:20:23.735>you're <00:20:24.014>seeing <00:20:24.294>today <00:20:24.575>already.

372
00:20:26.695 --> 00:20:29.995
<00:20:26.695>We <00:20:26.850>are <00:20:27.006>talking <00:20:27.161>about <00:20:27.317>more <00:20:27.472>than <00:20:27.628>six <00:20:27.783>times <00:20:27.939>better <00:20:28.095>performance

373
00:20:30.095 --> 00:20:32.995
<00:20:30.095>on <00:20:30.295>key <00:20:30.495>generative <00:20:30.695>VR <00:20:30.895>use <00:20:31.095>cases, <00:20:31.295>for <00:20:31.495>instance,

374
00:20:32.995 --> 00:20:34.755
<00:20:32.995>on <00:20:33.344>Gemma <00:20:33.695>three <00:20:34.044>on <00:20:34.395>Whisper.

375
00:20:35.335 --> 00:20:37.755
<00:20:35.335>And <00:20:35.490>also <00:20:35.646>we <00:20:35.801>have <00:20:35.957>seen <00:20:36.112>more <00:20:36.268>than <00:20:36.423>three <00:20:36.579>times <00:20:36.735>better

376
00:20:37.755 --> 00:20:40.155
<00:20:37.755>performance <00:20:38.035>with, <00:20:38.315>uh, <00:20:38.595>audio <00:20:38.875>gen, <00:20:39.155>with

377
00:20:40.155 --> 00:20:45.135
<00:20:40.155>through <00:20:40.330>stable <00:20:40.504>audio <00:20:40.680>open <00:20:40.855>small <00:20:41.030>to <00:20:41.205>give <00:20:41.379>a <00:20:41.555>bit

378
00:20:45.135 --> 00:20:47.405
<00:20:45.135>of <00:20:45.335>context <00:20:45.535>in <00:20:45.735>the <00:20:45.935>next, <00:20:46.135>uh, <00:20:46.335>few <00:20:46.535>minutes.

379
00:20:47.955 --> 00:20:51.245
<00:20:47.955>This <00:20:48.110>means <00:20:48.266>that <00:20:48.421>for <00:20:48.577>instance, <00:20:48.732>if <00:20:48.888>you're <00:20:49.043>using <00:20:49.199>Gemma <00:20:49.355>three,

380
00:20:51.865 --> 00:20:53.685
<00:20:51.865>it <00:20:52.215>will <00:20:52.565>enable <00:20:52.915>the, <00:20:53.265>uh,

381
00:20:53.685 --> 00:20:56.205
<00:20:53.685>text <00:20:53.918>summarization <00:20:54.151>in <00:20:54.385>a <00:20:54.618>just <00:20:54.851>few <00:20:55.085>seconds.

382
00:20:56.265 --> 00:20:59.605
<00:20:56.265>So <00:20:56.420>you <00:20:56.576>basically <00:20:56.731>start <00:20:56.887>seeing <00:20:57.042>the <00:20:57.198>text <00:20:57.353>on <00:20:57.509>the <00:20:57.665>screen.

383
00:20:59.635 --> 00:21:03.405
<00:20:59.635>Just <00:20:59.775>a <00:20:59.915>few <00:21:00.055>seconds <00:21:00.195>to <00:21:00.335>summarize <00:21:00.475>a <00:21:00.615>full, <00:21:00.754>uh, <00:21:00.895>paragraph <00:21:01.035>page

384
00:21:04.225 --> 00:21:05.605
<00:21:04.225>in <00:21:04.639>case <00:21:05.053>audio <00:21:05.467>gen.

385
00:21:05.865 --> 00:21:07.805
<00:21:05.865>It <00:21:06.098>means <00:21:06.331>that <00:21:06.565>you <00:21:06.798>have <00:21:07.031>11 <00:21:07.265>seconds

386
00:21:07.825 --> 00:21:09.725
<00:21:07.825>of <00:21:08.105>audio <00:21:08.385>in <00:21:08.665>roughly <00:21:08.945>two <00:21:09.225>seconds.

387
00:21:13.055 --> 00:21:14.605
<00:21:13.055>These <00:21:13.334>are <00:21:13.613>the <00:21:13.892>other <00:21:14.171>use <00:21:14.450>cases.

388
00:21:15.315 --> 00:21:17.565
<00:21:15.315>It's <00:21:15.515>not <00:21:15.715>just <00:21:15.915>about <00:21:16.115>ai, <00:21:16.315>it's <00:21:16.515>about <00:21:16.715>camera,

389
00:21:17.875 --> 00:21:22.325
<00:21:17.875>augmented <00:21:18.050>reality, <00:21:18.225>uh, <00:21:18.400>and <00:21:18.575>multi <00:21:18.750>ai, <00:21:18.925>many, <00:21:19.100>many <00:21:19.275>others.

390
00:21:22.385 --> 00:21:25.685
<00:21:22.385>So <00:21:22.492>as <00:21:22.600>I <00:21:22.708>said, <00:21:22.815>whatever <00:21:22.923>use <00:21:23.031>case <00:21:23.138>you <00:21:23.246>have, <00:21:23.354>if <00:21:23.461>you <00:21:23.569>have <00:21:23.677>a <00:21:23.785>lot

391
00:21:25.685 --> 00:21:27.805
<00:21:25.685>of <00:21:26.034>heavy <00:21:26.385>metrics, <00:21:26.735>multiplication <00:21:27.085>routines,

392
00:21:28.555 --> 00:21:32.125
<00:21:28.555>this <00:21:28.730>technology <00:21:28.905>will <00:21:29.080>help <00:21:29.255>you <00:21:29.430>to <00:21:29.605>improve <00:21:29.780>the <00:21:29.955>performance.

393
00:21:33.785 --> 00:21:35.045
<00:21:33.785>And <00:21:34.068>this <00:21:34.352>is <00:21:34.635>the <00:21:34.919>announcement.

394
00:21:35.995 --> 00:21:37.805
<00:21:35.995>This <00:21:36.274>is <00:21:36.554>already <00:21:36.834>available <00:21:37.114>on <00:21:37.395>iOS

395
00:21:38.225 --> 00:21:40.165
<00:21:38.225>and <00:21:38.504>it's <00:21:38.784>coming <00:21:39.064>soon <00:21:39.344>to <00:21:39.625>Android.

396
00:21:40.905 --> 00:21:44.845
<00:21:40.905>And <00:21:41.080>this <00:21:41.254>is <00:21:41.430>a, <00:21:41.605>my <00:21:41.780>recommendation <00:21:41.955>to <00:21:42.129>Android <00:21:42.305>developers.

397
00:21:45.425 --> 00:21:49.045
<00:21:45.425>If <00:21:45.658>you're <00:21:45.891>developing, <00:21:46.125>um, <00:21:46.358>an <00:21:46.591>AI <00:21:46.825>application

398
00:21:49.385 --> 00:21:53.645
<00:21:49.385>for <00:21:49.540>Android <00:21:49.696>smartphones, <00:21:49.851>now <00:21:50.007>is <00:21:50.162>the <00:21:50.318>time <00:21:50.473>to <00:21:50.629>look <00:21:50.785>at

399
00:21:53.755 --> 00:21:55.085
<00:21:53.755>what <00:21:54.054>AI <00:21:54.353>framework <00:21:54.652>you're <00:21:54.952>using

400
00:21:55.425 --> 00:21:57.245
<00:21:55.425>and <00:21:55.658>check <00:21:55.891>whether <00:21:56.125>you're <00:21:56.358>using <00:21:56.591>a <00:21:56.825>framework

401
00:21:57.245 --> 00:21:58.565
<00:21:57.245>with <00:21:57.640>cloud <00:21:58.037>AI <00:21:58.433>support.

402
00:21:58.715 --> 00:22:00.285
<00:21:58.715>Because <00:21:58.995>if <00:21:59.274>this <00:21:59.554>is <00:21:59.834>the <00:22:00.115>case,

403
00:22:00.985 --> 00:22:03.525
<00:22:00.985>you <00:22:01.185>won't <00:22:01.385>need <00:22:01.584>any <00:22:01.784>change <00:22:01.985>in <00:22:02.185>your <00:22:02.385>application.

404
00:22:03.825 --> 00:22:06.285
<00:22:03.825>You're <00:22:04.058>gonna <00:22:04.291>get <00:22:04.525>for <00:22:04.758>free <00:22:04.991>this <00:22:05.225>performance.

405
00:22:09.625 --> 00:22:12.365
<00:22:09.625>And <00:22:09.825>this <00:22:10.025>is <00:22:10.225>the <00:22:10.425>conclusion <00:22:10.625>of <00:22:10.825>this <00:22:11.025>presentation.

406
00:22:13.425 --> 00:22:18.085
<00:22:13.425>So <00:22:13.580>the <00:22:13.736>first <00:22:13.891>thing <00:22:14.047>is <00:22:14.202>about <00:22:14.358>SM <00:22:14.513>E <00:22:14.669>two <00:22:14.825>is

407
00:22:19.125 --> 00:22:22.925
<00:22:19.125>absolutely <00:22:19.325>the <00:22:19.525>most <00:22:19.725>versatile <00:22:19.925>and <00:22:20.125>future <00:22:20.325>ready <00:22:20.525>platform.

408
00:22:23.185 --> 00:22:25.845
<00:22:23.185>Um, <00:22:23.385>it <00:22:23.585>provides <00:22:23.784>the <00:22:23.985>programmability <00:22:24.185>that <00:22:24.385>we <00:22:24.585>need,

409
00:22:26.345 --> 00:22:28.165
<00:22:26.345>the <00:22:26.625>support <00:22:26.905>for <00:22:27.185>different <00:22:27.465>data <00:22:27.745>types

410
00:22:28.705 --> 00:22:31.805
<00:22:28.705>and <00:22:28.860>also <00:22:29.016>the <00:22:29.171>performance <00:22:29.327>that <00:22:29.482>we <00:22:29.638>need <00:22:29.793>for <00:22:29.949>having, <00:22:30.105>uh,

411
00:22:31.825 --> 00:22:33.445
<00:22:31.825>for <00:22:32.175>achieving <00:22:32.525>real <00:22:32.875>time <00:22:33.225>performance

412
00:22:33.505 --> 00:22:36.565
<00:22:33.505>for <00:22:33.785>AI <00:22:34.065>workloads <00:22:34.345>today <00:22:34.625>and <00:22:34.905>tomorrow.

413
00:22:38.345 --> 00:22:40.525
<00:22:38.345>The <00:22:38.578>other <00:22:38.811>aspect, <00:22:39.045>as <00:22:39.278>I <00:22:39.511>mentioned <00:22:39.745>earlier,

414
00:22:41.185 --> 00:22:43.725
<00:22:41.185>if <00:22:41.418>you <00:22:41.651>are <00:22:41.885>an <00:22:42.118>Android <00:22:42.351>smartphone <00:22:42.585>developer,

415
00:22:44.385 --> 00:22:46.805
<00:22:44.385>please <00:22:44.540>have <00:22:44.696>a <00:22:44.851>look <00:22:45.007>at <00:22:45.162>what <00:22:45.318>AI <00:22:45.473>framework <00:22:45.629>you're <00:22:45.785>using.

416
00:22:47.155 --> 00:22:49.365
<00:22:47.155>Because <00:22:47.355>if <00:22:47.555>you're <00:22:47.754>using <00:22:47.955>one <00:22:48.155>of <00:22:48.355>these <00:22:48.555>frameworks,

417
00:22:49.365 --> 00:22:52.845
<00:22:49.365>listen <00:22:49.540>here, <00:22:49.715>like <00:22:49.890>Light <00:22:50.065>Lightar <00:22:50.240>t, <00:22:50.415>media <00:22:50.590>pi, <00:22:50.765>Alibaba,

418
00:22:53.105 --> 00:22:56.725
<00:22:53.105>and <00:22:53.280>Microsoft <00:22:53.455>on <00:22:53.630>the <00:22:53.805>time <00:22:53.980>you're <00:22:54.155>good <00:22:54.330>to <00:22:54.505>go.

419
00:22:57.545 --> 00:22:58.845
<00:22:57.545>No <00:22:57.779>code <00:22:58.013>changes <00:22:58.247>on <00:22:58.481>your <00:22:58.715>end.

420
00:22:58.905 --> 00:23:00.445
<00:22:58.905>You're <00:22:59.251>gonna <00:22:59.598>get <00:22:59.944>the <00:23:00.291>performance

421
00:23:00.445 --> 00:23:02.285
<00:23:00.445>that <00:23:00.645>you <00:23:00.845>need <00:23:01.044>on <00:23:01.245>SME <00:23:01.445>two <00:23:01.645>for <00:23:01.845>free.

422
00:23:03.035 --> 00:23:06.125
<00:23:03.035>Many, <00:23:03.190>uh, <00:23:03.346>and <00:23:03.501>many <00:23:03.657>other <00:23:03.812>frameworks <00:23:03.968>will <00:23:04.123>come <00:23:04.279>later <00:23:04.435>this

423
00:23:06.125 --> 00:23:06.285
year.