WEBVTT

1
00:00:01.895 --> 00:00:03.965
<00:00:01.895>Hello <00:00:02.095>and <00:00:02.295>welcome <00:00:02.495>to <00:00:02.695>another <00:00:02.895>Coffee <00:00:03.094>with <00:00:03.295>Developers.

2
00:00:04.035 --> 00:00:05.605
<00:00:04.035>This <00:00:04.315>time, <00:00:04.595>uh, <00:00:04.875>from <00:00:05.155>the <00:00:05.435>office,

3
00:00:05.885 --> 00:00:07.125
<00:00:05.885>I <00:00:06.044>don't <00:00:06.203>know <00:00:06.363>why <00:00:06.522>I'm <00:00:06.682>dressed <00:00:06.841>like <00:00:07.001>this.

4
00:00:07.185 --> 00:00:08.805
<00:00:07.185>It <00:00:07.359>just <00:00:07.534>felt <00:00:07.709>like <00:00:07.885>the <00:00:08.059>right <00:00:08.235>thing <00:00:08.410>to <00:00:08.584>do.

5
00:00:08.855 --> 00:00:12.725
<00:00:08.855>Today <00:00:08.982>I've <00:00:09.109>got <00:00:09.236>two <00:00:09.364>people <00:00:09.491>here <00:00:09.618>that <00:00:09.745>know <00:00:09.873>a <00:00:10.000>lot <00:00:10.127>about <00:00:10.255>LLMs

6
00:00:12.725 --> 00:00:14.885
<00:00:12.725>and <00:00:13.075>about <00:00:13.424>retrieval, <00:00:13.774>augmented <00:00:14.125>regeneration,

7
00:00:15.145 --> 00:00:16.885
<00:00:15.145>and <00:00:15.320>all <00:00:15.495>the <00:00:15.670>stuff <00:00:15.844>that <00:00:16.020>AI <00:00:16.195>thinks <00:00:16.370>they're <00:00:16.544>doing.

8
00:00:16.885 --> 00:00:18.605
<00:00:16.885>It. <00:00:17.118>Both <00:00:17.351>are <00:00:17.585>working <00:00:17.818>for <00:00:18.051>Google <00:00:18.285>Cloud,

9
00:00:18.985 --> 00:00:21.325
<00:00:18.985>and <00:00:19.140>the <00:00:19.296>first <00:00:19.451>person <00:00:19.607>that <00:00:19.762>we <00:00:19.918>have <00:00:20.073>here <00:00:20.229>is <00:00:20.384>Meta

10
00:00:21.655 --> 00:00:23.285
<00:00:21.655>Tamel. <00:00:21.935>How <00:00:22.215>are <00:00:22.495>you <00:00:22.775>doing <00:00:23.055>today?

11
00:00:23.865 --> 00:00:26.365
<00:00:23.865>I'm <00:00:24.098>good. <00:00:24.331>How <00:00:24.564>are <00:00:24.798>you? <00:00:25.031>I'm <00:00:25.264>good.

12
00:00:26.425 --> 00:00:27.565
<00:00:26.425>Uh, <00:00:26.596>it <00:00:26.767>is <00:00:26.938>just <00:00:27.109>a <00:00:27.280>matter <00:00:27.451>of

13
00:00:27.565 --> 00:00:28.765
<00:00:27.565>like, <00:00:27.745>uh, <00:00:27.925>uh, <00:00:28.105>being <00:00:28.285>in <00:00:28.465>the <00:00:28.645>office.

14
00:00:28.885 --> 00:00:30.085
<00:00:28.885>I <00:00:29.065>never <00:00:29.245>record <00:00:29.425>these <00:00:29.605>things <00:00:29.785>at <00:00:29.965>home.

15
00:00:30.205 --> 00:00:31.725
<00:00:30.205>I <00:00:30.400>got <00:00:30.595>my <00:00:30.791>things <00:00:30.986>set <00:00:31.182>up <00:00:31.377>for <00:00:31.573>me.

16
00:00:31.805 --> 00:00:32.965
<00:00:31.805>I <00:00:32.013>got <00:00:32.222>my <00:00:32.431>coffee <00:00:32.640>and <00:00:32.849>everything,

17
00:00:32.965 --> 00:00:34.525
<00:00:32.965>and <00:00:33.245>here <00:00:33.525>I <00:00:33.805>got <00:00:34.085>this <00:00:34.365>microphone

18
00:00:34.525 --> 00:00:36.285
<00:00:34.525>that <00:00:34.758>probably <00:00:34.991>records <00:00:35.225>every <00:00:35.458>movement <00:00:35.691>of <00:00:35.925>mine,

19
00:00:36.285 --> 00:00:38.725
<00:00:36.285>so <00:00:36.412>I'm <00:00:36.539>not <00:00:36.666>quite <00:00:36.794>sure, <00:00:36.921>but <00:00:37.048>we'll <00:00:37.175>see <00:00:37.303>how <00:00:37.430>it <00:00:37.557>works <00:00:37.684>out.

20
00:00:38.905 --> 00:00:40.685
<00:00:38.905>And <00:00:39.185>there's <00:00:39.465>always <00:00:39.745>editing <00:00:40.025>it <00:00:40.305>recording.

21
00:00:41.185 --> 00:00:44.125
<00:00:41.185>The <00:00:41.340>other <00:00:41.496>person <00:00:41.651>we <00:00:41.807>have <00:00:41.962>here <00:00:42.118>is <00:00:42.273>Gu <00:00:42.429>laforge, <00:00:42.585>uh,

22
00:00:44.355 --> 00:00:45.445
<00:00:44.355>also <00:00:44.681>from <00:00:45.009>Google <00:00:45.336>Cloud.

23
00:00:45.815 --> 00:00:47.965
<00:00:45.815>First <00:00:46.015>of <00:00:46.214>all, <00:00:46.415>uh, <00:00:46.614>how <00:00:46.815>is <00:00:47.015>Jor <00:00:47.214>doing

24
00:00:49.805 --> 00:00:53.165
<00:00:49.805>J <00:00:50.005>Yeah, <00:00:50.205>I'm <00:00:50.405>not <00:00:50.605>part <00:00:50.805>of <00:00:51.005>Star <00:00:51.205>Trek,

25
00:00:53.945 --> 00:00:57.045
<00:00:53.945>but <00:00:54.085>you <00:00:54.225>know, <00:00:54.365>AI <00:00:54.505>and <00:00:54.645>LLM <00:00:54.785>stuff <00:00:54.925>is <00:00:55.065>the <00:00:55.205>future, <00:00:55.345>right?

26
00:00:57.225 --> 00:00:58.225
<00:00:57.225>So, <00:00:58.125>well,

27
00:00:59.605 --> 00:01:01.405
<00:00:59.605>I <00:00:59.805>guess <00:01:00.004>it <00:01:00.205>works, <00:01:00.404>it <00:01:00.605>works <00:01:00.805>together, <00:01:01.004>right?

28
00:01:01.575 --> 00:01:03.725
<00:01:01.575>Right. <00:01:01.808>So <00:01:02.041>both <00:01:02.275>of <00:01:02.508>you, <00:01:02.741>uh, <00:01:02.975>both

29
00:01:03.725 --> 00:01:05.085
<00:01:03.725>of <00:01:03.899>you <00:01:04.074>have <00:01:04.249>done <00:01:04.424>a <00:01:04.599>lot <00:01:04.774>of <00:01:04.949>this.

30
00:01:05.085 --> 00:01:06.365
<00:01:05.084>You've <00:01:05.372>given <00:01:05.661>talks <00:01:05.949>at, <00:01:06.237>uh,

31
00:01:06.365 --> 00:01:08.125
<00:01:06.365>there's <00:01:06.645>great <00:01:06.925>talks <00:01:07.205>at <00:01:07.485>DevOps <00:01:07.765>Belgium.

32
00:01:08.465 --> 00:01:10.845
<00:01:08.465>You <00:01:08.592>just <00:01:08.719>came <00:01:08.846>back <00:01:08.974>from <00:01:09.101>jfo <00:01:09.228>where <00:01:09.355>you <00:01:09.483>said, <00:01:09.610>I <00:01:09.737>don't <00:01:09.865>know,

33
00:01:10.845 --> 00:01:12.005
<00:01:10.845>somehow <00:01:11.106>I <00:01:11.366>got <00:01:11.628>that <00:01:11.889>impression

34
00:01:12.005 --> 00:01:13.205
<00:01:12.005>that <00:01:12.185>you <00:01:12.365>were <00:01:12.545>at <00:01:12.725>J <00:01:12.905>Focus <00:01:13.085>lately,

35
00:01:13.825 --> 00:01:16.285
<00:01:13.825>and, <00:01:14.025>uh, <00:01:14.225>you <00:01:14.425>both <00:01:14.625>work <00:01:14.825>for <00:01:15.025>Google <00:01:15.225>Cloud

36
00:01:16.345 --> 00:01:18.005
<00:01:16.345>and <00:01:16.625>you <00:01:16.905>are <00:01:17.185>both <00:01:17.465>AI <00:01:17.745>experts,

37
00:01:18.105 --> 00:01:19.405
<00:01:18.105>and <00:01:18.339>you <00:01:18.573>weren't <00:01:18.807>only <00:01:19.041>just <00:01:19.275>Google.

38
00:01:19.545 --> 00:01:22.125
<00:01:19.545>You <00:01:19.745>also, <00:01:19.945>uh, <00:01:20.145>worked <00:01:20.345>for <00:01:20.545>other <00:01:20.745>companies <00:01:20.945>before.

39
00:01:22.545 --> 00:01:23.565
<00:01:22.545>You've <00:01:22.774>been <00:01:23.004>in <00:01:23.233>the <00:01:23.463>AI

40
00:01:23.565 --> 00:01:25.285
<00:01:23.565>and <00:01:23.765>machine <00:01:23.965>learning <00:01:24.164>space <00:01:24.365>for <00:01:24.565>quite <00:01:24.765>a <00:01:24.965>while.

41
00:01:25.745 --> 00:01:27.645
<00:01:25.745>So <00:01:25.945>how <00:01:26.145>do <00:01:26.345>you <00:01:26.545>currently <00:01:26.745>feel <00:01:26.945>about <00:01:27.145>it?

42
00:01:27.705 --> 00:01:28.765
<00:01:27.705>Do <00:01:27.895>you <00:01:28.086>think <00:01:28.277>it's <00:01:28.468>great <00:01:28.659>that

43
00:01:28.765 --> 00:01:29.965
<00:01:28.765>there's <00:01:28.981>so <00:01:29.197>much <00:01:29.413>attention <00:01:29.629>about <00:01:29.845>it?

44
00:01:29.965 --> 00:01:32.445
<00:01:29.965>Or <00:01:30.105>if <00:01:30.245>for <00:01:30.385>somebody <00:01:30.525>who's <00:01:30.665>worked <00:01:30.805>for <00:01:30.945>it <00:01:31.085>for <00:01:31.225>that <00:01:31.365>long,

45
00:01:32.865 --> 00:01:35.325
<00:01:32.865>is <00:01:33.040>it <00:01:33.215>just <00:01:33.390>annoying <00:01:33.565>that <00:01:33.740>people <00:01:33.915>are <00:01:34.090>doing, <00:01:34.265>uh,

46
00:01:35.325 --> 00:01:37.325
<00:01:35.325>are <00:01:35.525>hyping <00:01:35.725>it <00:01:35.925>up <00:01:36.125>all <00:01:36.325>the <00:01:36.525>time? <00:01:36.725>Well,

47
00:01:37.325 --> 00:01:40.925
<00:01:37.325>For <00:01:37.465>me <00:01:37.605>it's, <00:01:37.745>uh, <00:01:37.885>very, <00:01:38.025>very <00:01:38.165>exciting <00:01:38.305>in <00:01:38.445>the <00:01:38.585>sense <00:01:38.725>that,

48
00:01:40.945 --> 00:01:44.365
<00:01:40.945>uh, <00:01:41.100>there's <00:01:41.256>always <00:01:41.411>something <00:01:41.567>new <00:01:41.722>every <00:01:41.878>week, <00:01:42.033>if <00:01:42.189>not <00:01:42.345>days.

49
00:01:44.365 --> 00:01:48.445
<00:01:44.365>Sometimes <00:01:44.481>like <00:01:44.598>a <00:01:44.715>new <00:01:44.831>model, <00:01:44.948>a <00:01:45.065>new, <00:01:45.181>uh, <00:01:45.298>a <00:01:45.415>new <00:01:45.531>paper <00:01:45.648>that, <00:01:45.765>uh,

50
00:01:48.445 --> 00:01:53.045
<00:01:48.445>explores <00:01:48.585>some, <00:01:48.725>some <00:01:48.865>aspect <00:01:49.005>of, <00:01:49.145>uh, <00:01:49.285>AI <00:01:49.425>or <00:01:49.565>lms, <00:01:49.705>et <00:01:49.845>cetera.

51
00:01:53.105 --> 00:01:56.045
<00:01:53.104>So <00:01:53.260>it's <00:01:53.416>super <00:01:53.571>interesting <00:01:53.727>to, <00:01:53.882>uh, <00:01:54.038>be <00:01:54.193>in <00:01:54.349>that <00:01:54.505>field

52
00:01:56.305 --> 00:01:58.085
<00:01:56.305>and, <00:01:56.655>um, <00:01:57.005>try <00:01:57.355>new <00:01:57.705>stuff

53
00:01:58.085 --> 00:01:59.645
<00:01:58.085>and <00:01:58.318>there's <00:01:58.551>always <00:01:58.785>something <00:01:59.018>to <00:01:59.251>try <00:01:59.485>out.

54
00:01:59.645 --> 00:02:00.645
<00:01:59.645>So <00:01:59.870>if <00:02:00.095>you <00:02:00.320>are <00:02:00.545>couriers,

55
00:02:00.645 --> 00:02:02.565
<00:02:00.645>there's <00:02:00.878>always <00:02:01.111>something <00:02:01.345>you, <00:02:01.578>you <00:02:01.811>can <00:02:02.045>explore.

56
00:02:02.945 --> 00:02:04.765
<00:02:02.945>So <00:02:03.225>that's, <00:02:03.505>uh, <00:02:03.785>I <00:02:04.065>love <00:02:04.345>that.

57
00:02:05.705 --> 00:02:07.845
<00:02:05.705>Do <00:02:05.845>you <00:02:05.985>feel <00:02:06.125>like <00:02:06.265>there's <00:02:06.405>a, <00:02:06.545>there's <00:02:06.685>so <00:02:06.825>much <00:02:06.965>to <00:02:07.105>know

58
00:02:08.025 --> 00:02:10.925
<00:02:08.025>and <00:02:08.164>people <00:02:08.305>try <00:02:08.445>to <00:02:08.585>take <00:02:08.725>shortcuts <00:02:08.865>all <00:02:09.005>the <00:02:09.145>time <00:02:09.285>right <00:02:09.425>now?

59
00:02:11.025 --> 00:02:12.485
<00:02:11.025>Or <00:02:11.244>how <00:02:11.463>do <00:02:11.682>you <00:02:11.901>feel <00:02:12.120>about <00:02:12.339>that?

60
00:02:13.275 --> 00:02:14.765
<00:02:13.275>Yeah, <00:02:13.498>I <00:02:13.722>mean, <00:02:13.945>I <00:02:14.168>agree <00:02:14.392>with <00:02:14.616>gim

61
00:02:14.765 --> 00:02:16.565
<00:02:14.765>that <00:02:14.998>there's <00:02:15.231>always <00:02:15.464>new <00:02:15.698>things <00:02:15.931>coming <00:02:16.165>up,

62
00:02:16.625 --> 00:02:19.925
<00:02:16.625>and <00:02:16.752>it's <00:02:16.879>kind <00:02:17.006>of, <00:02:17.134>I <00:02:17.261>always <00:02:17.388>feel <00:02:17.515>like <00:02:17.643>I'm <00:02:17.770>falling <00:02:17.897>behind, <00:02:18.025>so

63
00:02:19.925 --> 00:02:21.205
<00:02:19.925>as <00:02:20.069>soon <00:02:20.213>as <00:02:20.357>I <00:02:20.501>feel <00:02:20.644>like <00:02:20.789>I <00:02:20.933>learn <00:02:21.077>something,

64
00:02:21.205 --> 00:02:22.205
<00:02:21.204>there's <00:02:21.429>something <00:02:21.654>else, <00:02:21.880>something <00:02:22.105>else.

65
00:02:22.345 --> 00:02:23.805
<00:02:22.345>So <00:02:22.564>there's <00:02:22.783>this <00:02:23.002>an <00:02:23.221>anxiety <00:02:23.440>of <00:02:23.659>like,

66
00:02:23.805 --> 00:02:24.925
<00:02:23.805>okay, <00:02:23.949>do <00:02:24.093>I <00:02:24.237>know <00:02:24.381>enough <00:02:24.525>in <00:02:24.669>this <00:02:24.813>field?

67
00:02:24.985 --> 00:02:27.045
<00:02:24.985>Am <00:02:25.218>I <00:02:25.451>falling <00:02:25.685>behind? <00:02:25.918>So <00:02:26.151>that's <00:02:26.385>one.

68
00:02:27.865 --> 00:02:29.885
<00:02:27.865>The <00:02:28.040>other <00:02:28.215>thing <00:02:28.390>is <00:02:28.565>that, <00:02:28.740>I <00:02:28.915>mean, <00:02:29.090>I'm <00:02:29.265>very

69
00:02:29.885 --> 00:02:30.965
<00:02:29.885>excited <00:02:30.209>in <00:02:30.533>some <00:02:30.857>aspects.

70
00:02:30.995 --> 00:02:34.005
<00:02:30.995>Like, <00:02:31.195>for <00:02:31.395>example, <00:02:31.595>writing <00:02:31.795>code <00:02:31.995>like <00:02:32.195>changed <00:02:32.395>dramatically

71
00:02:34.005 --> 00:02:37.285
<00:02:34.005>for <00:02:34.132>me <00:02:34.259>now <00:02:34.386>with <00:02:34.514>like <00:02:34.641>AI <00:02:34.768>now, <00:02:34.895>like <00:02:35.023>I <00:02:35.150>almost <00:02:35.277>don't <00:02:35.405>want

72
00:02:37.285 --> 00:02:39.965
<00:02:37.285>to <00:02:37.424>write <00:02:37.565>without <00:02:37.704>ai, <00:02:37.845>even <00:02:37.984>though <00:02:38.125>I <00:02:38.265>know <00:02:38.405>it's <00:02:38.545>not <00:02:38.685>perfect,

73
00:02:40.465 --> 00:02:43.405
<00:02:40.465>but <00:02:40.592>at <00:02:40.719>least <00:02:40.846>like, <00:02:40.974>it <00:02:41.101>helps <00:02:41.228>me <00:02:41.355>a <00:02:41.483>lot <00:02:41.610>along <00:02:41.737>the <00:02:41.865>way,

74
00:02:43.405 --> 00:02:44.765
<00:02:43.405>and <00:02:43.541>then <00:02:43.677>if <00:02:43.813>it <00:02:43.948>doesn't <00:02:44.084>work, <00:02:44.221>I <00:02:44.357>can <00:02:44.493>fix <00:02:44.629>it.

75
00:02:44.985 --> 00:02:48.685
<00:02:44.985>Um, <00:02:45.125>so <00:02:45.265>it <00:02:45.405>really <00:02:45.545>sp <00:02:45.685>sp <00:02:45.825>it, <00:02:45.965>like <00:02:46.105>speed <00:02:46.245>it <00:02:46.385>up.

76
00:02:48.685 --> 00:02:51.725
<00:02:48.685>My, <00:02:48.918>my <00:02:49.151>development, <00:02:49.385>especially <00:02:49.618>front <00:02:49.851>end <00:02:50.085>development,

77
00:02:51.725 --> 00:02:53.805
<00:02:51.725>because <00:02:51.900>I'm <00:02:52.075>mostly <00:02:52.250>backend <00:02:52.424>developer, <00:02:52.600>so <00:02:52.775>if <00:02:52.950>I <00:02:53.125>need

78
00:02:53.805 --> 00:02:56.245
<00:02:53.805>to <00:02:53.945>put <00:02:54.085>some <00:02:54.225>kind <00:02:54.365>of <00:02:54.505>quick <00:02:54.645>UI <00:02:54.785>now, <00:02:54.925>I <00:02:55.065>don't <00:02:55.205>need

79
00:02:56.245 --> 00:02:58.405
<00:02:56.245>to <00:02:56.420>really <00:02:56.595>worry <00:02:56.770>about <00:02:56.945>like, <00:02:57.120>which <00:02:57.295>library <00:02:57.470>to <00:02:57.645>use,

80
00:02:59.025 --> 00:03:00.085
<00:02:59.025>how <00:02:59.215>to <00:02:59.406>do <00:02:59.597>the <00:02:59.788>basic <00:02:59.979>things.

81
00:03:00.085 --> 00:03:01.925
<00:03:00.085>Like <00:03:00.285>the <00:03:00.485>AI <00:03:00.685>just <00:03:00.885>gives <00:03:01.085>me <00:03:01.285>the <00:03:01.485>basics.

82
00:03:01.925 --> 00:03:02.965
<00:03:01.925>So <00:03:02.112>that's <00:03:02.299>very <00:03:02.486>exciting <00:03:02.673>to <00:03:02.861>me.

83
00:03:03.035 --> 00:03:06.245
<00:03:03.035>Like <00:03:03.174>it <00:03:03.315>feels <00:03:03.454>like <00:03:03.595>coding <00:03:03.734>is <00:03:03.875>fun <00:03:04.015>again, <00:03:04.155>in <00:03:04.295>a <00:03:04.435>way.

84
00:03:06.945 --> 00:03:09.485
<00:03:06.945>Um, <00:03:07.120>but <00:03:07.295>on <00:03:07.470>the <00:03:07.644>flip <00:03:07.820>side, <00:03:07.995>like <00:03:08.170>how, <00:03:08.345>how,

85
00:03:10.265 --> 00:03:11.445
<00:03:10.265>how <00:03:10.530>much <00:03:10.796>is <00:03:11.061>gonna <00:03:11.327>happen?

86
00:03:11.445 --> 00:03:13.765
<00:03:11.445>Like <00:03:11.620>at <00:03:11.795>some <00:03:11.970>point <00:03:12.144>if <00:03:12.320>there's <00:03:12.495>no <00:03:12.670>code <00:03:12.845>generational

87
00:03:13.825 --> 00:03:16.085
<00:03:13.825>and <00:03:13.980>the <00:03:14.136>AI <00:03:14.291>just <00:03:14.447>does <00:03:14.602>everything, <00:03:14.758>then <00:03:14.913>at <00:03:15.069>that <00:03:15.225>point,

88
00:03:16.115 --> 00:03:18.605
<00:03:16.115>like <00:03:16.242>we <00:03:16.369>need <00:03:16.496>to <00:03:16.624>think <00:03:16.751>about <00:03:16.878>what, <00:03:17.005>what <00:03:17.133>our <00:03:17.260>role <00:03:17.387>will <00:03:17.515>be.

89
00:03:18.985 --> 00:03:22.245
<00:03:18.985>So <00:03:19.140>there's <00:03:19.296>a <00:03:19.451>little <00:03:19.607>bit <00:03:19.762>of, <00:03:19.918>um, <00:03:20.073>unknown <00:03:20.229>basically <00:03:20.385>that,

90
00:03:22.545 --> 00:03:23.885
<00:03:22.545>you <00:03:22.746>know, <00:03:22.947>like <00:03:23.148>we'll <00:03:23.349>see <00:03:23.550>what <00:03:23.751>happens

91
00:03:24.065 --> 00:03:25.805
<00:03:24.065>and <00:03:24.298>what, <00:03:24.531>how <00:03:24.765>our <00:03:24.998>roles <00:03:25.231>will <00:03:25.465>change.

92
00:03:26.185 --> 00:03:29.005
<00:03:26.185>So <00:03:26.312>it's <00:03:26.439>kind <00:03:26.566>of <00:03:26.694>like <00:03:26.821>a <00:03:26.948>mixed <00:03:27.075>feeling <00:03:27.203>overall, <00:03:27.330>I <00:03:27.457>would <00:03:27.585>say.

93
00:03:30.875 --> 00:03:33.125
<00:03:30.875>Well, <00:03:31.050>it's <00:03:31.225>interesting <00:03:31.400>for <00:03:31.575>somebody <00:03:31.750>who <00:03:31.925>worked <00:03:32.100>on <00:03:32.275>browsers

94
00:03:33.125 --> 00:03:35.245
<00:03:33.125>and <00:03:33.280>works <00:03:33.436>on <00:03:33.591>CSS <00:03:33.747>facts <00:03:33.902>and <00:03:34.058>these <00:03:34.213>kind <00:03:34.369>of <00:03:34.525>things,

95
00:03:35.305 --> 00:03:37.765
<00:03:35.305>or <00:03:35.445>front <00:03:35.585>end <00:03:35.725>was <00:03:35.865>always <00:03:36.005>my, <00:03:36.145>my <00:03:36.285>big <00:03:36.425>thing <00:03:36.565>and <00:03:36.705>like,

96
00:03:38.025 --> 00:03:41.205
<00:03:38.025>and <00:03:38.152>people <00:03:38.279>was <00:03:38.406>like, <00:03:38.534>create <00:03:38.661>a <00:03:38.788>VI <00:03:38.915>app, <00:03:39.043>create <00:03:39.170>a <00:03:39.297>next <00:03:39.425>app,

97
00:03:41.205 --> 00:03:42.325
<00:03:41.204>create <00:03:41.541>desk <00:03:41.876>for <00:03:42.213>V

98
00:03:42.345 --> 00:03:43.965
<00:03:42.345>and <00:03:42.520>you're <00:03:42.695>like, <00:03:42.870>why <00:03:43.045>is, <00:03:43.220>why <00:03:43.395>is <00:03:43.570>all <00:03:43.745>this

99
00:03:43.965 --> 00:03:45.165
<00:03:43.965>boiler <00:03:44.235>plate <00:03:44.505>code <00:03:44.775>in <00:03:45.045>there?

100
00:03:45.505 --> 00:03:47.965
<00:03:45.505>But <00:03:45.704>yeah, <00:03:45.905>it's, <00:03:46.105>it's <00:03:46.305>basically, <00:03:46.505>it's <00:03:46.704>uh, <00:03:46.905>uh,

101
00:03:48.035 --> 00:03:49.445
<00:03:48.035>it's <00:03:48.458>convenience <00:03:48.881>for <00:03:49.304>developers

102
00:03:49.465 --> 00:03:51.645
<00:03:49.465>and <00:03:49.640>basically <00:03:49.815>if <00:03:49.990>you <00:03:50.165>don't <00:03:50.340>know <00:03:50.515>what <00:03:50.690>you're <00:03:50.865>doing,

103
00:03:51.715 --> 00:03:53.165
<00:03:51.715>then <00:03:51.932>you <00:03:52.150>might <00:03:52.367>as <00:03:52.585>well <00:03:52.802>have <00:03:53.019>something

104
00:03:53.165 --> 00:03:55.245
<00:03:53.165>that <00:03:53.340>other <00:03:53.515>people <00:03:53.690>have <00:03:53.864>built <00:03:54.040>for <00:03:54.215>you <00:03:54.390>that <00:03:54.565>actually,

105
00:03:55.505 --> 00:03:57.765
<00:03:55.505>you <00:03:55.680>know, <00:03:55.855>is <00:03:56.030>gonna <00:03:56.204>be <00:03:56.380>reliable <00:03:56.555>to <00:03:56.730>that <00:03:56.905>degree.

106
00:03:58.265 --> 00:04:01.605
<00:03:58.265>Eh, <00:03:58.392>I, <00:03:58.519>I'm <00:03:58.646>curious, <00:03:58.774>do <00:03:58.901>what, <00:03:59.028>what <00:03:59.155>editor <00:03:59.283>are, <00:03:59.410>are <00:03:59.537>you <00:03:59.665>using,

107
00:04:01.665 --> 00:04:04.525
<00:04:01.665>are <00:04:01.781>you <00:04:01.898>using <00:04:02.015>IDX <00:04:02.131>from <00:04:02.248>Google <00:04:02.364>or <00:04:02.481>are <00:04:02.598>you <00:04:02.715>a <00:04:02.831>vs <00:04:02.948>code <00:04:03.065>person?

108
00:04:04.635 --> 00:04:07.325
<00:04:04.635>Like <00:04:04.984>most <00:04:05.334>of <00:04:05.685>us <00:04:06.035>better,

109
00:04:08.075 --> 00:04:09.085
<00:04:08.075>Yeah, <00:04:08.529>mostly <00:04:08.984>vs.

110
00:04:09.085 --> 00:04:12.085
<00:04:09.085>Code <00:04:09.260>nowadays, <00:04:09.435>because <00:04:09.610>I, <00:04:09.785>I <00:04:09.960>program <00:04:10.135>in <00:04:10.310>different <00:04:10.485>languages.

111
00:04:12.085 --> 00:04:14.925
<00:04:12.085>Like, <00:04:12.240>so <00:04:12.396>I'm, <00:04:12.551>my <00:04:12.707>background <00:04:12.862>is <00:04:13.018>like <00:04:13.173>in <00:04:13.329>strongly <00:04:13.485>type

112
00:04:15.125 --> 00:04:16.405
<00:04:15.125>languages <00:04:15.412>like <00:04:15.701>Isha <00:04:15.988>and <00:04:16.277>Java.

113
00:04:16.625 --> 00:04:18.365
<00:04:16.625>Um, <00:04:17.091>but <00:04:17.558>then <00:04:18.024>recently

114
00:04:18.365 --> 00:04:20.205
<00:04:18.365>because <00:04:18.565>of <00:04:18.765>Gen <00:04:18.965>ai, <00:04:19.165>I <00:04:19.365>switched <00:04:19.565>to <00:04:19.765>Python.

115
00:04:20.625 --> 00:04:22.605
<00:04:20.625>So <00:04:20.780>I <00:04:20.936>think <00:04:21.091>we <00:04:21.247>as <00:04:21.402>code <00:04:21.558>is <00:04:21.713>kind <00:04:21.869>of <00:04:22.024>the,

116
00:04:23.025 --> 00:04:25.005
<00:04:23.025>the <00:04:23.224>base <00:04:23.424>level <00:04:23.625>ID <00:04:23.825>that <00:04:24.025>kind <00:04:24.224>of <00:04:24.424>works.

117
00:04:25.165 --> 00:04:27.605
<00:04:25.165>I <00:04:25.281>mean, <00:04:25.398>I <00:04:25.515>know <00:04:25.631>it's <00:04:25.748>not <00:04:25.865>as <00:04:25.981>good <00:04:26.098>as <00:04:26.215>like <00:04:26.331>Intelli, <00:04:26.448>let's <00:04:26.565>say

118
00:04:27.605 --> 00:04:29.605
<00:04:27.605>for <00:04:27.805>Java, <00:04:28.005>but <00:04:28.205>it's, <00:04:28.405>this <00:04:28.605>is <00:04:28.805>good <00:04:29.005>enough.

119
00:04:30.385 --> 00:04:33.285
<00:04:30.385>And <00:04:30.525>then <00:04:30.664>I <00:04:30.805>use <00:04:30.945>Google's <00:04:31.085>Gemini <00:04:31.224>code <00:04:31.365>assist <00:04:31.505>to <00:04:31.645>help <00:04:31.784>me

120
00:04:33.285 --> 00:04:35.165
<00:04:33.284>with <00:04:33.564>code <00:04:33.844>generation <00:04:34.124>and <00:04:34.405>code <00:04:34.684>completion.

121
00:04:35.265 --> 00:04:39.445
<00:04:35.265>And, <00:04:35.405>um, <00:04:35.544>COIs <00:04:35.685>Works <00:04:35.825>works <00:04:35.965>both <00:04:36.104>with <00:04:36.245>VS. <00:04:36.385>Code <00:04:36.525>and <00:04:36.664>IntelliJ.

122
00:04:40.065 --> 00:04:44.045
<00:04:40.065>Um, <00:04:40.205>well, <00:04:40.344>um, <00:04:40.485>JetBrains <00:04:40.625>ID <00:04:40.765>basically, <00:04:40.905>so <00:04:41.045>that's <00:04:41.185>what <00:04:41.325>I <00:04:41.465>use.

123
00:04:44.065 --> 00:04:45.605
<00:04:44.065>But <00:04:44.296>then <00:04:44.527>I <00:04:44.758>also <00:04:44.989>tried <00:04:45.220>different <00:04:45.451>things.

124
00:04:46.365 --> 00:04:47.405
<00:04:46.365>I <00:04:46.677>did <00:04:46.989>try <00:04:47.301>IDX

125
00:04:47.465 --> 00:04:48.885
<00:04:47.465>and <00:04:47.784>I <00:04:48.104>like <00:04:48.423>the <00:04:48.743>idea

126
00:04:48.905 --> 00:04:51.325
<00:04:48.905>of <00:04:49.255>having <00:04:49.604>your <00:04:49.955>whole <00:04:50.304>development

127
00:04:51.325 --> 00:04:52.605
<00:04:51.325>environment <00:04:51.613>in, <00:04:51.901>in <00:04:52.189>the <00:04:52.477>browser.

128
00:04:53.065 --> 00:04:55.045
<00:04:53.065>It <00:04:53.344>really <00:04:53.625>speeds <00:04:53.905>up <00:04:54.185>that <00:04:54.465>up.

129
00:04:55.865 --> 00:04:57.325
<00:04:55.865>But <00:04:56.084>then <00:04:56.303>I <00:04:56.522>did <00:04:56.741>try <00:04:56.960>things <00:04:57.179>like

130
00:04:57.905 --> 00:04:59.805
<00:04:57.905>cursor <00:04:58.184>just <00:04:58.465>in <00:04:58.744>my <00:04:59.025>hobby <00:04:59.304>projects,

131
00:04:59.805 --> 00:05:00.845
<00:04:59.805>and <00:04:59.961>I <00:05:00.117>really <00:05:00.273>like <00:05:00.429>it <00:05:00.585>as <00:05:00.741>well.

132
00:05:01.025 --> 00:05:03.685
<00:05:01.025>Um, <00:05:01.164>and <00:05:01.304>I <00:05:01.445>know <00:05:01.585>there's <00:05:01.724>like <00:05:01.864>10 <00:05:02.005>others <00:05:02.145>out <00:05:02.284>there <00:05:02.424>that

133
00:05:03.685 --> 00:05:04.685
<00:05:03.685>that's <00:05:03.865>on <00:05:04.045>my <00:05:04.225>list <00:05:04.405>to <00:05:04.585>try.

134
00:05:04.825 --> 00:05:06.045
<00:05:04.825>So, <00:05:05.191>yeah. <00:05:05.557>Yeah, <00:05:05.923>it's

135
00:05:06.205 --> 00:05:07.805
<00:05:06.205>Interesting <00:05:06.484>that <00:05:06.765>it's <00:05:07.044>built <00:05:07.325>into <00:05:07.604>GitHub

136
00:05:07.805 --> 00:05:08.845
<00:05:07.805>that <00:05:08.117>basically <00:05:08.429>when <00:05:08.741>you,

137
00:05:08.885 --> 00:05:11.405
<00:05:08.885>when <00:05:09.025>you're <00:05:09.164>on <00:05:09.305>any <00:05:09.445>GitHub <00:05:09.585>repository, <00:05:09.724>you <00:05:09.865>can <00:05:10.005>press <00:05:10.145>the, <00:05:10.284>uh,

138
00:05:11.425 --> 00:05:14.605
<00:05:11.425>the <00:05:11.565>full <00:05:11.705>stop <00:05:11.845>key <00:05:11.985>and <00:05:12.125>it <00:05:12.265>actually <00:05:12.405>opens <00:05:12.545>Visual <00:05:12.685>Studio <00:05:12.825>Code

139
00:05:14.785 --> 00:05:16.605
<00:05:14.785>as <00:05:15.018>the, <00:05:15.251>as <00:05:15.485>the <00:05:15.718>browser <00:05:15.951>based <00:05:16.185>version.

140
00:05:16.915 --> 00:05:18.765
<00:05:16.915>Well, <00:05:17.070>the <00:05:17.226>other <00:05:17.381>one's <00:05:17.537>a <00:05:17.692>browser <00:05:17.848>based <00:05:18.003>version <00:05:18.159>as <00:05:18.315>well.

141
00:05:18.885 --> 00:05:20.965
<00:05:18.885>'cause <00:05:19.040>it's <00:05:19.196>electron, <00:05:19.351>but <00:05:19.507>it <00:05:19.662>actually <00:05:19.818>has <00:05:19.973>it <00:05:20.129>in <00:05:20.284>there.

142
00:05:20.985 --> 00:05:23.245
<00:05:20.985>And <00:05:21.101>I <00:05:21.218>love <00:05:21.335>that <00:05:21.451>when <00:05:21.568>I <00:05:21.685>just <00:05:21.801>want <00:05:21.918>to <00:05:22.035>do <00:05:22.151>a <00:05:22.268>big, <00:05:22.385>uh,

143
00:05:23.245 --> 00:05:25.325
<00:05:23.245>quick <00:05:23.525>pull <00:05:23.805>request <00:05:24.085>for <00:05:24.365>somebody <00:05:24.645>instead

144
00:05:25.325 --> 00:05:26.845
<00:05:25.325>of <00:05:25.598>just <00:05:25.872>downloading <00:05:26.145>the <00:05:26.419>whole <00:05:26.693>thing

145
00:05:26.905 --> 00:05:28.285
<00:05:26.905>and <00:05:27.153>building <00:05:27.401>it <00:05:27.650>on <00:05:27.898>my <00:05:28.147>machine,

146
00:05:28.405 --> 00:05:30.245
<00:05:28.405>I <00:05:28.580>just <00:05:28.755>can <00:05:28.929>edit <00:05:29.104>it <00:05:29.280>in <00:05:29.455>the <00:05:29.630>browser <00:05:29.804>directly.

147
00:05:30.505 --> 00:05:32.765
<00:05:30.505>And <00:05:30.680>it's <00:05:30.855>amazing <00:05:31.030>how <00:05:31.205>far <00:05:31.380>we've <00:05:31.555>come <00:05:31.730>with <00:05:31.905>that.

148
00:05:32.825 --> 00:05:34.005
<00:05:32.825>So <00:05:33.179>that's <00:05:33.533>pretty <00:05:33.887>incredible.

149
00:05:34.385 --> 00:05:36.445
<00:05:34.385>Gu <00:05:34.618>uh, <00:05:34.851>the <00:05:35.085>big <00:05:35.318>breakthrough <00:05:35.551>that <00:05:35.784>led

150
00:05:36.445 --> 00:05:39.365
<00:05:36.445>to <00:05:36.585>the <00:05:36.724>whole <00:05:36.865>LLM <00:05:37.005>thing <00:05:37.145>was <00:05:37.284>to <00:05:37.425>me, <00:05:37.565>the <00:05:37.705>Transformers <00:05:37.844>paper,

151
00:05:39.375 --> 00:05:40.685
<00:05:39.375>which <00:05:39.610>kind <00:05:39.846>of <00:05:40.082>came <00:05:40.318>out <00:05:40.554>Google

152
00:05:41.265 --> 00:05:43.285
<00:05:41.265>and <00:05:41.440>then, <00:05:41.615>uh, <00:05:41.789>uh, <00:05:41.965>it <00:05:42.140>kind <00:05:42.315>of <00:05:42.490>like <00:05:42.664>chat.

153
00:05:43.485 --> 00:05:45.005
<00:05:43.485>GPT <00:05:43.713>took <00:05:43.941>over <00:05:44.169>and <00:05:44.397>everybody's <00:05:44.625>like, <00:05:44.853>oh,

154
00:05:45.005 --> 00:05:46.445
<00:05:45.005>it's <00:05:45.221>an <00:05:45.437>app, <00:05:45.653>it's <00:05:45.869>a <00:05:46.085>chat <00:05:46.301>thing.

155
00:05:46.785 --> 00:05:49.325
<00:05:46.784>And <00:05:46.960>nobody <00:05:47.135>looked <00:05:47.309>at <00:05:47.484>the, <00:05:47.659>at <00:05:47.835>the <00:05:48.010>piping <00:05:48.184>or,

156
00:05:49.325 --> 00:05:51.765
<00:05:49.325>or <00:05:49.465>the, <00:05:49.604>the, <00:05:49.745>the <00:05:49.885>way <00:05:50.025>it <00:05:50.164>actually <00:05:50.305>works <00:05:50.445>under <00:05:50.585>the <00:05:50.724>hood.

157
00:05:52.425 --> 00:05:55.445
<00:05:52.425>Um, <00:05:52.625>now <00:05:52.825>Google <00:05:53.025>is <00:05:53.225>of <00:05:53.425>course <00:05:53.625>could <00:05:53.825>leaps

158
00:05:55.445 --> 00:05:56.765
<00:05:55.445>and <00:05:55.593>bounds <00:05:55.742>as <00:05:55.890>well <00:05:56.039>in <00:05:56.187>this <00:05:56.336>kind <00:05:56.484>of <00:05:56.633>thing

159
00:05:56.765 --> 00:05:57.885
<00:05:56.765>with <00:05:57.101>the <00:05:57.437>Gemini <00:05:57.772>release

160
00:05:57.905 --> 00:05:59.365
<00:05:57.905>and <00:05:58.092>also <00:05:58.280>with <00:05:58.468>the <00:05:58.655>stuff <00:05:58.843>in <00:05:59.031>the <00:05:59.219>Chrome.

161
00:05:59.785 --> 00:06:02.525
<00:05:59.784>Do <00:05:59.901>you <00:06:00.018>think <00:06:00.135>this <00:06:00.251>is <00:06:00.368>actually <00:06:00.484>a <00:06:00.601>good <00:06:00.718>position <00:06:00.835>to <00:06:00.951>be <00:06:01.068>in <00:06:01.184>that,

162
00:06:02.585 --> 00:06:04.565
<00:06:02.585>uh, <00:06:02.818>that, <00:06:03.051>that <00:06:03.284>the <00:06:03.518>first <00:06:03.751>movers, <00:06:03.984>like

163
00:06:04.565 --> 00:06:06.605
<00:06:04.565>with <00:06:04.798>chat <00:06:05.031>GPT <00:06:05.265>being <00:06:05.498>in <00:06:05.731>the <00:06:05.965>limelight

164
00:06:06.605 --> 00:06:08.445
<00:06:06.605>and <00:06:06.838>everybody <00:06:07.071>wanting <00:06:07.305>it <00:06:07.538>to <00:06:07.771>be <00:06:08.005>everything,

165
00:06:08.825 --> 00:06:11.405
<00:06:08.825>you <00:06:09.000>can <00:06:09.175>concentrate <00:06:09.349>again <00:06:09.525>a <00:06:09.700>bit <00:06:09.875>on <00:06:10.050>the <00:06:10.224>functionality

166
00:06:11.405 --> 00:06:13.165
<00:06:11.405>behind <00:06:11.638>it <00:06:11.871>rather <00:06:12.104>than <00:06:12.338>the <00:06:12.571>feature <00:06:12.804>sets?

167
00:06:14.195 --> 00:06:15.885
<00:06:14.195>Yeah, <00:06:14.545>that's <00:06:14.895>an <00:06:15.245>interesting <00:06:15.594>question.

168
00:06:16.185 --> 00:06:18.965
<00:06:16.185>Um, <00:06:16.340>I <00:06:16.496>think <00:06:16.651>there <00:06:16.807>are <00:06:16.962>things <00:06:17.118>that <00:06:17.273>are <00:06:17.429>very <00:06:17.585>visible,

169
00:06:19.305 --> 00:06:21.405
<00:06:19.305>of <00:06:19.538>course, <00:06:19.771>chat, <00:06:20.005>GPT <00:06:20.238>was <00:06:20.471>very <00:06:20.705>visible,

170
00:06:21.625 --> 00:06:26.005
<00:06:21.625>but <00:06:21.800>there <00:06:21.975>are <00:06:22.150>other <00:06:22.325>things <00:06:22.500>that, <00:06:22.675>um, <00:06:22.850>Google <00:06:23.025>pioneered

171
00:06:26.005 --> 00:06:30.405
<00:06:26.005>and <00:06:26.145>came <00:06:26.284>up, <00:06:26.425>uh, <00:06:26.565>first, <00:06:26.705>for <00:06:26.844>example, <00:06:26.985>um, <00:06:27.125>when <00:06:27.265>we <00:06:27.405>introduced

172
00:06:30.925 --> 00:06:34.605
<00:06:30.925>structured <00:06:31.100>outputs <00:06:31.275>there, <00:06:31.450>there <00:06:31.625>was <00:06:31.800>jazz <00:06:31.975>mode <00:06:32.150>for, <00:06:32.325>um,

173
00:06:35.115 --> 00:06:38.085
<00:06:35.115>open <00:06:35.270>AI <00:06:35.426>models, <00:06:35.581>but, <00:06:35.737>uh, <00:06:35.892>you <00:06:36.048>couldn't <00:06:36.203>define <00:06:36.359>like <00:06:36.515>a,

174
00:06:38.485 --> 00:06:41.245
<00:06:38.485>a <00:06:38.685>strong <00:06:38.885>JN <00:06:39.085>schema <00:06:39.285>for, <00:06:39.485>for <00:06:39.685>the <00:06:39.885>outputs

175
00:06:41.265 --> 00:06:44.005
<00:06:41.265>and <00:06:41.465>structured <00:06:41.664>outputs, <00:06:41.865>uh, <00:06:42.065>came <00:06:42.265>first <00:06:42.465>with <00:06:42.664>Gemini,

176
00:06:44.005 --> 00:06:47.605
<00:06:44.005>for <00:06:44.145>example, <00:06:44.284>or <00:06:44.425>all <00:06:44.565>the <00:06:44.705>things <00:06:44.844>like, <00:06:44.985>let's <00:06:45.125>say, <00:06:45.265>uh, <00:06:45.405>well,

177
00:06:47.605 --> 00:06:50.165
<00:06:47.605>there's <00:06:47.745>been <00:06:47.885>a <00:06:48.025>bit <00:06:48.165>of <00:06:48.305>buzz <00:06:48.445>around, <00:06:48.585>for <00:06:48.725>example, <00:06:48.865>notebook <00:06:49.005>lm,

178
00:06:50.415 --> 00:06:52.085
<00:06:50.415>which <00:06:50.648>is <00:06:50.881>one <00:06:51.115>of <00:06:51.348>our, <00:06:51.581>uh, <00:06:51.815>products

179
00:06:52.085 --> 00:06:56.285
<00:06:52.085>and <00:06:52.260>experiments <00:06:52.435>where <00:06:52.609>you <00:06:52.784>have <00:06:52.960>those, <00:06:53.135>uh, <00:06:53.310>AI <00:06:53.484>hosts

180
00:06:56.285 --> 00:06:59.685
<00:06:56.284>that <00:06:56.424>discuss <00:06:56.564>about <00:06:56.705>the, <00:06:56.844>the <00:06:56.984>documents <00:06:57.124>you, <00:06:57.265>you, <00:06:57.405>you <00:06:57.544>gave <00:06:57.684>it

181
00:06:59.685 --> 00:07:01.205
<00:06:59.685>and <00:06:59.958>create <00:07:00.232>a <00:07:00.505>podcast, <00:07:00.779>et <00:07:01.053>cetera.

182
00:07:01.205 --> 00:07:03.285
<00:07:01.205>So <00:07:01.360>there <00:07:01.516>are <00:07:01.671>some <00:07:01.827>cool <00:07:01.982>innovations <00:07:02.138>coming <00:07:02.293>up <00:07:02.449>as <00:07:02.604>well,

183
00:07:03.825 --> 00:07:06.445
<00:07:03.825>and <00:07:04.000>not <00:07:04.175>necessarily <00:07:04.349>as <00:07:04.525>visible <00:07:04.700>as <00:07:04.875>this, <00:07:05.050>you <00:07:05.224>know,

184
00:07:06.445 --> 00:07:08.845
<00:07:06.445>first <00:07:06.645>mover <00:07:06.844>advantage <00:07:07.045>of <00:07:07.245>something <00:07:07.445>like <00:07:07.645>chat <00:07:07.844>GPT.

185
00:07:09.305 --> 00:07:13.965
<00:07:09.305>Uh, <00:07:09.432>but <00:07:09.559>I <00:07:09.686>kind <00:07:09.814>of <00:07:09.941>flag <00:07:10.068>this <00:07:10.195>challenger <00:07:10.323>place <00:07:10.450>in <00:07:10.577>a <00:07:10.705>sense

186
00:07:13.995 --> 00:07:17.685
<00:07:13.995>that, <00:07:14.122>um, <00:07:14.249>you <00:07:14.376>get <00:07:14.504>to, <00:07:14.631>okay, <00:07:14.758>we, <00:07:14.885>we <00:07:15.013>need <00:07:15.140>to <00:07:15.267>do <00:07:15.395>better.

187
00:07:17.745 --> 00:07:20.405
<00:07:17.745>So <00:07:17.900>for <00:07:18.056>example, <00:07:18.211>you, <00:07:18.367>you've, <00:07:18.522>maybe <00:07:18.678>you've <00:07:18.833>seen <00:07:18.989>that, <00:07:19.145>uh,

188
00:07:20.665 --> 00:07:23.685
<00:07:20.665>we <00:07:20.865>progressively <00:07:21.065>climb <00:07:21.265>the, <00:07:21.465>all <00:07:21.665>the <00:07:21.865>leaderboards <00:07:22.065>and,

189
00:07:23.945 --> 00:07:27.085
<00:07:23.945>and <00:07:24.072>benchmarks <00:07:24.199>to <00:07:24.326>be, <00:07:24.454>uh, <00:07:24.581>always <00:07:24.708>at <00:07:24.835>the <00:07:24.963>top, <00:07:25.090>if <00:07:25.217>not <00:07:25.344>the,

190
00:07:27.105 --> 00:07:30.445
<00:07:27.105>the, <00:07:27.280>the <00:07:27.455>first <00:07:27.630>model <00:07:27.805>everywhere <00:07:27.980>in <00:07:28.155>every, <00:07:28.330>uh, <00:07:28.505>benchmarks.

191
00:07:31.185 --> 00:07:34.205
<00:07:31.185>So <00:07:31.340>it's <00:07:31.496>interesting <00:07:31.651>to <00:07:31.807>see <00:07:31.962>this, <00:07:32.118>uh, <00:07:32.273>uh, <00:07:32.429>competition <00:07:32.585>be

192
00:07:34.205 --> 00:07:37.005
<00:07:34.205>between <00:07:34.360>the, <00:07:34.516>the, <00:07:34.671>the <00:07:34.827>actual, <00:07:34.982>uh, <00:07:35.138>players <00:07:35.293>in, <00:07:35.449>in <00:07:35.604>the

193
00:07:37.005 --> 00:07:38.005
<00:07:37.005>Field. <00:07:37.455>It's <00:07:37.905>interesting

194
00:07:38.005 --> 00:07:39.925
<00:07:38.005>to <00:07:38.180>see <00:07:38.355>when <00:07:38.530>you, <00:07:38.705>when <00:07:38.880>you <00:07:39.055>see <00:07:39.230>the <00:07:39.405>titles

195
00:07:39.925 --> 00:07:42.525
<00:07:39.925>of <00:07:40.065>some <00:07:40.205>of <00:07:40.345>your <00:07:40.485>posts, <00:07:40.625>what <00:07:40.765>you've <00:07:40.905>written <00:07:41.045>like <00:07:41.185>gu <00:07:41.325>like

196
00:07:43.125 --> 00:07:44.965
<00:07:43.125>advanced <00:07:43.358>rack <00:07:43.591>techniques, <00:07:43.825>that <00:07:44.058>something <00:07:44.291>I <00:07:44.525>expect,

197
00:07:44.985 --> 00:07:47.965
<00:07:44.985>but <00:07:45.160>things <00:07:45.335>you <00:07:45.510>never <00:07:45.685>dared <00:07:45.860>to <00:07:46.035>ask <00:07:46.210>about <00:07:46.385>LLMs.

198
00:07:48.635 --> 00:07:50.925
<00:07:48.635>What <00:07:48.775>was <00:07:48.914>that <00:07:49.055>about? <00:07:49.195>What <00:07:49.335>was <00:07:49.474>the <00:07:49.615>thing <00:07:49.755>you <00:07:49.895>never <00:07:50.034>dared

199
00:07:50.925 --> 00:07:52.245
<00:07:50.925>to <00:07:51.321>ask <00:07:51.717>about <00:07:52.113>LLMs?

200
00:07:52.595 --> 00:07:57.325
<00:07:52.595>Yeah, <00:07:52.722>the <00:07:52.849>thing <00:07:52.976>is, <00:07:53.104>uh, <00:07:53.231>so <00:07:53.358>there's <00:07:53.485>all <00:07:53.613>the <00:07:53.740>buzz, <00:07:53.867>you <00:07:53.995>know,

201
00:07:57.325 --> 00:07:58.405
<00:07:57.325>around <00:07:58.296>LLMs,

202
00:07:58.405 --> 00:08:00.525
<00:07:58.405>but <00:07:58.560>there <00:07:58.716>are <00:07:58.871>things <00:07:59.027>like, <00:07:59.182>I <00:07:59.338>mean, <00:07:59.493>along <00:07:59.649>the <00:07:59.804>way

203
00:08:00.585 --> 00:08:04.605
<00:08:00.585>as <00:08:00.701>I <00:08:00.818>was <00:08:00.935>learning, <00:08:01.051>so <00:08:01.168>I <00:08:01.284>did <00:08:01.401>some <00:08:01.518>AI <00:08:01.635>before <00:08:01.751>LLMs, <00:08:01.868>et <00:08:01.984>cetera,

204
00:08:04.625 --> 00:08:09.205
<00:08:04.625>but, <00:08:04.780>uh, <00:08:04.936>when <00:08:05.091>LLMs <00:08:05.247>came <00:08:05.402>up, <00:08:05.558>JGBT, <00:08:05.713>Gemini, <00:08:05.869>et <00:08:06.025>cetera,

205
00:08:09.665 --> 00:08:12.645
<00:08:09.665>uh, <00:08:09.805>there <00:08:09.945>are <00:08:10.085>some <00:08:10.225>topics <00:08:10.365>that <00:08:10.505>are <00:08:10.645>kind <00:08:10.785>of <00:08:10.925>glossed <00:08:11.065>over

206
00:08:12.705 --> 00:08:16.045
<00:08:12.705>or <00:08:12.860>we, <00:08:13.016>we <00:08:13.171>don't <00:08:13.327>really <00:08:13.482>talk <00:08:13.638>much <00:08:13.793>about <00:08:13.949>those <00:08:14.104>topics.

207
00:08:16.305 --> 00:08:18.205
<00:08:16.305>For <00:08:16.585>example, <00:08:16.865>okay, <00:08:17.145>we're <00:08:17.425>using <00:08:17.705>tokens,

208
00:08:18.205 --> 00:08:19.805
<00:08:18.205>but <00:08:18.484>why <00:08:18.765>are <00:08:19.044>we <00:08:19.325>using <00:08:19.604>tokens?

209
00:08:20.105 --> 00:08:21.365
<00:08:20.105>Why <00:08:20.388>not <00:08:20.672>words <00:08:20.955>or <00:08:21.239>letters

210
00:08:21.825 --> 00:08:26.685
<00:08:21.825>or <00:08:21.952>why, <00:08:22.079>um, <00:08:22.206>like, <00:08:22.334>why, <00:08:22.461>um, <00:08:22.588>LMS <00:08:22.715>are <00:08:22.843>not <00:08:22.970>good <00:08:23.097>at <00:08:23.224>math,

211
00:08:26.985 --> 00:08:29.365
<00:08:26.985>uh, <00:08:27.335>without <00:08:27.685>any <00:08:28.035>help, <00:08:28.385>uh,

212
00:08:30.145 --> 00:08:34.405
<00:08:30.145>or, <00:08:30.284>so <00:08:30.424>there <00:08:30.565>there <00:08:30.705>were <00:08:30.844>several <00:08:30.984>questions <00:08:31.125>I <00:08:31.265>asked <00:08:31.405>myself <00:08:31.544>I,

213
00:08:34.525 --> 00:08:36.485
<00:08:34.525>I <00:08:34.725>wondered <00:08:34.924>about, <00:08:35.125>and <00:08:35.324>I <00:08:35.525>was <00:08:35.725>like, <00:08:35.924>well,

214
00:08:36.745 --> 00:08:39.245
<00:08:36.745>I'm <00:08:36.919>not <00:08:37.095>reading <00:08:37.270>much <00:08:37.445>about <00:08:37.620>these <00:08:37.794>in <00:08:37.970>calls <00:08:38.145>and

215
00:08:39.505 --> 00:08:41.925
<00:08:39.505>or <00:08:39.784>seeing <00:08:40.064>anything <00:08:40.345>at <00:08:40.625>conference, <00:08:40.905>uh,

216
00:08:41.925 --> 00:08:43.565
<00:08:41.924>conferences <00:08:42.391>about <00:08:42.858>those <00:08:43.324>aspects.

217
00:08:43.765 --> 00:08:46.725
<00:08:43.765>I <00:08:43.892>was <00:08:44.019>like, <00:08:44.146>Hmm, <00:08:44.274>I <00:08:44.401>need <00:08:44.528>to <00:08:44.655>dig <00:08:44.783>deeper <00:08:44.910>to <00:08:45.037>better <00:08:45.165>understand.

218
00:08:46.725 --> 00:08:49.725
<00:08:46.725>So <00:08:46.880>it's <00:08:47.036>not <00:08:47.191>so <00:08:47.347>much <00:08:47.502>about <00:08:47.658>understanding <00:08:47.813>the <00:08:47.969>math, <00:08:48.125>like

219
00:08:49.865 --> 00:08:52.845
<00:08:49.865>how <00:08:50.145>the <00:08:50.425>metrics <00:08:50.705>calculations <00:08:50.985>actually <00:08:51.265>work,

220
00:08:52.865 --> 00:08:56.205
<00:08:52.865>but <00:08:53.065>really <00:08:53.265>figuring <00:08:53.465>out <00:08:53.665>the, <00:08:53.865>the <00:08:54.065>little <00:08:54.265>things

221
00:08:56.235 --> 00:08:57.765
<00:08:56.235>that <00:08:56.579>make <00:08:56.923>l <00:08:57.267>LMS <00:08:57.612>work

222
00:08:58.345 --> 00:09:02.765
<00:08:58.345>and <00:08:58.472>the <00:08:58.599>way <00:08:58.726>I <00:08:58.854>can <00:08:58.981>better <00:08:59.108>understand <00:08:59.235>why <00:08:59.363>they <00:08:59.490>work <00:08:59.617>in <00:08:59.745>some

223
00:09:03.395 --> 00:09:04.965
<00:09:03.395>aspects <00:09:04.095>or <00:09:04.795>scenarios

224
00:09:05.105 --> 00:09:08.525
<00:09:05.105>and <00:09:05.245>not <00:09:05.385>in <00:09:05.525>others, <00:09:05.665>basically <00:09:05.805>to, <00:09:05.945>to <00:09:06.085>take <00:09:06.225>the <00:09:06.365>best <00:09:06.505>out

225
00:09:08.525 --> 00:09:09.525
<00:09:08.525>of <00:09:08.975>the <00:09:09.425>lms.

226
00:09:09.525 --> 00:09:12.965
<00:09:09.525>So <00:09:09.665>I <00:09:09.805>was <00:09:09.944>very <00:09:10.084>curious <00:09:10.225>to, <00:09:10.365>you <00:09:10.505>know, <00:09:10.645>learn <00:09:10.785>and, <00:09:10.925>um,

227
00:09:13.465 --> 00:09:17.125
<00:09:13.465>and, <00:09:13.620>um, <00:09:13.776>you <00:09:13.931>know, <00:09:14.087>uh, <00:09:14.242>write <00:09:14.398>about, <00:09:14.553>uh, <00:09:14.709>those <00:09:14.865>things

228
00:09:17.225 --> 00:09:18.365
<00:09:17.225>and <00:09:17.481>share <00:09:17.738>about <00:09:17.994>those <00:09:18.251>things

229
00:09:18.365 --> 00:09:21.005
<00:09:18.365>that <00:09:18.520>I <00:09:18.676>found <00:09:18.831>along <00:09:18.987>the <00:09:19.142>way <00:09:19.298>in <00:09:19.453>my <00:09:19.609>learning <00:09:19.765>journey.

230
00:09:22.265 --> 00:09:23.925
<00:09:22.265>And <00:09:22.498>I <00:09:22.731>think <00:09:22.965>that's <00:09:23.198>general <00:09:23.431>good <00:09:23.665>advice.

231
00:09:24.085 --> 00:09:26.885
<00:09:24.085>I <00:09:24.212>mean, <00:09:24.339>I <00:09:24.466>started <00:09:24.594>my <00:09:24.721>blog <00:09:24.848>in <00:09:24.975>2006 <00:09:25.103>as <00:09:25.230>a <00:09:25.357>scratch <00:09:25.485>pad.

232
00:09:27.045 --> 00:09:29.045
<00:09:27.045>I <00:09:27.219>just <00:09:27.395>learned <00:09:27.569>something <00:09:27.745>and <00:09:27.920>I <00:09:28.094>wrote <00:09:28.270>it <00:09:28.444>down,

233
00:09:29.305 --> 00:09:31.965
<00:09:29.305>and <00:09:29.460>basically <00:09:29.616>I <00:09:29.771>did <00:09:29.927>know <00:09:30.082>something, <00:09:30.238>so <00:09:30.393>I <00:09:30.549>forced <00:09:30.704>myself

234
00:09:32.045 --> 00:09:34.445
<00:09:32.045>to <00:09:32.185>learn <00:09:32.324>it <00:09:32.464>and <00:09:32.604>wrote <00:09:32.745>down <00:09:32.885>the <00:09:33.025>learnings <00:09:33.165>in <00:09:33.305>my <00:09:33.444>blog

235
00:09:34.825 --> 00:09:36.245
<00:09:34.825>and <00:09:35.144>basically <00:09:35.464>learn <00:09:35.783>in <00:09:36.103>public.

236
00:09:36.345 --> 00:09:37.725
<00:09:36.345>And <00:09:36.593>that <00:09:36.841>became <00:09:37.090>a <00:09:37.338>big <00:09:37.587>success.

237
00:09:37.845 --> 00:09:39.805
<00:09:37.845>I <00:09:37.985>mean, <00:09:38.125>back <00:09:38.265>then <00:09:38.405>I <00:09:38.545>had, <00:09:38.685>I <00:09:38.825>made <00:09:38.965>money <00:09:39.105>with <00:09:39.245>it.

238
00:09:39.805 --> 00:09:41.885
<00:09:39.805>Forget <00:09:39.960>about <00:09:40.116>that <00:09:40.271>when <00:09:40.427>everybody <00:09:40.582>has <00:09:40.738>an <00:09:40.893>ad <00:09:41.049>blocker <00:09:41.204>now.

239
00:09:42.265 --> 00:09:45.205
<00:09:42.265>But, <00:09:42.392>uh, <00:09:42.519>it, <00:09:42.646>it's, <00:09:42.774>it, <00:09:42.901>it <00:09:43.028>was <00:09:43.155>really <00:09:43.283>interesting <00:09:43.410>to <00:09:43.537>see <00:09:43.665>how

240
00:09:45.205 --> 00:09:46.245
<00:09:45.205>that <00:09:45.517>actually <00:09:45.829>worked <00:09:46.141>out.

241
00:09:46.745 --> 00:09:49.845
<00:09:46.745>Now, <00:09:46.885>uh, <00:09:47.025>meta <00:09:47.165>you <00:09:47.305>have <00:09:47.445>a, <00:09:47.585>a <00:09:47.725>great <00:09:47.865>talk <00:09:48.005>about, <00:09:48.145>uh,

242
00:09:50.005 --> 00:09:51.605
<00:09:50.005>pitfalls <00:09:50.705>of <00:09:51.405>LLMs.

243
00:09:52.545 --> 00:09:53.805
<00:09:52.545>So, <00:09:53.112>uh, <00:09:53.679>pre

244
00:09:53.865 --> 00:09:57.365
<00:09:53.865>and <00:09:54.098>post-processing, <00:09:54.331>uh, <00:09:54.565>are, <00:09:54.798>is <00:09:55.031>request <00:09:55.265>required

245
00:09:57.365 --> 00:09:58.485
<00:09:57.365>with <00:09:57.869>LLMs <00:09:58.373>why?

246
00:09:59.715 --> 00:10:03.245
<00:09:59.715>Yeah, <00:09:59.855>so <00:09:59.995>the <00:10:00.135>thing, <00:10:00.275>the <00:10:00.415>great <00:10:00.555>thing <00:10:00.695>about <00:10:00.835>LLMs <00:10:00.975>is <00:10:01.115>that,

247
00:10:03.305 --> 00:10:05.645
<00:10:03.305>you <00:10:03.479>know, <00:10:03.655>to <00:10:03.829>get <00:10:04.005>an <00:10:04.180>output <00:10:04.354>from <00:10:04.530>L <00:10:04.704>lm,

248
00:10:05.645 --> 00:10:09.165
<00:10:05.645>you <00:10:05.761>just <00:10:05.878>make <00:10:05.995>a <00:10:06.111>single <00:10:06.228>API <00:10:06.345>call <00:10:06.461>it <00:10:06.578>can <00:10:06.694>be <00:10:06.811>any <00:10:06.928>easier, <00:10:07.045>right?

249
00:10:09.785 --> 00:10:12.365
<00:10:09.785>But <00:10:09.940>then <00:10:10.096>people <00:10:10.251>think <00:10:10.407>that, <00:10:10.562>okay, <00:10:10.718>it <00:10:10.873>is <00:10:11.029>so <00:10:11.185>easy,

250
00:10:12.705 --> 00:10:15.205
<00:10:12.705>but <00:10:13.055>usually <00:10:13.405>like <00:10:13.755>that's, <00:10:14.105>that's

251
00:10:15.205 --> 00:10:16.605
<00:10:15.205>for <00:10:15.457>hello <00:10:15.709>world <00:10:15.961>kind <00:10:16.213>of <00:10:16.465>applications.

252
00:10:16.625 --> 00:10:20.085
<00:10:16.625>But <00:10:16.780>usually <00:10:16.936>if <00:10:17.091>you <00:10:17.247>need <00:10:17.402>to <00:10:17.558>do <00:10:17.713>something <00:10:17.869>more <00:10:18.025>complicated,

253
00:10:20.385 --> 00:10:22.245
<00:10:20.385>you <00:10:20.665>need <00:10:20.944>to <00:10:21.225>pre-process <00:10:21.505>your <00:10:21.785>data

254
00:10:22.465 --> 00:10:24.445
<00:10:22.465>and <00:10:22.665>then <00:10:22.865>you <00:10:23.065>need <00:10:23.265>to <00:10:23.465>make <00:10:23.665>the <00:10:23.865>call.

255
00:10:24.905 --> 00:10:26.645
<00:10:24.905>Uh, <00:10:25.060>and <00:10:25.216>then <00:10:25.371>once <00:10:25.527>we <00:10:25.682>get <00:10:25.838>it <00:10:25.993>back, <00:10:26.149>you <00:10:26.305>need

256
00:10:26.645 --> 00:10:28.165
<00:10:26.645>to <00:10:26.918>actually <00:10:27.192>post-process <00:10:27.465>it, <00:10:27.739>you <00:10:28.012>know,

257
00:10:28.185 --> 00:10:31.405
<00:10:28.185>so <00:10:28.324>it's <00:10:28.464>never <00:10:28.604>just <00:10:28.744>a <00:10:28.885>single <00:10:29.025>API <00:10:29.165>call, <00:10:29.305>uh, <00:10:29.444>for <00:10:29.584>example,

258
00:10:31.465 --> 00:10:35.525
<00:10:31.465>if <00:10:31.605>you <00:10:31.745>need <00:10:31.885>to <00:10:32.025>ground <00:10:32.165>your, <00:10:32.305>um, <00:10:32.445>LLM, <00:10:32.585>you <00:10:32.725>need <00:10:32.865>to

259
00:10:36.685 --> 00:10:37.925
<00:10:36.685>probably <00:10:36.908>set <00:10:37.131>something <00:10:37.354>like <00:10:37.577>a <00:10:37.800>rag

260
00:10:38.075 --> 00:10:39.845
<00:10:38.075>that <00:10:38.355>y <00:10:38.635>will <00:10:38.915>talk <00:10:39.195>about <00:10:39.475>probably.

261
00:10:40.145 --> 00:10:41.285
<00:10:40.145>Um, <00:10:40.401>so <00:10:40.658>a <00:10:40.914>rag <00:10:41.170>pipeline.

262
00:10:41.285 --> 00:10:42.845
<00:10:41.285>So <00:10:41.412>that <00:10:41.539>means <00:10:41.666>that <00:10:41.794>you <00:10:41.921>need <00:10:42.048>to <00:10:42.175>take <00:10:42.303>your <00:10:42.430>documents, <00:10:42.557>you <00:10:42.685>need

263
00:10:42.845 --> 00:10:44.885
<00:10:42.845>to <00:10:42.972>chunk <00:10:43.099>them, <00:10:43.226>you <00:10:43.354>need <00:10:43.481>to <00:10:43.608>put <00:10:43.735>them <00:10:43.863>in <00:10:43.990>a <00:10:44.117>vector <00:10:44.245>store.

264
00:10:45.225 --> 00:10:47.405
<00:10:45.225>So <00:10:45.365>there's <00:10:45.505>a <00:10:45.645>lot <00:10:45.785>of <00:10:45.925>things <00:10:46.065>that <00:10:46.205>needs <00:10:46.345>to <00:10:46.485>happen <00:10:46.625>beforehand.

265
00:10:48.185 --> 00:10:50.805
<00:10:48.185>And <00:10:48.324>then <00:10:48.464>once <00:10:48.604>you <00:10:48.744>have <00:10:48.885>that, <00:10:49.025>then <00:10:49.165>you <00:10:49.305>make <00:10:49.444>the <00:10:49.584>call,

266
00:10:50.875 --> 00:10:52.005
<00:10:50.875>then <00:10:51.078>you <00:10:51.281>get <00:10:51.485>the <00:10:51.688>result <00:10:51.892>back,

267
00:10:52.005 --> 00:10:56.005
<00:10:52.005>and <00:10:52.180>then <00:10:52.355>again, <00:10:52.530>the <00:10:52.705>result <00:10:52.880>you <00:10:53.055>get <00:10:53.230>can <00:10:53.405>be

268
00:10:56.385 --> 00:10:57.765
<00:10:56.385>by <00:10:56.592>default, <00:10:56.799>it <00:10:57.006>can <00:10:57.213>be <00:10:57.420>any <00:10:57.627>format.

269
00:10:57.945 --> 00:10:59.965
<00:10:57.945>So <00:10:58.072>if <00:10:58.199>you <00:10:58.326>want <00:10:58.454>a <00:10:58.581>certain <00:10:58.708>format, <00:10:58.835>you <00:10:58.963>need <00:10:59.090>to <00:10:59.217>make <00:10:59.345>sure

270
00:10:59.965 --> 00:11:01.005
<00:10:59.965>that <00:11:00.199>there's <00:11:00.433>a <00:11:00.667>structured <00:11:00.901>output.

271
00:11:01.465 --> 00:11:03.925
<00:11:01.465>And <00:11:01.592>then <00:11:01.719>if <00:11:01.846>it's <00:11:01.974>JSO <00:11:02.101>that <00:11:02.228>you <00:11:02.355>need <00:11:02.483>to <00:11:02.610>get <00:11:02.737>the <00:11:02.865>JSO.

272
00:11:04.385 --> 00:11:06.805
<00:11:04.385>And <00:11:04.585>up <00:11:04.785>until <00:11:04.985>recently, <00:11:05.185>it <00:11:05.385>wasn't <00:11:05.585>great <00:11:05.785>json

273
00:11:06.805 --> 00:11:08.885
<00:11:06.805>so <00:11:06.960>sometimes <00:11:07.116>you <00:11:07.271>would <00:11:07.427>get <00:11:07.582>json, <00:11:07.738>sometimes <00:11:07.893>it <00:11:08.049>wouldn't <00:11:08.204>be

274
00:11:08.885 --> 00:11:11.805
<00:11:08.885>quite <00:11:09.025>json, <00:11:09.165>so <00:11:09.305>you <00:11:09.444>need <00:11:09.585>to <00:11:09.725>put <00:11:09.865>some <00:11:10.005>handling <00:11:10.145>around <00:11:10.285>that.

275
00:11:12.605 --> 00:11:15.405
<00:11:12.605>Nowadays <00:11:12.838>it's <00:11:13.071>better. <00:11:13.305>So <00:11:13.538>most <00:11:13.771>latest <00:11:14.005>models,

276
00:11:15.435 --> 00:11:17.045
<00:11:15.435>they <00:11:15.785>actually <00:11:16.135>give <00:11:16.484>you <00:11:16.834>JSON.

277
00:11:17.745 --> 00:11:18.765
<00:11:17.745>So <00:11:17.974>stuff <00:11:18.204>like <00:11:18.433>that, <00:11:18.663>right?

278
00:11:18.865 --> 00:11:20.805
<00:11:18.865>So <00:11:19.065>it's <00:11:19.265>never <00:11:19.465>just <00:11:19.665>a <00:11:19.865>single <00:11:20.065>API <00:11:20.265>call.

279
00:11:20.805 --> 00:11:22.365
<00:11:20.805>So <00:11:20.960>that's, <00:11:21.116>that's <00:11:21.271>why <00:11:21.427>I <00:11:21.582>tell <00:11:21.738>people <00:11:21.893>you <00:11:22.049>need <00:11:22.204>to

280
00:11:23.705 --> 00:11:26.085
<00:11:23.705>either <00:11:23.880>think <00:11:24.055>about <00:11:24.230>these <00:11:24.405>things <00:11:24.580>and <00:11:24.755>implement <00:11:24.930>them <00:11:25.105>yourself,

281
00:11:26.085 --> 00:11:28.565
<00:11:26.085>or <00:11:26.225>you <00:11:26.365>need <00:11:26.505>to <00:11:26.645>rely <00:11:26.785>on <00:11:26.925>a <00:11:27.065>framework <00:11:27.205>like <00:11:27.345>L <00:11:27.485>chain

282
00:11:28.785 --> 00:11:31.685
<00:11:28.785>or <00:11:28.985>L <00:11:29.185>chain <00:11:29.385>is <00:11:29.584>the <00:11:29.785>most <00:11:29.985>popular <00:11:30.185>one,

283
00:11:31.685 --> 00:11:33.565
<00:11:31.685>but <00:11:31.964>then <00:11:32.244>there's <00:11:32.525>LAMA <00:11:32.805>index, <00:11:33.084>um,

284
00:11:33.715 --> 00:11:37.405
<00:11:33.715>there's <00:11:33.890>a <00:11:34.065>semantic <00:11:34.240>kernel <00:11:34.415>from <00:11:34.590>Microsoft, <00:11:34.765>um, <00:11:34.940>stuff <00:11:35.115>like

285
00:11:37.405 --> 00:11:39.765
<00:11:37.405>that <00:11:37.579>so <00:11:37.755>that <00:11:37.930>you <00:11:38.105>can <00:11:38.280>kind <00:11:38.454>of <00:11:38.630>offload <00:11:38.805>some

286
00:11:39.765 --> 00:11:41.405
<00:11:39.765>of <00:11:39.998>the <00:11:40.231>stuff, <00:11:40.465>uh, <00:11:40.698>to <00:11:40.931>the <00:11:41.165>frameworks.

287
00:11:42.265 --> 00:11:44.685
<00:11:42.265>That's <00:11:42.439>interesting. <00:11:42.615>When, <00:11:42.790>when <00:11:42.965>I, <00:11:43.140>I <00:11:43.314>worked <00:11:43.490>at <00:11:43.665>Microsoft,

288
00:11:44.705 --> 00:11:47.445
<00:11:44.705>uh, <00:11:44.845>I <00:11:44.985>worked <00:11:45.125>at <00:11:45.265>Yahoo <00:11:45.405>when <00:11:45.545>Jason <00:11:45.685>came <00:11:45.825>out, <00:11:45.965>and <00:11:46.105>Dr.

289
00:11:47.445 --> 00:11:48.565
<00:11:47.445>Crockford <00:11:47.781>worked <00:11:48.117>with <00:11:48.453>me

290
00:11:48.945 --> 00:11:51.325
<00:11:48.945>and <00:11:49.120>I <00:11:49.295>worked <00:11:49.470>with <00:11:49.645>Enterprise <00:11:49.820>before <00:11:49.995>that <00:11:50.170>as <00:11:50.345>well.

291
00:11:51.325 --> 00:11:54.085
<00:11:51.325>And <00:11:51.480>it <00:11:51.636>had <00:11:51.791>like <00:11:51.947>XML <00:11:52.102>and <00:11:52.258>XML <00:11:52.413>schemas <00:11:52.569>and <00:11:52.725>soap

292
00:11:54.105 --> 00:11:55.365
<00:11:54.105>and <00:11:54.331>all <00:11:54.558>the <00:11:54.785>horrible <00:11:55.012>things <00:11:55.239>we

293
00:11:55.365 --> 00:11:56.565
<00:11:55.365>don't <00:11:55.581>wanna <00:11:55.797>know <00:11:56.013>about <00:11:56.229>any <00:11:56.445>longer.

294
00:11:57.225 --> 00:11:59.245
<00:11:57.225>And, <00:11:57.380>uh, <00:11:57.536>uh, <00:11:57.691>the <00:11:57.847>first <00:11:58.002>thing <00:11:58.158>I'm <00:11:58.313>like, <00:11:58.469>so <00:11:58.625>yeah,

295
00:11:59.245 --> 00:12:01.645
<00:11:59.245>where's <00:11:59.400>the <00:11:59.556>schema <00:11:59.711>and <00:11:59.867>how <00:12:00.022>can <00:12:00.178>I <00:12:00.333>validate <00:12:00.489>the <00:12:00.645>Jason?

296
00:12:02.145 --> 00:12:04.125
<00:12:02.145>And <00:12:02.285>he's <00:12:02.425>like, <00:12:02.564>I <00:12:02.704>don't <00:12:02.845>want <00:12:02.985>that. <00:12:03.125>It's <00:12:03.265>not <00:12:03.405>gonna <00:12:03.545>happen.

297
00:12:04.235 --> 00:12:06.205
<00:12:04.235>It's <00:12:04.410>just <00:12:04.585>basically <00:12:04.760>it's <00:12:04.935>a <00:12:05.110>very <00:12:05.285>easy <00:12:05.460>data <00:12:05.635>format,

298
00:12:06.345 --> 00:12:09.605
<00:12:06.345>but <00:12:06.472>now <00:12:06.599>it <00:12:06.726>seems <00:12:06.854>that <00:12:06.981>we <00:12:07.108>actually, <00:12:07.235>uh, <00:12:07.363>uh, <00:12:07.490>we, <00:12:07.617>we <00:12:07.745>need

299
00:12:09.605 --> 00:12:11.205
<00:12:09.605>that <00:12:09.885>in <00:12:10.165>that <00:12:10.445>environment <00:12:10.725>as <00:12:11.005>well.

300
00:12:11.465 --> 00:12:14.245
<00:12:11.465>So <00:12:11.640>Illa, <00:12:11.815>like, <00:12:11.990>when <00:12:12.165>it <00:12:12.340>comes <00:12:12.515>to <00:12:12.690>this <00:12:12.865>pre

301
00:12:14.245 --> 00:12:17.725
<00:12:14.245>and <00:12:14.385>post <00:12:14.525>processing, <00:12:14.665>it <00:12:14.805>seems <00:12:14.945>like <00:12:15.085>the <00:12:15.225>LLM <00:12:15.365>is <00:12:15.505>never <00:12:15.645>enough.

302
00:12:17.835 --> 00:12:20.885
<00:12:17.835>It's, <00:12:17.951>it <00:12:18.068>has <00:12:18.185>to <00:12:18.301>be <00:12:18.418>an <00:12:18.535>AI <00:12:18.651>stack <00:12:18.768>around <00:12:18.885>it <00:12:19.001>that <00:12:19.118>helps <00:12:19.235>you

303
00:12:20.885 --> 00:12:23.685
<00:12:20.885>to <00:12:21.118>actually <00:12:21.351>request <00:12:21.585>the <00:12:21.818>right <00:12:22.051>format, <00:12:22.285>validate

304
00:12:23.685 --> 00:12:26.005
<00:12:23.685>that <00:12:23.812>it <00:12:23.939>is <00:12:24.066>actually <00:12:24.194>in <00:12:24.321>a <00:12:24.448>format <00:12:24.575>that's, <00:12:24.703>that's <00:12:24.830>good <00:12:24.957>for <00:12:25.084>you,

305
00:12:26.465 --> 00:12:28.205
<00:12:26.465>and <00:12:26.698>then <00:12:26.931>convert <00:12:27.165>it <00:12:27.398>to <00:12:27.631>something <00:12:27.865>else.

306
00:12:28.945 --> 00:12:31.125
<00:12:28.945>So <00:12:29.085>what <00:12:29.225>do <00:12:29.365>you <00:12:29.505>think <00:12:29.645>is <00:12:29.785>the <00:12:29.925>most <00:12:30.065>important <00:12:30.205>part <00:12:30.345>of

307
00:12:31.125 --> 00:12:32.205
<00:12:31.125>that? <00:12:31.319>The <00:12:31.513>pre <00:12:31.708>or <00:12:31.902>the <00:12:32.097>post?

308
00:12:32.985 --> 00:12:34.085
<00:12:32.985>Oh, <00:12:33.315>pre <00:12:33.645>or <00:12:33.975>post.

309
00:12:34.625 --> 00:12:39.605
<00:12:34.625>Uh, <00:12:34.780>well, <00:12:34.936>I <00:12:35.091>think <00:12:35.247>somehow <00:12:35.402>the <00:12:35.558>post <00:12:35.713>situation <00:12:35.869>has <00:12:36.025>improved,

310
00:12:39.605 --> 00:12:42.285
<00:12:39.605>especially <00:12:39.885>with <00:12:40.165>the <00:12:40.445>structured <00:12:40.725>outputs, <00:12:41.005>uh,

311
00:12:42.285 --> 00:12:46.085
<00:12:42.285>because <00:12:42.425>now <00:12:42.564>models <00:12:42.704>or <00:12:42.844>most <00:12:42.985>models <00:12:43.125>are <00:12:43.265>able <00:12:43.405>to <00:12:43.545>really <00:12:43.685>follow

312
00:12:46.385 --> 00:12:49.765
<00:12:46.385>and <00:12:46.585>mandatory <00:12:46.785>relief <00:12:46.985>follow <00:12:47.185>the, <00:12:47.385>uh, <00:12:47.585>actual <00:12:47.785>js

313
00:12:49.765 --> 00:12:51.645
<00:12:49.765>and <00:12:50.045>schema <00:12:50.324>that <00:12:50.605>that's <00:12:50.885>been <00:12:51.165>requested.

314
00:12:52.425 --> 00:12:56.165
<00:12:52.425>So <00:12:52.564>maybe <00:12:52.704>it's <00:12:52.844>the, <00:12:52.984>what, <00:12:53.125>what <00:12:53.265>you <00:12:53.405>put <00:12:53.545>in <00:12:53.685>that <00:12:53.824>needs

315
00:12:56.165 --> 00:12:59.125
<00:12:56.165>to <00:12:56.444>be <00:12:56.724>maybe <00:12:57.005>pre-processed <00:12:57.285>or <00:12:57.564>DoubleCheck

316
00:12:59.225 --> 00:13:02.005
<00:12:59.225>or, <00:12:59.505>you <00:12:59.785>know, <00:13:00.065>asking <00:13:00.345>clarifying <00:13:00.625>questions

317
00:13:02.145 --> 00:13:06.845
<00:13:02.145>or, <00:13:02.272>uh, <00:13:02.399>uh, <00:13:02.526>I <00:13:02.654>remember <00:13:02.781>doing <00:13:02.908>a, <00:13:03.035>an <00:13:03.163>app <00:13:03.290>that <00:13:03.417>was, <00:13:03.545>um,

318
00:13:07.105 --> 00:13:11.125
<00:13:07.105>taking, <00:13:07.245>um, <00:13:07.385>so <00:13:07.525>I <00:13:07.665>was <00:13:07.805>a, <00:13:07.945>a <00:13:08.085>multimodal <00:13:08.225>kind <00:13:08.365>of <00:13:08.505>application

319
00:13:11.125 --> 00:13:13.205
<00:13:11.125>where <00:13:11.358>you <00:13:11.591>would <00:13:11.825>give <00:13:12.058>a, <00:13:12.291>a <00:13:12.525>picture

320
00:13:13.865 --> 00:13:16.885
<00:13:13.865>and <00:13:14.065>the <00:13:14.265>app <00:13:14.465>would, <00:13:14.665>uh, <00:13:14.865>generate, <00:13:15.065>uh, <00:13:15.265>hashtags

321
00:13:16.885 --> 00:13:18.325
<00:13:16.885>for <00:13:17.317>your <00:13:17.749>Instagram <00:13:18.181>posts.

322
00:13:19.065 --> 00:13:23.245
<00:13:19.065>And, <00:13:19.192>uh, <00:13:19.319>the, <00:13:19.446>the <00:13:19.574>thing <00:13:19.701>was <00:13:19.828>that, <00:13:19.955>um, <00:13:20.083>when <00:13:20.210>you <00:13:20.337>gave, <00:13:20.465>um,

323
00:13:24.385 --> 00:13:29.005
<00:13:24.385>the, <00:13:24.512>OR, <00:13:24.639>or <00:13:24.766>you <00:13:24.894>let <00:13:25.021>the <00:13:25.148>LLM <00:13:25.275>uh, <00:13:25.403>free <00:13:25.530>to <00:13:25.657>come <00:13:25.785>up

324
00:13:29.005 --> 00:13:31.725
<00:13:29.005>with <00:13:29.180>an <00:13:29.355>explanation <00:13:29.530>why <00:13:29.705>it <00:13:29.880>comes <00:13:30.055>with, <00:13:30.230>uh, <00:13:30.405>this

325
00:13:31.745 --> 00:13:35.045
<00:13:31.745>or <00:13:31.978>this <00:13:32.211>hashtag, <00:13:32.445>the, <00:13:32.678>the <00:13:32.911>hashtags, <00:13:33.145>uh,

326
00:13:35.045 --> 00:13:37.085
<00:13:35.045>that <00:13:35.324>were <00:13:35.604>generated <00:13:35.885>were <00:13:36.165>more <00:13:36.444>creative.

327
00:13:37.475 --> 00:13:40.565
<00:13:37.475>Whereas <00:13:37.675>when <00:13:37.875>I <00:13:38.075>was <00:13:38.275>using <00:13:38.475>structured <00:13:38.675>outputs, <00:13:38.875>uh,

328
00:13:40.805 --> 00:13:42.765
<00:13:40.805>I <00:13:41.084>would <00:13:41.364>get <00:13:41.645>less <00:13:41.925>creative <00:13:42.204>hashtags.

329
00:13:43.265 --> 00:13:44.885
<00:13:43.265>And <00:13:43.465>so <00:13:43.665>I <00:13:43.865>did <00:13:44.064>things <00:13:44.265>in <00:13:44.465>two <00:13:44.665>steps.

330
00:13:44.935 --> 00:13:49.325
<00:13:44.935>First, <00:13:45.109>be <00:13:45.285>free <00:13:45.459>to <00:13:45.635>generate <00:13:45.810>pros <00:13:45.984>and <00:13:46.160>suggest <00:13:46.334>hashtags.

331
00:13:49.425 --> 00:13:52.165
<00:13:49.425>And <00:13:49.599>then <00:13:49.775>the <00:13:49.949>second <00:13:50.125>step <00:13:50.300>where <00:13:50.474>I <00:13:50.650>extract <00:13:50.824>hashtags

332
00:13:52.675 --> 00:13:55.565
<00:13:52.675>from <00:13:52.830>the <00:13:52.986>first <00:13:53.141>request <00:13:53.297>and <00:13:53.452>the <00:13:53.608>output <00:13:53.763>was <00:13:53.919>much <00:13:54.074>better

333
00:13:55.565 --> 00:13:57.805
<00:13:55.565>because <00:13:55.845>I <00:13:56.125>had <00:13:56.405>more <00:13:56.685>creative <00:13:56.965>tags,

334
00:13:58.345 --> 00:13:59.565
<00:13:58.345>yet <00:13:58.619>they <00:13:58.894>were <00:13:59.168>very <00:13:59.443>structured

335
00:13:59.565 --> 00:14:02.165
<00:13:59.565>because <00:13:59.720>I <00:13:59.876>just <00:14:00.031>had <00:14:00.187>a <00:14:00.342>list <00:14:00.498>of <00:14:00.653>hashtags <00:14:00.809>in <00:14:00.965>the,

336
00:14:02.165 --> 00:14:04.205
<00:14:02.165>and <00:14:02.365>so <00:14:02.564>sometimes <00:14:02.765>you <00:14:02.964>have <00:14:03.165>to, <00:14:03.365>you <00:14:03.564>know,

337
00:14:04.205 --> 00:14:06.125
<00:14:04.205>experiment <00:14:04.380>a <00:14:04.555>little <00:14:04.730>bit <00:14:04.905>to <00:14:05.080>fi <00:14:05.255>to <00:14:05.430>figure <00:14:05.605>out

338
00:14:06.515 --> 00:14:08.805
<00:14:06.515>what <00:14:06.748>works <00:14:06.981>best <00:14:07.215>in <00:14:07.448>output <00:14:07.681>and <00:14:07.915>outputs.

339
00:14:08.805 --> 00:14:11.445
<00:14:08.805>And <00:14:09.038>sometimes <00:14:09.271>even <00:14:09.505>the, <00:14:09.738>the <00:14:09.971>way <00:14:10.204>you,

340
00:14:11.505 --> 00:14:15.405
<00:14:11.505>you <00:14:11.645>define <00:14:11.785>the <00:14:11.925>schema <00:14:12.064>in <00:14:12.205>our, <00:14:12.345>in <00:14:12.485>outputs <00:14:12.625>also <00:14:12.765>helps, <00:14:12.905>uh,

341
00:14:15.745 --> 00:14:18.445
<00:14:15.745>the <00:14:15.945>LLM <00:14:16.145>better <00:14:16.345>frame <00:14:16.545>its, <00:14:16.745>uh, <00:14:16.945>its <00:14:17.145>answer.

342
00:14:18.625 --> 00:14:19.645
<00:14:18.625>So <00:14:18.931>both <00:14:19.237>are <00:14:19.543>important,

343
00:14:19.705 --> 00:14:22.965
<00:14:19.705>but, <00:14:19.860>uh, <00:14:20.016>yeah, <00:14:20.171>the, <00:14:20.327>the <00:14:20.482>input <00:14:20.638>is <00:14:20.793>important <00:14:20.949>as <00:14:21.105>well.

344
00:14:23.475 --> 00:14:25.845
<00:14:23.475>Like, <00:14:23.602>I <00:14:23.729>should <00:14:23.856>also <00:14:23.984>add, <00:14:24.111>like, <00:14:24.238>I <00:14:24.365>find <00:14:24.493>a <00:14:24.620>little <00:14:24.747>bit <00:14:24.875>funny

345
00:14:26.265 --> 00:14:28.565
<00:14:26.265>how <00:14:26.545>the <00:14:26.824>things <00:14:27.105>that's <00:14:27.385>been <00:14:27.665>around

346
00:14:28.565 --> 00:14:29.965
<00:14:28.565>for <00:14:28.745>a <00:14:28.925>while, <00:14:29.105>they <00:14:29.285>come <00:14:29.465>up <00:14:29.645>as <00:14:29.825>new.

347
00:14:29.995 --> 00:14:32.885
<00:14:29.995>Like <00:14:30.170>for <00:14:30.345>example, <00:14:30.520>now <00:14:30.695>in <00:14:30.870>Python <00:14:31.045>you <00:14:31.220>can <00:14:31.395>define

348
00:14:32.885 --> 00:14:34.165
<00:14:32.885>like <00:14:33.461>tic <00:14:34.036>classes.

349
00:14:34.355 --> 00:14:36.525
<00:14:34.355>Like, <00:14:34.530>so <00:14:34.705>they're <00:14:34.880>basically <00:14:35.055>just <00:14:35.230>classes <00:14:35.405>that <00:14:35.580>you <00:14:35.755>define

350
00:14:37.065 --> 00:14:38.845
<00:14:37.065>and <00:14:37.265>then <00:14:37.465>you <00:14:37.665>pass <00:14:37.865>it <00:14:38.065>to <00:14:38.265>the <00:14:38.465>LLM,

351
00:14:38.945 --> 00:14:40.885
<00:14:38.945>and <00:14:39.145>then <00:14:39.345>when <00:14:39.545>you <00:14:39.745>get <00:14:39.945>the <00:14:40.145>response <00:14:40.345>back,

352
00:14:41.225 --> 00:14:43.525
<00:14:41.225>you <00:14:41.458>get <00:14:41.691>basically <00:14:41.925>this <00:14:42.158>strongly <00:14:42.391>type <00:14:42.625>classes,

353
00:14:44.385 --> 00:14:47.365
<00:14:44.385>and <00:14:44.525>it's <00:14:44.665>is <00:14:44.805>being <00:14:44.944>like <00:14:45.085>presented <00:14:45.225>as <00:14:45.365>like <00:14:45.505>this <00:14:45.645>new <00:14:45.785>thing.

354
00:14:47.505 --> 00:14:49.445
<00:14:47.505>But <00:14:47.705>I'm <00:14:47.905>like, <00:14:48.105>you <00:14:48.305>know, <00:14:48.505>in <00:14:48.705>general <00:14:48.905>world,

355
00:14:49.445 --> 00:14:51.525
<00:14:49.445>we <00:14:49.725>had <00:14:50.005>like <00:14:50.285>hibernate <00:14:50.565>with <00:14:50.845>databases

356
00:14:51.525 --> 00:14:53.805
<00:14:51.525>where <00:14:51.699>it <00:14:51.875>did <00:14:52.050>all <00:14:52.225>this <00:14:52.400>like <00:14:52.574>strongly <00:14:52.750>type <00:14:52.925>stuff,

357
00:14:53.905 --> 00:14:54.925
<00:14:53.905>you <00:14:54.363>know, <00:14:54.823>automatically.

358
00:14:55.105 --> 00:14:56.725
<00:14:55.105>So <00:14:55.385>it's <00:14:55.665>basically <00:14:55.945>the <00:14:56.225>same <00:14:56.505>thing,

359
00:14:56.745 --> 00:14:58.325
<00:14:56.745>but <00:14:56.978>in <00:14:57.211>a <00:14:57.445>different <00:14:57.678>context, <00:14:57.911>you <00:14:58.145>know?

360
00:14:58.425 --> 00:15:00.205
<00:14:58.425>And <00:14:59.125>yeah, <00:14:59.824>it's

361
00:15:00.205 --> 00:15:01.965
<00:15:00.205>A <00:15:00.345>bit <00:15:00.485>like <00:15:00.625>when <00:15:00.765>we <00:15:00.905>went, <00:15:01.045>when <00:15:01.185>we <00:15:01.325>went <00:15:01.465>from <00:15:01.605>JavaScript

362
00:15:01.965 --> 00:15:04.805
<00:15:01.965>to <00:15:02.120>type, <00:15:02.276>because <00:15:02.431>we <00:15:02.587>need, <00:15:02.742>we <00:15:02.898>needed <00:15:03.053>types <00:15:03.209>on <00:15:03.365>top

363
00:15:04.805 --> 00:15:07.325
<00:15:04.805>of <00:15:04.932>the <00:15:05.059>thing <00:15:05.186>to <00:15:05.314>scale <00:15:05.441>to <00:15:05.568>like <00:15:05.695>thousands <00:15:05.823>of <00:15:05.950>lines <00:15:06.077>of <00:15:06.204>code

364
00:15:07.705 --> 00:15:09.285
<00:15:07.705>and <00:15:08.055>actually <00:15:08.405>help <00:15:08.755>with <00:15:09.105>intelligence

365
00:15:09.385 --> 00:15:12.205
<00:15:09.385>and <00:15:09.560>like <00:15:09.735>the <00:15:09.910>IDs <00:15:10.085>giving <00:15:10.260>you <00:15:10.435>the <00:15:10.610>different <00:15:10.785>things.

366
00:15:12.705 --> 00:15:14.525
<00:15:12.705>Now, <00:15:12.938>when <00:15:13.171>you <00:15:13.405>said <00:15:13.638>like <00:15:13.871>creating <00:15:14.105>hashtags,

367
00:15:14.525 --> 00:15:17.045
<00:15:14.525>and <00:15:14.652>another <00:15:14.779>big <00:15:14.906>thing <00:15:15.034>that <00:15:15.161>I <00:15:15.288>always <00:15:15.415>is <00:15:15.543>big <00:15:15.670>of <00:15:15.797>a <00:15:15.925>bit

368
00:15:17.045 --> 00:15:19.525
<00:15:17.045>of <00:15:17.200>my <00:15:17.356>back <00:15:17.511>bear <00:15:17.667>is <00:15:17.822>when <00:15:17.978>people <00:15:18.133>do <00:15:18.289>alternative <00:15:18.444>text

369
00:15:19.585 --> 00:15:21.005
<00:15:19.585>for <00:15:19.904>images <00:15:20.224>and <00:15:20.543>say <00:15:20.863>like,

370
00:15:21.005 --> 00:15:22.965
<00:15:21.005>it's <00:15:21.180>good <00:15:21.355>enough <00:15:21.530>if <00:15:21.705>the <00:15:21.880>machine <00:15:22.055>writes <00:15:22.230>something <00:15:22.405>there.

371
00:15:23.225 --> 00:15:25.205
<00:15:23.225>But <00:15:23.458>as <00:15:23.691>a, <00:15:23.925>as <00:15:24.158>a <00:15:24.391>non-sighted <00:15:24.625>user,

372
00:15:25.405 --> 00:15:26.805
<00:15:25.405>I <00:15:25.719>might <00:15:26.035>get <00:15:26.349>absolute <00:15:26.665>nonsense.

373
00:15:27.245 --> 00:15:29.805
<00:15:27.245>A <00:15:27.385>great <00:15:27.525>example <00:15:27.665>that's <00:15:27.805>just <00:15:27.945>during <00:15:28.085>the <00:15:28.225>rounds <00:15:28.365>is <00:15:28.505>like <00:15:28.645>the,

374
00:15:29.805 --> 00:15:32.005
<00:15:29.805>that <00:15:30.005>people <00:15:30.204>asking <00:15:30.405>all <00:15:30.604>these <00:15:30.805>different <00:15:31.005>chat <00:15:31.204>systems

375
00:15:32.585 --> 00:15:34.685
<00:15:32.585>to <00:15:32.785>create <00:15:32.985>a <00:15:33.185>picture <00:15:33.385>of <00:15:33.585>an <00:15:33.785>empty <00:15:33.985>room

376
00:15:34.835 --> 00:15:37.165
<00:15:34.835>with <00:15:35.035>at <00:15:35.235>at <00:15:35.435>least <00:15:35.635>no <00:15:35.835>elephant <00:15:36.035>in <00:15:36.235>there.

377
00:15:37.465 --> 00:15:39.445
<00:15:37.465>And <00:15:37.620>all <00:15:37.776>of <00:15:37.931>them <00:15:38.087>actually <00:15:38.242>put <00:15:38.398>an <00:15:38.553>elephant <00:15:38.709>in <00:15:38.865>there

378
00:15:39.445 --> 00:15:41.565
<00:15:39.445>and <00:15:39.585>then <00:15:39.725>claimed <00:15:39.865>that <00:15:40.005>they <00:15:40.145>haven't <00:15:40.285>put <00:15:40.425>an <00:15:40.565>elephant <00:15:40.705>in <00:15:40.845>there.

379
00:15:41.585 --> 00:15:44.365
<00:15:41.585>So <00:15:41.760>that's <00:15:41.935>the <00:15:42.110>new <00:15:42.285>strawberry <00:15:42.460>problem <00:15:42.635>that <00:15:42.810>we <00:15:42.985>had

380
00:15:44.365 --> 00:15:45.405
<00:15:44.365>with <00:15:44.677>other <00:15:44.989>things <00:15:45.300>before.

381
00:15:46.105 --> 00:15:48.005
<00:15:46.105>Now <00:15:46.280>meta <00:15:46.455>in <00:15:46.630>your <00:15:46.805>talk, <00:15:46.980>the <00:15:47.155>other <00:15:47.330>thing <00:15:47.505>is

382
00:15:48.005 --> 00:15:50.085
<00:15:48.005>that <00:15:48.160>the <00:15:48.316>next <00:15:48.471>bit <00:15:48.627>is <00:15:48.782>the <00:15:48.938>problem <00:15:49.093>with <00:15:49.249>LLMs <00:15:49.405>is

383
00:15:50.085 --> 00:15:52.765
<00:15:50.085>that <00:15:50.285>they <00:15:50.485>hallucinate, <00:15:50.685>I <00:15:50.885>mean, <00:15:51.085>I <00:15:51.285>always <00:15:51.485>thought

384
00:15:52.765 --> 00:15:54.565
<00:15:52.765>that <00:15:52.998>hallucinate <00:15:53.231>sounded <00:15:53.465>like <00:15:53.698>a <00:15:53.931>bad <00:15:54.165>excuse.

385
00:15:54.675 --> 00:15:56.205
<00:15:54.675>Like <00:15:54.871>we <00:15:55.068>don't <00:15:55.265>know <00:15:55.461>why <00:15:55.658>it <00:15:55.855>does <00:15:56.052>it,

386
00:15:56.265 --> 00:15:57.805
<00:15:56.265>so <00:15:56.496>we <00:15:56.727>just <00:15:56.958>tell <00:15:57.189>it <00:15:57.420>this <00:15:57.651>hallucinates,

387
00:15:57.805 --> 00:15:59.925
<00:15:57.805>but <00:15:58.155>what <00:15:58.505>are <00:15:58.854>LLM <00:15:59.204>hallucinations

388
00:15:59.925 --> 00:16:01.005
<00:15:59.925>and <00:16:00.119>what <00:16:00.313>can <00:16:00.508>work <00:16:00.702>around <00:16:00.896>them?

389
00:16:02.355 --> 00:16:05.685
<00:16:02.355>Well, <00:16:02.510>basically <00:16:02.666>the <00:16:02.821>LLM <00:16:02.977>tells <00:16:03.132>you <00:16:03.288>stuff <00:16:03.443>that's <00:16:03.599>not <00:16:03.755>true,

390
00:16:05.905 --> 00:16:08.485
<00:16:05.905>but <00:16:06.045>it <00:16:06.185>does <00:16:06.324>it <00:16:06.464>in <00:16:06.605>a <00:16:06.745>such <00:16:06.885>a <00:16:07.025>convincing <00:16:07.165>kinda <00:16:07.305>way.

391
00:16:08.785 --> 00:16:11.285
<00:16:08.785>Um, <00:16:08.940>and <00:16:09.096>that's <00:16:09.251>the <00:16:09.407>problem <00:16:09.562>with <00:16:09.718>how <00:16:09.873>nations <00:16:10.029>is <00:16:10.185>like,

392
00:16:11.305 --> 00:16:14.085
<00:16:11.305>you <00:16:11.432>know, <00:16:11.559>for <00:16:11.686>example, <00:16:11.814>just <00:16:11.941>the <00:16:12.068>other <00:16:12.195>day <00:16:12.323>I <00:16:12.450>did <00:16:12.577>a <00:16:12.704>demo

393
00:16:14.345 --> 00:16:16.405
<00:16:14.345>and <00:16:14.578>I <00:16:14.811>asked <00:16:15.045>all <00:16:15.278>them, <00:16:15.511>you <00:16:15.745>know,

394
00:16:16.425 --> 00:16:18.485
<00:16:16.425>can <00:16:16.625>you <00:16:16.824>generate <00:16:17.025>the <00:16:17.224>first <00:16:17.425>50 <00:16:17.625>prime <00:16:17.824>numbers?

395
00:16:18.985 --> 00:16:20.165
<00:16:18.985>And <00:16:19.197>then <00:16:19.409>it <00:16:19.622>just <00:16:19.834>went <00:16:20.047>on

396
00:16:20.165 --> 00:16:22.405
<00:16:20.165>and <00:16:20.365>explained <00:16:20.564>like <00:16:20.765>how, <00:16:20.964>how <00:16:21.165>it's <00:16:21.365>gonna <00:16:21.564>generate

397
00:16:22.625 --> 00:16:24.685
<00:16:22.625>and <00:16:22.858>what <00:16:23.091>math <00:16:23.325>formula <00:16:23.558>it's <00:16:23.791>gonna <00:16:24.025>use.

398
00:16:25.225 --> 00:16:26.405
<00:16:25.225>So <00:16:25.490>it <00:16:25.756>looked <00:16:26.021>really <00:16:26.287>convincing,

399
00:16:26.405 --> 00:16:29.245
<00:16:26.405>but <00:16:26.545>in <00:16:26.685>the <00:16:26.824>end, <00:16:26.964>the <00:16:27.105>result <00:16:27.245>was <00:16:27.385>wrong, <00:16:27.525>you <00:16:27.665>know, <00:16:27.805>especially

400
00:16:29.245 --> 00:16:30.805
<00:16:29.245>with <00:16:29.478>math, <00:16:29.711>like <00:16:29.945>they're <00:16:30.178>not <00:16:30.411>that <00:16:30.645>great.

401
00:16:31.305 --> 00:16:34.125
<00:16:31.305>Um, <00:16:31.505>but <00:16:31.704>in <00:16:31.905>Gemini <00:16:32.104>two, <00:16:32.305>oh, <00:16:32.505>you <00:16:32.704>can

402
00:16:34.645 --> 00:16:36.965
<00:16:34.645>actually <00:16:34.995>do <00:16:35.345>enable <00:16:35.694>code <00:16:36.045>execution.

403
00:16:36.965 --> 00:16:40.765
<00:16:36.965>It's <00:16:37.140>a <00:16:37.315>tool <00:16:37.490>where <00:16:37.665>they <00:16:37.840>actually <00:16:38.015>generates <00:16:38.190>Python <00:16:38.365>code

404
00:16:40.785 --> 00:16:41.885
<00:16:40.785>and <00:16:41.032>then <00:16:41.280>it <00:16:41.527>runs <00:16:41.775>it.

405
00:16:42.345 --> 00:16:44.565
<00:16:42.345>So <00:16:42.578>with <00:16:42.811>that, <00:16:43.045>uh, <00:16:43.278>if <00:16:43.511>you <00:16:43.745>need

406
00:16:44.565 --> 00:16:46.565
<00:16:44.565>to <00:16:44.740>do <00:16:44.915>a <00:16:45.090>calculation <00:16:45.265>like <00:16:45.440>prime <00:16:45.615>numbers, <00:16:45.790>for <00:16:45.965>example,

407
00:16:46.795 --> 00:16:49.245
<00:16:46.795>then <00:16:47.028>you <00:16:47.261>get <00:16:47.495>basically <00:16:47.728>more <00:16:47.961>accurate <00:16:48.194>results.

408
00:16:49.425 --> 00:16:52.125
<00:16:49.425>So <00:16:49.564>that's <00:16:49.704>one <00:16:49.844>thing <00:16:49.984>you <00:16:50.125>can <00:16:50.265>do <00:16:50.405>to <00:16:50.545>make <00:16:50.685>things <00:16:50.824>better.

409
00:16:53.065 --> 00:16:55.405
<00:16:53.065>Um, <00:16:53.205>but <00:16:53.345>the <00:16:53.485>other <00:16:53.625>thing <00:16:53.765>you <00:16:53.905>can <00:16:54.045>do <00:16:54.185>is <00:16:54.325>basically, <00:16:54.465>uh,

410
00:16:55.405 --> 00:16:59.005
<00:16:55.405>you <00:16:55.545>need <00:16:55.685>to <00:16:55.824>ground <00:16:55.964>the <00:16:56.105>data, <00:16:56.245>uh, <00:16:56.385>ground <00:16:56.525>the <00:16:56.665>responses, <00:16:56.805>um,

411
00:16:59.395 --> 00:17:01.525
<00:16:59.395>with <00:16:59.595>some <00:16:59.795>data <00:16:59.995>you <00:17:00.194>can <00:17:00.395>either <00:17:00.595>ground <00:17:00.795>it

412
00:17:01.525 --> 00:17:04.565
<00:17:01.525>with <00:17:01.725>things <00:17:01.925>like <00:17:02.125>Google <00:17:02.324>search, <00:17:02.525>for <00:17:02.725>example, <00:17:02.925>um,

413
00:17:04.985 --> 00:17:06.485
<00:17:04.984>or <00:17:05.153>you <00:17:05.322>can <00:17:05.491>ground <00:17:05.659>it <00:17:05.828>with <00:17:05.997>your <00:17:06.166>own <00:17:06.334>data.

414
00:17:06.745 --> 00:17:09.685
<00:17:06.744>So <00:17:06.861>if <00:17:06.978>you <00:17:07.094>use <00:17:07.211>a <00:17:07.328>rag <00:17:07.444>kind <00:17:07.561>of <00:17:07.678>pipeline, <00:17:07.794>you <00:17:07.911>can <00:17:08.028>ingest <00:17:08.145>your,

415
00:17:09.755 --> 00:17:12.125
<00:17:09.755>your <00:17:09.910>data, <00:17:10.066>and <00:17:10.221>then <00:17:10.377>when <00:17:10.532>the <00:17:10.688>user <00:17:10.843>asks <00:17:10.999>a <00:17:11.155>question,

416
00:17:12.465 --> 00:17:13.845
<00:17:12.464>you <00:17:12.775>find <00:17:13.086>the <00:17:13.396>relevant <00:17:13.707>documents

417
00:17:14.225 --> 00:17:15.925
<00:17:14.224>and <00:17:14.425>then <00:17:14.625>you <00:17:14.824>feed <00:17:15.024>that <00:17:15.224>to <00:17:15.425>the <00:17:15.625>LLM.

418
00:17:15.945 --> 00:17:20.125
<00:17:15.944>So <00:17:16.061>that <00:17:16.178>LM <00:17:16.294>uses <00:17:16.411>that <00:17:16.528>kind <00:17:16.645>of <00:17:16.761>like <00:17:16.878>a, <00:17:16.994>it's <00:17:17.111>like <00:17:17.228>a <00:17:17.345>subset

419
00:17:20.185 --> 00:17:21.845
<00:17:20.185>of <00:17:20.385>data <00:17:20.585>that <00:17:20.784>it <00:17:20.984>uses <00:17:21.185>when <00:17:21.385>it <00:17:21.585>answers.

420
00:17:22.225 --> 00:17:24.765
<00:17:22.224>So <00:17:22.399>becau, <00:17:22.574>so <00:17:22.750>we <00:17:22.925>are <00:17:23.099>basically <00:17:23.274>constructing <00:17:23.449>the <00:17:23.625>LLM

421
00:17:24.985 --> 00:17:26.885
<00:17:24.984>to <00:17:25.334>a <00:17:25.685>small <00:17:26.034>data <00:17:26.385>set.

422
00:17:27.315 --> 00:17:29.205
<00:17:27.315>That <00:17:27.515>way <00:17:27.715>it <00:17:27.915>can <00:17:28.115>give <00:17:28.315>us <00:17:28.515>more <00:17:28.715>accurate

423
00:17:29.345 --> 00:17:32.085
<00:17:29.345>and <00:17:29.625>more, <00:17:29.905>you <00:17:30.185>know, <00:17:30.465>directed <00:17:30.745>answers.

424
00:17:32.225 --> 00:17:34.285
<00:17:32.225>So <00:17:32.365>that's, <00:17:32.504>that's <00:17:32.645>what <00:17:32.784>you <00:17:32.925>can <00:17:33.064>do <00:17:33.205>with <00:17:33.344>Hall <00:17:33.485>Nation, <00:17:33.625>uh,

425
00:17:34.315 --> 00:17:36.565
<00:17:34.315>grounding <00:17:34.781>your <00:17:35.248>responses, <00:17:35.715>basically.

426
00:17:37.105 --> 00:17:40.365
<00:17:37.105>Um, <00:17:37.260>that <00:17:37.416>means <00:17:37.571>you <00:17:37.727>need <00:17:37.882>to <00:17:38.038>use <00:17:38.193>something <00:17:38.349>like, <00:17:38.505>um,

427
00:17:40.945 --> 00:17:43.285
<00:17:40.945>on <00:17:41.145>Google <00:17:41.345>Cloud, <00:17:41.544>there's <00:17:41.745>a <00:17:41.945>Rex <00:17:42.145>AI <00:17:42.345>search

428
00:17:43.495 --> 00:17:46.285
<00:17:43.495>where <00:17:43.695>you <00:17:43.895>can <00:17:44.094>ingest <00:17:44.294>your <00:17:44.495>own <00:17:44.695>website <00:17:44.895>data

429
00:17:46.305 --> 00:17:49.045
<00:17:46.305>or <00:17:46.460>you <00:17:46.616>can <00:17:46.771>ingest <00:17:46.927>your <00:17:47.082>own <00:17:47.238>PDFs, <00:17:47.393>things <00:17:47.549>like <00:17:47.705>that.

430
00:17:49.825 --> 00:17:53.765
<00:17:49.825>And <00:17:49.952>then, <00:17:50.079>then <00:17:50.206>you <00:17:50.334>pass <00:17:50.461>that <00:17:50.588>as <00:17:50.715>a <00:17:50.843>tool <00:17:50.970>to <00:17:51.097>the <00:17:51.225>LLM,

431
00:17:53.825 --> 00:17:55.845
<00:17:53.825>and <00:17:54.025>then <00:17:54.225>LLM <00:17:54.425>will <00:17:54.625>use <00:17:54.825>that <00:17:55.025>instead <00:17:55.225>of,

432
00:17:56.755 --> 00:17:58.165
<00:17:56.755>instead <00:17:57.008>of <00:17:57.262>Google <00:17:57.516>search, <00:17:57.770>for <00:17:58.024>example.

433
00:17:58.265 --> 00:18:01.005
<00:17:58.265>So <00:17:58.405>that's <00:17:58.545>how <00:17:58.685>you <00:17:58.825>would <00:17:58.965>ground <00:17:59.105>with <00:17:59.245>your <00:17:59.385>own <00:17:59.525>private <00:17:59.665>data.

434
00:18:01.585 --> 00:18:03.485
<00:18:01.585>And <00:18:01.760>there's <00:18:01.935>so <00:18:02.110>many <00:18:02.285>different <00:18:02.460>ways <00:18:02.635>of <00:18:02.810>grounding, <00:18:02.985>again,

435
00:18:03.485 --> 00:18:06.485
<00:18:03.485>like <00:18:03.718>there's, <00:18:03.951>um, <00:18:04.185>LAMA <00:18:04.418>index, <00:18:04.651>for <00:18:04.885>example,

436
00:18:06.505 --> 00:18:09.405
<00:18:06.505>you <00:18:06.660>can <00:18:06.816>use <00:18:06.971>LAMA <00:18:07.127>index <00:18:07.282>to, <00:18:07.438>to <00:18:07.593>ground, <00:18:07.749>there's, <00:18:07.905>um,

437
00:18:09.835 --> 00:18:11.565
<00:18:09.835>lung <00:18:10.068>chain <00:18:10.301>has <00:18:10.535>different <00:18:10.768>ways <00:18:11.001>of <00:18:11.235>grounding.

438
00:18:11.565 --> 00:18:15.165
<00:18:11.565>So <00:18:11.765>like <00:18:11.965>the, <00:18:12.165>I <00:18:12.365>don't <00:18:12.565>think <00:18:12.765>there's <00:18:12.965>a,

439
00:18:16.155 --> 00:18:18.765
<00:18:16.155>there's <00:18:16.310>one <00:18:16.466>way <00:18:16.621>and <00:18:16.777>there's, <00:18:16.932>there's <00:18:17.088>no <00:18:17.243>one <00:18:17.399>standard <00:18:17.555>yet.

440
00:18:18.865 --> 00:18:21.245
<00:18:18.865>So <00:18:19.040>it <00:18:19.215>depends <00:18:19.390>where <00:18:19.565>you're <00:18:19.740>running, <00:18:19.915>uh, <00:18:20.090>which <00:18:20.265>cloud

441
00:18:21.585 --> 00:18:22.965
<00:18:21.585>and <00:18:21.792>what <00:18:21.999>kind <00:18:22.206>of <00:18:22.413>technologies <00:18:22.620>you're <00:18:22.827>using.

442
00:18:23.225 --> 00:18:27.325
<00:18:23.225>And <00:18:23.399>then <00:18:23.574>with <00:18:23.750>that, <00:18:23.925>you'll <00:18:24.100>use <00:18:24.274>one <00:18:24.449>grounding <00:18:24.625>technology,

443
00:18:27.325 --> 00:18:29.965
<00:18:27.325>basically, <00:18:27.480>depending <00:18:27.636>on <00:18:27.791>what <00:18:27.947>kind <00:18:28.102>of <00:18:28.258>grounding <00:18:28.413>you <00:18:28.569>wanna <00:18:28.725>do.

444
00:18:30.745 --> 00:18:33.605
<00:18:30.745>Now, <00:18:30.900>Guillaume, <00:18:31.056>the <00:18:31.211>other <00:18:31.367>problem <00:18:31.522>that, <00:18:31.678>uh, <00:18:31.833>LLMs <00:18:31.989>have <00:18:32.145>is

445
00:18:33.605 --> 00:18:35.405
<00:18:33.605>that <00:18:33.838>they, <00:18:34.071>uh, <00:18:34.305>they're <00:18:34.538>costly <00:18:34.771>to <00:18:35.005>train

446
00:18:35.405 --> 00:18:36.445
<00:18:35.405>and <00:18:35.639>they're <00:18:35.873>costly <00:18:36.107>to <00:18:36.341>weigh,

447
00:18:36.745 --> 00:18:38.805
<00:18:36.745>so <00:18:37.024>they're <00:18:37.304>actually <00:18:37.584>outdated <00:18:37.864>public <00:18:38.145>data.

448
00:18:38.945 --> 00:18:41.565
<00:18:38.945>So <00:18:39.085>I <00:18:39.225>remember <00:18:39.365>the <00:18:39.504>first <00:18:39.645>chat <00:18:39.784>GPT <00:18:39.925>version <00:18:40.064>were <00:18:40.205>from <00:18:40.345>2011.

449
00:18:41.785 --> 00:18:45.125
<00:18:41.785>So <00:18:41.912>when <00:18:42.039>you <00:18:42.166>asked <00:18:42.294>it <00:18:42.421>about <00:18:42.548>new <00:18:42.675>CSS <00:18:42.803>features <00:18:42.930>from <00:18:43.057>last <00:18:43.185>month

450
00:18:45.125 --> 00:18:47.725
<00:18:45.125>and <00:18:45.241>had <00:18:45.358>no <00:18:45.475>idea <00:18:45.591>how <00:18:45.708>to <00:18:45.825>do <00:18:45.941>that, <00:18:46.058>how <00:18:46.175>can <00:18:46.291>we <00:18:46.408>work <00:18:46.525>around

451
00:18:47.725 --> 00:18:50.485
<00:18:47.725>that <00:18:47.865>issue <00:18:48.004>that <00:18:48.145>you <00:18:48.284>work <00:18:48.425>with <00:18:48.564>stale <00:18:48.705>data <00:18:48.844>in <00:18:48.985>an <00:18:49.125>lm

452
00:18:51.315 --> 00:18:54.725
<00:18:51.315>Yeah, <00:18:51.490>so <00:18:51.665>typically, <00:18:51.840>uh, <00:18:52.015>since <00:18:52.190>we <00:18:52.365>mentioned <00:18:52.540>web <00:18:52.715>searches

453
00:18:55.265 --> 00:18:57.245
<00:18:55.265>and, <00:18:55.615>uh, <00:18:55.965>rag, <00:18:56.315>uh, <00:18:56.665>those,

454
00:18:57.255 --> 00:19:01.365
<00:18:57.255>those <00:18:57.395>two <00:18:57.535>aspects <00:18:57.675>are <00:18:57.815>definitely <00:18:57.955>the, <00:18:58.095>the <00:18:58.235>best <00:18:58.375>way <00:18:58.515>to, <00:18:58.655>uh,

455
00:19:01.695 --> 00:19:04.805
<00:19:01.695>solve <00:19:01.835>that <00:19:01.975>problem <00:19:02.115>in <00:19:02.254>the <00:19:02.395>sense <00:19:02.534>that <00:19:02.675>when <00:19:02.814>you <00:19:02.955>do <00:19:03.095>a,

456
00:19:05.085 --> 00:19:07.605
<00:19:05.085>a <00:19:05.260>web <00:19:05.435>search, <00:19:05.610>it's <00:19:05.785>gonna <00:19:05.960>search <00:19:06.135>for, <00:19:06.310>you <00:19:06.485>know,

457
00:19:07.605 --> 00:19:10.525
<00:19:07.605>live <00:19:07.838>information, <00:19:08.071>the, <00:19:08.305>the, <00:19:08.538>the <00:19:08.771>latest <00:19:09.005>information

458
00:19:10.545 --> 00:19:12.925
<00:19:10.545>that's <00:19:10.825>been <00:19:11.105>indexed <00:19:11.385>by <00:19:11.665>search <00:19:11.945>engines.

459
00:19:13.425 --> 00:19:15.925
<00:19:13.425>But <00:19:13.580>when <00:19:13.736>you <00:19:13.891>work <00:19:14.047>on <00:19:14.202>your <00:19:14.358>own <00:19:14.513>data, <00:19:14.669>of <00:19:14.825>course,

460
00:19:16.295 --> 00:19:19.365
<00:19:16.295>especially <00:19:16.528>when <00:19:16.761>it's <00:19:16.995>private <00:19:17.228>information, <00:19:17.461>customer <00:19:17.695>data,

461
00:19:19.625 --> 00:19:22.605
<00:19:19.625>et <00:19:19.780>cetera, <00:19:19.936>l <00:19:20.091>LMS <00:19:20.247>haven't <00:19:20.402>been <00:19:20.558>trained <00:19:20.713>on <00:19:20.869>that <00:19:21.025>information.

462
00:19:22.665 --> 00:19:25.885
<00:19:22.665>So <00:19:22.840>they <00:19:23.014>can <00:19:23.190>only <00:19:23.365>hallucinate <00:19:23.540>they, <00:19:23.715>it's <00:19:23.889>not <00:19:24.065>possible

463
00:19:25.885 --> 00:19:29.605
<00:19:25.885>that <00:19:26.025>they <00:19:26.165>give <00:19:26.305>proper, <00:19:26.445>you <00:19:26.585>know, <00:19:26.725>answers <00:19:26.865>out <00:19:27.004>of <00:19:27.145>that, <00:19:27.285>or,

464
00:19:29.625 --> 00:19:32.005
<00:19:29.625>or <00:19:29.800>they <00:19:29.975>could <00:19:30.150>just <00:19:30.325>say, <00:19:30.500>I <00:19:30.675>don't <00:19:30.850>know, <00:19:31.025>uh,

465
00:19:32.065 --> 00:19:33.125
<00:19:32.065>if <00:19:32.542>prompt <00:19:33.019>correctly.

466
00:19:33.505 --> 00:19:36.845
<00:19:33.505>Um, <00:19:33.660>so <00:19:33.816>when <00:19:33.971>you <00:19:34.127>use <00:19:34.282>rag, <00:19:34.438>actually <00:19:34.593>the, <00:19:34.749>the <00:19:34.905>information

467
00:19:36.845 --> 00:19:41.405
<00:19:36.845>that <00:19:36.985>the <00:19:37.125>LLM <00:19:37.265>will <00:19:37.405>generate <00:19:37.545>ultimately <00:19:37.685>is <00:19:37.825>as <00:19:37.965>up <00:19:38.105>to <00:19:38.245>date

468
00:19:41.505 --> 00:19:44.925
<00:19:41.505>as <00:19:41.621>the <00:19:41.738>data <00:19:41.855>you <00:19:41.971>gave <00:19:42.088>it, <00:19:42.205>uh, <00:19:42.321>in <00:19:42.438>the, <00:19:42.555>in <00:19:42.671>the <00:19:42.788>first <00:19:42.905>place

469
00:19:45.035 --> 00:19:47.005
<00:19:45.035>through <00:19:45.315>the, <00:19:45.595>the <00:19:45.875>rag <00:19:46.155>search <00:19:46.435>results

470
00:19:47.005 --> 00:19:49.365
<00:19:47.005>that <00:19:47.180>you <00:19:47.355>put <00:19:47.530>in <00:19:47.705>the <00:19:47.880>prompt <00:19:48.055>of <00:19:48.230>the <00:19:48.405>LLM.

471
00:19:49.465 --> 00:19:52.885
<00:19:49.465>So <00:19:49.592>if <00:19:49.719>your <00:19:49.846>data <00:19:49.974>is <00:19:50.101>up <00:19:50.228>to <00:19:50.355>date, <00:19:50.483>you <00:19:50.610>know, <00:19:50.737>vector, <00:19:50.865>database,

472
00:19:53.225 --> 00:19:56.485
<00:19:53.225>et <00:19:53.352>cetera, <00:19:53.479>then <00:19:53.606>the, <00:19:53.734>the <00:19:53.861>responses <00:19:53.988>will <00:19:54.115>be <00:19:54.243>up <00:19:54.370>to <00:19:54.497>date, <00:19:54.625>uh,

473
00:19:56.555 --> 00:19:58.005
<00:19:56.555>from, <00:19:56.990>from <00:19:57.425>the <00:19:57.860>LLM.

474
00:19:58.305 --> 00:20:00.525
<00:19:58.305>So <00:19:58.460>that's <00:19:58.616>really <00:19:58.771>the <00:19:58.927>two <00:19:59.082>way <00:19:59.238>to, <00:19:59.393>to <00:19:59.549>get, <00:19:59.705>uh,

475
00:20:00.835 --> 00:20:03.485
<00:20:00.835>past <00:20:01.068>outdated <00:20:01.301>data <00:20:01.535>and <00:20:01.768>get <00:20:02.001>live <00:20:02.235>information.

476
00:20:03.865 --> 00:20:07.405
<00:20:03.865>So <00:20:04.040>you <00:20:04.215>can <00:20:04.390>also <00:20:04.565>provide <00:20:04.740>LLM, <00:20:04.915>um, <00:20:05.090>access <00:20:05.265>to

477
00:20:08.025 --> 00:20:12.245
<00:20:08.025>any <00:20:08.180>API <00:20:08.336>basically, <00:20:08.491>um, <00:20:08.647>for <00:20:08.802>example, <00:20:08.958>let's <00:20:09.113>say <00:20:09.269>you <00:20:09.425>want

478
00:20:12.245 --> 00:20:14.885
<00:20:12.245>to <00:20:12.478>learn <00:20:12.711>about <00:20:12.945>weather <00:20:13.178>information <00:20:13.411>from <00:20:13.645>today.

479
00:20:15.725 --> 00:20:17.565
<00:20:15.725>I <00:20:15.899>mean, <00:20:16.074>one <00:20:16.250>easy <00:20:16.425>way <00:20:16.600>of <00:20:16.774>doing <00:20:16.949>that <00:20:17.125>is

480
00:20:17.785 --> 00:20:18.965
<00:20:17.785>to <00:20:18.050>run <00:20:18.316>the <00:20:18.581>Google <00:20:18.847>search

481
00:20:18.965 --> 00:20:20.085
<00:20:18.965>and <00:20:19.166>Google <00:20:19.368>search, <00:20:19.569>get <00:20:19.771>the <00:20:19.973>better

482
00:20:20.085 --> 00:20:21.365
<00:20:20.085>information, <00:20:20.373>but <00:20:20.661>if <00:20:20.949>you <00:20:21.237>wanna

483
00:20:21.955 --> 00:20:23.565
<00:20:21.955>Look <00:20:22.235>out <00:20:22.514>the <00:20:22.794>window <00:20:23.074>or, <00:20:23.355>yeah,

484
00:20:26.065 --> 00:20:29.965
<00:20:26.065>Or, <00:20:26.181>or <00:20:26.298>another <00:20:26.415>one <00:20:26.531>is <00:20:26.648>that <00:20:26.765>you, <00:20:26.881>you <00:20:26.998>have <00:20:27.115>a <00:20:27.231>web <00:20:27.348>API, <00:20:27.465>uh,

485
00:20:29.985 --> 00:20:31.845
<00:20:29.985>and <00:20:30.140>then <00:20:30.296>you <00:20:30.451>basically <00:20:30.607>provide <00:20:30.762>that <00:20:30.918>again <00:20:31.073>as <00:20:31.229>a <00:20:31.385>tool

486
00:20:31.845 --> 00:20:33.405
<00:20:31.845>to <00:20:32.045>the <00:20:32.245>LM <00:20:32.445>and <00:20:32.645>say, <00:20:32.845>look, <00:20:33.045>there's <00:20:33.245>this

487
00:20:33.955 --> 00:20:35.965
<00:20:33.955>weather <00:20:34.304>API <00:20:34.655>available <00:20:35.004>to <00:20:35.355>you.

488
00:20:36.305 --> 00:20:39.045
<00:20:36.305>Um, <00:20:36.480>and <00:20:36.655>you <00:20:36.830>can <00:20:37.005>call <00:20:37.180>it <00:20:37.355>with <00:20:37.530>this <00:20:37.705>parameters.

489
00:20:39.385 --> 00:20:42.325
<00:20:39.385>Um, <00:20:39.560>and <00:20:39.735>you <00:20:39.910>know, <00:20:40.085>this <00:20:40.260>is <00:20:40.435>kind <00:20:40.610>of <00:20:40.785>the,

490
00:20:42.385 --> 00:20:44.645
<00:20:42.385>so <00:20:42.560>you <00:20:42.735>basically <00:20:42.910>provide <00:20:43.085>a <00:20:43.260>function <00:20:43.435>with <00:20:43.610>some <00:20:43.785>description

491
00:20:44.645 --> 00:20:46.445
<00:20:44.645>of <00:20:44.820>like <00:20:44.995>what <00:20:45.170>the <00:20:45.345>function <00:20:45.520>is <00:20:45.695>supposed <00:20:45.870>to <00:20:46.045>do,

492
00:20:47.065 --> 00:20:48.365
<00:20:47.065>and <00:20:47.232>then <00:20:47.399>you <00:20:47.566>pass <00:20:47.733>that <00:20:47.900>to <00:20:48.067>the <00:20:48.235>LLM

493
00:20:48.365 --> 00:20:50.885
<00:20:48.365>and <00:20:48.492>then <00:20:48.619>LLM <00:20:48.746>when <00:20:48.874>you <00:20:49.001>ask <00:20:49.128>about <00:20:49.255>the <00:20:49.383>weather, <00:20:49.510>it <00:20:49.637>figures <00:20:49.765>out

494
00:20:50.885 --> 00:20:54.005
<00:20:50.885>that, <00:20:51.025>okay, <00:20:51.165>now <00:20:51.305>I'm, <00:20:51.445>someone <00:20:51.585>is <00:20:51.725>asking <00:20:51.865>me <00:20:52.004>about <00:20:52.145>weather, <00:20:52.285>so

495
00:20:55.025 --> 00:20:57.165
<00:20:55.025>can <00:20:55.165>you <00:20:55.305>call <00:20:55.445>this <00:20:55.585>function <00:20:55.725>that <00:20:55.865>you <00:20:56.005>told <00:20:56.145>me <00:20:56.285>it <00:20:56.425>exists?

496
00:20:57.545 --> 00:20:59.245
<00:20:57.545>And <00:20:57.745>then <00:20:57.945>your <00:20:58.145>application <00:20:58.345>will <00:20:58.545>call <00:20:58.745>the <00:20:58.945>function,

497
00:20:59.385 --> 00:21:00.885
<00:20:59.385>get <00:20:59.577>the <00:20:59.770>result, <00:20:59.963>feed <00:21:00.156>it <00:21:00.349>to <00:21:00.542>the <00:21:00.735>LLM,

498
00:21:01.155 --> 00:21:03.965
<00:21:01.155>then <00:21:01.355>LLM <00:21:01.555>will <00:21:01.754>respond <00:21:01.955>back <00:21:02.155>saying, <00:21:02.355>okay, <00:21:02.555>the,

499
00:21:04.145 --> 00:21:06.805
<00:21:04.145>the <00:21:04.320>weather <00:21:04.495>in <00:21:04.670>London <00:21:04.845>is <00:21:05.020>rainy <00:21:05.195>and <00:21:05.370>10 <00:21:05.545>degrees

500
00:21:06.805 --> 00:21:08.005
<00:21:06.805>or <00:21:06.985>whatever, <00:21:07.165>you <00:21:07.345>know, <00:21:07.525>something <00:21:07.705>like <00:21:07.885>that.

501
00:21:08.425 --> 00:21:10.605
<00:21:08.425>So <00:21:08.600>that's <00:21:08.774>another <00:21:08.950>way <00:21:09.125>of <00:21:09.300>like <00:21:09.475>feeding <00:21:09.649>your <00:21:09.825>LLM

502
00:21:10.605 --> 00:21:14.365
<00:21:10.605>with <00:21:10.745>like <00:21:10.885>any <00:21:11.025>kind <00:21:11.165>of <00:21:11.305>data <00:21:11.445>really <00:21:11.585>coming <00:21:11.725>from <00:21:11.865>any <00:21:12.005>API

503
00:21:14.365 --> 00:21:15.725
<00:21:14.365>that's <00:21:14.671>accessible <00:21:14.976>by <00:21:15.283>the <00:21:15.589>LM

504
00:21:16.785 --> 00:21:18.125
<00:21:16.785>And <00:21:17.086>that <00:21:17.388>becomes <00:21:17.689>really <00:21:17.991>immediate.

505
00:21:18.325 --> 00:21:20.245
<00:21:18.325>I <00:21:18.675>remember <00:21:19.025>Gemini <00:21:19.375>yesterday <00:21:19.725>announcing

506
00:21:20.245 --> 00:21:22.285
<00:21:20.245>that <00:21:20.445>it <00:21:20.645>can <00:21:20.844>actually <00:21:21.044>do <00:21:21.245>live <00:21:21.445>video <00:21:21.645>reading

507
00:21:22.305 --> 00:21:23.325
<00:21:22.305>of <00:21:22.611>your <00:21:22.917>mobile <00:21:23.223>phone.

508
00:21:23.625 --> 00:21:25.805
<00:21:23.625>So <00:21:23.825>you <00:21:24.025>can <00:21:24.225>actually <00:21:24.425>ask <00:21:24.625>the <00:21:24.825>Ask <00:21:25.025>Gemini,

509
00:21:25.805 --> 00:21:27.445
<00:21:25.805>what's <00:21:26.005>happening <00:21:26.205>on <00:21:26.405>your <00:21:26.605>phone <00:21:26.805>at <00:21:27.005>the <00:21:27.205>moment?

510
00:21:27.975 --> 00:21:30.045
<00:21:27.975>Which <00:21:28.208>sounds <00:21:28.441>to <00:21:28.675>me <00:21:28.908>kind <00:21:29.141>of <00:21:29.375>scary

511
00:21:30.365 --> 00:21:32.085
<00:21:30.365>'cause <00:21:30.520>I'm <00:21:30.676>like, <00:21:30.831>uh, <00:21:30.987>did <00:21:31.142>it <00:21:31.298>share <00:21:31.453>the <00:21:31.609>whole <00:21:31.765>thing?

512
00:21:32.085 --> 00:21:35.365
<00:21:32.085>Where <00:21:32.240>did <00:21:32.396>it <00:21:32.551>go? <00:21:32.707>So, <00:21:32.862>but <00:21:33.018>the <00:21:33.173>immediacy <00:21:33.329>is <00:21:33.485>there.

513
00:21:35.785 --> 00:21:37.485
<00:21:35.785>One <00:21:35.960>thing <00:21:36.135>you <00:21:36.310>have <00:21:36.485>in <00:21:36.660>your <00:21:36.835>slides <00:21:37.010>here <00:21:37.185>is

514
00:21:37.485 --> 00:21:39.165
<00:21:37.485>that <00:21:37.764>LLM <00:21:38.044>inputs <00:21:38.324>can <00:21:38.604>get <00:21:38.885>expensive.

515
00:21:39.165 --> 00:21:41.285
<00:21:39.165>What <00:21:39.292>do <00:21:39.419>you <00:21:39.546>mean <00:21:39.674>by <00:21:39.801>that? <00:21:39.928>And <00:21:40.055>how <00:21:40.183>can <00:21:40.310>work <00:21:40.437>around <00:21:40.565>that?

516
00:21:42.385 --> 00:21:46.605
<00:21:42.385>The <00:21:42.560>latest <00:21:42.735>models, <00:21:42.910>they <00:21:43.085>have <00:21:43.260>this <00:21:43.435>long <00:21:43.610>context, <00:21:43.785>I,

517
00:21:46.685 --> 00:21:48.125
<00:21:46.685>I <00:21:46.847>don't <00:21:47.009>remember <00:21:47.171>the <00:21:47.333>exact <00:21:47.495>number <00:21:47.657>'cause <00:21:47.819>it <00:21:47.981>always

518
00:21:48.325 --> 00:21:50.365
<00:21:48.325>increases, <00:21:48.558>it <00:21:48.791>was <00:21:49.025>like <00:21:49.258>1 <00:21:49.491>million <00:21:49.725>tos

519
00:21:50.365 --> 00:21:51.525
<00:21:50.365>or <00:21:50.539>something, <00:21:50.713>but <00:21:50.887>now <00:21:51.061>it's <00:21:51.235>2 <00:21:51.409>million.

520
00:21:52.465 --> 00:21:55.325
<00:21:52.465>And, <00:21:52.620>um, <00:21:52.776>what <00:21:52.931>that <00:21:53.087>enables <00:21:53.242>you <00:21:53.398>to <00:21:53.553>do <00:21:53.709>is, <00:21:53.865>um,

521
00:21:55.745 --> 00:21:59.485
<00:21:55.745>you <00:21:55.919>can <00:21:56.094>basically <00:21:56.270>send <00:21:56.445>like <00:21:56.620>long <00:21:56.794>texts, <00:21:56.969>like, <00:21:57.145>or,

522
00:21:59.505 --> 00:22:02.045
<00:21:59.505>or <00:21:59.660>like, <00:21:59.816>you <00:21:59.971>can <00:22:00.127>send <00:22:00.282>your <00:22:00.438>whole <00:22:00.593>repo, <00:22:00.749>for <00:22:00.905>example,

523
00:22:02.105 --> 00:22:03.405
<00:22:02.105>in <00:22:02.690>one <00:22:03.275>request,

524
00:22:03.545 --> 00:22:06.725
<00:22:03.545>or <00:22:03.661>you <00:22:03.778>can <00:22:03.895>send <00:22:04.011>like <00:22:04.128>bunch <00:22:04.245>of <00:22:04.361>videos <00:22:04.478>at <00:22:04.595>once <00:22:04.711>to <00:22:04.828>the <00:22:04.945>LLM

525
00:22:06.725 --> 00:22:08.685
<00:22:06.725>and <00:22:06.958>ask <00:22:07.191>LLM, <00:22:07.425>can <00:22:07.658>you <00:22:07.891>analyze <00:22:08.125>this?

526
00:22:08.685 --> 00:22:09.965
<00:22:08.685>And <00:22:08.849>it <00:22:09.014>will <00:22:09.178>do <00:22:09.343>that, <00:22:09.507>which <00:22:09.672>is <00:22:09.837>great

527
00:22:09.965 --> 00:22:11.965
<00:22:09.965>because, <00:22:10.139>you <00:22:10.314>know, <00:22:10.490>you're <00:22:10.665>giving <00:22:10.840>a <00:22:11.014>lot <00:22:11.189>of <00:22:11.365>context

528
00:22:12.025 --> 00:22:15.165
<00:22:12.025>to <00:22:12.165>the <00:22:12.305>LLM, <00:22:12.445>but <00:22:12.585>at <00:22:12.725>the <00:22:12.865>same <00:22:13.005>time, <00:22:13.145>like <00:22:13.285>these <00:22:13.425>things,

529
00:22:15.195 --> 00:22:16.685
<00:22:15.195>they, <00:22:15.530>they <00:22:15.865>cost <00:22:16.200>money, <00:22:16.536>right?

530
00:22:16.685 --> 00:22:18.245
<00:22:16.685>Like, <00:22:16.965>because <00:22:17.245>the <00:22:17.524>bigger <00:22:17.804>the <00:22:18.085>context,

531
00:22:18.345 --> 00:22:19.685
<00:22:18.345>the <00:22:18.586>more <00:22:18.827>tokens <00:22:19.068>you're <00:22:19.309>gonna <00:22:19.551>use.

532
00:22:20.585 --> 00:22:23.885
<00:22:20.585>So <00:22:20.725>if <00:22:20.865>you're <00:22:21.005>gonna <00:22:21.145>keep <00:22:21.285>sending <00:22:21.425>the <00:22:21.565>same <00:22:21.705>stuff <00:22:21.845>over, <00:22:21.985>over,

533
00:22:24.025 --> 00:22:26.485
<00:22:24.025>let, <00:22:24.200>let's <00:22:24.375>say <00:22:24.550>there's <00:22:24.725>a <00:22:24.900>video <00:22:25.075>over <00:22:25.250>a <00:22:25.425>movie

534
00:22:26.505 --> 00:22:28.125
<00:22:26.505>or <00:22:26.645>something <00:22:26.785>like <00:22:26.925>that, <00:22:27.065>and <00:22:27.205>you <00:22:27.345>want <00:22:27.485>to <00:22:27.625>ask <00:22:27.765>a <00:22:27.905>bunch

535
00:22:28.125 --> 00:22:29.125
<00:22:28.125>of <00:22:28.425>questions <00:22:28.725>about <00:22:29.025>it,

536
00:22:29.465 --> 00:22:31.005
<00:22:29.465>if <00:22:29.663>you <00:22:29.860>keep <00:22:30.059>sending <00:22:30.257>the <00:22:30.455>same <00:22:30.653>media <00:22:30.851>over

537
00:22:31.005 --> 00:22:33.485
<00:22:31.005>and <00:22:31.160>over, <00:22:31.316>you're <00:22:31.471>gonna <00:22:31.627>keep <00:22:31.782>paying <00:22:31.938>over <00:22:32.093>and <00:22:32.249>over, <00:22:32.405>right?

538
00:22:34.065 --> 00:22:36.405
<00:22:34.065>So <00:22:34.220>that's <00:22:34.376>what, <00:22:34.531>that's, <00:22:34.687>that's <00:22:34.842>why <00:22:34.998>you <00:22:35.153>can <00:22:35.309>get <00:22:35.465>expensive.

539
00:22:37.065 --> 00:22:40.165
<00:22:37.065>Um, <00:22:37.205>but <00:22:37.345>there <00:22:37.485>are <00:22:37.625>things <00:22:37.765>that <00:22:37.905>you <00:22:38.045>can <00:22:38.185>do <00:22:38.325>to <00:22:38.465>help,

540
00:22:40.225 --> 00:22:42.605
<00:22:40.225>and <00:22:40.504>these <00:22:40.784>are <00:22:41.064>basically <00:22:41.344>good <00:22:41.625>old

541
00:22:42.805 --> 00:22:43.965
<00:22:42.805>software <00:22:43.327>engineering <00:22:43.849>principles.

542
00:22:44.385 --> 00:22:47.045
<00:22:44.385>So <00:22:44.525>what <00:22:44.665>you <00:22:44.805>can <00:22:44.945>do <00:22:45.085>is, <00:22:45.225>for <00:22:45.365>example, <00:22:45.504>on, <00:22:45.645>um, <00:22:45.785>Gemini,

543
00:22:47.045 --> 00:22:48.725
<00:22:47.045>there's <00:22:47.395>something <00:22:47.745>called <00:22:48.095>context <00:22:48.445>caching.

544
00:22:49.585 --> 00:22:52.125
<00:22:49.585>And <00:22:49.725>the <00:22:49.865>idea <00:22:50.005>of <00:22:50.145>context <00:22:50.285>caching <00:22:50.425>is <00:22:50.565>basically <00:22:50.705>you <00:22:50.845>create <00:22:50.985>a

545
00:22:52.125 --> 00:22:55.325
<00:22:52.125>cache, <00:22:52.358>um, <00:22:52.591>and <00:22:52.825>then <00:22:53.058>you <00:22:53.291>save <00:22:53.525>things

546
00:22:55.325 --> 00:22:59.365
<00:22:55.325>that <00:22:55.465>you're <00:22:55.605>gonna <00:22:55.745>reuse <00:22:55.885>in <00:22:56.025>your <00:22:56.165>prompts, <00:22:56.305>like <00:22:56.445>videos <00:22:56.585>or <00:22:56.725>PDFs

547
00:22:59.385 --> 00:23:01.845
<00:22:59.385>or, <00:22:59.618>or <00:22:59.851>your <00:23:00.085>whole <00:23:00.318>GitHub <00:23:00.551>report, <00:23:00.785>whatever.

548
00:23:02.345 --> 00:23:06.885
<00:23:02.345>So <00:23:02.472>you <00:23:02.599>save <00:23:02.726>it <00:23:02.854>there <00:23:02.981>and <00:23:03.108>then <00:23:03.235>you <00:23:03.363>use <00:23:03.490>a <00:23:03.617>cache, <00:23:03.745>uh,

549
00:23:06.915 --> 00:23:08.445
<00:23:06.915>data <00:23:07.259>when <00:23:07.603>you <00:23:07.947>ask <00:23:08.292>questions.

550
00:23:09.035 --> 00:23:11.405
<00:23:09.035>That <00:23:09.190>way <00:23:09.346>you're <00:23:09.501>not, <00:23:09.657>you <00:23:09.812>are <00:23:09.968>only <00:23:10.123>sending <00:23:10.279>it <00:23:10.435>once

551
00:23:11.705 --> 00:23:13.765
<00:23:11.705>and <00:23:11.845>then <00:23:11.985>you're <00:23:12.125>just, <00:23:12.264>you <00:23:12.405>can <00:23:12.544>ask <00:23:12.685>multiple <00:23:12.824>questions <00:23:12.965>to <00:23:13.105>it,

552
00:23:13.765 --> 00:23:15.725
<00:23:13.765>and <00:23:13.965>it <00:23:14.165>will <00:23:14.365>be <00:23:14.565>much <00:23:14.765>cheaper <00:23:14.965>that <00:23:15.165>way.

553
00:23:16.465 --> 00:23:19.285
<00:23:16.465>So <00:23:16.745>that's, <00:23:17.024>mm-hmm. <00:23:17.304>That's <00:23:17.584>one <00:23:17.865>way

554
00:23:19.285 --> 00:23:20.445
<00:23:19.285>of <00:23:19.546>getting <00:23:19.807>the <00:23:20.068>expenses <00:23:20.329>down.

555
00:23:21.115 --> 00:23:24.325
<00:23:21.115>Another <00:23:21.465>one <00:23:21.815>is, <00:23:22.165>um, <00:23:22.515>like

556
00:23:25.265 --> 00:23:26.605
<00:23:25.265>if <00:23:25.506>you <00:23:25.747>keep <00:23:25.988>sending <00:23:26.229>prompts <00:23:26.471>one

557
00:23:26.605 --> 00:23:29.405
<00:23:26.605>after <00:23:26.745>another, <00:23:26.885>like <00:23:27.025>all, <00:23:27.165>you <00:23:27.305>know, <00:23:27.445>like <00:23:27.585>let's <00:23:27.725>say <00:23:27.865>you <00:23:28.005>have,

558
00:23:29.405 --> 00:23:33.285
<00:23:29.405>you <00:23:29.545>need <00:23:29.685>to <00:23:29.825>do <00:23:29.965>processing <00:23:30.105>or <00:23:30.245>like <00:23:30.385>a <00:23:30.524>hundred <00:23:30.665>things, <00:23:30.805>um,

559
00:23:33.385 --> 00:23:35.485
<00:23:33.385>and <00:23:33.585>you <00:23:33.785>can <00:23:33.985>just <00:23:34.185>do <00:23:34.385>the <00:23:34.585>naive <00:23:34.785>thing

560
00:23:35.485 --> 00:23:37.765
<00:23:35.485>and <00:23:35.659>just <00:23:35.834>send <00:23:36.010>a <00:23:36.185>hundred <00:23:36.360>requests, <00:23:36.534>one <00:23:36.709>after <00:23:36.885>another.

561
00:23:38.275 --> 00:23:40.365
<00:23:38.275>It's <00:23:38.475>gonna <00:23:38.675>be <00:23:38.875>expensive <00:23:39.075>because <00:23:39.275>first <00:23:39.475>of <00:23:39.675>all,

562
00:23:40.365 --> 00:23:42.525
<00:23:40.365>you're <00:23:40.645>sending <00:23:40.925>a <00:23:41.205>hundred <00:23:41.485>requests, <00:23:41.765>like

563
00:23:42.545 --> 00:23:44.485
<00:23:42.545>as <00:23:42.825>if <00:23:43.105>they're <00:23:43.385>separate, <00:23:43.665>separate <00:23:43.945>requests.

564
00:23:44.825 --> 00:23:46.045
<00:23:44.825>And <00:23:45.044>secondly, <00:23:45.264>it <00:23:45.483>will <00:23:45.703>be <00:23:45.923>expensive

565
00:23:46.045 --> 00:23:47.805
<00:23:46.045>because <00:23:46.278>you, <00:23:46.511>you're <00:23:46.745>gonna <00:23:46.978>do <00:23:47.211>it <00:23:47.445>sequentially.

566
00:23:48.505 --> 00:23:51.525
<00:23:48.505>Um, <00:23:48.660>again, <00:23:48.816>um, <00:23:48.971>you <00:23:49.127>can <00:23:49.282>use <00:23:49.438>the <00:23:49.593>good <00:23:49.749>old, <00:23:49.905>um,

567
00:23:52.045 --> 00:23:53.325
<00:23:52.045>software <00:23:52.429>eng <00:23:52.813>engineering <00:23:53.197>principles,

568
00:23:53.325 --> 00:23:54.845
<00:23:53.325>and <00:23:53.598>you <00:23:53.872>can <00:23:54.145>do <00:23:54.419>batch <00:23:54.693>generation,

569
00:23:54.845 --> 00:23:55.925
<00:23:54.845>what's <00:23:55.169>called <00:23:55.493>batch <00:23:55.817>generation.

570
00:23:56.235 --> 00:23:58.965
<00:23:56.235>This <00:23:56.435>is, <00:23:56.635>again, <00:23:56.834>another <00:23:57.034>API <00:23:57.235>from <00:23:57.435>Gemini <00:23:57.635>where

571
00:23:59.665 --> 00:24:01.045
<00:23:59.665>you <00:23:59.975>basically <00:24:00.286>just <00:24:00.596>say, <00:24:00.907>okay,

572
00:24:01.055 --> 00:24:03.765
<00:24:01.055>these <00:24:01.210>are <00:24:01.366>a <00:24:01.521>hundred <00:24:01.677>images <00:24:01.832>I <00:24:01.988>want <00:24:02.143>you <00:24:02.299>to <00:24:02.455>process,

573
00:24:03.865 --> 00:24:06.685
<00:24:03.865>for <00:24:04.020>example, <00:24:04.176>and <00:24:04.331>then <00:24:04.487>you <00:24:04.642>just <00:24:04.798>do <00:24:04.953>a <00:24:05.109>batch <00:24:05.265>call.

574
00:24:06.825 --> 00:24:09.885
<00:24:06.825>So <00:24:06.952>you <00:24:07.079>send <00:24:07.206>the <00:24:07.334>whole <00:24:07.461>call, <00:24:07.588>a <00:24:07.715>hundred <00:24:07.843>calls <00:24:07.970>out <00:24:08.097>at <00:24:08.225>once,

575
00:24:10.505 --> 00:24:13.085
<00:24:10.505>and <00:24:10.680>then <00:24:10.855>Gemini <00:24:11.030>will <00:24:11.205>do <00:24:11.380>all, <00:24:11.555>all <00:24:11.730>the <00:24:11.905>calls

576
00:24:13.225 --> 00:24:16.285
<00:24:13.225>and <00:24:13.504>then <00:24:13.784>populate <00:24:14.064>the <00:24:14.344>results <00:24:14.625>somewhere.

577
00:24:16.385 --> 00:24:18.045
<00:24:16.385>And <00:24:16.585>then <00:24:16.785>when, <00:24:16.985>when <00:24:17.185>it's <00:24:17.385>done, <00:24:17.585>you <00:24:17.785>go

578
00:24:18.045 --> 00:24:19.085
<00:24:18.045>and <00:24:18.279>check <00:24:18.513>the <00:24:18.747>results, <00:24:18.981>right?

579
00:24:19.905 --> 00:24:21.925
<00:24:19.905>Um, <00:24:20.254>this <00:24:20.605>again <00:24:20.955>makes <00:24:21.305>sense

580
00:24:22.045 --> 00:24:23.285
<00:24:22.045>because <00:24:22.324>you're <00:24:22.603>paralyzing <00:24:22.882>all <00:24:23.161>the

581
00:24:23.285 --> 00:24:24.965
<00:24:23.285>calls, <00:24:23.635>but <00:24:23.985>also <00:24:24.335>it's <00:24:24.685>cheaper.

582
00:24:25.145 --> 00:24:26.365
<00:24:25.145>So <00:24:25.328>instead <00:24:25.511>of <00:24:25.694>doing, <00:24:25.877>like, <00:24:26.060>I <00:24:26.243>think,

583
00:24:26.365 --> 00:24:27.565
<00:24:26.365>I <00:24:26.545>don't <00:24:26.725>remember <00:24:26.905>the <00:24:27.085>exact <00:24:27.265>number <00:24:27.445>again,

584
00:24:27.705 --> 00:24:30.245
<00:24:27.705>but <00:24:27.879>compared <00:24:28.054>to <00:24:28.230>regular <00:24:28.405>calls, <00:24:28.580>it, <00:24:28.754>it's <00:24:28.929>much <00:24:29.105>cheaper

585
00:24:30.305 --> 00:24:31.725
<00:24:30.305>to <00:24:30.487>do <00:24:30.670>it <00:24:30.852>a <00:24:31.035>batch <00:24:31.217>kind <00:24:31.400>of <00:24:31.582>call.

586
00:24:32.505 --> 00:24:34.405
<00:24:32.505>So <00:24:32.660>you <00:24:32.816>need <00:24:32.971>to <00:24:33.127>think <00:24:33.282>about <00:24:33.438>these <00:24:33.593>things <00:24:33.749>like <00:24:33.905>don't,

587
00:24:34.405 --> 00:24:36.525
<00:24:34.405>don't <00:24:34.580>just <00:24:34.754>do <00:24:34.930>the <00:24:35.105>default <00:24:35.280>thing, <00:24:35.455>the <00:24:35.629>easy <00:24:35.805>thing

588
00:24:36.525 --> 00:24:38.365
<00:24:36.525>to <00:24:36.665>just <00:24:36.805>make <00:24:36.945>a <00:24:37.085>call <00:24:37.225>and <00:24:37.365>get, <00:24:37.505>get <00:24:37.645>the <00:24:37.785>result, <00:24:37.925>like,

589
00:24:38.365 --> 00:24:39.645
<00:24:38.365>but <00:24:38.529>think <00:24:38.694>about <00:24:38.858>like <00:24:39.023>how <00:24:39.187>much <00:24:39.352>it <00:24:39.517>costs

590
00:24:39.985 --> 00:24:42.125
<00:24:39.985>and <00:24:40.159>what <00:24:40.334>kind <00:24:40.510>of <00:24:40.685>features <00:24:40.860>I <00:24:41.034>have <00:24:41.209>available, <00:24:41.385>like

591
00:24:42.275 --> 00:24:43.965
<00:24:42.275>that <00:24:42.741>generational <00:24:43.208>context <00:24:43.675>caching

592
00:24:44.145 --> 00:24:45.485
<00:24:44.145>to <00:24:44.295>make <00:24:44.446>it <00:24:44.597>a <00:24:44.748>little <00:24:44.898>bit <00:24:45.049>cheaper <00:24:45.200>for <00:24:45.351>you.

593
00:24:46.595 --> 00:24:49.045
<00:24:46.595>It's <00:24:46.722>so, <00:24:46.849>same <00:24:46.976>with <00:24:47.104>like <00:24:47.231>gen <00:24:47.358>ai, <00:24:47.485>when <00:24:47.613>you <00:24:47.740>think <00:24:47.867>about <00:24:47.995>it,

594
00:24:49.045 --> 00:24:51.445
<00:24:49.045>like, <00:24:49.245>okay, <00:24:49.445>let's <00:24:49.645>generate <00:24:49.845>five <00:24:50.045>pictures <00:24:50.245>for <00:24:50.445>me.

595
00:24:51.775 --> 00:24:53.205
<00:24:51.775>Let's <00:24:52.032>generate <00:24:52.289>a <00:24:52.547>video <00:24:52.804>for <00:24:53.062>me.

596
00:24:53.225 --> 00:24:55.165
<00:24:53.225>And <00:24:53.458>halfway <00:24:53.691>through <00:24:53.925>you <00:24:54.158>realize <00:24:54.391>it's <00:24:54.625>hallucinating,

597
00:24:55.165 --> 00:24:56.525
<00:24:55.165>it's <00:24:55.318>not <00:24:55.471>giving <00:24:55.624>me <00:24:55.777>the <00:24:55.930>thing <00:24:56.083>that <00:24:56.236>I <00:24:56.389>want,

598
00:24:56.905 --> 00:24:59.445
<00:24:56.905>and <00:24:57.060>you <00:24:57.216>want <00:24:57.371>to <00:24:57.527>press <00:24:57.682>Ctrl <00:24:57.838>C, <00:24:57.993>but <00:24:58.149>you <00:24:58.305>can't

599
00:24:59.515 --> 00:25:01.525
<00:24:59.515>because <00:24:59.865>it's <00:25:00.215>actually <00:25:00.565>just, <00:25:00.915>uh,

600
00:25:01.835 --> 00:25:03.325
<00:25:01.835>plowing <00:25:02.170>away <00:25:02.505>doing <00:25:02.840>the <00:25:03.176>thing.

601
00:25:03.745 --> 00:25:05.445
<00:25:03.745>And <00:25:03.978>I <00:25:04.211>think <00:25:04.445>there's <00:25:04.678>a <00:25:04.911>bit, <00:25:05.145>uh,

602
00:25:05.445 --> 00:25:08.925
<00:25:05.445>that <00:25:05.600>there's <00:25:05.756>a <00:25:05.911>concern <00:25:06.067>about <00:25:06.222>like <00:25:06.378>not <00:25:06.533>only <00:25:06.689>doing, <00:25:06.845>uh,

603
00:25:08.925 --> 00:25:10.925
<00:25:08.925>using <00:25:09.125>up <00:25:09.325>your <00:25:09.524>tokens, <00:25:09.725>which <00:25:09.925>can <00:25:10.125>get <00:25:10.325>expensive,

604
00:25:11.225 --> 00:25:13.205
<00:25:11.225>but <00:25:11.425>also <00:25:11.625>just <00:25:11.824>in <00:25:12.024>terms <00:25:12.225>of <00:25:12.425>memory <00:25:12.625>consumption

605
00:25:13.265 --> 00:25:15.325
<00:25:13.265>and <00:25:13.545>energy <00:25:13.825>consumption <00:25:14.105>that <00:25:14.385>is <00:25:14.665>unnecessary.

606
00:25:15.465 --> 00:25:18.045
<00:25:15.465>So, <00:25:15.745>uh, <00:25:16.024>batch <00:25:16.304>processing, <00:25:16.584>cleaning <00:25:16.865>up

607
00:25:18.045 --> 00:25:20.605
<00:25:18.045>before <00:25:18.220>you <00:25:18.395>actually <00:25:18.570>send <00:25:18.745>things <00:25:18.920>there, <00:25:19.095>there's <00:25:19.270>a <00:25:19.445>lot

608
00:25:20.605 --> 00:25:22.845
<00:25:20.605>of <00:25:20.745>tools <00:25:20.885>right <00:25:21.025>now, <00:25:21.165>for <00:25:21.305>example, <00:25:21.445>cropping <00:25:21.585>up <00:25:21.725>that <00:25:21.865>allows <00:25:22.005>you

609
00:25:22.845 --> 00:25:25.565
<00:25:22.845>to <00:25:22.985>upload <00:25:23.125>videos <00:25:23.265>and <00:25:23.405>give <00:25:23.545>you <00:25:23.685>like <00:25:23.825>a <00:25:23.965>five <00:25:24.105>hour <00:25:24.245>video

610
00:25:25.705 --> 00:25:27.885
<00:25:25.705>and <00:25:25.905>give <00:25:26.105>you <00:25:26.304>like <00:25:26.504>a <00:25:26.705>20 <00:25:26.905>minute <00:25:27.105>thing.

611
00:25:28.515 --> 00:25:30.605
<00:25:28.515>Nice <00:25:28.655>to <00:25:28.795>have, <00:25:28.935>but <00:25:29.075>at <00:25:29.215>the <00:25:29.355>same <00:25:29.495>time, <00:25:29.635>oh <00:25:29.775>my <00:25:29.915>God,

612
00:25:30.625 --> 00:25:32.365
<00:25:30.625>how <00:25:30.825>much <00:25:31.025>energy <00:25:31.225>is <00:25:31.425>being <00:25:31.625>wasted <00:25:31.825>that <00:25:32.025>way?

613
00:25:32.825 --> 00:25:35.485
<00:25:32.825>So <00:25:32.952>it <00:25:33.079>feels <00:25:33.206>like, <00:25:33.334>yeah, <00:25:33.461>we, <00:25:33.588>we, <00:25:33.715>we <00:25:33.843>are <00:25:33.970>in <00:25:34.097>a <00:25:34.225>world

614
00:25:35.485 --> 00:25:37.605
<00:25:35.485>where <00:25:35.625>we <00:25:35.764>just <00:25:35.905>think, <00:25:36.044>oh, <00:25:36.185>just <00:25:36.324>throw <00:25:36.465>it <00:25:36.604>at <00:25:36.745>the <00:25:36.885>machine,

615
00:25:37.665 --> 00:25:39.965
<00:25:37.665>but <00:25:37.840>let's <00:25:38.014>think <00:25:38.190>about <00:25:38.365>how <00:25:38.540>much <00:25:38.715>it <00:25:38.889>actually, <00:25:39.065>uh,

616
00:25:40.135 --> 00:25:41.445
<00:25:40.135>costs <00:25:40.528>with <00:25:40.921>that <00:25:41.313>one.

617
00:25:42.145 --> 00:25:43.325
<00:25:42.145>The <00:25:42.410>other <00:25:42.676>saying, <00:25:42.941>going <00:25:43.207>around

618
00:25:43.325 --> 00:25:46.325
<00:25:43.325>that <00:25:43.480>data <00:25:43.636>is <00:25:43.791>much <00:25:43.947>more <00:25:44.102>important <00:25:44.258>than <00:25:44.413>the <00:25:44.569>model, <00:25:44.725>is

619
00:25:46.325 --> 00:25:48.605
<00:25:46.325>that <00:25:46.480>really <00:25:46.636>that <00:25:46.791>much <00:25:46.947>of <00:25:47.102>a <00:25:47.258>differentiator <00:25:47.413>in <00:25:47.569>a <00:25:47.725>rag

620
00:25:48.605 --> 00:25:49.605
<00:25:48.605>or <00:25:49.055>multimodal <00:25:49.505>world?

621
00:25:49.985 --> 00:25:52.685
<00:25:49.985>And <00:25:50.140>also, <00:25:50.296>uh, <00:25:50.451>the <00:25:50.607>other <00:25:50.762>problem <00:25:50.918>is <00:25:51.073>like <00:25:51.229>generated <00:25:51.385>code

622
00:25:52.825 --> 00:25:55.245
<00:25:52.825>or <00:25:53.025>code <00:25:53.225>that <00:25:53.425>comes <00:25:53.625>back <00:25:53.825>from <00:25:54.025>an, <00:25:54.225>uh,

623
00:25:55.245 --> 00:25:58.445
<00:25:55.245>from <00:25:55.445>an <00:25:55.645>LLM <00:25:55.844>could <00:25:56.044>contain, <00:25:56.245>uh, <00:25:56.445>contain <00:25:56.645>PII

624
00:25:58.785 --> 00:26:01.205
<00:25:58.785>or <00:25:59.065>could <00:25:59.345>contain, <00:25:59.625>uh, <00:25:59.905>inappropriate <00:26:00.185>content.

625
00:26:01.705 --> 00:26:03.805
<00:26:01.705>How <00:26:01.845>can <00:26:01.985>we <00:26:02.125>work <00:26:02.264>around, <00:26:02.405>how <00:26:02.544>can <00:26:02.685>we <00:26:02.824>make <00:26:02.965>sure <00:26:03.105>that,

626
00:26:03.865 --> 00:26:06.165
<00:26:03.865>and <00:26:04.020>that, <00:26:04.176>that <00:26:04.331>an <00:26:04.487>LLM <00:26:04.642>doesn't <00:26:04.798>give <00:26:04.953>us <00:26:05.109>things <00:26:05.265>back

627
00:26:06.355 --> 00:26:07.605
<00:26:06.355>that <00:26:06.580>we <00:26:06.805>should <00:26:07.030>not <00:26:07.255>know <00:26:07.480>about?

628
00:26:07.765 --> 00:26:09.845
<00:26:07.765>I <00:26:07.965>know <00:26:08.165>there's <00:26:08.365>like <00:26:08.565>thousands <00:26:08.765>of <00:26:08.965>hidden, <00:26:09.165>uh,

629
00:26:09.845 --> 00:26:12.245
<00:26:09.845>private <00:26:10.125>GitHub <00:26:10.405>repos <00:26:10.685>were <00:26:10.965>just <00:26:11.245>indexed

630
00:26:12.245 --> 00:26:15.725
<00:26:12.245>and, <00:26:12.400>uh, <00:26:12.556>thrown <00:26:12.711>out <00:26:12.867>by, <00:26:13.022>by <00:26:13.178>Microsoft's, <00:26:13.333>uh, <00:26:13.489>uh, <00:26:13.645>copilot.

631
00:26:16.185 --> 00:26:18.325
<00:26:16.185>So <00:26:16.385>how <00:26:16.585>can <00:26:16.784>we <00:26:16.985>work <00:26:17.185>around <00:26:17.385>these <00:26:17.585>issues?

632
00:26:18.705 --> 00:26:20.805
<00:26:18.705>So <00:26:18.879>is <00:26:19.054>data <00:26:19.230>really <00:26:19.405>more <00:26:19.580>important <00:26:19.754>than <00:26:19.929>the <00:26:20.105>model?

633
00:26:20.825 --> 00:26:22.045
<00:26:20.825>And <00:26:20.981>what <00:26:21.138>can <00:26:21.295>we <00:26:21.452>do <00:26:21.609>to <00:26:21.766>clean <00:26:21.923>up

634
00:26:22.045 --> 00:26:23.165
<00:26:22.045>the <00:26:22.246>data <00:26:22.448>before <00:26:22.649>it <00:26:22.851>comes <00:26:23.053>back?

635
00:26:23.655 --> 00:26:27.645
<00:26:23.655>Right? <00:26:23.782>So, <00:26:23.909>um, <00:26:24.036>first <00:26:24.164>of <00:26:24.291>all, <00:26:24.418>I <00:26:24.545>want <00:26:24.673>to <00:26:24.800>highlight <00:26:24.927>this, <00:26:25.055>uh,

636
00:26:27.645 --> 00:26:31.645
<00:26:27.645>acronym, <00:26:27.845>uh, <00:26:28.045>GI <00:26:28.245>GO <00:26:28.445>garbage <00:26:28.645>in, <00:26:28.845>garbage <00:26:29.045>out.

637
00:26:32.185 --> 00:26:36.725
<00:26:32.185>So <00:26:32.325>obviously <00:26:32.465>if <00:26:32.605>have <00:26:32.745>been, <00:26:32.885>uh, <00:26:33.024>um, <00:26:33.165>fed <00:26:33.304>up <00:26:33.445>with, <00:26:33.585>uh,

638
00:26:37.065 --> 00:26:38.845
<00:26:37.065>you <00:26:37.298>know, <00:26:37.531>uh, <00:26:37.765>lots <00:26:37.998>of <00:26:38.231>garbage <00:26:38.465>stuff

639
00:26:38.845 --> 00:26:41.685
<00:26:38.845>or <00:26:39.000>non <00:26:39.156>necessarily <00:26:39.311>garbage, <00:26:39.467>but <00:26:39.622>stuff <00:26:39.778>that <00:26:39.933>is <00:26:40.089>not <00:26:40.245>relevant,

640
00:26:41.825 --> 00:26:45.365
<00:26:41.825>uh, <00:26:41.952>for, <00:26:42.079>for <00:26:42.206>the <00:26:42.334>context, <00:26:42.461>then <00:26:42.588>maybe, <00:26:42.715>yeah, <00:26:42.843>it <00:26:42.970>can <00:26:43.097>be, <00:26:43.225>uh,

641
00:26:45.595 --> 00:26:46.965
<00:26:45.595>seen <00:26:45.841>on <00:26:46.088>the <00:26:46.334>output <00:26:46.581>as <00:26:46.828>well.

642
00:26:47.545 --> 00:26:49.925
<00:26:47.545>Um, <00:26:47.825>I <00:26:48.105>think <00:26:48.385>that <00:26:48.665>most, <00:26:48.945>uh,

643
00:26:49.925 --> 00:26:53.405
<00:26:49.925>foundation <00:26:50.080>model <00:26:50.236>providers <00:26:50.391>have <00:26:50.547>been <00:26:50.702>spending <00:26:50.858>a <00:26:51.013>lot <00:26:51.169>of <00:26:51.325>time

644
00:26:54.205 --> 00:26:56.885
<00:26:54.205>cleaning <00:26:54.360>and <00:26:54.516>improving <00:26:54.671>the, <00:26:54.827>the <00:26:54.982>data <00:26:55.138>sets <00:26:55.293>on <00:26:55.449>which <00:26:55.605>they,

645
00:26:56.885 --> 00:26:59.725
<00:26:56.885>they <00:26:57.060>work <00:26:57.235>on, <00:26:57.410>uh, <00:26:57.585>and <00:26:57.760>trying <00:26:57.935>the, <00:26:58.110>the <00:26:58.285>models.

646
00:27:00.145 --> 00:27:04.405
<00:27:00.145>So <00:27:00.345>hopefully, <00:27:00.545>um, <00:27:00.745>I <00:27:00.945>hope <00:27:01.145>the <00:27:01.345>input, <00:27:01.545>uh,

647
00:27:04.875 --> 00:27:07.205
<00:27:04.875>data <00:27:05.050>at <00:27:05.225>at <00:27:05.400>least <00:27:05.575>during <00:27:05.750>the <00:27:05.925>training <00:27:06.100>is <00:27:06.275>cleaner.

648
00:27:07.425 --> 00:27:10.405
<00:27:07.425>Um, <00:27:07.600>you <00:27:07.774>know, <00:27:07.950>uh, <00:27:08.125>compared <00:27:08.300>to <00:27:08.475>maybe <00:27:08.649>the, <00:27:08.825>the,

649
00:27:10.405 --> 00:27:14.565
<00:27:10.405>the <00:27:10.638>first <00:27:10.871>few <00:27:11.105>iterations, <00:27:11.338>um, <00:27:11.571>there's <00:27:11.805>that.

650
00:27:14.595 --> 00:27:18.325
<00:27:14.595>Then, <00:27:14.750>uh, <00:27:14.906>when <00:27:15.061>you <00:27:15.217>implement <00:27:15.372>also <00:27:15.528>things <00:27:15.683>like <00:27:15.839>rag, <00:27:15.995>uh,

651
00:27:18.945 --> 00:27:23.045
<00:27:18.945>you <00:27:19.085>have <00:27:19.225>to <00:27:19.365>pay <00:27:19.504>attention <00:27:19.645>to <00:27:19.784>only <00:27:19.925>give <00:27:20.064>the, <00:27:20.205>the <00:27:20.345>results

652
00:27:23.075 --> 00:27:26.045
<00:27:23.075>that <00:27:23.275>matter <00:27:23.475>and <00:27:23.675>that <00:27:23.875>are, <00:27:24.075>um, <00:27:24.275>you <00:27:24.475>know,

653
00:27:26.045 --> 00:27:27.925
<00:27:26.045>like <00:27:26.511>multi-tenant <00:27:26.978>versus, <00:27:27.445>uh,

654
00:27:27.925 --> 00:27:29.805
<00:27:27.925>single-tenant <00:27:28.274>kind <00:27:28.625>of, <00:27:28.975>uh, <00:27:29.325>scenarios.

655
00:27:30.185 --> 00:27:33.485
<00:27:30.185>And <00:27:30.340>you <00:27:30.496>should <00:27:30.651>filter <00:27:30.807>the <00:27:30.962>data <00:27:31.118>just <00:27:31.273>for <00:27:31.429>one <00:27:31.585>customer.

656
00:27:34.025 --> 00:27:37.765
<00:27:34.025>Um, <00:27:34.152>so <00:27:34.279>you <00:27:34.406>only <00:27:34.534>put <00:27:34.661>in <00:27:34.788>the, <00:27:34.915>the <00:27:35.043>context <00:27:35.170>of <00:27:35.297>the <00:27:35.425>LLM,

657
00:27:38.155 --> 00:27:40.085
<00:27:38.155>just <00:27:38.435>the <00:27:38.715>information <00:27:38.995>for <00:27:39.274>that <00:27:39.555>customer.

658
00:27:40.825 --> 00:27:42.285
<00:27:40.825>Uh, <00:27:41.153>there's <00:27:41.482>that. <00:27:41.810>What <00:27:42.139>else?

659
00:27:42.625 --> 00:27:44.205
<00:27:42.625>Um, <00:27:44.025>yeah,

660
00:27:44.265 --> 00:27:48.285
<00:27:44.265>and, <00:27:44.405>um, <00:27:44.545>I <00:27:44.685>would <00:27:44.825>also <00:27:44.965>mention <00:27:45.105>things <00:27:45.245>like, <00:27:45.385>um, <00:27:45.525>um, <00:27:45.665>as,

661
00:27:48.285 --> 00:27:51.325
<00:27:48.285>for <00:27:48.485>example, <00:27:48.685>you <00:27:48.885>mentioned <00:27:49.085>about <00:27:49.285>PII <00:27:49.485>information, <00:27:49.685>uh,

662
00:27:51.385 --> 00:27:55.805
<00:27:51.385>you <00:27:51.512>can <00:27:51.639>also <00:27:51.766>wrap <00:27:51.894>the <00:27:52.021>LLM <00:27:52.148>calls <00:27:52.275>with, <00:27:52.403>uh, <00:27:52.530>access <00:27:52.657>to, <00:27:52.785>uh,

663
00:27:56.675 --> 00:28:00.365
<00:27:56.675>APIs <00:27:56.850>that <00:27:57.024>do <00:27:57.200>API <00:27:57.375>I, <00:27:57.550>uh, <00:27:57.725>reduction, <00:27:57.899>for <00:27:58.075>example.

664
00:28:00.865 --> 00:28:03.765
<00:28:00.865>So <00:28:01.005>on, <00:28:01.145>for, <00:28:01.285>for <00:28:01.425>example, <00:28:01.565>on <00:28:01.705>on <00:28:01.845>Google <00:28:01.985>Cloud, <00:28:02.125>there's <00:28:02.265>a,

665
00:28:03.765 --> 00:28:06.365
<00:28:03.765>there's <00:28:03.965>a <00:28:04.165>service, <00:28:04.365>um, <00:28:04.565>what <00:28:04.765>is <00:28:04.965>it <00:28:05.165>called?

666
00:28:06.505 --> 00:28:08.725
<00:28:06.505>Uh, <00:28:06.705>it <00:28:06.905>was <00:28:07.105>called <00:28:07.305>data <00:28:07.505>loss <00:28:07.705>prevention <00:28:07.905>before,

667
00:28:08.785 --> 00:28:10.805
<00:28:08.785>but <00:28:08.960>there, <00:28:09.135>there's <00:28:09.310>a <00:28:09.485>new <00:28:09.660>name, <00:28:09.835>I <00:28:10.010>forget, <00:28:10.185>uh,

668
00:28:10.915 --> 00:28:12.285
<00:28:10.915>what <00:28:11.161>it <00:28:11.408>is <00:28:11.654>or <00:28:11.901>new <00:28:12.148>acronym.

669
00:28:12.785 --> 00:28:13.965
<00:28:12.785>Uh, <00:28:12.997>but <00:28:13.209>you <00:28:13.422>can <00:28:13.634>say, <00:28:13.847>okay,

670
00:28:14.545 --> 00:28:16.485
<00:28:14.545>here's <00:28:14.825>the <00:28:15.105>input <00:28:15.385>from <00:28:15.665>the <00:28:15.945>customer.

671
00:28:16.745 --> 00:28:20.165
<00:28:16.745>Uh, <00:28:16.900>I'll <00:28:17.056>redact <00:28:17.211>everything <00:28:17.367>so <00:28:17.522>that <00:28:17.678>when <00:28:17.833>you <00:28:17.989>send <00:28:18.145>stuff

672
00:28:20.165 --> 00:28:23.645
<00:28:20.165>to <00:28:20.292>the <00:28:20.419>LLM, <00:28:20.546>it's <00:28:20.674>gonna, <00:28:20.801>there's <00:28:20.928>gonna <00:28:21.055>be <00:28:21.183>like <00:28:21.310>a, <00:28:21.437>you <00:28:21.565>know,

673
00:28:23.725 --> 00:28:26.445
<00:28:23.725>a <00:28:23.880>black <00:28:24.036>box, <00:28:24.191>uh, <00:28:24.347>over <00:28:24.502>the <00:28:24.658>email <00:28:24.813>address <00:28:24.969>or <00:28:25.125>something,

674
00:28:26.445 --> 00:28:27.805
<00:28:26.445>or <00:28:26.853>social <00:28:27.261>security <00:28:27.669>number.

675
00:28:28.425 --> 00:28:30.565
<00:28:28.425>And <00:28:28.565>then, <00:28:28.705>uh, <00:28:28.845>in <00:28:28.985>output <00:28:29.125>you <00:28:29.264>can <00:28:29.405>do <00:28:29.544>the <00:28:29.685>same <00:28:29.825>thing.

676
00:28:30.565 --> 00:28:35.045
<00:28:30.565>So <00:28:30.720>it's <00:28:30.876>also <00:28:31.031>things <00:28:31.187>like <00:28:31.342>guardrails <00:28:31.498>to <00:28:31.653>avoid, <00:28:31.809>uh, <00:28:31.965>people,

677
00:28:35.865 --> 00:28:37.965
<00:28:35.865>uh, <00:28:36.145>trying <00:28:36.425>to <00:28:36.705>derail <00:28:36.985>the <00:28:37.265>conversation

678
00:28:38.225 --> 00:28:42.325
<00:28:38.225>and, <00:28:38.380>uh, <00:28:38.536>uh, <00:28:38.691>encourage <00:28:38.847>the <00:28:39.002>LLM <00:28:39.158>to, <00:28:39.313>uh, <00:28:39.469>give <00:28:39.625>information

679
00:28:42.325 --> 00:28:43.685
<00:28:42.325>that <00:28:42.569>it's <00:28:42.814>not <00:28:43.059>supposed <00:28:43.304>to <00:28:43.549>give.

680
00:28:43.945 --> 00:28:46.725
<00:28:43.945>So <00:28:44.100>it's <00:28:44.256>really <00:28:44.411>about <00:28:44.567>the, <00:28:44.722>the <00:28:44.878>integration <00:28:45.033>of <00:28:45.189>all <00:28:45.345>this,

681
00:28:46.785 --> 00:28:48.485
<00:28:46.785>and <00:28:47.018>you <00:28:47.251>have <00:28:47.485>to <00:28:47.718>pay <00:28:47.951>attention <00:28:48.185>and,

682
00:28:48.625 --> 00:28:52.325
<00:28:48.625>and <00:28:48.800>put <00:28:48.975>good <00:28:49.150>security <00:28:49.325>principles <00:28:49.500>in <00:28:49.675>place, <00:28:49.850>et <00:28:50.025>cetera.

683
00:28:52.345 --> 00:28:55.405
<00:28:52.345>So <00:28:52.452>it's, <00:28:52.560>it's <00:28:52.668>a <00:28:52.775>lot <00:28:52.883>of, <00:28:52.991>uh, <00:28:53.098>it's <00:28:53.206>a <00:28:53.314>lot <00:28:53.421>of, <00:28:53.529>uh, <00:28:53.637>you <00:28:53.745>know,

684
00:28:55.405 --> 00:28:59.365
<00:28:55.405>like <00:28:55.560>the, <00:28:55.716>uh, <00:28:55.871>what, <00:28:56.027>what <00:28:56.182>is <00:28:56.338>it <00:28:56.493>called, <00:28:56.649>CSRF <00:28:56.805>protections

685
00:28:59.365 --> 00:29:03.325
<00:28:59.365>that <00:28:59.492>you <00:28:59.619>put <00:28:59.746>in <00:28:59.874>place <00:29:00.001>for, <00:29:00.128>for <00:29:00.255>your <00:29:00.383>HTM <00:29:00.510>forms, <00:29:00.637>et <00:29:00.765>cetera.

686
00:29:03.325 --> 00:29:06.685
<00:29:03.325>That's <00:29:03.465>the <00:29:03.605>kind <00:29:03.745>of <00:29:03.885>things <00:29:04.025>you, <00:29:04.165>you <00:29:04.305>have <00:29:04.445>to <00:29:04.585>pay <00:29:04.725>attention

687
00:29:06.785 --> 00:29:09.725
<00:29:06.785>to <00:29:06.925>if <00:29:07.065>you <00:29:07.205>don't <00:29:07.345>want <00:29:07.485>to, <00:29:07.625>uh, <00:29:07.765>fall <00:29:07.905>into <00:29:08.045>the, <00:29:08.185>those,

688
00:29:09.855 --> 00:29:11.485
<00:29:09.855>those <00:29:10.321>traps, <00:29:10.788>basically. <00:29:11.255>Yeah.

689
00:29:12.105 --> 00:29:13.765
<00:29:12.105>So <00:29:12.260>another <00:29:12.416>thing <00:29:12.571>that <00:29:12.727>a <00:29:12.882>lot <00:29:13.038>of <00:29:13.193>people <00:29:13.349>are <00:29:13.505>throwing

690
00:29:13.765 --> 00:29:17.485
<00:29:13.765>around <00:29:13.892>right <00:29:14.019>now <00:29:14.146>is, <00:29:14.274>is <00:29:14.401>the <00:29:14.528>rise <00:29:14.655>of <00:29:14.783>the <00:29:14.910>agentic <00:29:15.037>web, <00:29:15.165>uh,

691
00:29:17.635 --> 00:29:19.965
<00:29:17.635>meta, <00:29:17.835>what <00:29:18.035>is <00:29:18.235>your <00:29:18.435>take <00:29:18.635>on <00:29:18.835>that <00:29:19.035>one?

692
00:29:19.965 --> 00:29:21.245
<00:29:19.965>What <00:29:20.253>is <00:29:20.541>it <00:29:20.829>actually, <00:29:21.117>and,

693
00:29:21.345 --> 00:29:23.125
<00:29:21.345>and <00:29:21.578>why <00:29:21.811>is <00:29:22.045>it <00:29:22.278>such <00:29:22.511>a <00:29:22.745>differentiated?

694
00:29:24.715 --> 00:29:25.925
<00:29:24.715>Yeah, <00:29:24.932>I <00:29:25.150>mean, <00:29:25.368>what <00:29:25.586>is <00:29:25.803>it?

695
00:29:25.925 --> 00:29:29.685
<00:29:25.925>I <00:29:26.065>don't <00:29:26.205>know, <00:29:26.345>it's <00:29:26.485>really <00:29:26.625>like, <00:29:26.764>it's <00:29:26.905>such <00:29:27.044>an <00:29:27.185>overloaded <00:29:27.325>term

696
00:29:29.875 --> 00:29:32.725
<00:29:29.875>that <00:29:30.155>it <00:29:30.435>feels <00:29:30.715>like <00:29:30.995>any <00:29:31.275>LLM

697
00:29:32.725 --> 00:29:36.085
<00:29:32.725>that <00:29:32.899>does <00:29:33.074>something <00:29:33.250>ends <00:29:33.425>up <00:29:33.600>being <00:29:33.774>called <00:29:33.949>agentic, <00:29:34.125>right?

698
00:29:36.825 --> 00:29:39.565
<00:29:36.825>Um, <00:29:36.980>so <00:29:37.136>I <00:29:37.291>don't, <00:29:37.447>I <00:29:37.602>don't <00:29:37.758>really <00:29:37.913>have <00:29:38.069>like, <00:29:38.225>um,

699
00:29:40.605 --> 00:29:42.645
<00:29:40.605>a <00:29:40.805>good <00:29:41.005>answer <00:29:41.205>like, <00:29:41.405>uh, <00:29:41.605>what <00:29:41.805>is <00:29:42.005>agentic?

700
00:29:42.645 --> 00:29:46.365
<00:29:42.645>But <00:29:42.785>I, <00:29:42.925>I <00:29:43.065>guess <00:29:43.205>in <00:29:43.345>the <00:29:43.485>future <00:29:43.625>we'll <00:29:43.764>see <00:29:43.905>a <00:29:44.045>web

701
00:29:46.365 --> 00:29:49.805
<00:29:46.365>where <00:29:46.565>we <00:29:46.765>don't <00:29:46.965>just <00:29:47.165>search <00:29:47.365>for <00:29:47.565>information <00:29:47.765>randomly,

702
00:29:49.955 --> 00:29:51.525
<00:29:49.955>like <00:29:50.421>in <00:29:50.888>random <00:29:51.355>websites,

703
00:29:51.525 --> 00:29:54.805
<00:29:51.525>but <00:29:51.700>instead <00:29:51.875>we <00:29:52.050>have <00:29:52.225>these <00:29:52.400>agents <00:29:52.575>that <00:29:52.750>kind <00:29:52.925>of

704
00:29:55.545 --> 00:29:56.965
<00:29:55.545>get <00:29:55.864>the <00:29:56.184>information <00:29:56.503>for <00:29:56.822>us,

705
00:29:57.145 --> 00:29:58.885
<00:29:57.145>and <00:29:57.345>then <00:29:57.545>they <00:29:57.745>also <00:29:57.945>do <00:29:58.145>act <00:29:58.345>on <00:29:58.545>it,

706
00:29:58.885 --> 00:30:00.365
<00:29:58.885>like <00:29:59.151>they <00:29:59.417>do <00:29:59.684>something <00:29:59.950>for <00:30:00.217>us.

707
00:30:00.545 --> 00:30:04.285
<00:30:00.545>So <00:30:00.685>it's <00:30:00.825>more <00:30:00.965>so <00:30:01.105>we <00:30:01.245>just <00:30:01.385>kick <00:30:01.525>off <00:30:01.665>a <00:30:01.805>process <00:30:01.945>basically,

708
00:30:04.305 --> 00:30:06.565
<00:30:04.305>and <00:30:04.480>then <00:30:04.655>the <00:30:04.830>agents <00:30:05.005>kind <00:30:05.180>of <00:30:05.355>do <00:30:05.530>the <00:30:05.705>rest.

709
00:30:06.925 --> 00:30:10.645
<00:30:06.925>I <00:30:07.052>mean, <00:30:07.179>that's, <00:30:07.306>that's <00:30:07.434>how <00:30:07.561>I <00:30:07.688>see <00:30:07.815>it <00:30:07.943>and <00:30:08.070>what <00:30:08.197>it <00:30:08.325>means.

710
00:30:10.725 --> 00:30:12.365
<00:30:10.725>I <00:30:10.925>mean, <00:30:11.125>as <00:30:11.324>a <00:30:11.524>user, <00:30:11.725>I <00:30:11.925>think, <00:30:12.125>um,

711
00:30:13.025 --> 00:30:14.445
<00:30:13.025>I'm <00:30:13.238>excited <00:30:13.451>about <00:30:13.664>it <00:30:13.877>if <00:30:14.090>it <00:30:14.303>works.

712
00:30:14.825 --> 00:30:17.325
<00:30:14.825>So <00:30:14.965>that's <00:30:15.105>like <00:30:15.245>a <00:30:15.385>big, <00:30:15.525>if, <00:30:15.665>if <00:30:15.805>it <00:30:15.945>does <00:30:16.085>the <00:30:16.225>work

713
00:30:17.745 --> 00:30:19.365
<00:30:17.745>and <00:30:18.024>gives <00:30:18.304>me <00:30:18.584>the <00:30:18.864>relevant <00:30:19.145>information

714
00:30:20.225 --> 00:30:21.765
<00:30:20.225>and <00:30:20.571>then <00:30:20.918>go, <00:30:21.264>goes <00:30:21.611>ahead

715
00:30:21.765 --> 00:30:23.925
<00:30:21.765>and <00:30:21.881>let's <00:30:21.998>say <00:30:22.115>like <00:30:22.231>if <00:30:22.348>I'm <00:30:22.465>looking <00:30:22.581>for <00:30:22.698>a <00:30:22.815>hotel, <00:30:22.931>it <00:30:23.048>goes <00:30:23.165>ahead

716
00:30:23.925 --> 00:30:25.965
<00:30:23.925>and <00:30:24.065>books <00:30:24.205>the <00:30:24.345>hotel <00:30:24.485>for <00:30:24.625>me <00:30:24.764>and <00:30:24.905>sends <00:30:25.044>me <00:30:25.185>an <00:30:25.325>email.

717
00:30:26.065 --> 00:30:28.765
<00:30:26.065>And <00:30:26.192>if <00:30:26.319>all <00:30:26.446>works <00:30:26.574>great, <00:30:26.701>but <00:30:26.828>we <00:30:26.955>have <00:30:27.083>to <00:30:27.210>get <00:30:27.337>there, <00:30:27.465>right?

718
00:30:29.385 --> 00:30:31.085
<00:30:29.385>Um, <00:30:29.618>so <00:30:29.851>as <00:30:30.085>a <00:30:30.318>user, <00:30:30.551>I'm <00:30:30.785>excited.

719
00:30:31.305 --> 00:30:32.605
<00:30:31.305>Um, <00:30:31.695>as <00:30:32.085>a <00:30:32.475>developer,

720
00:30:33.915 --> 00:30:36.765
<00:30:33.915>it's <00:30:34.090>gonna <00:30:34.264>be <00:30:34.440>a <00:30:34.615>whole <00:30:34.790>different <00:30:34.965>wa <00:30:35.139>world, <00:30:35.315>basically.

721
00:30:36.885 --> 00:30:38.445
<00:30:36.885>Like <00:30:37.118>how <00:30:37.351>do <00:30:37.585>you <00:30:37.818>write <00:30:38.051>these <00:30:38.285>agents?

722
00:30:38.705 --> 00:30:43.205
<00:30:38.705>Um, <00:30:38.879>how <00:30:39.054>is <00:30:39.230>there <00:30:39.405>gonna <00:30:39.580>be <00:30:39.754>an <00:30:39.929>agent <00:30:40.105>marketplace

723
00:30:43.235 --> 00:30:45.885
<00:30:43.235>somewhere <00:30:43.435>where <00:30:43.635>I <00:30:43.834>just <00:30:44.034>install <00:30:44.235>these <00:30:44.435>agents? <00:30:44.635>And

724
00:30:46.425 --> 00:30:47.885
<00:30:46.425>We <00:30:46.687>tried <00:30:46.950>that <00:30:47.213>with <00:30:47.476>models, <00:30:47.739>right?

725
00:30:47.905 --> 00:30:50.205
<00:30:47.905>And <00:30:48.060>that <00:30:48.216>didn't <00:30:48.371>work <00:30:48.527>out <00:30:48.682>like <00:30:48.838>we <00:30:48.993>said, <00:30:49.149>like, <00:30:49.305>oh,

726
00:30:50.205 --> 00:30:51.365
<00:30:50.205>there's <00:30:50.413>gonna <00:30:50.622>be <00:30:50.831>a <00:30:51.040>model <00:30:51.249>marketplace

727
00:30:51.365 --> 00:30:52.725
<00:30:51.365>and <00:30:51.569>everybody <00:30:51.773>can <00:30:51.976>train <00:30:52.181>their <00:30:52.385>own <00:30:52.589>models

728
00:30:52.825 --> 00:30:55.845
<00:30:52.825>and <00:30:52.952>sell <00:30:53.079>it <00:30:53.206>to <00:30:53.334>sell <00:30:53.461>it <00:30:53.588>to <00:30:53.715>people <00:30:53.843>like <00:30:53.970>Amazon <00:30:54.097>and <00:30:54.225>Google,

729
00:30:55.865 --> 00:30:56.925
<00:30:55.865>and <00:30:56.103>that <00:30:56.342>didn't <00:30:56.580>work <00:30:56.819>out.

730
00:30:56.985 --> 00:30:59.925
<00:30:56.985>So <00:30:57.140>that <00:30:57.296>the <00:30:57.451>marketplace <00:30:57.607>always <00:30:57.762>the <00:30:57.918>first <00:30:58.073>thing <00:30:58.229>like, <00:30:58.385>oh,

731
00:30:59.925 --> 00:31:01.125
<00:30:59.925>cool, <00:31:00.195>we <00:31:00.465>can <00:31:00.735>monetize <00:31:01.005>that,

732
00:31:01.585 --> 00:31:03.885
<00:31:01.585>but <00:31:01.785>like, <00:31:01.985>uh, <00:31:02.185>that <00:31:02.385>then <00:31:02.585>it <00:31:02.785>not <00:31:02.985>growing

733
00:31:04.025 --> 00:31:05.045
<00:31:04.025>is <00:31:04.331>an <00:31:04.637>interesting <00:31:04.943>bit.

734
00:31:05.385 --> 00:31:08.005
<00:31:05.385>The <00:31:05.525>interesting <00:31:05.665>thing <00:31:05.805>about <00:31:05.945>what <00:31:06.085>I <00:31:06.225>see <00:31:06.365>about <00:31:06.504>the <00:31:06.645>agen, <00:31:06.785>uh,

735
00:31:08.005 --> 00:31:10.005
<00:31:08.005>uh, <00:31:08.160>news, <00:31:08.316>when <00:31:08.471>when <00:31:08.627>people <00:31:08.782>say <00:31:08.938>like, <00:31:09.093>get <00:31:09.249>more <00:31:09.405>excited,

736
00:31:10.025 --> 00:31:11.405
<00:31:10.025>the <00:31:10.273>more <00:31:10.521>actually <00:31:10.770>they <00:31:11.018>can <00:31:11.267>access.

737
00:31:11.425 --> 00:31:14.765
<00:31:11.425>So <00:31:11.541>like, <00:31:11.658>oh, <00:31:11.774>it <00:31:11.891>can <00:31:12.008>access <00:31:12.125>your <00:31:12.241>camera, <00:31:12.358>it <00:31:12.475>can, <00:31:12.591>it <00:31:12.708>can, <00:31:12.825>uh,

738
00:31:14.765 --> 00:31:16.285
<00:31:14.765>it <00:31:15.038>can <00:31:15.312>actually <00:31:15.585>simulate <00:31:15.859>your <00:31:16.133>voice.

739
00:31:16.305 --> 00:31:17.405
<00:31:16.305>It <00:31:16.503>could <00:31:16.701>do <00:31:16.899>a <00:31:17.097>voice <00:31:17.295>call

740
00:31:17.405 --> 00:31:19.845
<00:31:17.405>that <00:31:17.560>a <00:31:17.716>hotel <00:31:17.871>wouldn't <00:31:18.027>know <00:31:18.182>that <00:31:18.338>it's <00:31:18.493>not <00:31:18.649>a <00:31:18.805>person.

741
00:31:20.305 --> 00:31:21.645
<00:31:20.305>It <00:31:20.606>can <00:31:20.908>access <00:31:21.209>your <00:31:21.511>machine

742
00:31:21.705 --> 00:31:24.685
<00:31:21.705>and <00:31:21.938>actually <00:31:22.171>in <00:31:22.405>install <00:31:22.638>MPM <00:31:22.871>packages <00:31:23.105>randomly,

743
00:31:25.155 --> 00:31:27.485
<00:31:25.155>this <00:31:25.388>is <00:31:25.621>like <00:31:25.855>a <00:31:26.088>malwares <00:31:26.321>wet <00:31:26.555>stream.

744
00:31:27.705 --> 00:31:30.165
<00:31:27.705>You <00:31:27.845>know, <00:31:27.985>like, <00:31:28.125>do <00:31:28.264>you <00:31:28.405>think <00:31:28.544>we're <00:31:28.685>giving <00:31:28.824>these <00:31:28.965>things <00:31:29.105>too

745
00:31:30.165 --> 00:31:33.765
<00:31:30.165>much <00:31:30.292>power <00:31:30.419>and <00:31:30.546>we're <00:31:30.674>not, <00:31:30.801>we're <00:31:30.928>doing <00:31:31.055>it <00:31:31.183>just <00:31:31.310>for <00:31:31.437>the <00:31:31.565>sake

746
00:31:33.765 --> 00:31:35.605
<00:31:33.765>of <00:31:34.231>like <00:31:34.698>more <00:31:35.165>convenience.

747
00:31:36.395 --> 00:31:38.045
<00:31:36.395>What <00:31:36.570>do <00:31:36.745>you <00:31:36.920>think <00:31:37.095>you <00:31:37.270>almost <00:31:37.445>like <00:31:37.620>the <00:31:37.795>do,

748
00:31:38.045 --> 00:31:39.405
<00:31:38.045>do <00:31:38.219>we <00:31:38.394>need <00:31:38.569>to <00:31:38.744>find <00:31:38.919>that <00:31:39.094>middle <00:31:39.269>ground?

749
00:31:41.245 --> 00:31:44.045
<00:31:41.245>I <00:31:41.385>think <00:31:41.524>that <00:31:41.665>all <00:31:41.804>these, <00:31:41.945>uh, <00:31:42.084>agents <00:31:42.225>that <00:31:42.364>are <00:31:42.504>coming <00:31:42.645>up,

750
00:31:44.045 --> 00:31:48.605
<00:31:44.045>they <00:31:44.220>have <00:31:44.395>to <00:31:44.570>keep <00:31:44.745>security, <00:31:44.920>uh, <00:31:45.095>aspect <00:31:45.270>in <00:31:45.445>mind.

751
00:31:49.025 --> 00:31:53.885
<00:31:49.025>And, <00:31:49.225>uh, <00:31:49.425>the <00:31:49.625>way, <00:31:49.825>so <00:31:50.025>like <00:31:50.225>installing <00:31:50.425>packages

752
00:31:53.885 --> 00:31:56.205
<00:31:53.885>and <00:31:54.118>such, <00:31:54.351>I <00:31:54.585>wouldn't <00:31:54.818>use <00:31:55.051>such <00:31:55.285>agents,

753
00:31:56.265 --> 00:31:57.445
<00:31:56.265>my, <00:31:56.619>myself, <00:31:56.973>for <00:31:57.327>example.

754
00:31:57.545 --> 00:32:00.365
<00:31:57.545>Now, <00:31:57.720>I <00:31:57.895>don't <00:31:58.070>think <00:31:58.245>providers <00:31:58.420>will, <00:31:58.595>will <00:31:58.770>come <00:31:58.945>up

755
00:32:00.365 --> 00:32:03.685
<00:32:00.365>with <00:32:00.505>a <00:32:00.645>such <00:32:00.785>an <00:32:00.925>approach, <00:32:01.065>rather <00:32:01.205>that <00:32:01.345>they <00:32:01.485>would <00:32:01.625>give <00:32:01.765>you,

756
00:32:03.865 --> 00:32:06.685
<00:32:03.865>uh, <00:32:04.040>a <00:32:04.215>sandbox <00:32:04.390>on <00:32:04.565>which <00:32:04.740>things <00:32:04.915>could <00:32:05.090>be <00:32:05.265>installed,

757
00:32:06.685 --> 00:32:09.405
<00:32:06.685>but <00:32:06.918>they, <00:32:07.151>they <00:32:07.385>won't <00:32:07.618>let <00:32:07.851>agents, <00:32:08.085>uh,

758
00:32:09.885 --> 00:32:11.205
<00:32:09.885>actually <00:32:10.122>mess <00:32:10.360>up <00:32:10.597>with <00:32:10.835>your <00:32:11.072>environment.

759
00:32:11.385 --> 00:32:15.045
<00:32:11.385>It <00:32:11.560>wouldn't <00:32:11.735>be <00:32:11.910>responsible <00:32:12.085>for, <00:32:12.260>from <00:32:12.435>those <00:32:12.610>agent <00:32:12.785>providers.

760
00:32:15.545 --> 00:32:20.165
<00:32:15.545>So <00:32:15.745>I'm, <00:32:15.945>yeah, <00:32:16.145>again, <00:32:16.345>security <00:32:16.545>concerns <00:32:16.745>should <00:32:16.945>be,

761
00:32:20.265 --> 00:32:23.325
<00:32:20.265>you <00:32:20.372>know, <00:32:20.480>top <00:32:20.588>of <00:32:20.695>mind <00:32:20.803>and, <00:32:20.911>uh, <00:32:21.018>it <00:32:21.126>should <00:32:21.234>be <00:32:21.341>done <00:32:21.449>in <00:32:21.557>a <00:32:21.665>way

762
00:32:23.325 --> 00:32:27.085
<00:32:23.325>that, <00:32:23.558>uh, <00:32:23.791>enable <00:32:24.025>rather <00:32:24.258>than <00:32:24.491>well, <00:32:24.725>um,

763
00:32:27.385 --> 00:32:30.085
<00:32:27.385>enable <00:32:27.735>new <00:32:28.085>scenarios <00:32:28.435>for <00:32:28.785>sure,

764
00:32:30.505 --> 00:32:34.285
<00:32:30.505>but <00:32:30.680>in <00:32:30.855>a <00:32:31.030>sandboxed <00:32:31.205>kind <00:32:31.380>of, <00:32:31.555>uh, <00:32:31.730>way, <00:32:31.905>right?

765
00:32:34.795 --> 00:32:36.285
<00:32:34.795>Another <00:32:35.063>thing <00:32:35.331>that <00:32:35.599>bugs <00:32:35.867>me <00:32:36.136>is

766
00:32:36.285 --> 00:32:37.965
<00:32:36.285>that <00:32:36.565>everybody <00:32:36.845>now <00:32:37.125>is <00:32:37.405>super <00:32:37.685>excited

767
00:32:37.965 --> 00:32:39.245
<00:32:37.965>about, <00:32:38.349>like, <00:32:38.733>there's <00:32:39.117>headlines.

768
00:32:39.305 --> 00:32:42.005
<00:32:39.305>Oh, <00:32:39.480>chat, <00:32:39.655>PD <00:32:39.830>now <00:32:40.005>is <00:32:40.180>a <00:32:40.355>native <00:32:40.530>iOS <00:32:40.705>app,

769
00:32:42.025 --> 00:32:43.605
<00:32:42.025>and <00:32:42.375>you're <00:32:42.725>like, <00:32:43.075>well, <00:32:43.425>amazing.

770
00:32:43.755 --> 00:32:46.365
<00:32:43.755>Like, <00:32:43.910>we <00:32:44.066>have <00:32:44.221>PWAs <00:32:44.377>and <00:32:44.532>stuff <00:32:44.688>like <00:32:44.843>that <00:32:44.999>for <00:32:45.155>ages.

771
00:32:46.405 --> 00:32:47.765
<00:32:46.405>I <00:32:46.609>could <00:32:46.813>turn <00:32:47.017>anything <00:32:47.221>into <00:32:47.425>an <00:32:47.629>app,

772
00:32:48.185 --> 00:32:50.485
<00:32:48.185>and <00:32:48.385>why <00:32:48.585>would <00:32:48.784>I <00:32:48.985>want <00:32:49.185>like <00:32:49.385>50 <00:32:49.585>different

773
00:32:50.565 --> 00:32:51.725
<00:32:50.565>chatbots <00:32:50.913>on <00:32:51.261>my <00:32:51.609>machine?

774
00:32:51.745 --> 00:32:54.725
<00:32:51.745>It <00:32:51.885>feels <00:32:52.024>like <00:32:52.165>going <00:32:52.304>back <00:32:52.445>to <00:32:52.584>when <00:32:52.725>we <00:32:52.864>had <00:32:53.004>like <00:32:53.145>ICQ,

775
00:32:55.015 --> 00:32:57.365
<00:32:55.015>Skype <00:32:55.481>Messenger, <00:32:55.948>Yahoo <00:32:56.415>Messenger,

776
00:32:57.665 --> 00:32:59.325
<00:32:57.665>and <00:32:57.898>then <00:32:58.131>we <00:32:58.365>use <00:32:58.598>things <00:32:58.831>like <00:32:59.065>Trillium

777
00:32:59.345 --> 00:33:02.245
<00:32:59.345>or <00:32:59.472>Adio <00:32:59.599>to <00:32:59.726>actually <00:32:59.854>have <00:32:59.981>one <00:33:00.108>thing <00:33:00.235>that <00:33:00.363>has <00:33:00.490>at <00:33:00.617>them <00:33:00.745>all.

778
00:33:02.705 --> 00:33:03.765
<00:33:02.705>So <00:33:02.864>do <00:33:03.023>you <00:33:03.182>think <00:33:03.341>in <00:33:03.500>the <00:33:03.659>future

779
00:33:03.795 --> 00:33:06.485
<00:33:03.795>that <00:33:03.995>maybe <00:33:04.195>the <00:33:04.395>operating <00:33:04.595>system <00:33:04.795>of <00:33:04.995>mobile <00:33:05.195>devices

780
00:33:06.625 --> 00:33:10.045
<00:33:06.625>or <00:33:06.800>even <00:33:06.975>on <00:33:07.150>desktop <00:33:07.325>devices <00:33:07.500>will <00:33:07.675>be <00:33:07.850>a <00:33:08.025>place

781
00:33:10.065 --> 00:33:11.845
<00:33:10.065>to <00:33:10.345>host <00:33:10.625>all <00:33:10.905>these <00:33:11.185>different <00:33:11.465>engines

782
00:33:11.845 --> 00:33:13.485
<00:33:11.845>that <00:33:12.125>do <00:33:12.405>things <00:33:12.685>differently <00:33:12.965>from <00:33:13.245>us?

783
00:33:13.665 --> 00:33:17.165
<00:33:13.665>Do <00:33:13.805>you <00:33:13.945>or <00:33:14.085>do <00:33:14.225>you <00:33:14.365>think <00:33:14.504>we, <00:33:14.645>the, <00:33:14.784>uh, <00:33:14.925>the <00:33:15.065>packaging

784
00:33:17.505 --> 00:33:20.205
<00:33:17.505>to <00:33:17.705>sell <00:33:17.905>one <00:33:18.105>product <00:33:18.305>with <00:33:18.505>a <00:33:18.705>model <00:33:18.905>inside

785
00:33:20.785 --> 00:33:22.005
<00:33:20.785>is <00:33:21.151>just <00:33:21.517>too <00:33:21.883>convenient.

786
00:33:22.725 --> 00:33:24.325
<00:33:22.725>I <00:33:23.074>mean, <00:33:23.425>you <00:33:23.774>know, <00:33:24.125>companies,

787
00:33:24.325 --> 00:33:25.525
<00:33:24.325>they <00:33:24.479>like <00:33:24.633>to <00:33:24.787>have <00:33:24.942>their <00:33:25.096>own <00:33:25.250>things, <00:33:25.405>right?

788
00:33:25.525 --> 00:33:26.605
<00:33:25.525>So <00:33:25.719>I <00:33:25.913>don't <00:33:26.108>see, <00:33:26.302>for <00:33:26.497>example,

789
00:33:26.605 --> 00:33:29.565
<00:33:26.605>like <00:33:26.805>NOS <00:33:27.005>from <00:33:27.205>one <00:33:27.405>company <00:33:27.605>having <00:33:27.805>the <00:33:28.005>model

790
00:33:29.585 --> 00:33:31.565
<00:33:29.585>or <00:33:29.740>another <00:33:29.896>company, <00:33:30.051>like <00:33:30.207>in <00:33:30.362>a <00:33:30.518>native <00:33:30.673>kind <00:33:30.829>of <00:33:30.985>way.

791
00:33:31.675 --> 00:33:33.565
<00:33:31.675>Obviously <00:33:31.908>they're <00:33:32.141>gonna <00:33:32.375>want <00:33:32.608>their <00:33:32.841>own <00:33:33.075>models.

792
00:33:33.905 --> 00:33:37.365
<00:33:33.905>Um, <00:33:34.045>so <00:33:34.185>I <00:33:34.325>think <00:33:34.465>that <00:33:34.605>will <00:33:34.745>stay <00:33:34.885>because <00:33:35.024>we <00:33:35.165>have <00:33:35.305>companies,

793
00:33:38.065 --> 00:33:40.645
<00:33:38.065>but <00:33:38.220>at <00:33:38.376>the <00:33:38.531>same <00:33:38.687>time, <00:33:38.842>I <00:33:38.998>also <00:33:39.153>think <00:33:39.309>that, <00:33:39.465>um,

794
00:33:42.145 --> 00:33:45.805
<00:33:42.145>models <00:33:42.378>are <00:33:42.611>almost <00:33:42.845>like, <00:33:43.078>um, <00:33:43.311>implementation <00:33:43.545>detail.

795
00:33:45.925 --> 00:33:48.485
<00:33:45.925>I <00:33:46.065>think <00:33:46.205>they <00:33:46.345>will <00:33:46.485>be <00:33:46.625>at <00:33:46.764>some <00:33:46.905>point <00:33:47.044>where, <00:33:47.185>you <00:33:47.325>know,

796
00:33:48.485 --> 00:33:50.085
<00:33:48.485>just <00:33:48.685>like <00:33:48.885>I, <00:33:49.084>I <00:33:49.284>type <00:33:49.485>into <00:33:49.685>a <00:33:49.885>website

797
00:33:50.085 --> 00:33:51.965
<00:33:50.085>and <00:33:50.365>then <00:33:50.645>I, <00:33:50.925>the <00:33:51.205>website <00:33:51.485>opens,

798
00:33:51.985 --> 00:33:53.805
<00:33:51.985>but <00:33:52.185>under <00:33:52.385>the <00:33:52.584>covers <00:33:52.784>there's <00:33:52.985>all <00:33:53.185>these <00:33:53.385>networks,

799
00:33:53.805 --> 00:33:54.925
<00:33:53.805>right, <00:33:54.057>that <00:33:54.309>make <00:33:54.561>that <00:33:54.812>happen.

800
00:33:55.265 --> 00:33:56.605
<00:33:55.265>But <00:33:55.437>as <00:33:55.609>a <00:33:55.781>user, <00:33:55.954>I <00:33:56.126>don't <00:33:56.298>care, <00:33:56.471>right?

801
00:33:56.605 --> 00:33:58.405
<00:33:56.605>Like, <00:33:56.780>I <00:33:56.955>just <00:33:57.130>type <00:33:57.305>and <00:33:57.480>I <00:33:57.655>get <00:33:57.830>the <00:33:58.005>information.

802
00:33:59.065 --> 00:34:01.365
<00:33:59.065>So <00:33:59.192>I <00:33:59.319>think <00:33:59.446>similar <00:33:59.574>to <00:33:59.701>that, <00:33:59.828>like <00:33:59.955>the <00:34:00.083>models <00:34:00.210>will <00:34:00.337>be <00:34:00.465>like

803
00:34:01.365 --> 00:34:03.925
<00:34:01.365>that <00:34:01.565>in <00:34:01.765>the <00:34:01.965>background, <00:34:02.165>like <00:34:02.365>getting <00:34:02.565>me <00:34:02.765>stuff,

804
00:34:03.995 --> 00:34:07.245
<00:34:03.995>telling <00:34:04.169>me <00:34:04.344>stuff, <00:34:04.520>but <00:34:04.695>what, <00:34:04.870>what, <00:34:05.044>what's <00:34:05.219>that <00:34:05.395>model?

805
00:34:07.345 --> 00:34:08.685
<00:34:07.345>Who <00:34:07.546>is <00:34:07.747>it <00:34:07.948>where <00:34:08.149>it <00:34:08.350>comes <00:34:08.551>from?

806
00:34:08.885 --> 00:34:10.045
<00:34:08.885>I <00:34:09.093>think <00:34:09.302>that <00:34:09.511>as <00:34:09.720>a <00:34:09.929>user,

807
00:34:10.125 --> 00:34:12.565
<00:34:10.125>I <00:34:10.324>wouldn't <00:34:10.525>care, <00:34:10.725>I <00:34:10.925>wouldn't <00:34:11.125>care <00:34:11.324>about <00:34:11.525>that.

808
00:34:12.725 --> 00:34:15.485
<00:34:12.725>I <00:34:12.880>think <00:34:13.036>that's <00:34:13.191>the <00:34:13.347>feature <00:34:13.502>that <00:34:13.658>we <00:34:13.813>will <00:34:13.969>gonna <00:34:14.125>have.

809
00:34:16.265 --> 00:34:21.085
<00:34:16.264>And <00:34:16.420>I <00:34:16.576>also <00:34:16.731>see <00:34:16.887>models <00:34:17.042>like <00:34:17.198>being <00:34:17.353>embedded, <00:34:17.509>like <00:34:17.665>everywhere.

810
00:34:21.155 --> 00:34:23.205
<00:34:21.155>Like, <00:34:21.355>so <00:34:21.555>it <00:34:21.755>would <00:34:21.955>be <00:34:22.155>like <00:34:22.355>the <00:34:22.555>same

811
00:34:23.735 --> 00:34:25.205
<00:34:23.735>model <00:34:24.065>probably <00:34:24.396>on <00:34:24.727>your <00:34:25.058>laptop,

812
00:34:25.205 --> 00:34:27.565
<00:34:25.205>and <00:34:25.360>then <00:34:25.516>you, <00:34:25.671>maybe <00:34:25.827>you <00:34:25.982>have <00:34:26.138>your <00:34:26.293>phone, <00:34:26.449>same <00:34:26.605>thing

813
00:34:27.995 --> 00:34:29.605
<00:34:27.995>that <00:34:28.170>maybe <00:34:28.344>you, <00:34:28.520>you <00:34:28.694>would <00:34:28.870>turn <00:34:29.045>on <00:34:29.219>your <00:34:29.395>tv.

814
00:34:29.715 --> 00:34:33.365
<00:34:29.715>Like, <00:34:29.855>so <00:34:29.995>I, <00:34:30.135>I <00:34:30.275>see <00:34:30.415>this <00:34:30.555>like, <00:34:30.695>you <00:34:30.835>know, <00:34:30.975>one <00:34:31.115>model

815
00:34:33.365 --> 00:34:36.445
<00:34:33.364>that <00:34:33.564>knows <00:34:33.764>everything <00:34:33.964>about <00:34:34.165>you <00:34:34.364>across <00:34:34.564>different <00:34:34.764>mediums,

816
00:34:37.065 --> 00:34:39.165
<00:34:37.065>and <00:34:37.205>then <00:34:37.345>it <00:34:37.485>just, <00:34:37.625>you <00:34:37.764>just <00:34:37.905>work <00:34:38.045>with <00:34:38.185>the <00:34:38.325>same <00:34:38.465>thing.

817
00:34:39.165 --> 00:34:42.245
<00:34:39.165>Like, <00:34:39.304>that's, <00:34:39.445>that's <00:34:39.585>how <00:34:39.725>I <00:34:39.864>envision <00:34:40.005>like <00:34:40.145>where <00:34:40.284>like <00:34:40.425>it <00:34:40.565>just,

818
00:34:42.245 --> 00:34:43.325
<00:34:42.245>there's <00:34:42.439>this <00:34:42.633>thing <00:34:42.828>I <00:34:43.022>talk <00:34:43.216>to

819
00:34:43.325 --> 00:34:44.405
<00:34:43.324>and <00:34:43.487>it <00:34:43.649>just <00:34:43.811>knows <00:34:43.973>everything <00:34:44.135>about <00:34:44.297>me,

820
00:34:44.405 --> 00:34:46.245
<00:34:44.405>and <00:34:44.605>then <00:34:44.805>it <00:34:45.005>helps <00:34:45.205>me <00:34:45.405>where <00:34:45.605>I <00:34:45.805>am.

821
00:34:47.305 --> 00:34:49.485
<00:34:47.304>Um, <00:34:47.504>so <00:34:47.705>that's <00:34:47.904>where <00:34:48.105>I <00:34:48.304>think <00:34:48.504>we'll <00:34:48.705>be,

822
00:34:49.585 --> 00:34:51.325
<00:34:49.585>but <00:34:49.784>I <00:34:49.985>don't <00:34:50.185>know, <00:34:50.385>I <00:34:50.585>mean, <00:34:50.784>we'll <00:34:50.985>see,

823
00:34:51.905 --> 00:34:54.445
<00:34:51.905>But <00:34:52.045>I <00:34:52.185>think <00:34:52.325>with, <00:34:52.465>uh, <00:34:52.605>generative <00:34:52.745>ai, <00:34:52.885>I <00:34:53.025>think <00:34:53.165>that <00:34:53.305>the,

824
00:34:54.505 --> 00:34:59.365
<00:34:54.505>the <00:34:54.680>real <00:34:54.855>success <00:34:55.030>will <00:34:55.205>be <00:34:55.380>not <00:34:55.555>with <00:34:55.730>chatbots <00:34:55.905>everywhere

825
00:34:59.425 --> 00:35:01.645
<00:34:59.425>and <00:34:59.580>all <00:34:59.736>sorts <00:34:59.891>of <00:35:00.047>chatbots <00:35:00.202>that <00:35:00.358>we <00:35:00.513>have <00:35:00.669>to <00:35:00.825>install,

826
00:35:01.665 --> 00:35:04.765
<00:35:01.665>but <00:35:02.015>making <00:35:02.365>LLM <00:35:02.715>somewhat <00:35:03.065>seamless

827
00:35:04.905 --> 00:35:07.605
<00:35:04.905>and <00:35:05.185>transparent <00:35:05.465>so <00:35:05.745>that <00:35:06.025>the, <00:35:06.305>uh,

828
00:35:07.725 --> 00:35:10.925
<00:35:07.725>overall <00:35:08.005>user <00:35:08.285>experience <00:35:08.565>is <00:35:08.845>improved, <00:35:09.125>uh,

829
00:35:10.955 --> 00:35:15.445
<00:35:10.955>because <00:35:11.235>everything <00:35:11.515>is <00:35:11.795>smart <00:35:12.075>everywhere, <00:35:12.355>pre-filled

830
00:35:16.095 --> 00:35:17.725
<00:35:16.095>forms <00:35:16.328>and <00:35:16.561>all <00:35:16.794>that <00:35:17.028>kind <00:35:17.261>of <00:35:17.495>stuff.

831
00:35:18.345 --> 00:35:21.205
<00:35:18.345>And <00:35:18.578>the <00:35:18.811>LM <00:35:19.044>becomes <00:35:19.278>kind <00:35:19.511>of <00:35:19.745>invisible.

832
00:35:21.545 --> 00:35:23.005
<00:35:21.545>You <00:35:21.983>ultimately, <00:35:22.421>once, <00:35:22.859>uh,

833
00:35:23.395 --> 00:35:26.685
<00:35:23.395>it's <00:35:23.570>in <00:35:23.745>integrated <00:35:23.920>correctly <00:35:24.095>into <00:35:24.270>the, <00:35:24.445>the <00:35:24.620>various <00:35:24.795>apps

834
00:35:26.685 --> 00:35:29.485
<00:35:26.685>that <00:35:26.840>we <00:35:26.996>use, <00:35:27.151>uh, <00:35:27.307>on <00:35:27.462>an <00:35:27.618>everyday <00:35:27.773>basis, <00:35:27.929>you <00:35:28.085>know,

835
00:35:29.485 --> 00:35:32.565
<00:35:29.485>whether <00:35:29.685>it's <00:35:29.885>your <00:35:30.085>word <00:35:30.285>processor, <00:35:30.485>whether <00:35:30.685>it's, <00:35:30.885>uh,

836
00:35:33.085 --> 00:35:36.005
<00:35:33.085>I <00:35:33.260>don't <00:35:33.435>know, <00:35:33.610>uh, <00:35:33.785>your <00:35:33.960>coding <00:35:34.135>assistant, <00:35:34.310>et <00:35:34.485>cetera.

837
00:35:36.145 --> 00:35:38.365
<00:35:36.145>It <00:35:36.320>has <00:35:36.495>to <00:35:36.670>be <00:35:36.845>about <00:35:37.020>the, <00:35:37.195>the <00:35:37.370>seamless <00:35:37.545>integration

838
00:35:38.365 --> 00:35:42.445
<00:35:38.365>and <00:35:38.540>transparency <00:35:38.714>rather <00:35:38.890>than <00:35:39.064>being, <00:35:39.240>uh, <00:35:39.415>about <00:35:39.589>X <00:35:39.765>apps

839
00:35:42.445 --> 00:35:44.685
<00:35:42.445>that <00:35:42.585>you <00:35:42.725>need <00:35:42.865>to <00:35:43.005>install <00:35:43.145>to <00:35:43.285>get <00:35:43.425>your, <00:35:43.565>your <00:35:43.705>job <00:35:43.845>done.

840
00:35:45.205 --> 00:35:46.685
<00:35:45.205>I <00:35:45.371>was <00:35:45.538>gonna <00:35:45.704>say, <00:35:45.871>like, <00:35:46.037>it <00:35:46.203>always <00:35:46.370>boils <00:35:46.537>down

841
00:35:46.685 --> 00:35:48.445
<00:35:46.685>to <00:35:46.860>like <00:35:47.035>user <00:35:47.210>experience <00:35:47.384>in <00:35:47.560>the <00:35:47.735>end, <00:35:47.910>I <00:35:48.085>think.

842
00:35:48.445 --> 00:35:50.085
<00:35:48.445>Yeah, <00:35:48.678>yeah, <00:35:48.911>yeah. <00:35:49.145>I <00:35:49.378>mean, <00:35:49.611>the, <00:35:49.845>the,

843
00:35:50.305 --> 00:35:53.085
<00:35:50.305>it <00:35:50.421>is <00:35:50.538>gonna <00:35:50.654>be <00:35:50.771>like <00:35:50.888>once <00:35:51.004>the <00:35:51.121>models <00:35:51.238>are <00:35:51.355>pretty <00:35:51.471>much <00:35:51.588>like <00:35:51.705>the

844
00:35:53.085 --> 00:35:54.725
<00:35:53.085>same, <00:35:53.785>like <00:35:54.485>give

845
00:35:54.725 --> 00:35:58.485
<00:35:54.725>or <00:35:54.865>take, <00:35:55.005>then <00:35:55.145>I <00:35:55.285>think <00:35:55.424>who's <00:35:55.565>gonna <00:35:55.705>be <00:35:55.845>successful <00:35:55.985>is <00:35:56.125>like,

846
00:35:58.485 --> 00:36:00.725
<00:35:58.485>who <00:35:58.640>creates <00:35:58.796>like, <00:35:58.951>the <00:35:59.107>best <00:35:59.262>experiences <00:35:59.418>for <00:35:59.573>the <00:35:59.729>users <00:35:59.885>so

847
00:36:00.725 --> 00:36:02.445
<00:36:00.725>that <00:36:00.958>they <00:36:01.191>don't <00:36:01.424>have <00:36:01.658>to <00:36:01.891>be <00:36:02.125>frustrated

848
00:36:02.445 --> 00:36:04.765
<00:36:02.445>with <00:36:02.911>the <00:36:03.378>technology. <00:36:03.845>Mm-hmm.

849
00:36:05.085 --> 00:36:06.725
<00:36:05.085>I <00:36:05.260>think <00:36:05.435>we <00:36:05.610>have <00:36:05.785>that <00:36:05.960>in <00:36:06.135>the <00:36:06.310>photo <00:36:06.485>space.

850
00:36:07.005 --> 00:36:09.925
<00:36:07.005>I <00:36:07.121>mean, <00:36:07.238>like <00:36:07.355>when, <00:36:07.471>uh, <00:36:07.588>I've <00:36:07.705>got <00:36:07.821>a <00:36:07.938>pixel <00:36:08.055>phone <00:36:08.171>since <00:36:08.288>day <00:36:08.405>one,

851
00:36:10.345 --> 00:36:13.765
<00:36:10.345>and <00:36:10.461>uh, <00:36:10.578>it <00:36:10.694>is <00:36:10.811>like <00:36:10.928>at <00:36:11.044>a <00:36:11.161>certain <00:36:11.278>time <00:36:11.395>the <00:36:11.511>amount <00:36:11.628>of <00:36:11.745>lenses

852
00:36:13.865 --> 00:36:15.725
<00:36:13.865>and <00:36:14.064>the <00:36:14.265>amount <00:36:14.464>of <00:36:14.665>like, <00:36:14.865>uh, <00:36:15.064>uh, <00:36:15.265>uh,

853
00:36:15.915 --> 00:36:17.965
<00:36:15.915>sensors <00:36:16.115>in <00:36:16.315>there <00:36:16.515>were <00:36:16.715>not <00:36:16.915>that <00:36:17.115>important <00:36:17.315>anymore.

854
00:36:18.285 --> 00:36:20.005
<00:36:18.285>'cause <00:36:18.484>none <00:36:18.685>of <00:36:18.884>the <00:36:19.085>pictures <00:36:19.285>that <00:36:19.484>you <00:36:19.685>took

855
00:36:20.105 --> 00:36:21.685
<00:36:20.105>as <00:36:20.338>actually <00:36:20.571>the <00:36:20.805>picture <00:36:21.038>that <00:36:21.271>it <00:36:21.505>recorded,

856
00:36:21.865 --> 00:36:24.085
<00:36:21.865>it <00:36:22.145>will <00:36:22.424>be <00:36:22.705>cleaned <00:36:22.984>up <00:36:23.265>automatically.

857
00:36:24.185 --> 00:36:26.285
<00:36:24.185>It <00:36:24.418>will <00:36:24.651>be <00:36:24.884>just <00:36:25.118>a <00:36:25.351>DD <00:36:25.585>deno.

858
00:36:26.285 --> 00:36:27.765
<00:36:26.285>There's <00:36:26.551>all <00:36:26.817>kind <00:36:27.084>of <00:36:27.350>stuff <00:36:27.616>happening.

859
00:36:27.825 --> 00:36:29.845
<00:36:27.825>So <00:36:28.058>the, <00:36:28.291>the <00:36:28.524>model <00:36:28.758>on <00:36:28.991>the <00:36:29.225>device

860
00:36:29.845 --> 00:36:32.725
<00:36:29.845>that <00:36:30.020>actually <00:36:30.194>changes <00:36:30.370>those <00:36:30.544>images <00:36:30.720>while <00:36:30.895>you're <00:36:31.069>taking <00:36:31.245>them

861
00:36:32.775 --> 00:36:34.645
<00:36:32.775>right <00:36:33.055>after <00:36:33.335>you've <00:36:33.615>taken <00:36:33.895>them <00:36:34.175>gives

862
00:36:34.645 --> 00:36:35.765
<00:36:34.645>you <00:36:34.981>a <00:36:35.317>different <00:36:35.653>experience.

863
00:36:35.795 --> 00:36:40.045
<00:36:35.795>Much <00:36:35.950>like, <00:36:36.106>but <00:36:36.261>I <00:36:36.417>mean, <00:36:36.572>of <00:36:36.728>course, <00:36:36.883>uh, <00:36:37.039>like <00:36:37.195>people

864
00:36:40.105 --> 00:36:41.765
<00:36:40.105>who <00:36:40.338>are <00:36:40.571>not <00:36:40.805>going <00:36:41.038>for <00:36:41.271>the <00:36:41.505>purest,

865
00:36:41.865 --> 00:36:44.005
<00:36:41.865>purest <00:36:42.064>approach <00:36:42.265>would <00:36:42.464>be <00:36:42.665>saying <00:36:42.865>that <00:36:43.064>that's <00:36:43.265>horrible

866
00:36:44.005 --> 00:36:46.165
<00:36:44.005>because <00:36:44.205>it's <00:36:44.405>like, <00:36:44.605>I <00:36:44.805>never <00:36:45.005>to <00:36:45.205>take <00:36:45.405>anything.

867
00:36:46.545 --> 00:36:50.085
<00:36:46.545>But <00:36:46.672>then <00:36:46.799>again, <00:36:46.926>I <00:36:47.054>guess <00:36:47.181>if <00:36:47.308>you <00:36:47.435>nowadays <00:36:47.563>press <00:36:47.690>the, <00:36:47.817>the, <00:36:47.945>uh,

868
00:36:50.085 --> 00:36:51.525
<00:36:50.085>uh, <00:36:50.301>press <00:36:50.517>the <00:36:50.733>brake <00:36:50.949>in <00:36:51.165>your <00:36:51.381>car,

869
00:36:51.525 --> 00:36:53.765
<00:36:51.525>you're <00:36:51.700>not <00:36:51.875>actually <00:36:52.050>connected <00:36:52.225>to <00:36:52.400>the <00:36:52.575>brakes <00:36:52.750>any <00:36:52.925>longer.

870
00:36:53.765 --> 00:36:56.645
<00:36:53.765>There's <00:36:53.920>a <00:36:54.076>few <00:36:54.231>computers <00:36:54.387>inwe <00:36:54.542>in <00:36:54.698>between <00:36:54.853>there <00:36:55.009>as <00:36:55.165>well.

871
00:36:56.645 --> 00:36:58.405
<00:36:56.645>We've <00:36:56.820>been <00:36:56.995>in <00:36:57.170>this <00:36:57.345>world <00:36:57.520>for <00:36:57.695>quite <00:36:57.870>some <00:36:58.045>time.

872
00:36:59.225 --> 00:37:00.685
<00:36:59.225>Uh, <00:36:59.487>like <00:36:59.750>what <00:37:00.013>is <00:37:00.276>one <00:37:00.538>thing

873
00:37:00.915 --> 00:37:04.005
<00:37:00.915>that <00:37:01.055>you <00:37:01.195>see <00:37:01.335>people <00:37:01.475>do <00:37:01.615>wrong <00:37:01.755>when <00:37:01.895>implementing <00:37:02.035>AI <00:37:02.175>in <00:37:02.315>their

874
00:37:04.005 --> 00:37:05.845
<00:37:04.005>products <00:37:04.285>that <00:37:04.565>drives <00:37:04.845>you <00:37:05.125>nuts, <00:37:05.405>meta,

875
00:37:05.845 --> 00:37:07.325
<00:37:05.845>what <00:37:06.067>you <00:37:06.288>want <00:37:06.511>people <00:37:06.732>to <00:37:06.955>stop <00:37:07.176>doing?

876
00:37:08.385 --> 00:37:10.485
<00:37:08.385>Oh <00:37:08.560>God. <00:37:08.735>Like <00:37:08.910>I <00:37:09.085>have <00:37:09.260>a <00:37:09.435>story <00:37:09.610>on <00:37:09.785>this.

877
00:37:10.945 --> 00:37:14.885
<00:37:10.945>So <00:37:11.061>last, <00:37:11.178>last <00:37:11.295>December <00:37:11.411>I <00:37:11.528>was <00:37:11.645>in <00:37:11.761>Asia <00:37:11.878>and <00:37:11.995>I <00:37:12.111>had <00:37:12.228>a <00:37:12.345>flight,

878
00:37:15.265 --> 00:37:17.165
<00:37:15.265>and <00:37:15.464>then <00:37:15.665>I <00:37:15.865>had <00:37:16.065>to <00:37:16.265>change <00:37:16.464>the <00:37:16.665>flight,

879
00:37:17.665 --> 00:37:19.725
<00:37:17.665>but <00:37:17.898>the <00:37:18.131>airline, <00:37:18.365>I <00:37:18.598>won't <00:37:18.831>name <00:37:19.065>which

880
00:37:19.725 --> 00:37:20.885
<00:37:19.725>one, <00:37:19.933>maybe <00:37:20.142>I <00:37:20.351>should <00:37:20.560>name <00:37:20.769>them.

881
00:37:20.885 --> 00:37:23.685
<00:37:20.885>But <00:37:21.060>anyway, <00:37:21.235>um, <00:37:21.410>they <00:37:21.585>had <00:37:21.760>a <00:37:21.935>chatbot, <00:37:22.110>you <00:37:22.285>know,

882
00:37:23.865 --> 00:37:26.965
<00:37:23.865>and <00:37:24.004>there <00:37:24.145>was <00:37:24.285>no <00:37:24.424>way, <00:37:24.564>like <00:37:24.705>the <00:37:24.845>chatbot <00:37:24.984>was <00:37:25.125>quite <00:37:25.265>helpful,

883
00:37:27.035 --> 00:37:29.605
<00:37:27.035>like <00:37:27.210>it <00:37:27.384>would <00:37:27.560>pull <00:37:27.734>up <00:37:27.910>my <00:37:28.085>information <00:37:28.259>on <00:37:28.435>and,

884
00:37:30.025 --> 00:37:31.525
<00:37:30.025>and <00:37:30.175>tell <00:37:30.325>me <00:37:30.475>when <00:37:30.625>my <00:37:30.775>fight <00:37:30.925>is <00:37:31.075>and <00:37:31.225>all <00:37:31.375>that,

885
00:37:31.585 --> 00:37:32.965
<00:37:31.585>but <00:37:31.833>for <00:37:32.081>changing <00:37:32.330>it, <00:37:32.578>it <00:37:32.827>just,

886
00:37:33.025 --> 00:37:35.405
<00:37:33.025>it <00:37:33.165>was <00:37:33.305>like <00:37:33.445>unchangeable <00:37:33.585>fa <00:37:33.725>but <00:37:33.865>he <00:37:34.005>wouldn't <00:37:34.145>tell <00:37:34.285>me <00:37:34.425>that.

887
00:37:35.985 --> 00:37:38.525
<00:37:35.985>And <00:37:36.125>I <00:37:36.265>just <00:37:36.405>went <00:37:36.545>in <00:37:36.685>circles <00:37:36.825>like <00:37:36.965>multiple <00:37:37.105>days, <00:37:37.245>like <00:37:37.385>trying

888
00:37:38.525 --> 00:37:40.805
<00:37:38.525>to <00:37:38.758>get <00:37:38.991>past <00:37:39.225>this, <00:37:39.458>uh, <00:37:39.691>uh, <00:37:39.925>chatbot

889
00:37:40.985 --> 00:37:42.685
<00:37:40.985>and <00:37:41.185>talk <00:37:41.385>to <00:37:41.585>someone <00:37:41.785>just <00:37:41.985>to <00:37:42.185>verify <00:37:42.385>it,

890
00:37:42.785 --> 00:37:44.125
<00:37:42.785>but <00:37:42.957>I <00:37:43.129>just <00:37:43.301>couldn't <00:37:43.474>find <00:37:43.646>it, <00:37:43.818>you <00:37:43.991>know?

891
00:37:44.145 --> 00:37:46.605
<00:37:44.145>And <00:37:44.425>it <00:37:44.705>was <00:37:44.985>so <00:37:45.265>frustrating, <00:37:45.545>um,

892
00:37:47.115 --> 00:37:49.005
<00:37:47.115>because <00:37:47.270>I <00:37:47.426>think <00:37:47.581>it's <00:37:47.737>like <00:37:47.892>a, <00:37:48.048>one <00:37:48.203>of <00:37:48.359>those <00:37:48.515>cases

893
00:37:49.005 --> 00:37:50.605
<00:37:49.005>where <00:37:49.355>technology <00:37:49.705>is <00:37:50.055>being <00:37:50.405>used,

894
00:37:50.605 --> 00:37:54.205
<00:37:50.605>and <00:37:50.732>I <00:37:50.859>think <00:37:50.986>it, <00:37:51.114>it <00:37:51.241>does <00:37:51.368>help <00:37:51.495>up <00:37:51.623>to <00:37:51.750>an <00:37:51.877>certain <00:37:52.005>extent,

895
00:37:54.265 --> 00:37:57.125
<00:37:54.265>but <00:37:54.404>at <00:37:54.545>some <00:37:54.685>point, <00:37:54.825>like <00:37:54.964>you <00:37:55.105>need <00:37:55.245>to <00:37:55.384>get <00:37:55.525>people <00:37:55.665>involved.

896
00:37:57.185 --> 00:37:58.925
<00:37:57.185>So <00:37:57.360>there <00:37:57.535>has <00:37:57.710>to <00:37:57.884>be <00:37:58.060>a <00:37:58.235>path <00:37:58.410>to <00:37:58.585>that.

897
00:37:59.465 --> 00:38:01.885
<00:37:59.465>Uh, <00:37:59.620>you <00:37:59.776>can't <00:37:59.931>just <00:38:00.087>expect <00:38:00.242>AI <00:38:00.398>to, <00:38:00.553>to <00:38:00.709>do <00:38:00.865>things

898
00:38:01.905 --> 00:38:05.925
<00:38:01.905>and, <00:38:02.045>you <00:38:02.185>know, <00:38:02.325>maybe <00:38:02.465>the <00:38:02.605>airline <00:38:02.745>saved <00:38:02.885>a <00:38:03.025>lot <00:38:03.165>of <00:38:03.305>cost

899
00:38:05.925 --> 00:38:07.485
<00:38:05.925>because <00:38:06.158>of <00:38:06.391>this, <00:38:06.625>but <00:38:06.858>then <00:38:07.091>they're <00:38:07.325>gonna,

900
00:38:07.515 --> 00:38:09.285
<00:38:07.515>they <00:38:07.690>also <00:38:07.865>frustrated <00:38:08.040>a <00:38:08.214>lot <00:38:08.390>of <00:38:08.565>people <00:38:08.740>like <00:38:08.915>me.

901
00:38:09.305 --> 00:38:11.325
<00:38:09.305>So <00:38:09.444>next <00:38:09.585>time <00:38:09.725>I <00:38:09.865>book <00:38:10.004>a <00:38:10.145>flight, <00:38:10.285>I'll <00:38:10.424>think <00:38:10.565>about <00:38:10.705>this

902
00:38:11.325 --> 00:38:12.765
<00:38:11.325>because <00:38:11.510>I <00:38:11.695>know <00:38:11.880>that <00:38:12.065>I <00:38:12.250>won't <00:38:12.435>be <00:38:12.621>able

903
00:38:12.765 --> 00:38:13.885
<00:38:12.765>to <00:38:12.966>change <00:38:13.168>the <00:38:13.369>flight, <00:38:13.571>you <00:38:13.773>know?

904
00:38:13.945 --> 00:38:16.045
<00:38:13.945>So <00:38:14.145>make <00:38:14.345>sure <00:38:14.545>there's <00:38:14.745>a <00:38:14.945>path <00:38:15.145>to <00:38:15.345>people.

905
00:38:16.325 --> 00:38:17.325
<00:38:16.325>I <00:38:16.475>think <00:38:16.625>that's <00:38:16.774>what <00:38:16.924>I <00:38:17.075>would <00:38:17.225>say.

906
00:38:18.275 --> 00:38:19.685
<00:38:18.275>It's <00:38:18.486>a <00:38:18.698>bit <00:38:18.909>like <00:38:19.121>these <00:38:19.332>telephone <00:38:19.544>systems,

907
00:38:19.685 --> 00:38:22.685
<00:38:19.685>when <00:38:19.792>you <00:38:19.900>were <00:38:20.008>asked <00:38:20.115>to <00:38:20.223>press <00:38:20.331>1, <00:38:20.438>2, <00:38:20.546>3, <00:38:20.654>to <00:38:20.761>go <00:38:20.869>to <00:38:20.977>that <00:38:21.085>menu

908
00:38:22.745 --> 00:38:24.965
<00:38:22.745>and <00:38:22.978>that <00:38:23.211>menu, <00:38:23.444>the, <00:38:23.678>the <00:38:23.911>first <00:38:24.145>ones,

909
00:38:24.965 --> 00:38:26.765
<00:38:24.965>when <00:38:25.140>you <00:38:25.315>always <00:38:25.490>press <00:38:25.665>a <00:38:25.840>number <00:38:26.015>that <00:38:26.190>didn't <00:38:26.365>exist,

910
00:38:26.765 --> 00:38:28.205
<00:38:26.765>that <00:38:26.981>got <00:38:27.197>you <00:38:27.413>directly <00:38:27.629>to <00:38:27.845>a <00:38:28.060>person

911
00:38:28.205 --> 00:38:30.325
<00:38:28.205>because <00:38:28.438>the <00:38:28.671>system <00:38:28.904>was <00:38:29.138>basically <00:38:29.371>saying, <00:38:29.605>okay,

912
00:38:30.325 --> 00:38:32.365
<00:38:30.325>that <00:38:30.480>person's <00:38:30.636>too <00:38:30.791>dumb <00:38:30.947>to <00:38:31.102>find <00:38:31.258>the <00:38:31.413>three <00:38:31.569>on <00:38:31.725>the,

913
00:38:32.625 --> 00:38:34.005
<00:38:32.625>on <00:38:32.935>the <00:38:33.246>telephone <00:38:33.556>or <00:38:33.867>something.

914
00:38:34.345 --> 00:38:36.445
<00:38:34.345>But <00:38:34.520>sadly <00:38:34.694>enough, <00:38:34.870>nowadays <00:38:35.044>they <00:38:35.220>just <00:38:35.395>kick <00:38:35.569>you <00:38:35.745>out.

915
00:38:36.525 --> 00:38:37.645
<00:38:36.525>I <00:38:36.726>mean, <00:38:36.928>h <00:38:37.129>HP <00:38:37.331>just <00:38:37.533>announced

916
00:38:37.645 --> 00:38:40.965
<00:38:37.645>that <00:38:37.772>they <00:38:37.899>put <00:38:38.026>a <00:38:38.154>15 <00:38:38.281>minute <00:38:38.408>break <00:38:38.535>in <00:38:38.663>the <00:38:38.790>telephone <00:38:38.917>calls <00:38:39.045>with

917
00:38:41.065 --> 00:38:43.485
<00:38:41.065>for <00:38:41.205>people <00:38:41.345>because <00:38:41.485>they <00:38:41.625>just <00:38:41.765>don't <00:38:41.905>want <00:38:42.045>to <00:38:42.185>talk <00:38:42.325>to <00:38:42.465>them.

918
00:38:44.105 --> 00:38:47.125
<00:38:44.105>Uh, <00:38:44.232>uh, <00:38:44.359>in <00:38:44.486>England <00:38:44.614>there's <00:38:44.741>this, <00:38:44.868>uh, <00:38:44.995>uh, <00:38:45.123>we <00:38:45.250>are <00:38:45.377>gonna <00:38:45.505>have

919
00:38:47.125 --> 00:38:48.965
<00:38:47.125>that, <00:38:47.325>those <00:38:47.525>people <00:38:47.725>on <00:38:47.925>coffee <00:38:48.125>with <00:38:48.325>developers <00:38:48.525>soon,

920
00:38:48.965 --> 00:38:52.605
<00:38:48.965>they <00:38:49.120>make <00:38:49.276>this <00:38:49.431>ai <00:38:49.587>granny <00:38:49.742>that <00:38:49.898>basically <00:38:50.053>spammers <00:38:50.209>when, <00:38:50.365>or,

921
00:38:52.605 --> 00:38:55.205
<00:38:52.605>or, <00:38:52.760>or, <00:38:52.916>or, <00:38:53.071>or <00:38:53.227>phishes <00:38:53.382>when <00:38:53.538>they <00:38:53.693>actually <00:38:53.849>start <00:38:54.005>calling,

922
00:38:55.595 --> 00:38:57.845
<00:38:55.595>they <00:38:55.770>actually <00:38:55.944>talk <00:38:56.120>to <00:38:56.294>an <00:38:56.470>anime, <00:38:56.645>uh, <00:38:56.819>to <00:38:56.995>a,

923
00:38:58.125 --> 00:38:59.925
<00:38:58.125>a <00:38:58.325>woman <00:38:58.525>doesn't <00:38:58.725>exist <00:38:58.925>and <00:38:59.125>waste <00:38:59.325>their <00:38:59.525>time.

924
00:39:00.505 --> 00:39:03.245
<00:39:00.505>So <00:39:00.632>I <00:39:00.759>think <00:39:00.886>that's <00:39:01.014>a <00:39:01.141>very, <00:39:01.268>very <00:39:01.395>cool, <00:39:01.523>like <00:39:01.650>kind <00:39:01.777>of <00:39:01.905>a,

925
00:39:03.365 --> 00:39:06.645
<00:39:03.365>a <00:39:03.504>physical <00:39:03.645>honey <00:39:03.785>bot, <00:39:03.924>uh, <00:39:04.064>a <00:39:04.205>honeypot, <00:39:04.345>uh, <00:39:04.484>for <00:39:04.625>like <00:39:04.765>spammers.

926
00:39:06.645 --> 00:39:07.965
<00:39:06.645>And <00:39:06.843>that <00:39:07.041>was <00:39:07.239>really <00:39:07.437>interesting <00:39:07.635>to <00:39:07.833>see.

927
00:39:08.625 --> 00:39:12.285
<00:39:08.625>So, <00:39:08.765>um, <00:39:08.905>to <00:39:09.045>end <00:39:09.185>gu <00:39:09.325>uh, <00:39:09.465>uh, <00:39:09.605>what <00:39:09.745>is <00:39:09.885>one <00:39:10.025>thing

928
00:39:12.285 --> 00:39:14.245
<00:39:12.285>that <00:39:12.565>you <00:39:12.845>think <00:39:13.125>everybody <00:39:13.404>learning <00:39:13.685>AI

929
00:39:14.245 --> 00:39:15.365
<00:39:14.245>should <00:39:14.497>get <00:39:14.749>their <00:39:15.000>head <00:39:15.252>around?

930
00:39:15.715 --> 00:39:18.965
<00:39:15.715>Like, <00:39:15.842>what <00:39:15.969>is, <00:39:16.096>where <00:39:16.224>do <00:39:16.351>you <00:39:16.478>get <00:39:16.605>started <00:39:16.733>to <00:39:16.860>actually <00:39:16.987>be <00:39:17.115>a,

931
00:39:19.265 --> 00:39:21.845
<00:39:19.265>not <00:39:19.420>only <00:39:19.576>a, <00:39:19.731>a, <00:39:19.887>a <00:39:20.042>victim, <00:39:20.198>as <00:39:20.353>you <00:39:20.509>said, <00:39:20.665>like

932
00:39:21.845 --> 00:39:23.765
<00:39:21.845>that <00:39:22.044>you're <00:39:22.245>feeling, <00:39:22.444>be <00:39:22.645>feeling, <00:39:22.845>you're <00:39:23.044>falling <00:39:23.245>behind

933
00:39:23.825 --> 00:39:26.045
<00:39:23.825>and <00:39:24.105>you're <00:39:24.384>feeling, <00:39:24.665>uh, <00:39:24.944>left <00:39:25.225>out,

934
00:39:26.105 --> 00:39:30.085
<00:39:26.105>but <00:39:26.245>what <00:39:26.385>is <00:39:26.525>one <00:39:26.665>thing <00:39:26.805>that <00:39:26.945>is <00:39:27.085>the <00:39:27.225>best, <00:39:27.365>like <00:39:27.505>return

935
00:39:30.145 --> 00:39:33.205
<00:39:30.145>for <00:39:30.285>your <00:39:30.425>investment <00:39:30.565>as <00:39:30.705>a, <00:39:30.845>as <00:39:30.985>a <00:39:31.125>mental <00:39:31.265>person, <00:39:31.405>like <00:39:31.545>to,

936
00:39:33.205 --> 00:39:34.725
<00:39:33.205>to <00:39:33.547>start <00:39:33.889>thinking <00:39:34.231>about <00:39:34.573>ai?

937
00:39:36.545 --> 00:39:40.925
<00:39:36.545>That's <00:39:36.720>a <00:39:36.895>great <00:39:37.070>question. <00:39:37.245>Um, <00:39:37.420>I <00:39:37.595>mean, <00:39:37.770>there, <00:39:37.945>there,

938
00:39:40.925 --> 00:39:43.525
<00:39:40.925>there's <00:39:41.100>lots <00:39:41.275>of <00:39:41.450>interesting <00:39:41.625>resources <00:39:41.800>on, <00:39:41.975>on <00:39:42.150>the <00:39:42.325>web

939
00:39:43.665 --> 00:39:47.565
<00:39:43.665>or <00:39:43.792>on <00:39:43.919>books, <00:39:44.046>uh, <00:39:44.174>that <00:39:44.301>may <00:39:44.428>be, <00:39:44.555>uh, <00:39:44.683>interesting <00:39:44.810>for <00:39:44.937>people <00:39:45.065>to,

940
00:39:47.945 --> 00:39:50.925
<00:39:47.945>you <00:39:48.100>know, <00:39:48.256>read <00:39:48.411>about <00:39:48.567>to, <00:39:48.722>uh, <00:39:48.878>better <00:39:49.033>understand <00:39:49.189>the, <00:39:49.345>uh,

941
00:39:51.065 --> 00:39:54.125
<00:39:51.065>the <00:39:51.265>tech, <00:39:51.465>the <00:39:51.665>technology <00:39:51.865>that's, <00:39:52.065>uh, <00:39:52.265>involved, <00:39:52.465>how,

942
00:39:54.305 --> 00:39:55.605
<00:39:54.305>how <00:39:54.538>it's <00:39:54.772>working <00:39:55.007>under <00:39:55.241>the <00:39:55.475>hood.

943
00:39:55.665 --> 00:39:58.525
<00:39:55.665>So, <00:39:55.805>uh, <00:39:55.945>especially, <00:39:56.085>I <00:39:56.225>mean, <00:39:56.365>if <00:39:56.505>you <00:39:56.645>are <00:39:56.785>curious, <00:39:56.925>there's, <00:39:57.065>uh,

944
00:39:58.595 --> 00:40:01.285
<00:39:58.595>there's <00:39:58.770>really <00:39:58.944>lots <00:39:59.120>of <00:39:59.294>material <00:39:59.470>on, <00:39:59.645>on <00:39:59.819>that, <00:39:59.995>right?

945
00:40:01.685 --> 00:40:05.805
<00:40:01.685>I <00:40:01.840>would <00:40:01.996>just <00:40:02.151>encourage <00:40:02.307>people <00:40:02.462>to, <00:40:02.618>uh, <00:40:02.773>follow <00:40:02.929>maybe <00:40:03.085>some

946
00:40:06.585 --> 00:40:10.565
<00:40:06.585>AI <00:40:06.725>influencers <00:40:06.865>here <00:40:07.005>and <00:40:07.145>there <00:40:07.285>or, <00:40:07.425>uh, <00:40:07.565>to, <00:40:07.705>to <00:40:07.845>try <00:40:07.985>to,

947
00:40:10.585 --> 00:40:12.805
<00:40:10.585>or <00:40:10.818>there, <00:40:11.051>there's <00:40:11.285>a <00:40:11.518>newsletter <00:40:11.751>that <00:40:11.985>I'm

948
00:40:13.365 --> 00:40:14.645
<00:40:13.365>subscribed <00:40:13.557>to, <00:40:13.749>uh, <00:40:13.941>what <00:40:14.133>is <00:40:14.325>it <00:40:14.517>called?

949
00:40:14.645 --> 00:40:17.485
<00:40:14.645>Like <00:40:14.820>TLDR <00:40:14.995>on <00:40:15.170>generative <00:40:15.345>AR <00:40:15.520>or <00:40:15.695>something <00:40:15.870>like <00:40:16.045>this.

950
00:40:18.025 --> 00:40:21.245
<00:40:18.025>Uh, <00:40:18.165>like <00:40:18.305>every <00:40:18.445>day <00:40:18.585>they, <00:40:18.725>they <00:40:18.865>share <00:40:19.005>the, <00:40:19.145>the <00:40:19.285>latest <00:40:19.425>news

951
00:40:21.505 --> 00:40:25.845
<00:40:21.505>and <00:40:21.621>it's <00:40:21.738>good, <00:40:21.855>a <00:40:21.971>good <00:40:22.088>way <00:40:22.205>to, <00:40:22.321>uh, <00:40:22.438>you <00:40:22.555>know, <00:40:22.671>feel <00:40:22.788>for, <00:40:22.905>um,

952
00:40:26.235 --> 00:40:27.445
<00:40:26.235>what, <00:40:26.507>what's <00:40:26.779>going <00:40:27.051>on, <00:40:27.324>what,

953
00:40:27.445 --> 00:40:29.005
<00:40:27.445>what <00:40:27.725>are <00:40:28.005>the <00:40:28.285>latest <00:40:28.565>developments, <00:40:28.845>what

954
00:40:29.005 --> 00:40:30.365
<00:40:29.005>what <00:40:29.311>are <00:40:29.617>the <00:40:29.923>latest <00:40:30.229>trends?

955
00:40:30.985 --> 00:40:33.885
<00:40:30.985>And, <00:40:31.125>uh, <00:40:31.265>then <00:40:31.405>you, <00:40:31.545>you <00:40:31.685>don't <00:40:31.825>have <00:40:31.965>to <00:40:32.105>go <00:40:32.245>very <00:40:32.385>deep

956
00:40:33.885 --> 00:40:35.725
<00:40:33.885>through <00:40:34.235>all <00:40:34.585>the <00:40:34.935>articles <00:40:35.285>and,

957
00:40:35.865 --> 00:40:38.125
<00:40:35.865>and <00:40:36.098>papers <00:40:36.331>that <00:40:36.564>are <00:40:36.798>published <00:40:37.031>by <00:40:37.265>researchers,

958
00:40:38.345 --> 00:40:40.285
<00:40:38.345>but <00:40:38.520>at <00:40:38.694>least <00:40:38.870>get <00:40:39.044>getting <00:40:39.220>a <00:40:39.395>sense <00:40:39.569>of, <00:40:39.745>uh,

959
00:40:40.555 --> 00:40:43.085
<00:40:40.555>what <00:40:40.754>things <00:40:40.955>are <00:40:41.154>happening, <00:40:41.355>you <00:40:41.555>know, <00:40:41.754>in <00:40:41.955>the,

960
00:40:43.085 --> 00:40:47.485
<00:40:43.085>in <00:40:43.212>the <00:40:43.339>field <00:40:43.466>is <00:40:43.594>good <00:40:43.721>to, <00:40:43.848>uh, <00:40:43.975>uh, <00:40:44.103>try <00:40:44.230>to, <00:40:44.357>uh, <00:40:44.485>portray

961
00:40:47.545 --> 00:40:50.285
<00:40:47.545>or <00:40:47.778>to, <00:40:48.011>um, <00:40:48.245>for, <00:40:48.478>no, <00:40:48.711>not <00:40:48.945>forecast,

962
00:40:50.305 --> 00:40:52.565
<00:40:50.305>but <00:40:50.654>to <00:40:51.004>imagine <00:40:51.355>the <00:40:51.705>places

963
00:40:52.985 --> 00:40:57.645
<00:40:52.985>or, <00:40:53.140>um, <00:40:53.296>maybe <00:40:53.451>the, <00:40:53.607>the <00:40:53.762>new <00:40:53.918>features <00:40:54.073>where, <00:40:54.229>uh, <00:40:54.385>that,

964
00:40:57.645 --> 00:41:00.125
<00:40:57.645>that <00:40:57.820>your <00:40:57.995>application <00:40:58.170>could <00:40:58.345>benefit <00:40:58.520>from <00:40:58.695>by <00:40:58.870>using, <00:40:59.045>uh,

965
00:41:00.595 --> 00:41:01.645
<00:41:00.595>LLMs <00:41:00.783>in <00:41:00.973>a <00:41:01.162>way <00:41:01.351>or <00:41:01.540>another.

966
00:41:01.785 --> 00:41:03.485
<00:41:01.785>So <00:41:02.018>it's <00:41:02.251>hard <00:41:02.484>to <00:41:02.718>find <00:41:02.951>good <00:41:03.185>sources,

967
00:41:03.625 --> 00:41:06.685
<00:41:03.625>but <00:41:03.825>there, <00:41:04.025>there <00:41:04.225>are <00:41:04.425>some, <00:41:04.625>um, <00:41:04.825>interesting, <00:41:05.025>uh,

968
00:41:06.955 --> 00:41:10.805
<00:41:06.955>newsletters <00:41:07.110>maybe <00:41:07.266>that, <00:41:07.421>that <00:41:07.577>people <00:41:07.732>can <00:41:07.888>follow <00:41:08.043>to, <00:41:08.199>uh, <00:41:08.355>uh,

969
00:41:10.825 --> 00:41:12.765
<00:41:10.825>get <00:41:11.000>up <00:41:11.174>to <00:41:11.350>speed <00:41:11.524>with <00:41:11.700>with <00:41:11.875>what's <00:41:12.049>going <00:41:12.225>on.

970
00:41:13.725 --> 00:41:16.895
<00:41:13.725>It's <00:41:13.852>pretty <00:41:13.979>cool <00:41:14.106>that <00:41:14.234>something <00:41:14.361>as <00:41:14.488>co <00:41:14.615>as <00:41:14.743>old <00:41:14.870>as <00:41:14.997>feeds <00:41:15.125>and

971
00:41:16.955 --> 00:41:19.655
<00:41:16.955>and <00:41:17.110>newsletters <00:41:17.266>are <00:41:17.421>still <00:41:17.577>the <00:41:17.732>best <00:41:17.888>place <00:41:18.043>to <00:41:18.199>find <00:41:18.355>things.

972
00:41:20.255 --> 00:41:22.815
<00:41:20.255>'cause <00:41:20.430>when <00:41:20.605>you <00:41:20.780>said <00:41:20.955>AI <00:41:21.130>influencers, <00:41:21.305>I <00:41:21.480>started <00:41:21.655>flinching

973
00:41:23.055 --> 00:41:26.015
<00:41:23.055>'cause <00:41:23.210>like, <00:41:23.366>uh, <00:41:23.521>a <00:41:23.677>lot <00:41:23.832>of <00:41:23.988>people <00:41:24.143>were <00:41:24.299>VR <00:41:24.455>experts

974
00:41:26.195 --> 00:41:28.015
<00:41:26.195>and <00:41:26.395>then <00:41:26.595>next <00:41:26.795>morning <00:41:26.995>they <00:41:27.195>were <00:41:27.395>i <00:41:27.595>AI

975
00:41:28.015 --> 00:41:29.215
<00:41:28.015>influencers <00:41:28.555>on <00:41:29.095>LinkedIn.

976
00:41:29.215 --> 00:41:30.935
<00:41:29.215>That <00:41:29.370>seemed <00:41:29.526>to <00:41:29.681>be <00:41:29.837>the <00:41:29.992>new <00:41:30.148>cool <00:41:30.303>thing <00:41:30.459>to <00:41:30.615>do.

977
00:41:31.395 --> 00:41:33.445
<00:41:31.395>And <00:41:31.595>a <00:41:31.795>lot <00:41:31.995>of <00:41:32.195>it <00:41:32.395>is <00:41:32.595>like <00:41:32.795>marketing

978
00:41:33.665 --> 00:41:35.525
<00:41:33.665>and <00:41:33.945>connecting <00:41:34.225>that <00:41:34.505>from <00:41:34.785>the <00:41:35.065>other.

979
00:41:35.535 --> 00:41:37.645
<00:41:35.535>Maybe <00:41:35.710>we <00:41:35.884>need <00:41:36.060>an <00:41:36.234>agent, <00:41:36.410>an <00:41:36.585>agent <00:41:36.759>to <00:41:36.935>work

980
00:41:37.645 --> 00:41:38.845
<00:41:37.645>through <00:41:37.915>these <00:41:38.185>things <00:41:38.455>for <00:41:38.725>us.

981
00:41:38.985 --> 00:41:41.565
<00:41:38.985>So <00:41:39.140>exactly. <00:41:39.296>But <00:41:39.451>then <00:41:39.607>again, <00:41:39.762>I <00:41:39.918>mean, <00:41:40.073>I'm <00:41:40.229>just <00:41:40.385>looking

982
00:41:41.565 --> 00:41:43.925
<00:41:41.565>through <00:41:41.765>all <00:41:41.965>the <00:41:42.165>job, <00:41:42.365>the, <00:41:42.565>the, <00:41:42.765>the <00:41:42.965>descriptions

983
00:41:43.985 --> 00:41:45.845
<00:41:43.985>for <00:41:44.218>our <00:41:44.451>conference <00:41:44.685>coming <00:41:44.918>up <00:41:45.151>in <00:41:45.385>July.

984
00:41:46.105 --> 00:41:48.365
<00:41:46.105>So <00:41:46.338>we <00:41:46.571>had <00:41:46.805>like <00:41:47.038>over <00:41:47.271>2,500 <00:41:47.505>submissions

985
00:41:48.365 --> 00:41:49.445
<00:41:48.365>and <00:41:48.527>I <00:41:48.689>have <00:41:48.851>to <00:41:49.013>go <00:41:49.175>through <00:41:49.337>them

986
00:41:49.865 --> 00:41:52.045
<00:41:49.865>and <00:41:50.145>the <00:41:50.424>amount <00:41:50.705>of <00:41:50.984>like <00:41:51.265>presentations

987
00:41:52.045 --> 00:41:54.005
<00:41:52.045>that <00:41:52.245>you <00:41:52.445>see <00:41:52.645>have <00:41:52.845>been <00:41:53.045>the, <00:41:53.245>the <00:41:53.445>call

988
00:41:54.005 --> 00:41:55.845
<00:41:54.005>for <00:41:54.205>paper <00:41:54.405>have <00:41:54.605>been <00:41:54.805>done <00:41:55.005>by <00:41:55.205>chat <00:41:55.405>GPT

989
00:41:56.045 --> 00:41:57.205
<00:41:56.045>'cause <00:41:56.306>nobody <00:41:56.567>speaks <00:41:56.828>like <00:41:57.089>that.

990
00:41:57.815 --> 00:42:01.085
<00:41:57.815>Don't <00:41:57.970>do <00:41:58.126>that. <00:41:58.281>Don't <00:41:58.437>hide <00:41:58.592>behi <00:41:58.748>behind, <00:41:58.903>uh, <00:41:59.059>and <00:41:59.215>technology

991
00:42:01.225 --> 00:42:02.605
<00:42:01.225>and <00:42:01.535>sell <00:42:01.846>it <00:42:02.156>as <00:42:02.467>you,

992
00:42:03.205 --> 00:42:05.645
<00:42:03.205>'cause <00:42:03.312>it's <00:42:03.420>you <00:42:03.528>on <00:42:03.635>stage <00:42:03.743>at <00:42:03.851>the <00:42:03.958>end <00:42:04.066>and <00:42:04.174>I <00:42:04.281>wanna <00:42:04.389>see <00:42:04.497>you <00:42:04.605>there.

993
00:42:06.105 --> 00:42:08.605
<00:42:06.105>And <00:42:06.260>I <00:42:06.416>guess <00:42:06.571>with <00:42:06.727>that, <00:42:06.882>I'm <00:42:07.038>looking <00:42:07.193>forward <00:42:07.349>to <00:42:07.505>seeing

994
00:42:08.635 --> 00:42:09.845
<00:42:08.635>what <00:42:08.998>next <00:42:09.361>from <00:42:09.723>you

995
00:42:10.465 --> 00:42:13.565
<00:42:10.465>and <00:42:10.592>uh, <00:42:10.719>hopefully <00:42:10.846>we'll <00:42:10.974>see <00:42:11.101>you <00:42:11.228>soon <00:42:11.355>at <00:42:11.483>our <00:42:11.610>event <00:42:11.737>as <00:42:11.865>well.

996
00:42:13.665 --> 00:42:14.725
<00:42:13.665>But <00:42:13.903>maybe <00:42:14.142>there's <00:42:14.380>a <00:42:14.618>chance

997
00:42:15.305 --> 00:42:17.165
<00:42:15.305>and, <00:42:15.538>uh, <00:42:15.771>thanks <00:42:16.004>very <00:42:16.238>much <00:42:16.471>for <00:42:16.705>this.

998
00:42:17.225 --> 00:42:20.845
<00:42:17.225>So <00:42:17.352>that <00:42:17.479>was <00:42:17.606>fun. <00:42:17.734>I <00:42:17.861>hope <00:42:17.988>you <00:42:18.115>had <00:42:18.243>fun <00:42:18.370>too. <00:42:18.497>So <00:42:18.625>definitely.

999
00:42:21.045 --> 00:42:24.045
<00:42:21.045>I <00:42:21.245>hope <00:42:21.445>to <00:42:21.645>see <00:42:21.845>you <00:42:22.045>soon. <00:42:22.245>Thanks <00:42:22.445>everyone.