WEBVTT

1
00:00:01.955 --> 00:00:03.765
<00:00:01.955>Welcome <00:00:02.235>to <00:00:02.515>Now <00:00:02.795>Coffee <00:00:03.075>with <00:00:03.355>Developers.

2
00:00:03.905 --> 00:00:06.765
<00:00:03.905>I'm <00:00:04.060>here <00:00:04.216>with <00:00:04.371>Eric <00:00:04.527>Eng, <00:00:04.682>who <00:00:04.838>wrote <00:00:04.993>an <00:00:05.149>interesting <00:00:05.305>article

3
00:00:06.815 --> 00:00:09.965
<00:00:06.815>where <00:00:06.990>we <00:00:07.165>compared, <00:00:07.340>uh, <00:00:07.515>chat <00:00:07.690>GPT <00:00:07.865>and <00:00:08.040>Google <00:00:08.215>results,

4
00:00:10.505 --> 00:00:11.645
<00:00:10.505>and <00:00:10.710>that's <00:00:10.915>what <00:00:11.120>we're <00:00:11.325>gonna <00:00:11.530>cover.

5
00:00:11.825 --> 00:00:13.725
<00:00:11.825>But <00:00:12.058>also <00:00:12.291>the <00:00:12.524>general <00:00:12.758>idea <00:00:12.991>of <00:00:13.225>what,

6
00:00:13.905 --> 00:00:15.365
<00:00:13.905>how <00:00:14.167>the <00:00:14.430>search <00:00:14.693>market <00:00:14.956>is <00:00:15.219>changing,

7
00:00:15.825 --> 00:00:17.565
<00:00:15.825>how <00:00:16.105>the <00:00:16.384>indexing <00:00:16.665>market <00:00:16.945>is <00:00:17.224>changing.

8
00:00:17.985 --> 00:00:20.405
<00:00:17.985>But <00:00:18.160>first <00:00:18.335>of <00:00:18.509>all, <00:00:18.685>like <00:00:18.860>what <00:00:19.035>makes <00:00:19.210>you <00:00:19.384>an

9
00:00:20.405 --> 00:00:21.445
<00:00:20.405>expert <00:00:20.717>in <00:00:21.029>this <00:00:21.341>space?

10
00:00:21.585 --> 00:00:24.165
<00:00:21.585>How <00:00:21.725>do <00:00:21.865>you, <00:00:22.005>how <00:00:22.145>have <00:00:22.285>you <00:00:22.425>worked <00:00:22.565>on <00:00:22.705>this, <00:00:22.845>uh, <00:00:22.985>kind

11
00:00:24.165 --> 00:00:25.765
<00:00:24.165>of <00:00:24.515>environment <00:00:24.865>in <00:00:25.215>the <00:00:25.564>past?

12
00:00:26.905 --> 00:00:29.445
<00:00:26.905>So, <00:00:27.105>um, <00:00:27.305>from <00:00:27.505>the <00:00:27.705>SBO <00:00:27.905>side <00:00:28.105>of <00:00:28.305>things,

13
00:00:29.595 --> 00:00:33.085
<00:00:29.595>I've <00:00:29.750>been <00:00:29.906>involved <00:00:30.061>in <00:00:30.217>SEO <00:00:30.372>for, <00:00:30.528>you <00:00:30.683>know, <00:00:30.839>25 <00:00:30.994>years.

14
00:00:33.745 --> 00:00:36.245
<00:00:33.745>Uh, <00:00:33.919>wrote <00:00:34.095>the <00:00:34.269>book <00:00:34.445>called <00:00:34.620>The <00:00:34.794>Art <00:00:34.970>of <00:00:35.144>seo,

15
00:00:36.245 --> 00:00:40.205
<00:00:36.245>or <00:00:36.372>co-wrote <00:00:36.499>the <00:00:36.626>book <00:00:36.754>called <00:00:36.881>The <00:00:37.008>Art <00:00:37.135>of <00:00:37.263>SEO, <00:00:37.390>founded <00:00:37.517>a, <00:00:37.644>um,

16
00:00:40.345 --> 00:00:42.805
<00:00:40.345>one <00:00:40.500>of <00:00:40.656>the <00:00:40.811>more <00:00:40.967>well <00:00:41.122>known <00:00:41.278>agencies <00:00:41.433>in <00:00:41.589>its <00:00:41.745>time,

17
00:00:42.865 --> 00:00:44.405
<00:00:42.865>and <00:00:43.211>sold <00:00:43.558>that <00:00:43.904>in <00:00:44.251>2018,

18
00:00:45.345 --> 00:00:47.405
<00:00:45.345>an <00:00:45.625>agency <00:00:45.905>called <00:00:46.185>Stone <00:00:46.464>Temple <00:00:46.745>Consulting.

19
00:00:47.915 --> 00:00:49.245
<00:00:47.915>We'd <00:00:48.154>grown <00:00:48.393>it <00:00:48.633>to <00:00:48.872>70 <00:00:49.111>people

20
00:00:49.265 --> 00:00:51.045
<00:00:49.265>and <00:00:49.465>worked <00:00:49.665>with <00:00:49.865>many <00:00:50.065>of <00:00:50.265>the <00:00:50.465>largest <00:00:50.665>brands.

21
00:00:51.465 --> 00:00:54.845
<00:00:51.465>Um, <00:00:51.640>and <00:00:51.815>so <00:00:51.990>I, <00:00:52.165>I <00:00:52.340>have <00:00:52.515>a <00:00:52.690>technical <00:00:52.865>background.

22
00:00:55.065 --> 00:00:57.965
<00:00:55.065>I'm <00:00:55.265>not <00:00:55.464>currently <00:00:55.665>actively <00:00:55.864>coding, <00:00:56.065>by <00:00:56.265>the <00:00:56.464>way,

23
00:00:58.185 --> 00:01:02.925
<00:00:58.185>but <00:00:58.385>I <00:00:58.585>have <00:00:58.785>taken <00:00:58.985>classes <00:00:59.185>from <00:00:59.385>Jeffrey <00:00:59.585>Hinton

24
00:01:03.345 --> 00:01:08.045
<00:01:03.345>and, <00:01:03.578>uh, <00:01:03.811>Andrew <00:01:04.045>ing, <00:01:04.278>um, <00:01:04.511>um, <00:01:04.745>both

25
00:01:08.105 --> 00:01:11.325
<00:01:08.105>who <00:01:08.260>are <00:01:08.416>very, <00:01:08.571>very <00:01:08.727>well <00:01:08.882>known <00:01:09.038>in, <00:01:09.193>uh, <00:01:09.349>AI <00:01:09.505>circles.

26
00:01:11.665 --> 00:01:15.485
<00:01:11.664>And <00:01:11.820>during <00:01:11.976>those <00:01:12.131>classes, <00:01:12.287>I <00:01:12.442>actually <00:01:12.598>learned <00:01:12.753>how <00:01:12.909>to <00:01:13.065>write,

27
00:01:16.065 --> 00:01:18.685
<00:01:16.065>you <00:01:16.220>know, <00:01:16.376>some <00:01:16.531>of <00:01:16.687>the <00:01:16.842>simpler <00:01:16.998>forms <00:01:17.153>of <00:01:17.309>AI <00:01:17.465>algorithms.

28
00:01:18.685 --> 00:01:21.605
<00:01:18.685>So <00:01:18.918>I <00:01:19.151>actually <00:01:19.385>have <00:01:19.618>an <00:01:19.851>insight <00:01:20.085>into

29
00:01:21.905 --> 00:01:24.605
<00:01:21.905>how <00:01:22.105>neural <00:01:22.305>networks <00:01:22.505>are <00:01:22.705>structured, <00:01:22.905>how <00:01:23.105>they <00:01:23.305>work,

30
00:01:25.025 --> 00:01:28.685
<00:01:25.025>and <00:01:25.180>I've <00:01:25.336>created <00:01:25.491>a <00:01:25.647>few <00:01:25.802>very <00:01:25.958>simple <00:01:26.113>versions <00:01:26.269>of <00:01:26.425>that.

31
00:01:29.385 --> 00:01:32.405
<00:01:29.385>So <00:01:29.560>what's <00:01:29.735>interesting <00:01:29.910>about <00:01:30.085>that <00:01:30.260>is <00:01:30.435>when <00:01:30.610>you <00:01:30.785>understand

32
00:01:33.345 --> 00:01:35.245
<00:01:33.345>the <00:01:33.625>basic <00:01:33.905>math <00:01:34.185>that's <00:01:34.465>going <00:01:34.745>on

33
00:01:35.265 --> 00:01:38.365
<00:01:35.265>and <00:01:35.420>being <00:01:35.576>used <00:01:35.731>at <00:01:35.887>the <00:01:36.042>root <00:01:36.198>of <00:01:36.353>large <00:01:36.509>language <00:01:36.665>models,

34
00:01:39.025 --> 00:01:40.845
<00:01:39.025>it <00:01:39.258>gives <00:01:39.491>you <00:01:39.725>a <00:01:39.958>different <00:01:40.191>perception <00:01:40.425>of

35
00:01:41.595 --> 00:01:44.685
<00:01:41.595>what <00:01:41.770>might <00:01:41.945>be <00:01:42.120>possible <00:01:42.295>and <00:01:42.470>what's <00:01:42.645>silly <00:01:42.820>to <00:01:42.995>consider.

36
00:01:45.685 --> 00:01:47.535
<00:01:45.685>It's <00:01:45.885>an <00:01:46.085>interesting <00:01:46.285>thing <00:01:46.485>how <00:01:46.685>like <00:01:46.885>machine <00:01:47.085>learning

37
00:01:47.675 --> 00:01:50.895
<00:01:47.675>and <00:01:47.830>like, <00:01:47.986>uh, <00:01:48.141>uh, <00:01:48.297>deep <00:01:48.452>data <00:01:48.608>analysis <00:01:48.763>has <00:01:48.919>been <00:01:49.075>around

38
00:01:50.895 --> 00:01:53.415
<00:01:50.895>for <00:01:51.050>such <00:01:51.206>a <00:01:51.361>long <00:01:51.517>time, <00:01:51.672>and <00:01:51.828>now <00:01:51.983>everything <00:01:52.139>gets <00:01:52.295>clobbered

39
00:01:53.415 --> 00:01:56.135
<00:01:53.414>with <00:01:53.615>this <00:01:53.815>AI <00:01:54.014>as <00:01:54.214>a <00:01:54.414>hype, <00:01:54.615>uh, <00:01:54.815>title.

40
00:01:56.285 --> 00:01:58.855
<00:01:56.285>Like <00:01:56.485>everything <00:01:56.685>gets <00:01:56.884>put <00:01:57.085>into <00:01:57.285>the <00:01:57.485>same <00:01:57.685>box

41
00:01:58.875 --> 00:02:00.215
<00:01:58.875>and <00:01:59.116>say <00:01:59.357>like, <00:01:59.598>it's <00:01:59.839>just <00:02:00.081>magic.

42
00:02:00.395 --> 00:02:02.935
<00:02:00.395>So <00:02:00.628>it's <00:02:00.861>just <00:02:01.095>trusted. <00:02:01.328>But <00:02:01.561>your <00:02:01.795>article

43
00:02:03.085 --> 00:02:06.135
<00:02:03.085>that <00:02:03.225>we <00:02:03.365>are <00:02:03.505>gonna <00:02:03.645>link <00:02:03.785>here <00:02:03.925>as <00:02:04.065>well <00:02:04.205>is <00:02:04.345>basically, <00:02:04.485>you,

44
00:02:06.155 --> 00:02:07.455
<00:02:06.155>you <00:02:06.447>did <00:02:06.740>a <00:02:07.032>deep <00:02:07.325>analysis.

45
00:02:07.455 --> 00:02:09.015
<00:02:07.455>It's <00:02:07.688>really <00:02:07.921>long <00:02:08.155>read, <00:02:08.388>but <00:02:08.621>it's <00:02:08.854>great

46
00:02:09.035 --> 00:02:11.695
<00:02:09.035>to <00:02:09.234>actually <00:02:09.435>see <00:02:09.634>somebody <00:02:09.835>going <00:02:10.035>into <00:02:10.234>these <00:02:10.435>details

47
00:02:12.145 --> 00:02:16.495
<00:02:12.145>where <00:02:12.285>you <00:02:12.425>compared <00:02:12.565>a <00:02:12.705>chat <00:02:12.845>GPT, <00:02:12.985>uh, <00:02:13.125>free <00:02:13.265>chat, <00:02:13.405>GPT <00:02:13.545>tier,

48
00:02:16.595 --> 00:02:19.255
<00:02:16.595>not <00:02:16.795>the, <00:02:16.995>the <00:02:17.195>paid <00:02:17.395>one <00:02:17.595>with <00:02:17.795>Google <00:02:17.995>results.

49
00:02:20.265 --> 00:02:22.685
<00:02:20.265>So <00:02:20.440>what <00:02:20.614>were <00:02:20.790>your <00:02:20.964>main <00:02:21.140>findings <00:02:21.315>where, <00:02:21.489>where <00:02:21.665>you,

50
00:02:22.685 --> 00:02:25.245
<00:02:22.685>where <00:02:22.840>you <00:02:22.996>say <00:02:23.151>one <00:02:23.307>is <00:02:23.462>better <00:02:23.618>than <00:02:23.773>the <00:02:23.929>other, <00:02:24.085>what

51
00:02:25.245 --> 00:02:26.925
<00:02:25.245>what <00:02:25.478>would <00:02:25.711>be <00:02:25.945>the, <00:02:26.178>the <00:02:26.411>elevator <00:02:26.645>pitch

52
00:02:26.985 --> 00:02:28.125
<00:02:26.985>for <00:02:27.190>each <00:02:27.395>of <00:02:27.600>them <00:02:27.805>for <00:02:28.011>you?

53
00:02:29.625 --> 00:02:33.645
<00:02:29.625>So, <00:02:29.825>um, <00:02:30.025>yeah, <00:02:30.225>I <00:02:30.425>think, <00:02:30.625>uh, <00:02:30.825>in <00:02:31.025>terms

54
00:02:33.645 --> 00:02:36.085
<00:02:33.645>of <00:02:33.845>the <00:02:34.045>main <00:02:34.245>findings, <00:02:34.445>I <00:02:34.645>found <00:02:34.845>that, <00:02:35.045>uh,

55
00:02:36.515 --> 00:02:39.685
<00:02:36.515>there's <00:02:36.714>certain <00:02:36.915>classes <00:02:37.114>of <00:02:37.315>queries <00:02:37.515>where, <00:02:37.714>where <00:02:37.915>Google

56
00:02:40.865 --> 00:02:43.725
<00:02:40.865>is <00:02:41.098>not <00:02:41.331>any <00:02:41.565>under <00:02:41.798>any <00:02:42.031>immediate <00:02:42.265>threat.

57
00:02:43.785 --> 00:02:47.045
<00:02:43.785>And, <00:02:43.940>uh, <00:02:44.096>I <00:02:44.251>would <00:02:44.407>say <00:02:44.562>things <00:02:44.718>like <00:02:44.873>commercial <00:02:45.029>queries, <00:02:45.185>uh,

58
00:02:47.255 --> 00:02:51.765
<00:02:47.255>local <00:02:47.535>queries, <00:02:47.815>navigational <00:02:48.095>queries, <00:02:48.375>um, <00:02:48.655>uh,

59
00:02:51.765 --> 00:02:55.565
<00:02:51.765>those <00:02:51.964>are <00:02:52.165>things <00:02:52.364>that <00:02:52.565>Google's <00:02:52.765>leveraging <00:02:52.964>other <00:02:53.165>kinds

60
00:02:55.565 --> 00:02:58.845
<00:02:55.565>of <00:02:55.720>databases <00:02:55.876>that <00:02:56.031>you <00:02:56.187>don't <00:02:56.342>find <00:02:56.498>by <00:02:56.653>crawling <00:02:56.809>the <00:02:56.965>web.

61
00:02:59.465 --> 00:03:02.445
<00:02:59.465>Uh, <00:02:59.815>and, <00:03:00.165>um, <00:03:00.515>and, <00:03:00.865>and,

62
00:03:02.465 --> 00:03:04.565
<00:03:02.465>and <00:03:02.665>so <00:03:02.865>I <00:03:03.065>shared <00:03:03.265>a <00:03:03.465>bunch <00:03:03.665>of <00:03:03.865>results.

63
00:03:04.745 --> 00:03:09.565
<00:03:04.745>So <00:03:04.900>for <00:03:05.056>example, <00:03:05.211>I <00:03:05.367>shared <00:03:05.522>a <00:03:05.678>result <00:03:05.833>of, <00:03:05.989>um, <00:03:06.145>uh,

64
00:03:09.625 --> 00:03:12.725
<00:03:09.625>asking <00:03:09.858>for <00:03:10.091>directions <00:03:10.325>to <00:03:10.558>Whole <00:03:10.791>Foods <00:03:11.025>from

65
00:03:12.895 --> 00:03:15.645
<00:03:12.895>where <00:03:13.095>I <00:03:13.295>was <00:03:13.495>sitting <00:03:13.695>here <00:03:13.895>in <00:03:14.095>Southborough, <00:03:14.295>Massachusetts.

66
00:03:16.285 --> 00:03:20.955
<00:03:16.285>I <00:03:16.440>know <00:03:16.596>the <00:03:16.751>wake <00:03:16.907>quite <00:03:17.062>well <00:03:17.218>actually, <00:03:17.373>but, <00:03:17.529>um, <00:03:17.685>uh,

67
00:03:21.215 --> 00:03:25.155
<00:03:21.215>and, <00:03:21.370>you <00:03:21.526>know, <00:03:21.681>Google <00:03:21.837>provided <00:03:21.992>a, <00:03:22.148>a, <00:03:22.303>a <00:03:22.459>fabulous <00:03:22.615>result.

68
00:03:25.175 --> 00:03:27.075
<00:03:25.175>It <00:03:25.455>knew <00:03:25.735>where <00:03:26.015>I <00:03:26.295>was. <00:03:26.575>Um,

69
00:03:27.775 --> 00:03:30.795
<00:03:27.775>and, <00:03:27.975>uh, <00:03:28.175>it <00:03:28.375>was, <00:03:28.575>uh, <00:03:28.775>you <00:03:28.975>know, <00:03:29.175>point

70
00:03:30.795 --> 00:03:31.835
<00:03:30.795>to <00:03:31.029>point <00:03:31.263>really <00:03:31.497>well <00:03:31.731>done.

71
00:03:32.095 --> 00:03:34.075
<00:03:32.095>Now, <00:03:32.375>Google <00:03:32.655>has <00:03:32.935>an <00:03:33.215>advantage <00:03:33.495>there,

72
00:03:34.215 --> 00:03:35.475
<00:03:34.215>and <00:03:34.404>this <00:03:34.593>is <00:03:34.782>an <00:03:34.971>example <00:03:35.160>of <00:03:35.349>one

73
00:03:35.475 --> 00:03:37.195
<00:03:35.475>of <00:03:35.708>those <00:03:35.941>database <00:03:36.174>things <00:03:36.408>I'm <00:03:36.641>talking <00:03:36.875>about.

74
00:03:38.135 --> 00:03:41.875
<00:03:38.135>Um, <00:03:38.274>you <00:03:38.415>know, <00:03:38.554>uh, <00:03:38.695>I <00:03:38.834>use <00:03:38.975>Google <00:03:39.114>Maps <00:03:39.255>on <00:03:39.394>this <00:03:39.535>device.

75
00:03:42.575 --> 00:03:44.315
<00:03:42.575>It <00:03:42.924>knows <00:03:43.274>where <00:03:43.625>I'm, <00:03:43.975>uh,

76
00:03:45.215 --> 00:03:48.755
<00:03:45.215>and <00:03:45.390>correspondingly <00:03:45.565>Bing <00:03:45.740>doesn't <00:03:45.915>have <00:03:46.090>that <00:03:46.265>level <00:03:46.440>of <00:03:46.615>data.

77
00:03:49.295 --> 00:03:51.995
<00:03:49.295>So <00:03:49.470>the <00:03:49.645>chat <00:03:49.820>GPT <00:03:49.995>thing, <00:03:50.170>it <00:03:50.345>was <00:03:50.520>quite <00:03:50.695>interesting.

78
00:03:52.615 --> 00:03:55.395
<00:03:52.615>It <00:03:52.815>assumed <00:03:53.015>I <00:03:53.215>was <00:03:53.415>in <00:03:53.615>the <00:03:53.815>neighboring <00:03:54.015>town

79
00:03:55.395 --> 00:03:59.835
<00:03:55.395>because <00:03:55.550>it <00:03:55.706>couldn't, <00:03:55.861>you <00:03:56.017>know, <00:03:56.172>locate <00:03:56.328>me <00:03:56.483>quite <00:03:56.639>so <00:03:56.795>precisely.

80
00:04:00.575 --> 00:04:03.155
<00:04:00.575>And <00:04:00.714>then <00:04:00.855>it <00:04:00.994>gave <00:04:01.135>a <00:04:01.274>set <00:04:01.415>of <00:04:01.554>directions <00:04:01.695>that <00:04:01.834>were <00:04:01.975>nonsensical,

81
00:04:03.775 --> 00:04:06.835
<00:04:03.775>uh, <00:04:03.950>saying <00:04:04.125>that <00:04:04.300>I <00:04:04.475>should <00:04:04.650>follow <00:04:04.825>Route <00:04:05.000>20 <00:04:05.175>East,

82
00:04:07.285 --> 00:04:08.595
<00:04:07.285>which <00:04:07.520>will <00:04:07.756>mean <00:04:07.992>nothing <00:04:08.228>to <00:04:08.464>any

83
00:04:08.595 --> 00:04:09.635
<00:04:08.595>of <00:04:08.782>you <00:04:08.969>unless <00:04:09.156>you're <00:04:09.343>from <00:04:09.531>Massachusetts.

84
00:04:10.215 --> 00:04:13.555
<00:04:10.215>But <00:04:10.355>that's <00:04:10.495>beside <00:04:10.635>the <00:04:10.775>point <00:04:10.915>until <00:04:11.055>you <00:04:11.195>get <00:04:11.335>to <00:04:11.475>Route <00:04:11.615>90

85
00:04:14.135 --> 00:04:16.035
<00:04:14.135>and <00:04:14.290>take <00:04:14.446>the <00:04:14.601>exit <00:04:14.757>there <00:04:14.912>to <00:04:15.068>get <00:04:15.223>on <00:04:15.379>Route <00:04:15.535>90.

86
00:04:16.415 --> 00:04:19.235
<00:04:16.415>The <00:04:16.555>problem <00:04:16.695>is <00:04:16.835>Route <00:04:16.975>20 <00:04:17.115>East <00:04:17.255>doesn't <00:04:17.395>run <00:04:17.535>into <00:04:17.675>Route <00:04:17.815>90.

87
00:04:20.175 --> 00:04:22.355
<00:04:20.175>So <00:04:20.375>this <00:04:20.575>is <00:04:20.775>an <00:04:20.975>example <00:04:21.175>of <00:04:21.375>an <00:04:21.575>error,

88
00:04:22.455 --> 00:04:25.275
<00:04:22.455>but <00:04:22.582>that <00:04:22.709>those <00:04:22.836>a <00:04:22.964>very <00:04:23.091>detailed <00:04:23.218>answer <00:04:23.345>to <00:04:23.473>one <00:04:23.600>part <00:04:23.727>of <00:04:23.854>it.

89
00:04:25.295 --> 00:04:26.675
<00:04:25.295>Let <00:04:25.502>me <00:04:25.709>give <00:04:25.916>a <00:04:26.123>higher <00:04:26.330>level <00:04:26.537>answer

90
00:04:26.695 --> 00:04:27.915
<00:04:26.695>to <00:04:26.914>the <00:04:27.134>rest <00:04:27.353>of <00:04:27.573>your <00:04:27.793>question.

91
00:04:28.575 --> 00:04:33.515
<00:04:28.575>Um, <00:04:28.750>Chris, <00:04:28.925>which, <00:04:29.099>um, <00:04:29.275>on <00:04:29.450>the <00:04:29.625>Chachi <00:04:29.800>PT <00:04:29.974>side

92
00:04:33.515 --> 00:04:36.595
<00:04:33.515>of <00:04:33.690>things, <00:04:33.865>um, <00:04:34.039>there <00:04:34.215>are <00:04:34.390>definitely <00:04:34.565>classes <00:04:34.740>of <00:04:34.914>queries

93
00:04:36.595 --> 00:04:37.675
<00:04:36.595>where <00:04:36.789>it <00:04:36.983>does <00:04:37.178>a <00:04:37.372>lot <00:04:37.567>better.

94
00:04:38.415 --> 00:04:41.395
<00:04:38.415>Um, <00:04:38.615>you <00:04:38.815>know, <00:04:39.015>certainly <00:04:39.215>anything <00:04:39.415>involving <00:04:39.615>any <00:04:39.815>kind

95
00:04:41.395 --> 00:04:44.875
<00:04:41.395>of <00:04:41.594>content <00:04:41.794>analysis, <00:04:41.995>uh, <00:04:42.195>those <00:04:42.395>kinds <00:04:42.594>of <00:04:42.794>queries.

96
00:04:45.465 --> 00:04:47.795
<00:04:45.465>This, <00:04:45.640>it's <00:04:45.815>the <00:04:45.990>only <00:04:46.165>game <00:04:46.340>in <00:04:46.515>town <00:04:46.690>right <00:04:46.865>now.

97
00:04:48.175 --> 00:04:51.675
<00:04:48.175>Uh, <00:04:48.375>well <00:04:48.575>at <00:04:48.775>least <00:04:48.975>compared <00:04:49.175>to <00:04:49.375>Google <00:04:49.575>Gemini

98
00:04:51.675 --> 00:04:52.675
<00:04:51.675>as <00:04:51.975>a <00:04:52.275>standalone <00:04:52.575>tool.

99
00:04:52.675 --> 00:04:57.355
<00:04:52.675>We'll <00:04:52.782>try <00:04:52.890>to <00:04:52.998>do <00:04:53.105>it, <00:04:53.213>but <00:04:53.321>not <00:04:53.428>as <00:04:53.536>well <00:04:53.644>as <00:04:53.751>Chatt <00:04:53.859>PT <00:04:53.967>search <00:04:54.075>does.

100
00:04:58.135 --> 00:05:03.115
<00:04:58.135>Um, <00:04:58.414>so, <00:04:58.695>um, <00:04:58.974>that's <00:04:59.255>now <00:04:59.534>it's

101
00:05:03.635 --> 00:05:05.555
<00:05:03.635>a <00:05:03.914>flawed <00:05:04.195>sort <00:05:04.474>of <00:05:04.755>content <00:05:05.034>analysis,

102
00:05:05.555 --> 00:05:08.315
<00:05:05.555>and <00:05:05.710>you <00:05:05.866>need <00:05:06.021>to <00:05:06.177>treat <00:05:06.332>it <00:05:06.488>like <00:05:06.643>a <00:05:06.799>brainstorming <00:05:06.955>partner,

103
00:05:08.535 --> 00:05:10.835
<00:05:08.535>but <00:05:08.710>it <00:05:08.885>does <00:05:09.060>it <00:05:09.235>way <00:05:09.410>better <00:05:09.585>than <00:05:09.760>Google <00:05:09.935>does,

104
00:05:11.425 --> 00:05:13.755
<00:05:11.425>does <00:05:11.775>better <00:05:12.125>on <00:05:12.475>disambiguation <00:05:12.825>queries.

105
00:05:13.905 --> 00:05:17.075
<00:05:13.905>Also. <00:05:14.060>It's <00:05:14.216>another <00:05:14.371>area <00:05:14.527>I <00:05:14.682>found <00:05:14.838>of <00:05:14.993>interest <00:05:15.149>that, <00:05:15.304>um,

106
00:05:17.575 --> 00:05:18.955
<00:05:17.575>it <00:05:17.823>did <00:05:18.071>a <00:05:18.320>better <00:05:18.568>job <00:05:18.817>of.

107
00:05:20.075 --> 00:05:22.615
<00:05:20.075>So <00:05:20.250>disambiguation <00:05:20.425>you <00:05:20.599>mean <00:05:20.775>like, <00:05:20.950>when <00:05:21.125>you <00:05:21.300>go <00:05:21.474>to

108
00:05:22.795 --> 00:05:24.695
<00:05:22.795>to <00:05:23.028>Wikipedia, <00:05:23.261>you <00:05:23.495>get <00:05:23.728>like <00:05:23.961>a <00:05:24.195>term

109
00:05:24.695 --> 00:05:25.935
<00:05:24.695>that <00:05:24.918>could <00:05:25.141>be <00:05:25.364>12 <00:05:25.587>different <00:05:25.811>things

110
00:05:25.995 --> 00:05:28.175
<00:05:25.995>and <00:05:26.228>it <00:05:26.461>has <00:05:26.695>a <00:05:26.928>disambiguation <00:05:27.161>page <00:05:27.395>there.

111
00:05:28.595 --> 00:05:32.495
<00:05:28.595>So <00:05:28.750>Jet <00:05:28.906>GPT <00:05:29.061>would <00:05:29.217>pick <00:05:29.372>the <00:05:29.528>right <00:05:29.683>disambiguation <00:05:29.839>compared <00:05:29.995>to

112
00:05:32.495 --> 00:05:33.695
<00:05:32.495>what <00:05:32.765>you <00:05:33.035>asked <00:05:33.305>it <00:05:33.575>before?

113
00:05:34.395 --> 00:05:36.415
<00:05:34.395>Or <00:05:34.522>how <00:05:34.649>do <00:05:34.776>you <00:05:34.904>mean <00:05:35.031>it <00:05:35.158>does <00:05:35.285>a <00:05:35.413>better <00:05:35.540>job <00:05:35.667>in <00:05:35.794>that?

114
00:05:36.955 --> 00:05:39.655
<00:05:36.955>And <00:05:37.094>by <00:05:37.234>the <00:05:37.375>way, <00:05:37.515>the <00:05:37.655>answer <00:05:37.794>to <00:05:37.935>that <00:05:38.075>question, <00:05:38.215>of <00:05:38.354>course,

115
00:05:39.675 --> 00:05:43.775
<00:05:39.675>rooted <00:05:39.830>in <00:05:39.986>some <00:05:40.141>degree, <00:05:40.297>inevitably <00:05:40.452>in <00:05:40.608>some <00:05:40.763>level <00:05:40.919>of <00:05:41.075>bias,

116
00:05:43.955 --> 00:05:47.235
<00:05:43.955>by <00:05:44.110>which, <00:05:44.266>I <00:05:44.421>mean, <00:05:44.577>I <00:05:44.732>had <00:05:44.888>a <00:05:45.043>type <00:05:45.199>of <00:05:45.354>answer

117
00:05:47.235 --> 00:05:48.475
<00:05:47.235>that <00:05:47.458>I <00:05:47.681>felt <00:05:47.904>that <00:05:48.127>was <00:05:48.351>better.

118
00:05:49.555 --> 00:05:51.415
<00:05:49.555>Um, <00:05:49.755>and <00:05:49.955>let <00:05:50.155>me <00:05:50.355>give <00:05:50.555>you <00:05:50.755>an <00:05:50.955>example.

119
00:05:51.615 --> 00:05:55.215
<00:05:51.615>I <00:05:51.815>could <00:05:52.015>ask, <00:05:52.215>um, <00:05:52.415>both <00:05:52.615>chat <00:05:52.815>GBT <00:05:53.015>search

120
00:05:55.555 --> 00:05:58.805
<00:05:55.555>and, <00:05:55.788>uh, <00:05:56.021>Google <00:05:56.255>what <00:05:56.488>is <00:05:56.721>a <00:05:56.955>Jaguar.

121
00:05:59.465 --> 00:06:02.685
<00:05:59.465>Um, <00:05:59.605>and <00:05:59.745>the <00:05:59.885>entire <00:06:00.025>Google <00:06:00.165>page <00:06:00.305>will <00:06:00.445>be <00:06:00.585>about <00:06:00.725>the <00:06:00.865>animal.

122
00:06:04.125 --> 00:06:08.495
<00:06:04.125>Okay. <00:06:04.280>Uh, <00:06:04.436>whereas <00:06:04.591>the <00:06:04.747>chat <00:06:04.902>GPT <00:06:05.058>page <00:06:05.213>will <00:06:05.369>note <00:06:05.525>that,

123
00:06:08.955 --> 00:06:12.335
<00:06:08.955>uh, <00:06:09.155>there's <00:06:09.354>an <00:06:09.555>animal, <00:06:09.755>there's <00:06:09.955>a <00:06:10.155>car, <00:06:10.354>uh,

124
00:06:12.335 --> 00:06:13.575
<00:06:12.335>you <00:06:12.558>know, <00:06:12.781>a <00:06:13.004>few <00:06:13.227>other <00:06:13.450>things.

125
00:06:13.715 --> 00:06:15.535
<00:06:13.715>So <00:06:13.948>for <00:06:14.181>example, <00:06:14.414>there's <00:06:14.648>an <00:06:14.881>operating <00:06:15.114>system,

126
00:06:15.535 --> 00:06:18.055
<00:06:15.535>there's <00:06:15.768>a <00:06:16.001>guitar, <00:06:16.235>and <00:06:16.468>then <00:06:16.701>there's <00:06:16.935>a,

127
00:06:18.555 --> 00:06:21.175
<00:06:18.555>an <00:06:18.788>American <00:06:19.021>football <00:06:19.255>team <00:06:19.488>called <00:06:19.721>the <00:06:19.955>Jaguars.

128
00:06:21.755 --> 00:06:23.735
<00:06:21.755>Um, <00:06:22.105>and, <00:06:22.455>you <00:06:22.805>know, <00:06:23.155>a,

129
00:06:23.895 --> 00:06:25.495
<00:06:23.895>a <00:06:24.094>human <00:06:24.294>might <00:06:24.495>mean <00:06:24.695>any <00:06:24.895>of <00:06:25.094>those <00:06:25.294>things.

130
00:06:26.455 --> 00:06:29.215
<00:06:26.455>I <00:06:26.688>believe <00:06:26.921>that <00:06:27.155>the <00:06:27.388>Google <00:06:27.621>result <00:06:27.854>is

131
00:06:30.695 --> 00:06:33.625
<00:06:30.695>operating <00:06:30.850>more <00:06:31.006>on <00:06:31.161>the <00:06:31.317>as <00:06:31.472>assumption <00:06:31.628>that <00:06:31.783>the <00:06:31.939>great <00:06:32.094>majority

132
00:06:33.625 --> 00:06:34.865
<00:06:33.625>of <00:06:33.904>people <00:06:34.183>mean <00:06:34.462>the <00:06:34.741>animal.

133
00:06:34.925 --> 00:06:36.745
<00:06:34.925>So <00:06:35.205>we'll <00:06:35.485>just <00:06:35.765>answer <00:06:36.045>the <00:06:36.325>animal.

134
00:06:37.345 --> 00:06:38.705
<00:06:37.345>I, <00:06:37.651>I <00:06:37.957>had <00:06:38.263>a <00:06:38.568>preference

135
00:06:38.885 --> 00:06:42.625
<00:06:38.885>and <00:06:39.040>hence <00:06:39.196>I <00:06:39.351>was <00:06:39.507>scored <00:06:39.662>chat, <00:06:39.818>GPT <00:06:39.973>search <00:06:40.129>higher, <00:06:40.284>um,

136
00:06:43.125 --> 00:06:45.265
<00:06:43.125>to <00:06:43.325>explain <00:06:43.525>what <00:06:43.725>all <00:06:43.925>the <00:06:44.125>various <00:06:44.325>options <00:06:44.525>are

137
00:06:45.265 --> 00:06:47.865
<00:06:45.265>and <00:06:45.420>give <00:06:45.576>people <00:06:45.731>ways <00:06:45.887>to <00:06:46.042>go <00:06:46.198>into <00:06:46.353>the <00:06:46.509>various <00:06:46.664>details.

138
00:06:48.725 --> 00:06:51.105
<00:06:48.725>I'm <00:06:48.900>actually <00:06:49.075>surprised <00:06:49.250>that <00:06:49.425>Google <00:06:49.600>does <00:06:49.775>the, <00:06:49.950>does <00:06:50.125>the,

139
00:06:51.165 --> 00:06:52.225
<00:06:51.165>the <00:06:51.403>main <00:06:51.642>thing, <00:06:51.880>the <00:06:52.119>animal,

140
00:06:52.225 --> 00:06:54.225
<00:06:52.225>because <00:06:52.458>I <00:06:52.691>would've <00:06:52.925>thought <00:06:53.158>that <00:06:53.391>the <00:06:53.625>brand

141
00:06:54.565 --> 00:06:56.705
<00:06:54.565>who <00:06:54.765>somebody <00:06:54.965>would've <00:06:55.165>paid <00:06:55.365>for <00:06:55.565>actually <00:06:55.765>getting <00:06:55.965>this

142
00:06:56.705 --> 00:06:58.105
<00:06:56.705>as <00:06:56.957>the <00:06:57.209>most <00:06:57.461>result <00:06:57.713>in <00:06:57.965>there.

143
00:06:58.745 --> 00:07:01.105
<00:06:58.745>'cause <00:06:58.872>that's <00:06:58.999>one <00:06:59.126>of <00:06:59.254>the <00:06:59.381>things <00:06:59.508>that <00:06:59.635>drives <00:06:59.763>me <00:06:59.890>nuts <00:07:00.017>the <00:07:00.145>most

144
00:07:01.195 --> 00:07:04.265
<00:07:01.195>about <00:07:01.335>like, <00:07:01.474>uh, <00:07:01.615>uh, <00:07:01.755>I <00:07:01.895>mean, <00:07:02.034>I've, <00:07:02.175>I've <00:07:02.315>always <00:07:02.455>used <00:07:02.594>search.

145
00:07:04.465 --> 00:07:06.305
<00:07:04.465>I, <00:07:04.664>I <00:07:04.864>worked <00:07:05.065>on <00:07:05.265>a <00:07:05.465>few <00:07:05.664>search <00:07:05.864>products,

146
00:07:06.605 --> 00:07:09.025
<00:07:06.605>but <00:07:06.732>it, <00:07:06.859>it <00:07:06.986>drove <00:07:07.114>me <00:07:07.241>nuts <00:07:07.368>that <00:07:07.495>like, <00:07:07.623>when, <00:07:07.750>when <00:07:07.877>I <00:07:08.005>look

147
00:07:09.025 --> 00:07:13.785
<00:07:09.025>for <00:07:09.164>something <00:07:09.304>right <00:07:09.445>now, <00:07:09.585>I <00:07:09.724>get <00:07:09.864>like, <00:07:10.005>not <00:07:10.145>the <00:07:10.284>right <00:07:10.424>content,

148
00:07:14.045 --> 00:07:16.345
<00:07:14.045>but <00:07:14.245>I <00:07:14.445>get <00:07:14.645>content <00:07:14.845>that <00:07:15.045>somebody <00:07:15.245>paid <00:07:15.445>for.

149
00:07:16.655 --> 00:07:19.225
<00:07:16.655>Like, <00:07:16.782>for <00:07:16.909>example, <00:07:17.036>I <00:07:17.164>have <00:07:17.291>a <00:07:17.418>shirt <00:07:17.545>that <00:07:17.673>has <00:07:17.800>a <00:07:17.927>certain <00:07:18.054>name

150
00:07:19.725 --> 00:07:22.625
<00:07:19.725>and <00:07:19.852>I, <00:07:19.979>and <00:07:20.106>a <00:07:20.234>certain <00:07:20.361>brand, <00:07:20.488>and <00:07:20.615>I <00:07:20.743>look <00:07:20.870>for <00:07:20.997>that <00:07:21.125>one,

151
00:07:22.625 --> 00:07:24.025
<00:07:22.625>and <00:07:22.835>I <00:07:23.045>go <00:07:23.255>to <00:07:23.465>Bing, <00:07:23.674>for <00:07:23.885>example,

152
00:07:24.125 --> 00:07:26.345
<00:07:24.125>and <00:07:24.280>it <00:07:24.436>gives <00:07:24.591>me <00:07:24.747>like <00:07:24.902>20 <00:07:25.058>different <00:07:25.213>brands <00:07:25.369>of <00:07:25.525>like,

153
00:07:26.345 --> 00:07:27.985
<00:07:26.345>that <00:07:26.500>are <00:07:26.656>similar <00:07:26.811>to <00:07:26.967>one <00:07:27.122>that <00:07:27.278>I <00:07:27.433>was <00:07:27.589>looking <00:07:27.745>for.

154
00:07:28.645 --> 00:07:31.345
<00:07:28.645>So <00:07:28.784>that's <00:07:28.924>something <00:07:29.065>I <00:07:29.205>would <00:07:29.344>expect <00:07:29.484>from <00:07:29.625>an <00:07:29.765>LLM <00:07:29.905>to <00:07:30.044>do.

155
00:07:31.345 --> 00:07:33.985
<00:07:31.345>But <00:07:31.485>I <00:07:31.625>see <00:07:31.765>search <00:07:31.905>engines <00:07:32.045>doing <00:07:32.185>the <00:07:32.325>same <00:07:32.465>thing <00:07:32.605>right <00:07:32.745>now.

156
00:07:33.985 --> 00:07:37.385
<00:07:33.985>Like <00:07:34.092>the <00:07:34.200>first, <00:07:34.308>I <00:07:34.415>mean, <00:07:34.523>a <00:07:34.631>few <00:07:34.738>years <00:07:34.846>ago <00:07:34.954>I <00:07:35.061>wrote <00:07:35.169>a <00:07:35.277>blog <00:07:35.385>post

157
00:07:37.385 --> 00:07:39.025
<00:07:37.385>that <00:07:37.618>the <00:07:37.851>web <00:07:38.085>starts <00:07:38.318>at <00:07:38.551>page <00:07:38.784>four

158
00:07:39.025 --> 00:07:42.705
<00:07:39.025>because <00:07:39.164>the <00:07:39.304>first <00:07:39.445>three <00:07:39.585>pages <00:07:39.724>are <00:07:39.864>paid <00:07:40.005>content <00:07:40.145>and, <00:07:40.284>uh, <00:07:40.424>uh,

159
00:07:42.705 --> 00:07:46.545
<00:07:42.705>and <00:07:42.860>like <00:07:43.016>SEO <00:07:43.171>optimized <00:07:43.327>content <00:07:43.482>rather <00:07:43.638>than <00:07:43.793>your <00:07:43.949>real <00:07:44.104>result.

160
00:07:47.205 --> 00:07:49.905
<00:07:47.205>Did, <00:07:47.380>did <00:07:47.555>you <00:07:47.729>find <00:07:47.905>with <00:07:48.080>the <00:07:48.255>more <00:07:48.430>generic <00:07:48.604>searches

161
00:07:49.975 --> 00:07:52.665
<00:07:49.975>that <00:07:50.130>you <00:07:50.286>did <00:07:50.441>that, <00:07:50.597>that, <00:07:50.752>uh, <00:07:50.908>Google <00:07:51.063>gives <00:07:51.219>you <00:07:51.375>like

162
00:07:52.695 --> 00:07:55.065
<00:07:52.695>what <00:07:52.870>you're <00:07:53.045>looking <00:07:53.219>for <00:07:53.395>or <00:07:53.570>a, <00:07:53.745>a <00:07:53.920>focused <00:07:54.094>thing?

163
00:07:55.365 --> 00:07:58.865
<00:07:55.365>Or <00:07:55.540>do <00:07:55.715>you <00:07:55.890>also <00:07:56.065>see <00:07:56.240>that, <00:07:56.415>um, <00:07:56.590>SEO <00:07:56.765>optimized

164
00:07:58.965 --> 00:08:00.385
<00:07:58.965>and <00:07:59.391>also <00:07:59.817>sold <00:08:00.243>content

165
00:08:00.445 --> 00:08:01.745
<00:08:00.445>and <00:08:00.835>ads <00:08:01.225>being <00:08:01.615>displayed,

166
00:08:02.025 --> 00:08:04.225
<00:08:02.025>watering <00:08:02.200>down <00:08:02.375>the <00:08:02.549>results <00:08:02.724>of <00:08:02.900>search <00:08:03.075>engines <00:08:03.250>as <00:08:03.424>well?

167
00:08:04.915 --> 00:08:08.645
<00:08:04.915>Well, <00:08:05.031>you <00:08:05.148>do <00:08:05.265>get, <00:08:05.381>um, <00:08:05.498>I <00:08:05.615>mean, <00:08:05.731>yes, <00:08:05.848>there's <00:08:05.965>a <00:08:06.081>lot <00:08:06.198>of <00:08:06.315>people

168
00:08:08.745 --> 00:08:11.765
<00:08:08.745>who <00:08:08.920>are <00:08:09.095>really <00:08:09.270>good <00:08:09.445>at <00:08:09.620>SEO <00:08:09.795>optimized <00:08:09.970>content, <00:08:10.145>and,

169
00:08:12.225 --> 00:08:16.925
<00:08:12.225>and <00:08:12.380>you <00:08:12.536>can, <00:08:12.691>um, <00:08:12.847>still <00:08:13.002>today <00:08:13.158>have <00:08:13.313>some <00:08:13.469>success, <00:08:13.625>um,

170
00:08:17.945 --> 00:08:20.925
<00:08:17.945>uh, <00:08:18.145>you <00:08:18.344>know, <00:08:18.545>getting <00:08:18.745>higher <00:08:18.945>rankings <00:08:19.145>than <00:08:19.344>other

171
00:08:21.315 --> 00:08:22.485
<00:08:21.315>signals <00:08:21.841>might <00:08:22.368>suggest.

172
00:08:22.985 --> 00:08:27.845
<00:08:22.985>Google <00:08:23.125>tries <00:08:23.265>to <00:08:23.405>combat <00:08:23.545>this <00:08:23.685>with <00:08:23.825>the <00:08:23.965>use <00:08:24.105>of <00:08:24.245>multiple <00:08:24.385>types

173
00:08:27.865 --> 00:08:32.685
<00:08:27.865>of <00:08:27.992>signals, <00:08:28.119>um, <00:08:28.246>as <00:08:28.374>we <00:08:28.501>learned <00:08:28.628>in <00:08:28.755>their <00:08:28.883>API <00:08:29.010>leak <00:08:29.137>of, <00:08:29.265>uh,

174
00:08:32.905 --> 00:08:37.285
<00:08:32.905>may <00:08:33.079>of, <00:08:33.255>uh, <00:08:33.429>last <00:08:33.605>year, <00:08:33.780>um, <00:08:33.954>that, <00:08:34.130>uh, <00:08:34.304>um,

175
00:08:37.425 --> 00:08:40.205
<00:08:37.424>so <00:08:37.625>they <00:08:37.824>use <00:08:38.025>user <00:08:38.224>engagement <00:08:38.424>data, <00:08:38.625>including <00:08:38.824>Chrome,

176
00:08:40.985 --> 00:08:43.685
<00:08:40.985>to <00:08:41.218>just <00:08:41.451>see <00:08:41.685>how <00:08:41.918>well <00:08:42.151>users <00:08:42.385>respond

177
00:08:44.715 --> 00:08:46.335
<00:08:44.715>to, <00:08:45.415>uh, <00:08:46.115>content.

178
00:08:47.115 --> 00:08:49.975
<00:08:47.115>So <00:08:47.290>if <00:08:47.465>the <00:08:47.640>content <00:08:47.815>is <00:08:47.990>like, <00:08:48.165>you <00:08:48.340>know, <00:08:48.515>bad,

179
00:08:50.475 --> 00:08:53.535
<00:08:50.475>it <00:08:50.615>sends <00:08:50.755>a <00:08:50.895>pretty <00:08:51.035>clear <00:08:51.175>signal <00:08:51.315>that <00:08:51.455>users <00:08:51.595>aren't <00:08:51.735>liking <00:08:51.875>it

180
00:08:54.155 --> 00:08:55.645
<00:08:54.155>and <00:08:54.378>they <00:08:54.602>can <00:08:54.825>do <00:08:55.049>something <00:08:55.272>about <00:08:55.496>it.

181
00:08:56.145 --> 00:09:00.645
<00:08:56.145>The <00:08:56.345>reality <00:08:56.545>is <00:08:56.745>that <00:08:56.944>it's <00:08:57.145>probably <00:08:57.345>a <00:08:57.545>pretty

182
00:09:01.815 --> 00:09:06.725
<00:09:01.815>crude <00:09:01.955>signal <00:09:02.095>because <00:09:02.235>as <00:09:02.375>we <00:09:02.515>see <00:09:02.655>with <00:09:02.795>some <00:09:02.935>of <00:09:03.075>the, <00:09:03.215>uh,

183
00:09:07.045 --> 00:09:08.965
<00:09:07.045>reactions <00:09:07.278>to <00:09:07.511>the <00:09:07.745>early <00:09:07.978>content <00:09:08.211>from <00:09:08.444>chat,

184
00:09:09.305 --> 00:09:11.365
<00:09:09.305>GT <00:09:09.584>content <00:09:09.864>can <00:09:10.145>look <00:09:10.425>pretty <00:09:10.704>good,

185
00:09:11.985 --> 00:09:14.365
<00:09:11.985>but <00:09:12.265>not <00:09:12.545>actually <00:09:12.825>be <00:09:13.105>pretty <00:09:13.385>good.

186
00:09:14.905 --> 00:09:18.405
<00:09:14.905>And <00:09:15.079>it <00:09:15.255>takes <00:09:15.430>sometimes <00:09:15.605>a <00:09:15.780>subject <00:09:15.954>matter <00:09:16.130>expert <00:09:16.305>to

187
00:09:19.135 --> 00:09:22.125
<00:09:19.135>understand <00:09:19.415>the, <00:09:19.694>um, <00:09:19.975>the, <00:09:20.255>the <00:09:20.535>things

188
00:09:22.125 --> 00:09:24.085
<00:09:22.125>that <00:09:22.325>are <00:09:22.525>flawed <00:09:22.725>in <00:09:22.925>a <00:09:23.125>piece <00:09:23.325>of <00:09:23.525>content.

189
00:09:24.665 --> 00:09:27.765
<00:09:24.665>Uh, <00:09:24.805>I, <00:09:24.944>I'd <00:09:25.084>like <00:09:25.224>to <00:09:25.365>just <00:09:25.505>share <00:09:25.645>a <00:09:25.785>quick <00:09:25.925>example <00:09:26.064>of,

190
00:09:27.945 --> 00:09:29.365
<00:09:27.945>of <00:09:28.158>exactly <00:09:28.371>this <00:09:28.584>kind <00:09:28.797>of <00:09:29.010>a <00:09:29.223>case.

191
00:09:29.685 --> 00:09:33.125
<00:09:29.685>I <00:09:29.824>did <00:09:29.964>a <00:09:30.104>queries <00:09:30.244>in <00:09:30.385>earlier <00:09:30.525>studies <00:09:30.665>I <00:09:30.805>did <00:09:30.944>around <00:09:31.084>this.

192
00:09:33.425 --> 00:09:36.885
<00:09:33.425>The <00:09:33.580>query <00:09:33.736>was <00:09:33.891>what <00:09:34.047>was <00:09:34.202>the <00:09:34.358>significance <00:09:34.513>of <00:09:34.669>the <00:09:34.824>sinking

193
00:09:36.885 --> 00:09:38.565
<00:09:36.885>of <00:09:37.118>the <00:09:37.351>Bismarck <00:09:37.585>in <00:09:37.818>World <00:09:38.051>War <00:09:38.285>ii?

194
00:09:38.825 --> 00:09:41.765
<00:09:38.825>Uh, <00:09:39.058>one <00:09:39.291>of <00:09:39.525>Germany's <00:09:39.758>two <00:09:39.991>prized <00:09:40.225>battleships

195
00:09:41.765 --> 00:09:45.205
<00:09:41.765>during <00:09:41.965>World <00:09:42.165>War <00:09:42.365>ii <00:09:42.564>and <00:09:42.765>the <00:09:42.965>various, <00:09:43.165>uh,

196
00:09:45.295 --> 00:09:47.245
<00:09:45.295>generative <00:09:45.645>AI <00:09:45.995>platforms <00:09:46.344>came <00:09:46.694>back

197
00:09:47.305 --> 00:09:50.005
<00:09:47.305>and <00:09:47.505>it <00:09:47.704>was <00:09:47.905>the <00:09:48.104>largest <00:09:48.305>battleship <00:09:48.505>ever <00:09:48.704>built,

198
00:09:50.075 --> 00:09:54.645
<00:09:50.075>they <00:09:50.202>would <00:09:50.329>say, <00:09:50.456>and <00:09:50.584>they <00:09:50.711>would <00:09:50.838>say <00:09:50.965>that <00:09:51.093>it <00:09:51.220>ended <00:09:51.347>the <00:09:51.475>Battle

199
00:09:54.665 --> 00:09:56.245
<00:09:54.665>of <00:09:54.898>the <00:09:55.131>Atlantic <00:09:55.365>in <00:09:55.598>World <00:09:55.831>War <00:09:56.064>ii.

200
00:09:56.785 --> 00:10:01.005
<00:09:56.785>So <00:09:56.901>having <00:09:57.018>been <00:09:57.135>a <00:09:57.251>World <00:09:57.368>War <00:09:57.485>II <00:09:57.601>geek <00:09:57.718>when <00:09:57.834>I <00:09:57.951>was <00:09:58.068>a <00:09:58.185>teenager,

201
00:10:01.905 --> 00:10:04.405
<00:10:01.905>um, <00:10:02.060>I, <00:10:02.216>I <00:10:02.371>know <00:10:02.527>the <00:10:02.682>truth <00:10:02.838>of <00:10:02.993>those <00:10:03.149>two <00:10:03.305>things,

202
00:10:04.405 --> 00:10:06.805
<00:10:04.405>which <00:10:04.638>is <00:10:04.871>the <00:10:05.105>Japanese <00:10:05.338>built <00:10:05.571>multiple <00:10:05.805>battleships

203
00:10:06.805 --> 00:10:09.725
<00:10:06.805>that <00:10:06.979>were <00:10:07.155>larger, <00:10:07.329>and <00:10:07.505>it <00:10:07.680>didn't <00:10:07.854>end <00:10:08.030>the <00:10:08.204>Battle

204
00:10:09.725 --> 00:10:11.325
<00:10:09.725>of <00:10:09.958>the <00:10:10.191>Atlantic <00:10:10.425>in <00:10:10.658>World <00:10:10.891>War <00:10:11.125>ii.

205
00:10:11.385 --> 00:10:14.405
<00:10:11.385>It <00:10:11.585>shifted <00:10:11.785>it <00:10:11.985>from, <00:10:12.185>uh, <00:10:12.385>to <00:10:12.585>a <00:10:12.785>degree,

206
00:10:14.985 --> 00:10:16.285
<00:10:14.985>but <00:10:15.277>you <00:10:15.569>wouldn't <00:10:15.862>know <00:10:16.155>that

207
00:10:16.285 --> 00:10:18.525
<00:10:16.285>unless <00:10:16.518>you <00:10:16.751>really <00:10:16.985>already <00:10:17.218>knew <00:10:17.451>the <00:10:17.685>history.

208
00:10:18.865 --> 00:10:22.965
<00:10:18.865>So <00:10:19.005>you <00:10:19.145>have <00:10:19.285>to <00:10:19.425>have <00:10:19.565>this <00:10:19.705>willingness <00:10:19.845>to <00:10:19.985>dive <00:10:20.125>in <00:10:20.265>and,

209
00:10:22.965 --> 00:10:24.485
<00:10:22.965>and <00:10:23.307>find, <00:10:23.649>uh, <00:10:23.991>find <00:10:24.333>out

210
00:10:24.485 --> 00:10:26.005
<00:10:24.485>what <00:10:24.713>the <00:10:24.941>real <00:10:25.169>truth <00:10:25.397>is <00:10:25.625>behind <00:10:25.853>something.

211
00:10:26.865 --> 00:10:31.165
<00:10:26.865>And <00:10:26.981>I <00:10:27.098>think <00:10:27.215>that <00:10:27.331>was <00:10:27.448>really <00:10:27.565>one <00:10:27.681>of <00:10:27.798>the <00:10:27.915>big <00:10:28.031>things <00:10:28.148>that, <00:10:28.265>um,

212
00:10:31.825 --> 00:10:33.245
<00:10:31.825>has <00:10:32.144>struck <00:10:32.464>me <00:10:32.783>all <00:10:33.103>along

213
00:10:33.425 --> 00:10:36.125
<00:10:33.425>as <00:10:33.658>I <00:10:33.891>read <00:10:34.125>various <00:10:34.358>people <00:10:34.591>publish <00:10:34.824>content

214
00:10:36.505 --> 00:10:39.725
<00:10:36.505>and <00:10:36.705>saying <00:10:36.905>that, <00:10:37.105>you <00:10:37.305>know, <00:10:37.505>chat <00:10:37.705>GPT <00:10:37.905>content

215
00:10:40.105 --> 00:10:43.005
<00:10:40.105>or <00:10:40.385>somebody <00:10:40.665>else's <00:10:40.945>content, <00:10:41.225>um, <00:10:41.505>is,

216
00:10:43.265 --> 00:10:44.485
<00:10:43.265>is <00:10:43.539>gonna <00:10:43.814>take <00:10:44.088>over <00:10:44.363>search

217
00:10:44.595 --> 00:10:47.885
<00:10:44.595>because <00:10:44.828>they <00:10:45.061>do <00:10:45.295>a <00:10:45.528>quick <00:10:45.761>surface <00:10:45.995>read

218
00:10:47.945 --> 00:10:51.325
<00:10:47.945>and <00:10:48.085>a <00:10:48.225>texty <00:10:48.365>type <00:10:48.505>response <00:10:48.645>is <00:10:48.785>pretty <00:10:48.925>cool, <00:10:49.065>and <00:10:49.205>it's <00:10:49.345>nice

219
00:10:51.345 --> 00:10:52.525
<00:10:51.345>and <00:10:51.876>easy <00:10:52.406>process.

220
00:10:53.505 --> 00:10:58.365
<00:10:53.505>Um, <00:10:53.645>but <00:10:53.785>the <00:10:53.925>various <00:10:54.064>kinds <00:10:54.205>of <00:10:54.345>problems <00:10:54.485>with <00:10:54.625>it <00:10:54.765>are <00:10:54.905>many.

221
00:10:58.745 --> 00:11:01.555
<00:10:58.745>You <00:10:58.978>have <00:10:59.211>errors, <00:10:59.445>you <00:10:59.678>have <00:10:59.911>emissions, <00:11:00.145>um,

222
00:11:01.695 --> 00:11:03.675
<00:11:01.695>you <00:11:01.928>also <00:11:02.161>have <00:11:02.395>other <00:11:02.628>sorts <00:11:02.861>of <00:11:03.095>situations.

223
00:11:03.785 --> 00:11:07.915
<00:11:03.785>Like <00:11:03.912>I <00:11:04.039>would <00:11:04.166>get <00:11:04.294>responses <00:11:04.421>from <00:11:04.548>chat <00:11:04.675>GPT <00:11:04.803>in <00:11:04.930>my <00:11:05.057>study <00:11:05.185>here,

224
00:11:08.485 --> 00:11:12.195
<00:11:08.485>which, <00:11:08.625>you <00:11:08.765>know, <00:11:08.905>seemed <00:11:09.045>like <00:11:09.185>a, <00:11:09.325>you <00:11:09.465>know, <00:11:09.605>a <00:11:09.745>decent <00:11:09.885>response.

225
00:11:12.815 --> 00:11:15.635
<00:11:12.815>But <00:11:12.931>the <00:11:13.048>problem <00:11:13.165>was <00:11:13.281>that <00:11:13.398>I <00:11:13.515>knew <00:11:13.631>that <00:11:13.748>I <00:11:13.865>was <00:11:13.981>going <00:11:14.098>to <00:11:14.215>need

226
00:11:15.775 --> 00:11:17.675
<00:11:15.775>to <00:11:16.125>reference <00:11:16.475>multiple <00:11:16.824>other <00:11:17.175>sites

227
00:11:17.675 --> 00:11:18.915
<00:11:17.675>to <00:11:17.861>get <00:11:18.046>all <00:11:18.233>the <00:11:18.419>information <00:11:18.605>I <00:11:18.790>wanted.

228
00:11:19.145 --> 00:11:23.275
<00:11:19.145>Chat <00:11:19.272>GPT <00:11:19.399>would <00:11:19.526>serve <00:11:19.654>up <00:11:19.781>a <00:11:19.908>kind <00:11:20.035>of <00:11:20.163>a <00:11:20.290>random <00:11:20.417>sample <00:11:20.545>of,

229
00:11:23.695 --> 00:11:25.475
<00:11:23.695>you <00:11:23.928>know, <00:11:24.161>a <00:11:24.395>couple <00:11:24.628>of <00:11:24.861>authoritative <00:11:25.095>sites

230
00:11:25.585 --> 00:11:27.755
<00:11:25.585>that <00:11:25.865>it <00:11:26.145>built <00:11:26.425>its <00:11:26.705>response <00:11:26.985>on.

231
00:11:28.335 --> 00:11:30.475
<00:11:28.335>And <00:11:28.475>what <00:11:28.615>I <00:11:28.755>really <00:11:28.895>needed <00:11:29.035>was <00:11:29.175>the <00:11:29.315>list <00:11:29.455>of <00:11:29.595>the <00:11:29.735>six

232
00:11:30.535 --> 00:11:32.875
<00:11:30.535>or <00:11:31.001>seven <00:11:31.468>various <00:11:31.935>resources.

233
00:11:33.075 --> 00:11:35.515
<00:11:33.075>'cause <00:11:33.215>I <00:11:33.355>was <00:11:33.495>gonna <00:11:33.635>have <00:11:33.775>to <00:11:33.915>go <00:11:34.055>through <00:11:34.195>all <00:11:34.335>of <00:11:34.475>them

234
00:11:35.575 --> 00:11:36.915
<00:11:35.575>to <00:11:35.816>really <00:11:36.057>get <00:11:36.298>what <00:11:36.539>I <00:11:36.781>wanted.

235
00:11:37.655 --> 00:11:41.315
<00:11:37.655>So <00:11:37.810>there's <00:11:37.966>a <00:11:38.121>number <00:11:38.277>of <00:11:38.432>these <00:11:38.588>kinds <00:11:38.743>of <00:11:38.899>scenarios <00:11:39.055>that,

236
00:11:41.625 --> 00:11:45.075
<00:11:41.625>that <00:11:41.765>come <00:11:41.905>up <00:11:42.045>when <00:11:42.185>you <00:11:42.325>kind <00:11:42.465>of <00:11:42.605>pull <00:11:42.745>back <00:11:42.885>the <00:11:43.025>covers

237
00:11:45.135 --> 00:11:47.035
<00:11:45.135>and <00:11:45.335>try <00:11:45.535>to <00:11:45.735>really <00:11:45.935>understand <00:11:46.135>what's <00:11:46.335>going <00:11:46.535>on.

238
00:11:47.665 --> 00:11:49.835
<00:11:47.665>Well <00:11:47.865>chat, <00:11:48.064>uh, <00:11:48.265>uh, <00:11:48.464>Bing <00:11:48.665>Chat <00:11:48.865>does <00:11:49.064>that,

239
00:11:49.835 --> 00:11:51.435
<00:11:49.835>it <00:11:50.185>basically <00:11:50.535>lists <00:11:50.885>the <00:11:51.235>pages

240
00:11:51.435 --> 00:11:53.885
<00:11:51.435>where <00:11:51.574>he <00:11:51.714>got <00:11:51.854>the <00:11:51.994>information <00:11:52.135>from <00:11:52.275>and <00:11:52.415>what <00:11:52.555>the <00:11:52.694>source <00:11:52.834>was.

241
00:11:53.945 --> 00:11:55.205
<00:11:53.945>It <00:11:54.228>says <00:11:54.512>like, <00:11:54.795>it's <00:11:55.079>Wikipedia

242
00:11:55.205 --> 00:11:57.285
<00:11:55.205>or <00:11:55.360>it's <00:11:55.516>been <00:11:55.671>the <00:11:55.827>web <00:11:55.982>and <00:11:56.138>these <00:11:56.293>kind <00:11:56.449>of <00:11:56.605>things.

243
00:11:57.385 --> 00:11:58.925
<00:11:57.385>But, <00:11:57.662>uh, <00:11:57.939>it <00:11:58.216>still <00:11:58.493>doesn't <00:11:58.771>mean

244
00:11:58.925 --> 00:12:00.565
<00:11:58.925>that <00:11:59.158>it <00:11:59.391>actually <00:11:59.625>is <00:11:59.858>the <00:12:00.091>right <00:12:00.324>resource.

245
00:12:00.765 --> 00:12:03.325
<00:12:00.765>I <00:12:00.905>mean, <00:12:01.045>you <00:12:01.185>could <00:12:01.324>have <00:12:01.465>published <00:12:01.605>any <00:12:01.745>random <00:12:01.885>things <00:12:02.025>on <00:12:02.165>the

246
00:12:03.525 --> 00:12:06.045
<00:12:03.525>internet, <00:12:03.699>uh, <00:12:03.875>but <00:12:04.050>it, <00:12:04.225>it, <00:12:04.400>at <00:12:04.574>least <00:12:04.750>it's <00:12:04.925>good

247
00:12:06.045 --> 00:12:07.205
<00:12:06.045>to <00:12:06.253>know <00:12:06.462>where <00:12:06.671>it <00:12:06.880>came <00:12:07.089>from.

248
00:12:07.805 --> 00:12:10.365
<00:12:07.805>I <00:12:07.932>think <00:12:08.059>one <00:12:08.186>of <00:12:08.314>the <00:12:08.441>bigger <00:12:08.568>problems <00:12:08.695>is <00:12:08.823>also <00:12:08.950>that <00:12:09.077>the, <00:12:09.204>uh,

249
00:12:10.365 --> 00:12:14.165
<00:12:10.365>that <00:12:10.505>the <00:12:10.645>way, <00:12:10.785>uh, <00:12:10.925>um, <00:12:11.065>uh, <00:12:11.205>chat <00:12:11.345>GPT <00:12:11.485>talks <00:12:11.625>to <00:12:11.765>you,

250
00:12:14.725 --> 00:12:16.485
<00:12:14.725>I <00:12:14.880>always <00:12:15.036>say <00:12:15.191>like, <00:12:15.347>it's, <00:12:15.502>it <00:12:15.658>seems <00:12:15.813>like <00:12:15.969>a <00:12:16.125>happy

251
00:12:16.515 --> 00:12:18.005
<00:12:16.515>Californian <00:12:17.185>in <00:12:17.856>1980.

252
00:12:18.435 --> 00:12:21.085
<00:12:18.435>Like <00:12:18.590>they, <00:12:18.746>they, <00:12:18.901>they, <00:12:19.057>they, <00:12:19.212>they <00:12:19.368>sound <00:12:19.523>very, <00:12:19.679>very <00:12:19.834>warm

253
00:12:21.105 --> 00:12:22.685
<00:12:21.105>and <00:12:21.385>they <00:12:21.665>sound <00:12:21.945>like <00:12:22.225>very <00:12:22.505>knowledgeable.

254
00:12:22.715 --> 00:12:25.005
<00:12:22.715>It's <00:12:22.890>like <00:12:23.065>mansplaining <00:12:23.240>as <00:12:23.415>a <00:12:23.590>service <00:12:23.765>to <00:12:23.940>a <00:12:24.115>degree

255
00:12:25.035 --> 00:12:27.885
<00:12:25.035>because <00:12:25.268>there's <00:12:25.501>sometimes <00:12:25.735>no <00:12:25.968>data <00:12:26.201>behind <00:12:26.435>it.

256
00:12:28.185 --> 00:12:30.725
<00:12:28.185>But <00:12:28.359>it <00:12:28.535>still <00:12:28.709>sounds <00:12:28.885>like <00:12:29.060>a <00:12:29.234>very <00:12:29.410>simple <00:12:29.584>thing.

257
00:12:30.945 --> 00:12:34.365
<00:12:30.945>Simple, <00:12:31.061>uh, <00:12:31.178>to <00:12:31.295>me <00:12:31.411>it <00:12:31.528>feels <00:12:31.645>like <00:12:31.761>a, <00:12:31.878>a <00:12:31.995>a <00:12:32.111>a <00:12:32.228>reader's <00:12:32.345>digest

258
00:12:34.465 --> 00:12:35.885
<00:12:34.465>of <00:12:34.891>the <00:12:35.317>web, <00:12:35.742>basically.

259
00:12:36.235 --> 00:12:38.165
<00:12:36.235>Like, <00:12:36.515>here's <00:12:36.795>the, <00:12:37.075>here's <00:12:37.355>the <00:12:37.635>viewpoints

260
00:12:38.165 --> 00:12:40.845
<00:12:38.165>that <00:12:38.320>are <00:12:38.476>interesting, <00:12:38.631>but <00:12:38.787>when <00:12:38.942>it <00:12:39.098>comes <00:12:39.253>to <00:12:39.409>proper <00:12:39.564>research,

261
00:12:41.275 --> 00:12:44.005
<00:12:41.275>then <00:12:41.430>it <00:12:41.586>actually <00:12:41.741>means <00:12:41.897>that <00:12:42.052>you <00:12:42.208>still <00:12:42.363>have <00:12:42.519>to <00:12:42.675>go

262
00:12:44.005 --> 00:12:45.645
<00:12:44.005>to <00:12:44.238>the <00:12:44.471>resources <00:12:44.705>that <00:12:44.938>you <00:12:45.171>talked <00:12:45.405>about.

263
00:12:46.315 --> 00:12:49.165
<00:12:46.315>Then <00:12:46.455>again, <00:12:46.595>in <00:12:46.735>an <00:12:46.875>energetic <00:12:47.015>web, <00:12:47.155>like <00:12:47.295>when <00:12:47.435>we <00:12:47.575>say <00:12:47.715>like,

264
00:12:49.165 --> 00:12:51.485
<00:12:49.165>we <00:12:49.305>are <00:12:49.444>gonna <00:12:49.584>have <00:12:49.724>agents <00:12:49.865>that <00:12:50.005>serve <00:12:50.145>the <00:12:50.285>web <00:12:50.425>for <00:12:50.564>us

265
00:12:51.625 --> 00:12:53.885
<00:12:51.625>and <00:12:51.825>actually <00:12:52.025>click <00:12:52.225>through <00:12:52.425>websites <00:12:52.625>for <00:12:52.825>us <00:12:53.025>and,

266
00:12:53.905 --> 00:12:57.125
<00:12:53.905>and <00:12:54.060>submit <00:12:54.216>forms <00:12:54.371>and <00:12:54.527>these <00:12:54.682>kind <00:12:54.838>of <00:12:54.993>things, <00:12:55.149>uh, <00:12:55.305>it,

267
00:12:57.145 --> 00:12:59.805
<00:12:57.145>it <00:12:57.285>sold <00:12:57.425>us <00:12:57.564>to <00:12:57.704>like, <00:12:57.845>we <00:12:57.985>do <00:12:58.125>the <00:12:58.265>research <00:12:58.405>for <00:12:58.545>you,

268
00:12:59.865 --> 00:13:02.085
<00:12:59.865>and <00:13:00.040>then <00:13:00.215>the <00:13:00.390>chat <00:13:00.565>system <00:13:00.740>gives <00:13:00.915>you <00:13:01.090>the <00:13:01.265>result.

269
00:13:02.465 --> 00:13:06.125
<00:13:02.465>But <00:13:02.592>it <00:13:02.719>seems <00:13:02.846>like <00:13:02.974>in <00:13:03.101>a <00:13:03.228>world <00:13:03.355>where <00:13:03.483>the <00:13:03.610>machine <00:13:03.737>always <00:13:03.865>has

270
00:13:06.125 --> 00:13:07.365
<00:13:06.125>to <00:13:06.404>give <00:13:06.683>you <00:13:06.962>something <00:13:07.241>back,

271
00:13:08.105 --> 00:13:09.405
<00:13:08.105>that's <00:13:08.300>the <00:13:08.495>thing <00:13:08.690>that <00:13:08.885>drives <00:13:09.079>me <00:13:09.275>nuts.

272
00:13:09.405 --> 00:13:10.565
<00:13:09.405>Like, <00:13:09.579>when, <00:13:09.753>when <00:13:09.927>I <00:13:10.101>go <00:13:10.275>to <00:13:10.449>Google

273
00:13:10.625 --> 00:13:12.005
<00:13:10.625>and <00:13:10.873>have <00:13:11.121>a <00:13:11.370>Google <00:13:11.618>search <00:13:11.867>list,

274
00:13:12.005 --> 00:13:13.525
<00:13:12.005>know <00:13:12.200>the <00:13:12.395>result, <00:13:12.591>I <00:13:12.786>get <00:13:12.982>an <00:13:13.177>empty <00:13:13.372>page.

275
00:13:13.635 --> 00:13:15.685
<00:13:13.635>It's, <00:13:13.915>it's <00:13:14.194>not <00:13:14.475>often <00:13:14.755>happening <00:13:15.035>anymore,

276
00:13:16.105 --> 00:13:18.285
<00:13:16.105>but <00:13:16.280>sometimes <00:13:16.455>it <00:13:16.630>just <00:13:16.805>says <00:13:16.980>like, <00:13:17.155>I <00:13:17.330>don't <00:13:17.505>know.

277
00:13:18.705 --> 00:13:21.205
<00:13:18.705>But <00:13:18.860>an <00:13:19.016>an <00:13:19.171>LLM <00:13:19.327>will <00:13:19.482>never <00:13:19.638>say, <00:13:19.793>I <00:13:19.949>don't <00:13:20.105>know.

278
00:13:21.205 --> 00:13:23.685
<00:13:21.205>It <00:13:21.485>just <00:13:21.765>basically <00:13:22.045>then <00:13:22.325>starts <00:13:22.605>hallucinating

279
00:13:23.685 --> 00:13:26.545
<00:13:23.685>and <00:13:23.918>gives <00:13:24.151>you <00:13:24.385>random <00:13:24.618>stuff <00:13:24.851>back, <00:13:25.084>right?

280
00:13:26.645 --> 00:13:29.705
<00:13:26.645>And <00:13:26.878>it's, <00:13:27.111>is <00:13:27.345>this <00:13:27.578>a <00:13:27.811>marketing <00:13:28.045>thing

281
00:13:29.765 --> 00:13:32.545
<00:13:29.765>or <00:13:29.881>do <00:13:29.998>we <00:13:30.115>think, <00:13:30.231>do <00:13:30.348>you <00:13:30.465>think <00:13:30.581>there <00:13:30.698>will <00:13:30.814>be <00:13:30.931>a <00:13:31.048>change <00:13:31.165>in

282
00:13:32.545 --> 00:13:33.585
<00:13:32.545>that <00:13:32.732>in <00:13:32.919>the <00:13:33.106>future <00:13:33.293>as <00:13:33.481>well?

283
00:13:33.585 --> 00:13:36.105
<00:13:33.585>Where <00:13:33.740>if <00:13:33.896>there <00:13:34.051>will <00:13:34.207>be <00:13:34.362>more <00:13:34.518>honesty <00:13:34.673>in <00:13:34.829>these <00:13:34.985>systems

284
00:13:36.175 --> 00:13:39.025
<00:13:36.175>that <00:13:36.314>say <00:13:36.454>like, <00:13:36.594>this <00:13:36.734>is <00:13:36.875>really <00:13:37.015>not <00:13:37.155>information <00:13:37.295>that <00:13:37.435>I <00:13:37.574>know,

285
00:13:39.025 --> 00:13:41.065
<00:13:39.025>please <00:13:39.258>ask, <00:13:39.491>gimme <00:13:39.725>more <00:13:39.958>information <00:13:40.191>to <00:13:40.425>research

286
00:13:42.145 --> 00:13:43.145
<00:13:42.145>Y <00:13:42.595>Yeah. <00:13:43.045>Um,

287
00:13:43.145 --> 00:13:47.105
<00:13:43.145>that's <00:13:43.319>a <00:13:43.495>great <00:13:43.670>question, <00:13:43.845>Chris. <00:13:44.020>I <00:13:44.194>can <00:13:44.370>only <00:13:44.545>speculate.

288
00:13:47.645 --> 00:13:52.465
<00:13:47.645>Um, <00:13:47.845>one <00:13:48.045>hopes <00:13:48.245>that <00:13:48.444>they <00:13:48.645>will, <00:13:48.845>um, <00:13:49.045>um,

289
00:13:52.725 --> 00:13:53.985
<00:13:52.725>do <00:13:53.292>a <00:13:53.859>better

290
00:13:54.045 --> 00:13:57.545
<00:13:54.045>and <00:13:54.219>more <00:13:54.395>complete <00:13:54.569>job <00:13:54.745>of, <00:13:54.920>of <00:13:55.094>admitting <00:13:55.270>their <00:13:55.444>shortcomings.

291
00:13:58.005 --> 00:13:59.825
<00:13:58.005>The <00:13:58.238>challenge <00:13:58.471>though, <00:13:58.705>is <00:13:58.938>a <00:13:59.171>marketing <00:13:59.405>one,

292
00:14:00.255 --> 00:14:03.865
<00:14:00.255>because <00:14:00.395>a <00:14:00.535>lot <00:14:00.675>of <00:14:00.814>the <00:14:00.955>times <00:14:01.095>the <00:14:01.235>issues <00:14:01.375>in <00:14:01.515>the <00:14:01.655>gaps

293
00:14:04.005 --> 00:14:06.025
<00:14:04.005>and, <00:14:04.205>you <00:14:04.405>know, <00:14:04.605>things <00:14:04.805>that <00:14:05.005>are <00:14:05.205>missing <00:14:05.405>from

294
00:14:06.025 --> 00:14:08.785
<00:14:06.025>what <00:14:06.199>you <00:14:06.375>should <00:14:06.550>be <00:14:06.725>receiving <00:14:06.900>as <00:14:07.074>a <00:14:07.250>response, <00:14:07.425>it,

295
00:14:08.885 --> 00:14:11.585
<00:14:08.885>it <00:14:09.060>takes <00:14:09.235>someone <00:14:09.410>who <00:14:09.585>really <00:14:09.760>knows <00:14:09.935>what <00:14:10.110>they're <00:14:10.285>doing

296
00:14:11.645 --> 00:14:14.665
<00:14:11.645>to <00:14:11.800>understand <00:14:11.956>that <00:14:12.111>they're <00:14:12.267>there <00:14:12.422>and <00:14:12.578>users <00:14:12.733>might <00:14:12.889>run <00:14:13.045>off

297
00:14:14.665 --> 00:14:16.505
<00:14:14.665>and <00:14:14.865>do <00:14:15.064>things <00:14:15.265>with <00:14:15.464>the <00:14:15.665>information <00:14:15.865>they've <00:14:16.064>gotten.

298
00:14:17.245 --> 00:14:19.745
<00:14:17.245>And <00:14:17.595>depending <00:14:17.945>on <00:14:18.295>their <00:14:18.645>application,

299
00:14:19.745 --> 00:14:22.905
<00:14:19.745>they <00:14:19.900>might <00:14:20.056>get <00:14:20.211>a <00:14:20.367>poor <00:14:20.522>grade, <00:14:20.678>they <00:14:20.833>might, <00:14:20.989>uh, <00:14:21.145>um,

300
00:14:23.285 --> 00:14:24.545
<00:14:23.285>get <00:14:23.663>bad <00:14:24.040>medical <00:14:24.419>advice.

301
00:14:24.575 --> 00:14:28.185
<00:14:24.575>Even <00:14:24.730>with <00:14:24.886>the <00:14:25.041>warnings <00:14:25.197>that <00:14:25.352>are <00:14:25.508>given, <00:14:25.663>um, <00:14:25.819>you <00:14:25.975>know,

302
00:14:28.405 --> 00:14:29.905
<00:14:28.405>any <00:14:28.630>number <00:14:28.855>of <00:14:29.079>different <00:14:29.305>things <00:14:29.530>could <00:14:29.755>happen.

303
00:14:30.785 --> 00:14:33.545
<00:14:30.785>I, <00:14:30.940>I <00:14:31.096>think <00:14:31.251>that's <00:14:31.407>a, <00:14:31.562>that's <00:14:31.718>a, <00:14:31.873>a <00:14:32.029>real <00:14:32.185>issue

304
00:14:33.545 --> 00:14:36.905
<00:14:33.545>and <00:14:33.700>it's <00:14:33.856>a, <00:14:34.011>it's <00:14:34.167>an <00:14:34.322>outcome <00:14:34.478>of <00:14:34.633>the <00:14:34.789>underlying <00:14:34.944>algorithms,

305
00:14:36.905 --> 00:14:41.585
<00:14:36.905>which <00:14:37.045>in <00:14:37.185>rough <00:14:37.324>terms <00:14:37.464>is <00:14:37.605>trying <00:14:37.745>to <00:14:37.885>fit <00:14:38.025>an <00:14:38.165>algebraic <00:14:38.305>equation

306
00:14:41.685 --> 00:14:43.985
<00:14:41.685>to <00:14:41.964>describe <00:14:42.244>all <00:14:42.525>the <00:14:42.805>world's <00:14:43.084>information.

307
00:14:44.405 --> 00:14:47.745
<00:14:44.405>And <00:14:44.579>I <00:14:44.755>think, <00:14:44.930>you <00:14:45.105>know, <00:14:45.280>it's <00:14:45.454>a <00:14:45.630>simplistic <00:14:45.805>explanation,

308
00:14:47.745 --> 00:14:52.045
<00:14:47.745>but <00:14:47.885>it's <00:14:48.025>roughly, <00:14:48.165>uh, <00:14:48.305>on <00:14:48.445>the <00:14:48.585>money <00:14:48.725>here <00:14:48.865>with <00:14:49.005>some <00:14:49.145>patches

309
00:14:52.045 --> 00:14:54.365
<00:14:52.045>that <00:14:52.161>are <00:14:52.278>put <00:14:52.395>on <00:14:52.511>top <00:14:52.628>of <00:14:52.745>it <00:14:52.861>to <00:14:52.978>fix <00:14:53.094>certain <00:14:53.211>kinds <00:14:53.328>of <00:14:53.444>errors.

310
00:14:54.985 --> 00:14:58.725
<00:14:54.985>Um, <00:14:55.265>and <00:14:55.545>it's, <00:14:55.825>it's <00:14:56.105>not <00:14:56.385>possible

311
00:14:58.725 --> 00:15:01.485
<00:14:58.725>to <00:14:58.925>write <00:14:59.125>an <00:14:59.325>algebraic, <00:14:59.525>I, <00:14:59.725>I'll <00:14:59.925>stand <00:15:00.125>by,

312
00:15:01.505 --> 00:15:03.005
<00:15:01.505>you <00:15:01.842>can <00:15:02.180>gimme <00:15:02.517>quantum <00:15:02.855>computers.

313
00:15:03.445 --> 00:15:06.085
<00:15:03.445>I <00:15:03.620>don't <00:15:03.795>think <00:15:03.970>you <00:15:04.145>can <00:15:04.320>write <00:15:04.495>an <00:15:04.670>algebraic <00:15:04.845>equation

314
00:15:06.145 --> 00:15:07.565
<00:15:06.145>to <00:15:06.400>describe <00:15:06.656>all <00:15:06.911>the <00:15:07.167>world's <00:15:07.423>information.

315
00:15:07.765 --> 00:15:11.845
<00:15:07.765>I <00:15:07.920>think <00:15:08.076>you <00:15:08.231>can <00:15:08.387>do <00:15:08.542>a <00:15:08.698>lot <00:15:08.853>of <00:15:09.009>interesting <00:15:09.165>things

316
00:15:12.475 --> 00:15:15.965
<00:15:12.475>with <00:15:12.630>it, <00:15:12.786>but <00:15:12.941>it's <00:15:13.097>only <00:15:13.252>so <00:15:13.408>far <00:15:13.563>it <00:15:13.719>can <00:15:13.875>go.

317
00:15:16.065 --> 00:15:19.645
<00:15:16.065>And <00:15:16.240>people <00:15:16.415>will <00:15:16.590>try <00:15:16.765>other <00:15:16.940>things <00:15:17.115>like <00:15:17.290>retrieval <00:15:17.465>augmented

318
00:15:19.645 --> 00:15:23.765
<00:15:19.645>generation, <00:15:19.878>which <00:15:20.111>is <00:15:20.345>this <00:15:20.578>technology <00:15:20.811>for <00:15:21.045>providing

319
00:15:24.525 --> 00:15:28.915
<00:15:24.525>a <00:15:24.758>constraining <00:15:24.991>database <00:15:25.225>of <00:15:25.458>known <00:15:25.691>information <00:15:25.925>to,

320
00:15:29.375 --> 00:15:32.875
<00:15:29.375>um, <00:15:29.575>the <00:15:29.775>LLM <00:15:29.975>to <00:15:30.175>limit <00:15:30.375>how <00:15:30.575>it <00:15:30.775>responds

321
00:15:32.935 --> 00:15:35.955
<00:15:32.935>and, <00:15:33.214>um, <00:15:33.494>you <00:15:33.775>know, <00:15:34.055>reduce <00:15:34.334>errors.

322
00:15:36.915 --> 00:15:39.435
<00:15:36.915>Ultimately, <00:15:37.148>if <00:15:37.381>you, <00:15:37.615>you <00:15:37.848>build <00:15:38.081>a <00:15:38.314>database

323
00:15:39.535 --> 00:15:41.115
<00:15:39.535>of <00:15:39.885>all <00:15:40.235>the <00:15:40.584>world's <00:15:40.935>information,

324
00:15:41.415 --> 00:15:43.515
<00:15:41.415>though <00:15:41.648>the <00:15:41.881>LLM <00:15:42.115>can't <00:15:42.348>make <00:15:42.581>any <00:15:42.814>errors,

325
00:15:44.255 --> 00:15:45.625
<00:15:44.255>well <00:15:44.460>then <00:15:44.665>you <00:15:44.871>already <00:15:45.077>have <00:15:45.282>a <00:15:45.488>database

326
00:15:45.625 --> 00:15:46.665
<00:15:45.625>of <00:15:45.859>all <00:15:46.093>the <00:15:46.327>world's <00:15:46.560>information.

327
00:15:46.665 --> 00:15:51.305
<00:15:46.665>What <00:15:46.792>do <00:15:46.919>I <00:15:47.046>need <00:15:47.174>the <00:15:47.301>LLM <00:15:47.428>for <00:15:47.555>except <00:15:47.683>to <00:15:47.810>summarize <00:15:47.937>it. <00:15:48.064>So

328
00:15:52.645 --> 00:15:55.325
<00:15:52.645>I <00:15:52.785>guess <00:15:52.925>translation <00:15:53.064>is <00:15:53.204>the <00:15:53.345>thing <00:15:53.485>like, <00:15:53.625>uh, <00:15:53.765>uh, <00:15:53.905>in <00:15:54.045>context,

329
00:15:56.085 --> 00:15:58.205
<00:15:56.085>I <00:15:56.260>mean, <00:15:56.435>what, <00:15:56.610>when, <00:15:56.785>when <00:15:56.960>it <00:15:57.135>comes <00:15:57.310>to <00:15:57.485>prompting,

330
00:15:58.205 --> 00:16:00.245
<00:15:58.205>like <00:15:58.380>when <00:15:58.555>it <00:15:58.730>comes <00:15:58.905>to <00:15:59.080>talking <00:15:59.255>to <00:15:59.430>these <00:15:59.605>systems,

331
00:16:00.745 --> 00:16:01.925
<00:16:00.745>the <00:16:01.010>way <00:16:01.276>you <00:16:01.541>prompt <00:16:01.807>them

332
00:16:01.985 --> 00:16:04.525
<00:16:01.985>and <00:16:02.112>the <00:16:02.239>way <00:16:02.366>you <00:16:02.494>tell <00:16:02.621>them <00:16:02.748>to <00:16:02.875>give <00:16:03.003>you <00:16:03.130>information <00:16:03.257>is <00:16:03.385>a

333
00:16:04.525 --> 00:16:05.605
<00:16:04.525>completely <00:16:05.011>different <00:16:05.497>result.

334
00:16:05.925 --> 00:16:08.245
<00:16:05.925>I <00:16:06.064>mean, <00:16:06.204>I <00:16:06.344>found <00:16:06.484>that <00:16:06.625>roles <00:16:06.765>are <00:16:06.905>a <00:16:07.045>very <00:16:07.185>important <00:16:07.324>thing

335
00:16:08.245 --> 00:16:12.005
<00:16:08.245>that <00:16:08.372>you <00:16:08.499>tell <00:16:08.626>them <00:16:08.754>like, <00:16:08.881>you <00:16:09.008>are <00:16:09.135>a <00:16:09.263>great, <00:16:09.390>uh, <00:16:09.517>five <00:16:09.645>teacher

336
00:16:12.625 --> 00:16:14.805
<00:16:12.625>and <00:16:12.800>explain <00:16:12.975>these <00:16:13.150>things <00:16:13.325>to <00:16:13.500>me <00:16:13.675>as <00:16:13.850>you <00:16:14.025>would

337
00:16:14.805 --> 00:16:16.205
<00:16:14.805>to <00:16:15.057>a <00:16:15.309>child <00:16:15.561>kind <00:16:15.813>of <00:16:16.065>thing.

338
00:16:16.505 --> 00:16:19.485
<00:16:16.505>And <00:16:16.645>then <00:16:16.785>you <00:16:16.925>get <00:16:17.064>the <00:16:17.205>better <00:16:17.345>information <00:16:17.485>than <00:16:17.625>you <00:16:17.765>would <00:16:17.905>than

339
00:16:19.485 --> 00:16:22.085
<00:16:19.485>you, <00:16:19.640>than <00:16:19.796>you <00:16:19.951>say, <00:16:20.107>like, <00:16:20.262>gimme <00:16:20.418>just <00:16:20.573>the <00:16:20.729>information, <00:16:20.885>the,

340
00:16:22.085 --> 00:16:25.885
<00:16:22.085>like, <00:16:22.260>uh, <00:16:22.435>by, <00:16:22.610>by <00:16:22.785>focusing <00:16:22.960>more <00:16:23.135>in <00:16:23.310>your <00:16:23.485>requests

341
00:16:25.985 --> 00:16:29.005
<00:16:25.985>to <00:16:26.140>the <00:16:26.296>machine, <00:16:26.451>you <00:16:26.607>probably <00:16:26.762>get <00:16:26.918>better <00:16:27.073>results <00:16:27.229>as <00:16:27.385>well.

342
00:16:29.005 --> 00:16:32.125
<00:16:29.005>But <00:16:29.180>then <00:16:29.355>again, <00:16:29.530>I <00:16:29.705>find <00:16:29.880>it <00:16:30.055>so <00:16:30.230>time <00:16:30.405>consuming.

343
00:16:32.275 --> 00:16:35.725
<00:16:32.275>Like <00:16:32.402>oftentimes <00:16:32.529>I'm <00:16:32.656>like, <00:16:32.784>why <00:16:32.911>would <00:16:33.038>I <00:16:33.165>want <00:16:33.293>to, <00:16:33.420>uh, <00:16:33.547>to <00:16:33.675>chat

344
00:16:35.725 --> 00:16:38.005
<00:16:35.725>to <00:16:35.865>a <00:16:36.005>system <00:16:36.145>for <00:16:36.285>like <00:16:36.425>10 <00:16:36.565>minutes <00:16:36.705>about <00:16:36.845>the <00:16:36.985>best <00:16:37.125>recipe

345
00:16:38.145 --> 00:16:40.725
<00:16:38.145>for <00:16:38.300>pancakes <00:16:38.456>when <00:16:38.611>I <00:16:38.767>just <00:16:38.922>could <00:16:39.078>read <00:16:39.233>through <00:16:39.389>a <00:16:39.545>website?

346
00:16:41.425 --> 00:16:43.365
<00:16:41.425>But <00:16:41.625>then <00:16:41.824>the <00:16:42.025>web <00:16:42.224>has <00:16:42.425>changed <00:16:42.625>as <00:16:42.824>well.

347
00:16:43.475 --> 00:16:44.925
<00:16:43.475>Like, <00:16:43.736>we, <00:16:43.997>we <00:16:44.258>don't <00:16:44.519>find <00:16:44.780>recipe

348
00:16:45.085 --> 00:16:46.605
<00:16:45.085>websites <00:16:45.541>for <00:16:45.997>pancakes <00:16:46.453>anymore.

349
00:16:46.905 --> 00:16:50.125
<00:16:46.905>We <00:16:47.079>find <00:16:47.255>10 <00:16:47.430>minute <00:16:47.605>YouTube <00:16:47.780>videos <00:16:47.954>for <00:16:48.130>pancake <00:16:48.305>recipes

350
00:16:50.255 --> 00:16:52.725
<00:16:50.255>where <00:16:50.430>people <00:16:50.605>ask <00:16:50.780>us <00:16:50.955>to, <00:16:51.130>to <00:16:51.305>like, <00:16:51.480>and <00:16:51.655>subscribe

351
00:16:52.785 --> 00:16:55.325
<00:16:52.785>and <00:16:52.912>then <00:16:53.039>get <00:16:53.166>a <00:16:53.294>VPN <00:16:53.421>provider <00:16:53.548>and <00:16:53.675>do <00:16:53.803>all <00:16:53.930>kind <00:16:54.057>of <00:16:54.185>things.

352
00:16:55.825 --> 00:16:58.965
<00:16:55.825>So <00:16:55.952>that <00:16:56.079>the <00:16:56.206>spams <00:16:56.334>of <00:16:56.461>the <00:16:56.588>web, <00:16:56.715>of <00:16:56.843>the <00:16:56.970>web <00:16:57.097>search <00:16:57.225>results

353
00:16:59.065 --> 00:17:02.765
<00:16:59.065>as <00:16:59.205>well <00:16:59.345>is <00:16:59.485>probably <00:16:59.625>what <00:16:59.765>drives <00:16:59.905>people <00:17:00.045>to <00:17:00.185>go <00:17:00.325>through <00:17:00.465>lms.

354
00:17:02.965 --> 00:17:05.205
<00:17:02.965>'cause <00:17:03.198>they <00:17:03.431>get <00:17:03.665>their <00:17:03.898>the <00:17:04.131>information <00:17:04.365>immediately.

355
00:17:05.835 --> 00:17:07.205
<00:17:05.835>That <00:17:06.081>doesn't <00:17:06.328>mean, <00:17:06.574>though <00:17:06.821>to <00:17:07.068>me,

356
00:17:07.205 --> 00:17:08.445
<00:17:07.204>that <00:17:07.428>the <00:17:07.651>quality <00:17:07.874>is <00:17:08.097>good, <00:17:08.320>right?

357
00:17:08.875 --> 00:17:12.765
<00:17:08.875>Yeah. <00:17:09.002>So <00:17:09.129>I <00:17:09.256>did <00:17:09.384>share <00:17:09.511>an <00:17:09.638>example <00:17:09.765>in <00:17:09.893>the <00:17:10.020>study <00:17:10.147>of, <00:17:10.275>uh,

358
00:17:12.985 --> 00:17:15.085
<00:17:12.984>asking <00:17:13.218>for <00:17:13.451>a <00:17:13.685>salmon <00:17:13.918>recipe, <00:17:14.151>I <00:17:14.385>believe,

359
00:17:15.455 --> 00:17:17.565
<00:17:15.454>where <00:17:15.734>actually <00:17:16.014>the <00:17:16.294>Google <00:17:16.574>result <00:17:16.855>was.

360
00:17:17.805 --> 00:17:21.285
<00:17:17.805>I <00:17:17.960>mean, <00:17:18.116>there <00:17:18.271>were, <00:17:18.427>there <00:17:18.582>were <00:17:18.738>websites <00:17:18.893>with <00:17:19.049>salmon <00:17:19.205>recipes,

361
00:17:21.865 --> 00:17:25.605
<00:17:21.865>uh, <00:17:21.992>quite <00:17:22.119>near <00:17:22.246>the <00:17:22.374>top, <00:17:22.501>and <00:17:22.628>it <00:17:22.755>was <00:17:22.883>fairly <00:17:23.010>easy <00:17:23.137>to <00:17:23.265>parse.

362
00:17:25.905 --> 00:17:29.005
<00:17:25.905>But, <00:17:26.105>but, <00:17:26.305>but <00:17:26.504>I <00:17:26.704>agree, <00:17:26.905>there's <00:17:27.105>certainly <00:17:27.305>plenty

363
00:17:29.005 --> 00:17:32.605
<00:17:29.005>of <00:17:29.132>situations <00:17:29.259>where <00:17:29.386>it's, <00:17:29.514>as <00:17:29.641>you <00:17:29.768>say, <00:17:29.895>it's <00:17:30.023>harder <00:17:30.150>to <00:17:30.277>get <00:17:30.405>at

364
00:17:33.145 --> 00:17:35.605
<00:17:33.145>the <00:17:33.345>content <00:17:33.545>you <00:17:33.745>want <00:17:33.945>in, <00:17:34.145>in, <00:17:34.345>in <00:17:34.545>search.

365
00:17:35.745 --> 00:17:40.005
<00:17:35.745>But <00:17:35.885>having <00:17:36.024>said <00:17:36.165>a <00:17:36.304>number <00:17:36.445>of <00:17:36.584>things <00:17:36.725>that <00:17:36.864>suggest <00:17:37.004>that <00:17:37.145>I'm

366
00:17:40.925 --> 00:17:43.725
<00:17:40.925>negative <00:17:41.041>on <00:17:41.158>chat, <00:17:41.274>GPT, <00:17:41.391>I <00:17:41.508>want <00:17:41.625>to <00:17:41.741>turn <00:17:41.858>it <00:17:41.975>around <00:17:42.091>a <00:17:42.208>little <00:17:42.325>bit

367
00:17:43.725 --> 00:17:45.645
<00:17:43.725>because <00:17:44.074>I <00:17:44.425>have <00:17:44.774>my <00:17:45.125>concerns,

368
00:17:46.305 --> 00:17:47.925
<00:17:46.305>but <00:17:46.585>that's <00:17:46.865>different <00:17:47.145>than <00:17:47.425>being <00:17:47.705>negative.

369
00:17:48.025 --> 00:17:50.445
<00:17:48.025>And <00:17:48.125>I, <00:17:48.225>I <00:17:48.325>kind <00:17:48.425>of <00:17:48.525>of <00:17:48.625>want <00:17:48.725>to <00:17:48.825>draw <00:17:48.925>that <00:17:49.025>out <00:17:49.125>a <00:17:49.225>little <00:17:49.325>bit <00:17:49.425>more,

370
00:17:50.575 --> 00:17:54.245
<00:17:50.575>which <00:17:50.715>is, <00:17:50.855>I <00:17:50.995>believe <00:17:51.135>the <00:17:51.275>gen <00:17:51.415>AI <00:17:51.555>tools <00:17:51.695>like <00:17:51.835>chat, <00:17:51.975>GPT

371
00:17:54.305 --> 00:17:56.805
<00:17:54.305>and <00:17:54.480>Claude <00:17:54.655>is <00:17:54.830>good <00:17:55.005>at <00:17:55.180>certain <00:17:55.355>things <00:17:55.530>and, <00:17:55.705>uh,

372
00:17:56.865 --> 00:17:58.525
<00:17:56.865>and <00:17:57.098>Gemini <00:17:57.331>is <00:17:57.565>good <00:17:57.798>at <00:17:58.031>certain <00:17:58.265>things.

373
00:17:58.785 --> 00:18:02.165
<00:17:58.785>Um, <00:17:58.960>and <00:17:59.135>copilot <00:17:59.310>is <00:17:59.485>obviously <00:17:59.660>just <00:17:59.835>basically <00:18:00.010>chat <00:18:00.185>GPT,

374
00:18:02.505 --> 00:18:05.765
<00:18:02.505>but <00:18:02.705>they're <00:18:02.905>really <00:18:03.105>good <00:18:03.305>when <00:18:03.505>you <00:18:03.705>treat <00:18:03.905>them

375
00:18:05.905 --> 00:18:08.685
<00:18:05.905>as <00:18:06.105>a <00:18:06.305>brainstorming <00:18:06.504>partner <00:18:06.705>for <00:18:06.905>your <00:18:07.105>work, <00:18:07.305>not

376
00:18:08.685 --> 00:18:12.525
<00:18:08.685>as <00:18:08.885>the <00:18:09.085>absolute <00:18:09.284>golden <00:18:09.485>source <00:18:09.685>of <00:18:09.885>true <00:18:10.085>information

377
00:18:12.785 --> 00:18:15.005
<00:18:12.785>or <00:18:13.135>the <00:18:13.485>perfect <00:18:13.835>information <00:18:14.185>set.

378
00:18:15.065 --> 00:18:18.765
<00:18:15.065>Let, <00:18:15.192>let <00:18:15.319>me <00:18:15.446>just <00:18:15.574>give <00:18:15.701>an <00:18:15.828>example, <00:18:15.955>which <00:18:16.083>is <00:18:16.210>imagine <00:18:16.337>that <00:18:16.465>I,

379
00:18:19.505 --> 00:18:22.005
<00:18:19.505>uh, <00:18:19.705>have <00:18:19.905>been <00:18:20.105>tasked <00:18:20.305>with <00:18:20.505>creating <00:18:20.705>a <00:18:20.905>piece

380
00:18:22.005 --> 00:18:24.445
<00:18:22.005>of <00:18:22.355>content <00:18:22.705>about <00:18:23.055>some <00:18:23.405>topic.

381
00:18:24.905 --> 00:18:29.765
<00:18:24.905>We <00:18:25.032>can <00:18:25.159>go <00:18:25.286>back <00:18:25.414>to <00:18:25.541>my <00:18:25.668>example <00:18:25.795>of, <00:18:25.923>uh, <00:18:26.050>um, <00:18:26.177>the <00:18:26.305>syncing

382
00:18:29.765 --> 00:18:32.645
<00:18:29.765>of <00:18:29.920>the <00:18:30.076>Bismarck <00:18:30.231>in <00:18:30.387>World <00:18:30.542>War <00:18:30.698>ii, <00:18:30.853>uh, <00:18:31.009>for <00:18:31.165>example,

383
00:18:33.105 --> 00:18:36.765
<00:18:33.105>and <00:18:33.245>I <00:18:33.385>asked <00:18:33.525>my <00:18:33.665>Gen <00:18:33.805>AI <00:18:33.945>platform <00:18:34.085>for <00:18:34.225>an <00:18:34.365>outline <00:18:34.505>of

384
00:18:36.765 --> 00:18:39.085
<00:18:36.765>that <00:18:36.940>article, <00:18:37.115>and <00:18:37.290>maybe <00:18:37.465>I'll <00:18:37.640>be <00:18:37.815>a <00:18:37.990>little <00:18:38.165>clever

385
00:18:39.105 --> 00:18:40.565
<00:18:39.105>and <00:18:39.324>I'll <00:18:39.543>ask <00:18:39.762>it <00:18:39.981>for <00:18:40.200>three <00:18:40.419>outlines,

386
00:18:40.785 --> 00:18:42.325
<00:18:40.785>and <00:18:41.062>then <00:18:41.339>I'll <00:18:41.616>review <00:18:41.893>the <00:18:42.171>outlines

387
00:18:42.345 --> 00:18:44.765
<00:18:42.345>and <00:18:42.578>I'll, <00:18:42.811>um, <00:18:43.045>uh, <00:18:43.278>go <00:18:43.511>through <00:18:43.745>them

388
00:18:44.985 --> 00:18:48.325
<00:18:44.985>and, <00:18:45.112>uh, <00:18:45.239>drop <00:18:45.366>out <00:18:45.494>the <00:18:45.621>things <00:18:45.748>that <00:18:45.875>I <00:18:46.003>don't <00:18:46.130>think, <00:18:46.257>uh, <00:18:46.385>belong

389
00:18:48.385 --> 00:18:50.525
<00:18:48.385>and <00:18:48.512>maybe <00:18:48.639>add <00:18:48.766>a <00:18:48.894>thing <00:18:49.021>or <00:18:49.148>two <00:18:49.275>that <00:18:49.403>I <00:18:49.530>think <00:18:49.657>they <00:18:49.785>missed.

390
00:18:50.625 --> 00:18:55.285
<00:18:50.625>And <00:18:50.732>I <00:18:50.840>can <00:18:50.948>do <00:18:51.055>that <00:18:51.163>much <00:18:51.271>faster <00:18:51.378>using <00:18:51.486>the <00:18:51.594>gen <00:18:51.701>ai <00:18:51.809>ai <00:18:51.917>tool <00:18:52.025>than

391
00:18:55.285 --> 00:18:57.165
<00:18:55.285>I <00:18:55.425>would <00:18:55.565>if <00:18:55.705>I <00:18:55.845>started <00:18:55.985>with <00:18:56.125>a <00:18:56.265>blank <00:18:56.405>sheet <00:18:56.545>of <00:18:56.685>paper.

392
00:18:57.505 --> 00:18:59.205
<00:18:57.505>And, <00:18:57.738>and, <00:18:57.971>and <00:18:58.205>so <00:18:58.438>it <00:18:58.671>gets <00:18:58.905>tricky

393
00:18:59.225 --> 00:19:00.845
<00:18:59.225>as <00:18:59.425>you <00:18:59.625>go <00:18:59.824>further <00:19:00.024>and <00:19:00.225>further <00:19:00.425>into <00:19:00.625>it.

394
00:19:01.035 --> 00:19:03.085
<00:19:01.035>Like <00:19:01.210>if <00:19:01.385>you <00:19:01.560>ask <00:19:01.735>it <00:19:01.910>to <00:19:02.085>write <00:19:02.260>the <00:19:02.435>article.

395
00:19:03.545 --> 00:19:04.965
<00:19:03.545>So <00:19:03.971>far <00:19:04.397>my <00:19:04.822>experience,

396
00:19:05.185 --> 00:19:06.485
<00:19:05.185>and <00:19:05.352>I've <00:19:05.519>been <00:19:05.686>through <00:19:05.853>this <00:19:06.020>with <00:19:06.187>a <00:19:06.355>number

397
00:19:06.485 --> 00:19:10.815
<00:19:06.485>of <00:19:06.685>different <00:19:06.885>companies, <00:19:07.084>is <00:19:07.284>that <00:19:07.485>it's <00:19:07.685>almost <00:19:07.885>not

398
00:19:11.325 --> 00:19:12.735
<00:19:11.325>helpful, <00:19:12.593>um,

399
00:19:12.735 --> 00:19:15.055
<00:19:12.735>because <00:19:12.909>there's <00:19:13.084>enough <00:19:13.260>rework <00:19:13.435>that <00:19:13.610>needs <00:19:13.784>to <00:19:13.959>be <00:19:14.135>done

400
00:19:15.115 --> 00:19:18.695
<00:19:15.115>to <00:19:15.242>get <00:19:15.369>it <00:19:15.496>to <00:19:15.624>where, <00:19:15.751>you <00:19:15.878>know, <00:19:16.005>each <00:19:16.133>particular <00:19:16.260>company <00:19:16.387>I <00:19:16.515>work

401
00:19:18.695 --> 00:19:21.735
<00:19:18.695>with <00:19:18.822>in <00:19:18.949>my <00:19:19.076>examples <00:19:19.204>here <00:19:19.331>felt <00:19:19.458>it <00:19:19.585>was <00:19:19.713>suitable <00:19:19.840>for <00:19:19.967>their <00:19:20.095>use.

402
00:19:21.845 --> 00:19:23.335
<00:19:21.845>There's <00:19:22.113>other <00:19:22.381>things <00:19:22.649>you <00:19:22.917>can <00:19:23.186>ask.

403
00:19:23.795 --> 00:19:25.895
<00:19:23.795>You <00:19:23.970>can <00:19:24.145>ask <00:19:24.320>for <00:19:24.495>key <00:19:24.670>trends <00:19:24.845>on <00:19:25.020>the <00:19:25.195>topic.

404
00:19:26.515 --> 00:19:29.935
<00:19:26.515>You <00:19:26.655>can <00:19:26.795>ask <00:19:26.935>for, <00:19:27.075>um, <00:19:27.215>give <00:19:27.355>me <00:19:27.495>a <00:19:27.635>list <00:19:27.775>of <00:19:27.915>facts

405
00:19:29.995 --> 00:19:33.255
<00:19:29.995>and <00:19:30.228>statistics <00:19:30.461>about <00:19:30.695>the <00:19:30.928>topic, <00:19:31.161>including <00:19:31.395>sources.

406
00:19:34.035 --> 00:19:37.495
<00:19:34.035>Um, <00:19:34.175>you <00:19:34.315>know, <00:19:34.455>give <00:19:34.595>me <00:19:34.735>a <00:19:34.875>set <00:19:35.015>of <00:19:35.155>frequently <00:19:35.295>asked <00:19:35.435>questions

407
00:19:37.835 --> 00:19:39.535
<00:19:37.835>and <00:19:38.068>you <00:19:38.301>can <00:19:38.535>approach <00:19:38.768>it <00:19:39.001>multiple <00:19:39.235>different

408
00:19:39.855 --> 00:19:41.095
<00:19:39.855>ways, <00:19:40.413>different <00:19:40.971>ways.

409
00:19:41.095 --> 00:19:45.495
<00:19:41.095>And <00:19:41.250>then <00:19:41.406>my <00:19:41.561>job <00:19:41.717>as <00:19:41.872>a, <00:19:42.028>a <00:19:42.183>content <00:19:42.339>creator <00:19:42.495>is,

410
00:19:46.275 --> 00:19:47.695
<00:19:46.275>is <00:19:46.914>greatly <00:19:47.553>simplified

411
00:19:47.695 --> 00:19:49.575
<00:19:47.695>because <00:19:47.928>everything <00:19:48.161>has <00:19:48.395>been <00:19:48.628>assembled <00:19:48.861>for <00:19:49.095>me,

412
00:19:49.575 --> 00:19:50.695
<00:19:49.575>like <00:19:50.079>rapid <00:19:50.582>fire.

413
00:19:51.075 --> 00:19:54.135
<00:19:51.075>So <00:19:51.230>maybe <00:19:51.386>it <00:19:51.541>only <00:19:51.697>saves <00:19:51.852>me <00:19:52.008>20% <00:19:52.163>of <00:19:52.319>the <00:19:52.475>time

414
00:19:54.155 --> 00:19:55.655
<00:19:54.155>and <00:19:54.379>the <00:19:54.605>cost <00:19:54.830>of <00:19:55.055>creating <00:19:55.280>the <00:19:55.504>article,

415
00:19:56.045 --> 00:19:59.415
<00:19:56.045>what <00:19:56.200>company <00:19:56.356>out <00:19:56.511>there <00:19:56.667>wouldn't <00:19:56.822>die <00:19:56.978>for <00:19:57.133>a <00:19:57.289>20% <00:19:57.445>gain.

416
00:20:00.135 --> 00:20:01.935
<00:20:00.135>I <00:20:00.485>mean, <00:20:00.835>it's, <00:20:01.185>that's <00:20:01.535>real.

417
00:20:01.955 --> 00:20:04.055
<00:20:01.955>That's <00:20:02.235>very <00:20:02.514>important <00:20:02.794>and <00:20:03.074>it's <00:20:03.355>valuable.

418
00:20:04.605 --> 00:20:06.535
<00:20:04.605>Everybody <00:20:04.955>who's <00:20:05.305>in <00:20:05.655>any <00:20:06.005>level

419
00:20:06.535 --> 00:20:08.895
<00:20:06.535>of <00:20:06.710>content <00:20:06.885>creation <00:20:07.060>should <00:20:07.235>be <00:20:07.410>doing <00:20:07.585>something <00:20:07.760>along <00:20:07.935>these

420
00:20:08.895 --> 00:20:10.975
<00:20:08.895>lines, <00:20:09.245>um, <00:20:09.595>in <00:20:09.945>my <00:20:10.295>opinion,

421
00:20:11.285 --> 00:20:13.375
<00:20:11.285>because <00:20:11.460>there's <00:20:11.635>so <00:20:11.810>much <00:20:11.985>to <00:20:12.160>be <00:20:12.335>gotten <00:20:12.510>from <00:20:12.685>it.

422
00:20:13.795 --> 00:20:15.935
<00:20:13.795>And <00:20:13.950>of <00:20:14.106>course, <00:20:14.261>there's, <00:20:14.417>there's <00:20:14.572>a <00:20:14.728>lot <00:20:14.883>of <00:20:15.039>other <00:20:15.195>simpler

423
00:20:16.615 --> 00:20:21.175
<00:20:16.615>queries <00:20:16.770>where <00:20:16.926>the <00:20:17.081>gen <00:20:17.237>AI <00:20:17.392>tools, <00:20:17.548>you <00:20:17.703>know, <00:20:17.859>provide, <00:20:18.015>um,

424
00:20:21.875 --> 00:20:26.135
<00:20:21.875>you <00:20:22.030>know, <00:20:22.186>good <00:20:22.341>enough <00:20:22.497>information, <00:20:22.652>uh, <00:20:22.808>for <00:20:22.963>the, <00:20:23.119>you <00:20:23.275>know,

425
00:20:26.135 --> 00:20:27.455
<00:20:26.135>the, <00:20:26.432>the <00:20:26.729>situation <00:20:27.025>at <00:20:27.322>hand.

426
00:20:27.675 --> 00:20:30.945
<00:20:27.675>So <00:20:27.850>it's <00:20:28.024>sort <00:20:28.200>of <00:20:28.375>finding <00:20:28.550>those <00:20:28.725>places <00:20:28.899>where <00:20:29.075>the,

427
00:20:31.615 --> 00:20:35.145
<00:20:31.615>essentially <00:20:31.848>the <00:20:32.081>potential <00:20:32.315>problems <00:20:32.548>don't <00:20:32.781>bother <00:20:33.015>you.

428
00:20:35.885 --> 00:20:38.625
<00:20:35.885>An <00:20:36.040>interesting <00:20:36.196>one <00:20:36.351>is <00:20:36.507>though, <00:20:36.662>like <00:20:36.818>the, <00:20:36.973>the, <00:20:37.129>the <00:20:37.285>emergence

429
00:20:38.625 --> 00:20:42.425
<00:20:38.625>of <00:20:38.800>AI <00:20:38.975>slop, <00:20:39.150>like, <00:20:39.325>uh, <00:20:39.500>generated <00:20:39.675>content <00:20:39.850>from <00:20:40.025>AI

430
00:20:42.695 --> 00:20:45.825
<00:20:42.695>that <00:20:42.870>is <00:20:43.044>there <00:20:43.220>to, <00:20:43.395>to <00:20:43.570>just <00:20:43.745>overwhelm <00:20:43.919>a <00:20:44.095>system

431
00:20:46.005 --> 00:20:48.205
<00:20:46.005>and <00:20:46.205>overwhelm <00:20:46.405>a <00:20:46.605>search <00:20:46.805>engine, <00:20:47.005>just <00:20:47.205>to <00:20:47.405>show

432
00:20:48.205 --> 00:20:50.965
<00:20:48.205>that <00:20:48.360>there <00:20:48.516>was <00:20:48.671>great <00:20:48.827>examples <00:20:48.982>where <00:20:49.138>somebody <00:20:49.293>had <00:20:49.449>a <00:20:49.605>website

433
00:20:50.965 --> 00:20:53.245
<00:20:50.965>and <00:20:51.139>he <00:20:51.314>said <00:20:51.490>like, <00:20:51.665>okay, <00:20:51.840>ask <00:20:52.014>the <00:20:52.189>AI <00:20:52.365>system

434
00:20:53.305 --> 00:20:55.085
<00:20:53.305>to <00:20:53.585>SEO <00:20:53.865>optimize <00:20:54.145>it <00:20:54.425>for <00:20:54.705>him.

435
00:20:55.425 --> 00:20:56.645
<00:20:55.425>And <00:20:55.791>basically <00:20:56.157>it <00:20:56.523>managed

436
00:20:56.665 --> 00:20:58.685
<00:20:56.665>to <00:20:56.865>get <00:20:57.065>him <00:20:57.264>high <00:20:57.465>on <00:20:57.665>the <00:20:57.865>Google <00:20:58.065>results

437
00:20:58.685 --> 00:21:01.365
<00:20:58.685>and <00:20:58.812>on <00:20:58.939>the <00:20:59.066>ping <00:20:59.194>results, <00:20:59.321>but <00:20:59.448>none <00:20:59.575>of <00:20:59.703>the <00:20:59.830>content <00:20:59.957>was <00:21:00.085>left.

438
00:21:01.365 --> 00:21:04.125
<00:21:01.365>Like, <00:21:01.540>basically <00:21:01.715>it <00:21:01.890>was <00:21:02.065>just <00:21:02.240>random <00:21:02.415>things <00:21:02.590>in <00:21:02.765>there.

439
00:21:04.985 --> 00:21:07.005
<00:21:04.985>And <00:21:05.185>that's <00:21:05.385>something <00:21:05.584>that, <00:21:05.784>uh, <00:21:05.985>I, <00:21:06.185>I <00:21:06.385>think

440
00:21:07.065 --> 00:21:10.245
<00:21:07.065>as <00:21:07.220>a <00:21:07.376>content <00:21:07.531>creator, <00:21:07.687>it <00:21:07.842>becomes <00:21:07.998>really, <00:21:08.153>really <00:21:08.309>hard <00:21:08.465>to

441
00:21:10.835 --> 00:21:13.445
<00:21:10.835>compete <00:21:11.115>with <00:21:11.395>this <00:21:11.675>automated <00:21:11.955>generated <00:21:12.235>stuff

442
00:21:13.465 --> 00:21:14.645
<00:21:13.465>by <00:21:13.819>thousands <00:21:14.173>of <00:21:14.527>bots.

443
00:21:15.105 --> 00:21:17.605
<00:21:15.105>So <00:21:15.245>do <00:21:15.385>you <00:21:15.525>think <00:21:15.665>there <00:21:15.805>is <00:21:15.945>a <00:21:16.085>way <00:21:16.225>for <00:21:16.365>content <00:21:16.505>creators

444
00:21:17.745 --> 00:21:19.165
<00:21:17.745>to <00:21:17.957>still <00:21:18.170>stand <00:21:18.384>out <00:21:18.597>and <00:21:18.810>make <00:21:19.023>sure

445
00:21:19.165 --> 00:21:20.925
<00:21:19.165>that <00:21:19.445>our <00:21:19.725>stuff <00:21:20.004>is <00:21:20.284>being <00:21:20.565>found

446
00:21:21.145 --> 00:21:24.685
<00:21:21.145>by <00:21:21.300>people <00:21:21.456>rather <00:21:21.611>than <00:21:21.767>just <00:21:21.922>like <00:21:22.078>the, <00:21:22.233>the, <00:21:22.389>the <00:21:22.545>things

447
00:21:24.685 --> 00:21:27.165
<00:21:24.685>that <00:21:24.840>the <00:21:24.996>machine <00:21:25.151>wants <00:21:25.307>to <00:21:25.462>hear <00:21:25.618>created <00:21:25.773>by <00:21:25.929>another <00:21:26.085>machine

448
00:21:27.595 --> 00:21:28.595
<00:21:27.595>Through <00:21:28.495>brand?

449
00:21:28.825 --> 00:21:33.805
<00:21:28.825>If <00:21:28.952>you <00:21:29.079>have <00:21:29.206>a <00:21:29.334>really <00:21:29.461>good <00:21:29.588>brand, <00:21:29.715>um, <00:21:29.843>that <00:21:29.970>becomes <00:21:30.097>an <00:21:30.225>easy

450
00:21:35.065 --> 00:21:39.565
<00:21:35.065>metric <00:21:35.205>that <00:21:35.345>search <00:21:35.485>engines <00:21:35.625>can <00:21:35.765>use, <00:21:35.905>that <00:21:36.045>Google <00:21:36.185>can <00:21:36.325>use <00:21:36.465>to,

451
00:21:40.305 --> 00:21:42.605
<00:21:40.305>um, <00:21:40.771>um, <00:21:41.238>you <00:21:41.705>know,

452
00:21:42.955 --> 00:21:45.245
<00:21:42.955>have <00:21:43.155>more <00:21:43.355>trust <00:21:43.554>in <00:21:43.754>the <00:21:43.955>content <00:21:44.155>created <00:21:44.355>there,

453
00:21:45.535 --> 00:21:48.445
<00:21:45.535>which <00:21:45.710>doesn't <00:21:45.885>mean <00:21:46.060>that <00:21:46.235>really <00:21:46.410>good <00:21:46.585>brands <00:21:46.760>won't <00:21:46.935>abuse

454
00:21:48.445 --> 00:21:49.485
<00:21:48.445>that <00:21:49.380>somehow.

455
00:21:50.345 --> 00:21:51.845
<00:21:50.345>Uh, <00:21:50.615>it, <00:21:50.885>it <00:21:51.155>is <00:21:51.425>a <00:21:51.695>concern.

456
00:21:52.085 --> 00:21:56.285
<00:21:52.085>I <00:21:52.240>agree <00:21:52.396>that, <00:21:52.551>um, <00:21:52.707>that <00:21:52.862>this, <00:21:53.018>they're <00:21:53.173>definitely <00:21:53.329>examples <00:21:53.485>of

457
00:21:56.285 --> 00:21:58.045
<00:21:56.285>where <00:21:56.635>this <00:21:56.985>is <00:21:57.335>working, <00:21:57.685>uh,

458
00:21:58.105 --> 00:22:01.045
<00:21:58.105>and <00:21:58.338>people <00:21:58.571>are <00:21:58.805>succeeding <00:21:59.038>in <00:21:59.271>doing <00:21:59.505>this.

459
00:22:01.085 --> 00:22:02.445
<00:22:01.085>And <00:22:01.289>Google, <00:22:01.493>of <00:22:01.697>course, <00:22:01.901>is <00:22:02.105>doing <00:22:02.309>everything

460
00:22:02.445 --> 00:22:03.525
<00:22:02.445>they <00:22:02.639>can <00:22:02.833>to <00:22:03.028>root <00:22:03.222>it <00:22:03.417>out.

461
00:22:04.355 --> 00:22:08.415
<00:22:04.355>Um, <00:22:04.530>and <00:22:04.705>I <00:22:04.880>have <00:22:05.055>a <00:22:05.230>strong <00:22:05.405>belief <00:22:05.580>that's <00:22:05.755>one

462
00:22:08.415 --> 00:22:11.655
<00:22:08.415>of <00:22:08.570>the <00:22:08.726>reasons <00:22:08.881>why <00:22:09.037>the <00:22:09.192>cycle <00:22:09.348>of <00:22:09.503>Google <00:22:09.659>updates <00:22:09.815>is

463
00:22:11.795 --> 00:22:13.255
<00:22:11.795>so <00:22:12.057>much <00:22:12.320>faster <00:22:12.583>than <00:22:12.846>it <00:22:13.109>was.

464
00:22:14.355 --> 00:22:18.945
<00:22:14.355>We <00:22:14.471>had <00:22:14.588>one <00:22:14.705>point, <00:22:14.821>I <00:22:14.938>think <00:22:15.055>it <00:22:15.171>was <00:22:15.288>like <00:22:15.405>after <00:22:15.521>March <00:22:15.638>or <00:22:15.755>May

465
00:22:18.945 --> 00:22:22.425
<00:22:18.945>or <00:22:19.072>last <00:22:19.199>year, <00:22:19.326>we <00:22:19.454>didn't <00:22:19.581>see <00:22:19.708>an <00:22:19.835>update <00:22:19.963>for <00:22:20.090>like <00:22:20.217>five <00:22:20.345>months

466
00:22:22.485 --> 00:22:25.705
<00:22:22.485>or <00:22:22.659>something, <00:22:22.834>and <00:22:23.010>then <00:22:23.185>it <00:22:23.360>was <00:22:23.534>bang, <00:22:23.709>bang <00:22:23.885>month

467
00:22:25.705 --> 00:22:27.145
<00:22:25.705>after <00:22:26.137>month, <00:22:26.569>you <00:22:27.001>know,

468
00:22:27.345 --> 00:22:29.905
<00:22:27.345>'cause <00:22:27.520>they're <00:22:27.695>trying <00:22:27.870>to, <00:22:28.045>they're <00:22:28.220>clean <00:22:28.395>this <00:22:28.570>crap <00:22:28.745>out.

469
00:22:30.295 --> 00:22:31.705
<00:22:30.295>Well, <00:22:30.506>I <00:22:30.718>guess <00:22:30.929>it's <00:22:31.141>also <00:22:31.352>the <00:22:31.563>release

470
00:22:31.705 --> 00:22:34.065
<00:22:31.705>of <00:22:31.845>Gemini <00:22:31.985>was <00:22:32.125>also <00:22:32.264>the <00:22:32.405>thing <00:22:32.544>that <00:22:32.685>they <00:22:32.824>actually <00:22:32.965>had <00:22:33.105>like,

471
00:22:34.685 --> 00:22:37.385
<00:22:34.685>uh, <00:22:34.840>uh, <00:22:34.996>uh, <00:22:35.151>uh, <00:22:35.307>cooking <00:22:35.462>in <00:22:35.618>the <00:22:35.773>background <00:22:35.929>for <00:22:36.085>month.

472
00:22:37.765 --> 00:22:39.825
<00:22:37.765>And <00:22:37.940>now <00:22:38.115>they <00:22:38.290>finally <00:22:38.465>released <00:22:38.640>it <00:22:38.815>and <00:22:38.990>they <00:22:39.165>wanted,

473
00:22:39.965 --> 00:22:42.105
<00:22:39.965>and <00:22:40.139>it's <00:22:40.314>interesting <00:22:40.490>because <00:22:40.665>when <00:22:40.840>you <00:22:41.014>do <00:22:41.189>the <00:22:41.365>comparisons

474
00:22:42.105 --> 00:22:44.625
<00:22:42.105>of <00:22:42.260>like <00:22:42.416>the <00:22:42.571>different <00:22:42.727>engines, <00:22:42.882>Gemini <00:22:43.038>is <00:22:43.193>doing <00:22:43.349>really <00:22:43.505>well,

475
00:22:45.015 --> 00:22:48.465
<00:22:45.015>like <00:22:45.170>compared <00:22:45.326>to, <00:22:45.481>to <00:22:45.637>open <00:22:45.792>AI <00:22:45.948>saying <00:22:46.103>like, <00:22:46.259>they, <00:22:46.415>they,

476
00:22:48.525 --> 00:22:51.225
<00:22:48.525>the <00:22:48.665>cost <00:22:48.805>of <00:22:48.945>it <00:22:49.085>is <00:22:49.225>far <00:22:49.365>too <00:22:49.505>high <00:22:49.645>than <00:22:49.785>the, <00:22:49.925>what,

477
00:22:51.255 --> 00:22:52.465
<00:22:51.255>what <00:22:51.472>they <00:22:51.690>maintain <00:22:51.908>at <00:22:52.126>the <00:22:52.344>moment.

478
00:22:52.465 --> 00:22:54.545
<00:22:52.465>Even <00:22:52.665>the <00:22:52.865>$200 <00:22:53.064>a <00:22:53.264>month <00:22:53.465>is <00:22:53.665>actually <00:22:53.865>not

479
00:22:54.745 --> 00:22:55.945
<00:22:54.745>breaking <00:22:55.105>even <00:22:55.465>for <00:22:55.824>them.

480
00:22:56.845 --> 00:22:58.425
<00:22:56.845>So <00:22:57.078>it's <00:22:57.311>an <00:22:57.545>interesting <00:22:57.778>bit <00:22:58.011>to <00:22:58.245>see

481
00:22:58.445 --> 00:23:00.345
<00:22:58.445>how <00:22:58.645>much <00:22:58.845>money <00:22:59.044>will <00:22:59.245>go <00:22:59.445>into <00:22:59.645>that <00:22:59.845>one.

482
00:23:00.895 --> 00:23:03.185
<00:23:00.895>What <00:23:01.095>I <00:23:01.295>found <00:23:01.495>interesting <00:23:01.695>is <00:23:01.895>like <00:23:02.095>two <00:23:02.295>things.

483
00:23:03.325 --> 00:23:06.985
<00:23:03.325>The, <00:23:03.465>the, <00:23:03.605>um, <00:23:03.745>the <00:23:03.885>indexing <00:23:04.025>of <00:23:04.165>Google <00:23:04.305>was <00:23:04.445>very, <00:23:04.585>very <00:23:04.725>fast.

484
00:23:07.575 --> 00:23:08.905
<00:23:07.575>Like <00:23:07.874>my <00:23:08.173>blog <00:23:08.472>has <00:23:08.772>been

485
00:23:08.905 --> 00:23:10.785
<00:23:08.905>around <00:23:09.080>since <00:23:09.254>2006 <00:23:09.430>when <00:23:09.605>I <00:23:09.780>wrote <00:23:09.955>a <00:23:10.129>blog <00:23:10.305>post.

486
00:23:10.845 --> 00:23:12.585
<00:23:10.845>10 <00:23:11.000>minutes <00:23:11.156>later <00:23:11.311>I <00:23:11.467>found <00:23:11.622>it <00:23:11.778>in <00:23:11.933>a <00:23:12.089>Google <00:23:12.245>search.

487
00:23:13.405 --> 00:23:16.825
<00:23:13.405>Now, <00:23:13.560>uh, <00:23:13.716>uh, <00:23:13.871>LLMs <00:23:14.027>have <00:23:14.182>a <00:23:14.338>model <00:23:14.493>that <00:23:14.649>actually <00:23:14.805>needs

488
00:23:16.825 --> 00:23:18.625
<00:23:16.825>to <00:23:17.000>be <00:23:17.175>weighted, <00:23:17.350>that <00:23:17.525>needs <00:23:17.700>to <00:23:17.875>be <00:23:18.050>cleaned <00:23:18.225>up,

489
00:23:18.625 --> 00:23:19.945
<00:23:18.625>that <00:23:18.922>needs <00:23:19.219>to <00:23:19.515>be <00:23:19.812>re-released.

490
00:23:20.245 --> 00:23:22.505
<00:23:20.245>Yes. <00:23:20.445>There <00:23:20.645>is <00:23:20.844>no <00:23:21.044>immediacy <00:23:21.245>in <00:23:21.445>that <00:23:21.645>one.

491
00:23:22.985 --> 00:23:24.985
<00:23:22.985>I <00:23:23.159>always <00:23:23.334>feel <00:23:23.510>like <00:23:23.685>when <00:23:23.860>I <00:23:24.034>use <00:23:24.209>chat <00:23:24.385>GPT

492
00:23:24.985 --> 00:23:26.745
<00:23:24.985>or <00:23:25.218>something, <00:23:25.451>it <00:23:25.685>feels <00:23:25.918>like <00:23:26.151>hitting, <00:23:26.385>uh,

493
00:23:26.865 --> 00:23:28.025
<00:23:26.865>I <00:23:27.126>feel <00:23:27.387>lucky <00:23:27.648>in <00:23:27.909>Google

494
00:23:28.175 --> 00:23:29.785
<00:23:28.175>because <00:23:28.455>I <00:23:28.735>get <00:23:29.014>the <00:23:29.294>first <00:23:29.575>result

495
00:23:29.785 --> 00:23:31.265
<00:23:29.785>that <00:23:30.051>has <00:23:30.317>been <00:23:30.584>indexed <00:23:30.850>years <00:23:31.117>ago.

496
00:23:31.925 --> 00:23:34.385
<00:23:31.925>And <00:23:32.205>information <00:23:32.485>is <00:23:32.764>normally <00:23:33.044>like <00:23:33.325>one

497
00:23:34.385 --> 00:23:36.425
<00:23:34.385>or <00:23:34.540>two <00:23:34.696>years <00:23:34.851>out <00:23:35.007>of <00:23:35.162>date <00:23:35.318>in <00:23:35.473>the <00:23:35.629>free <00:23:35.785>versions,

498
00:23:36.525 --> 00:23:37.905
<00:23:36.525>not <00:23:36.732>in <00:23:36.939>the, <00:23:37.146>in <00:23:37.353>the <00:23:37.560>paid <00:23:37.767>ones.

499
00:23:38.485 --> 00:23:41.185
<00:23:38.485>So <00:23:38.612>do <00:23:38.739>you <00:23:38.866>think <00:23:38.994>that's <00:23:39.121>an, <00:23:39.248>uh, <00:23:39.375>that's <00:23:39.503>a, <00:23:39.630>a, <00:23:39.757>a <00:23:39.885>thing

500
00:23:41.185 --> 00:23:42.705
<00:23:41.185>that <00:23:41.640>will <00:23:42.097>make <00:23:42.553>sure

501
00:23:42.705 --> 00:23:45.325
<00:23:42.705>that <00:23:42.905>search <00:23:43.105>is <00:23:43.304>still <00:23:43.504>an <00:23:43.705>interesting <00:23:43.905>bit <00:23:44.105>compared

502
00:23:45.385 --> 00:23:47.885
<00:23:45.385>to <00:23:45.540>just <00:23:45.696>having <00:23:45.851>a <00:23:46.007>chat <00:23:46.162>as <00:23:46.318>your <00:23:46.473>main <00:23:46.629>information <00:23:46.785>source?

503
00:23:48.995 --> 00:23:51.855
<00:23:48.995>The <00:23:49.150>immediacy <00:23:49.306>of <00:23:49.461>it <00:23:49.617>is, <00:23:49.772>is <00:23:49.928>basically <00:23:50.083>that <00:23:50.239>the <00:23:50.395>delay

504
00:23:51.985 --> 00:23:55.895
<00:23:51.985>until <00:23:52.159>the <00:23:52.334>model <00:23:52.510>gets <00:23:52.685>recreated <00:23:52.860>is <00:23:53.034>something <00:23:53.209>that <00:23:53.385>will

505
00:23:56.565 --> 00:23:58.415
<00:23:56.565>make <00:23:56.765>sure <00:23:56.965>that <00:23:57.165>search <00:23:57.365>will <00:23:57.565>not <00:23:57.765>go <00:23:57.965>away.

506
00:23:58.955 --> 00:24:02.565
<00:23:58.955>Yeah. <00:23:59.095>Well, <00:23:59.235>in <00:23:59.375>Google <00:23:59.514>par, <00:23:59.655>uh, <00:23:59.794>parlance, <00:23:59.935>uh, <00:24:00.074>we <00:24:00.215>would <00:24:00.355>call

507
00:24:02.565 --> 00:24:04.325
<00:24:02.565>that <00:24:03.265>freshness, <00:24:03.965>right?

508
00:24:04.705 --> 00:24:09.485
<00:24:04.705>Uh, <00:24:04.938>so, <00:24:05.171>um, <00:24:05.405>we, <00:24:05.638>um, <00:24:05.871>the <00:24:06.105>need

509
00:24:09.485 --> 00:24:10.645
<00:24:09.485>for <00:24:09.745>fresh <00:24:10.006>content, <00:24:10.268>you <00:24:10.529>know,

510
00:24:10.645 --> 00:24:12.085
<00:24:10.645>there's <00:24:10.904>a <00:24:11.163>sporting <00:24:11.422>event <00:24:11.681>going <00:24:11.941>on.

511
00:24:12.425 --> 00:24:16.445
<00:24:12.425>Um, <00:24:12.625>a <00:24:12.825>major <00:24:13.024>political <00:24:13.225>figure <00:24:13.425>is <00:24:13.625>speaking, <00:24:13.825>uh,

512
00:24:16.445 --> 00:24:18.925
<00:24:16.445>people <00:24:16.678>are <00:24:16.911>looking <00:24:17.145>for <00:24:17.378>election <00:24:17.611>results <00:24:17.845>there.

513
00:24:21.465 --> 00:24:24.485
<00:24:21.465>Uh, <00:24:21.698>you <00:24:21.931>know, <00:24:22.165>uh, <00:24:22.398>sports <00:24:22.631>scores, <00:24:22.865>uh,

514
00:24:25.025 --> 00:24:26.165
<00:24:25.025>uh, <00:24:25.538>weather <00:24:26.051>information.

515
00:24:26.165 --> 00:24:30.005
<00:24:26.165>These <00:24:26.305>are <00:24:26.445>all <00:24:26.585>things <00:24:26.725>where <00:24:26.865>immediacy <00:24:27.004>is <00:24:27.145>a <00:24:27.284>big <00:24:27.425>issue, <00:24:27.565>right?

516
00:24:30.585 --> 00:24:33.565
<00:24:30.585>Um, <00:24:30.818>and <00:24:31.051>then <00:24:31.285>there's <00:24:31.518>events, <00:24:31.751>earthquakes, <00:24:31.985>volcanoes,

517
00:24:33.565 --> 00:24:34.965
<00:24:33.565>tornadoes, <00:24:34.195>et <00:24:34.824>cetera.

518
00:24:35.465 --> 00:24:38.925
<00:24:35.465>Um, <00:24:35.639>these <00:24:35.814>are, <00:24:35.990>uh, <00:24:36.165>there's <00:24:36.340>a <00:24:36.514>lot <00:24:36.689>of <00:24:36.865>queries

519
00:24:38.925 --> 00:24:42.325
<00:24:38.925>where <00:24:39.158>people <00:24:39.391>want <00:24:39.625>very <00:24:39.858>real <00:24:40.091>time <00:24:40.325>response.

520
00:24:42.865 --> 00:24:45.925
<00:24:42.865>It <00:24:42.992>will <00:24:43.119>take <00:24:43.246>the <00:24:43.374>LLMs <00:24:43.501>a <00:24:43.628>while <00:24:43.755>to <00:24:43.883>get <00:24:44.010>that <00:24:44.137>set <00:24:44.265>up.

521
00:24:46.155 --> 00:24:49.205
<00:24:46.155>Yeah, <00:24:46.295>I'm <00:24:46.435>not <00:24:46.575>sure <00:24:46.715>what <00:24:46.855>path <00:24:46.995>you <00:24:47.135>have <00:24:47.274>to <00:24:47.415>go <00:24:47.555>down.

522
00:24:49.265 --> 00:24:51.565
<00:24:49.265>And <00:24:49.465>I <00:24:49.665>think <00:24:49.865>it <00:24:50.065>leads <00:24:50.265>Chris <00:24:50.465>to <00:24:50.665>one

523
00:24:51.565 --> 00:24:55.325
<00:24:51.565>of <00:24:51.720>the <00:24:51.876>other <00:24:52.031>big <00:24:52.187>challenges, <00:24:52.342>which <00:24:52.498>is <00:24:52.653>the <00:24:52.809>LLMs <00:24:52.965>currently,

524
00:24:55.325 --> 00:24:59.725
<00:24:55.325>or <00:24:55.465>the <00:24:55.605>gen <00:24:55.745>AI <00:24:55.885>platforms <00:24:56.025>don't <00:24:56.165>really <00:24:56.305>have <00:24:56.445>a <00:24:56.585>valid <00:24:56.725>way

525
00:24:59.725 --> 00:25:02.045
<00:24:59.725>to <00:25:00.191>monetize <00:25:00.658>their <00:25:01.125>platform.

526
00:25:02.965 --> 00:25:06.865
<00:25:02.965>And <00:25:03.105>the <00:25:03.245>place <00:25:03.385>where <00:25:03.524>they're <00:25:03.665>making <00:25:03.804>the <00:25:03.945>most <00:25:04.084>inroads <00:25:04.225>is <00:25:04.365>on

527
00:25:06.865 --> 00:25:09.625
<00:25:06.865>informational <00:25:07.098>queries, <00:25:07.331>where <00:25:07.565>for <00:25:07.798>the <00:25:08.031>most <00:25:08.265>part,

528
00:25:09.625 --> 00:25:11.225
<00:25:09.625>people <00:25:09.975>don't <00:25:10.325>care <00:25:10.675>to <00:25:11.025>advertise.

529
00:25:11.455 --> 00:25:15.945
<00:25:11.455>Even <00:25:11.610>when <00:25:11.766>they <00:25:11.921>try <00:25:12.077>to <00:25:12.232>introduce <00:25:12.388>advertising, <00:25:12.543>they <00:25:12.699>won't <00:25:12.855>be,

530
00:25:17.045 --> 00:25:19.785
<00:25:17.045>um, <00:25:17.245>the <00:25:17.445>best <00:25:17.645>solution <00:25:17.845>for <00:25:18.045>the <00:25:18.245>right, <00:25:18.445>um,

531
00:25:19.815 --> 00:25:21.465
<00:25:19.815>context <00:25:21.215>effectively.

532
00:25:21.655 --> 00:25:24.465
<00:25:21.655>That, <00:25:21.810>that's, <00:25:21.966>that's <00:25:22.121>a <00:25:22.277>big <00:25:22.432>challenge <00:25:22.588>that <00:25:22.743>they're <00:25:22.899>gonna <00:25:23.055>have

533
00:25:24.465 --> 00:25:25.465
<00:25:24.465>to <00:25:24.645>figure <00:25:24.824>out <00:25:25.004>how <00:25:25.185>to <00:25:25.365>solve.

534
00:25:25.465 --> 00:25:28.425
<00:25:25.465>Because <00:25:25.620>as <00:25:25.776>they <00:25:25.931>get <00:25:26.087>into <00:25:26.242>some <00:25:26.398>more <00:25:26.553>of <00:25:26.709>these, <00:25:26.865>more

535
00:25:28.425 --> 00:25:29.585
<00:25:28.425>and <00:25:28.773>more <00:25:29.121>complex <00:25:29.469>models

536
00:25:29.765 --> 00:25:32.835
<00:25:29.765>and <00:25:29.965>everything <00:25:30.165>else, <00:25:30.365>they're <00:25:30.565>driving <00:25:30.765>the <00:25:30.965>expense <00:25:31.165>up

537
00:25:33.455 --> 00:25:37.435
<00:25:33.455>and <00:25:33.595>still, <00:25:33.735>you <00:25:33.875>know, <00:25:34.014>20 <00:25:34.155>bucks <00:25:34.294>or <00:25:34.435>200 <00:25:34.574>bucks <00:25:34.715>a <00:25:34.855>month

538
00:25:37.435 --> 00:25:39.315
<00:25:37.435>or <00:25:37.610>whatever <00:25:37.784>it <00:25:37.960>is, <00:25:38.135>just <00:25:38.310>like <00:25:38.485>you <00:25:38.659>said <00:25:38.835>earlier,

539
00:25:39.465 --> 00:25:41.635
<00:25:39.465>just <00:25:39.745>comes <00:25:40.024>nowhere <00:25:40.304>near <00:25:40.584>covering <00:25:40.865>it

540
00:25:42.375 --> 00:25:45.395
<00:25:42.375>and <00:25:42.575>Microsoft's <00:25:42.775>gonna <00:25:42.975>want <00:25:43.175>their <00:25:43.375>$13 <00:25:43.575>billion <00:25:43.775>back.

541
00:25:45.395 --> 00:25:46.915
<00:25:45.395>They're <00:25:45.623>gonna <00:25:45.851>wanna <00:25:46.079>make <00:25:46.307>profit <00:25:46.534>on <00:25:46.763>that.

542
00:25:47.145 --> 00:25:48.395
<00:25:47.145>Yeah, <00:25:47.426>it's <00:25:47.707>an <00:25:47.988>interesting <00:25:48.270>one.

543
00:25:48.395 --> 00:25:51.195
<00:25:48.395>Like <00:25:48.535>with <00:25:48.675>the, <00:25:48.815>uh, <00:25:48.955>uh, <00:25:49.095>with <00:25:49.235>the <00:25:49.375>monetization <00:25:49.514>of <00:25:49.655>the, <00:25:49.795>uh,

544
00:25:51.495 --> 00:25:53.875
<00:25:51.495>as <00:25:51.669>I <00:25:51.844>said <00:25:52.020>before, <00:25:52.195>like, <00:25:52.370>go <00:25:52.544>Google <00:25:52.719>search <00:25:52.895>results.

545
00:25:54.185 --> 00:25:55.715
<00:25:54.185>Bing <00:25:54.460>search <00:25:54.735>results <00:25:55.011>are <00:25:55.286>like <00:25:55.562>full

546
00:25:55.715 --> 00:25:58.235
<00:25:55.715>of <00:25:55.948>advertisements <00:25:56.181>nowadays <00:25:56.415>rather <00:25:56.648>than <00:25:56.881>like <00:25:57.115>getting

547
00:25:58.235 --> 00:25:59.355
<00:25:58.235>results <00:25:58.571>from <00:25:58.907>the <00:25:59.243>web.

548
00:25:59.735 --> 00:26:02.675
<00:25:59.735>And, <00:25:59.875>uh, <00:26:00.014>one <00:26:00.155>interesting <00:26:00.294>thing <00:26:00.435>that <00:26:00.574>I <00:26:00.715>looked <00:26:00.854>at <00:26:00.995>was, <00:26:01.135>uh,

549
00:26:02.675 --> 00:26:05.835
<00:26:02.675>there <00:26:02.830>was <00:26:02.986>a <00:26:03.141>virtual <00:26:03.297>article <00:26:03.452>about, <00:26:03.608>uh, <00:26:03.763>different <00:26:03.919>AI <00:26:04.075>crawlers

550
00:26:05.855 --> 00:26:07.515
<00:26:05.855>and <00:26:06.088>how <00:26:06.321>they <00:26:06.555>actually <00:26:06.788>index <00:26:07.021>the <00:26:07.255>web.

551
00:26:08.015 --> 00:26:11.915
<00:26:08.015>And <00:26:08.155>it <00:26:08.295>feels <00:26:08.435>like, <00:26:08.575>uh, <00:26:08.715>2001 <00:26:08.855>in, <00:26:08.995>in <00:26:09.135>the <00:26:09.275>search <00:26:09.415>world.

552
00:26:12.075 --> 00:26:15.155
<00:26:12.075>'cause <00:26:12.250>a <00:26:12.425>lot <00:26:12.600>of <00:26:12.775>those <00:26:12.950>actually <00:26:13.125>don't <00:26:13.300>understand <00:26:13.475>JavaScript.

553
00:26:15.155 --> 00:26:17.715
<00:26:15.155>They <00:26:15.330>don't <00:26:15.504>follow <00:26:15.680>JavaScript <00:26:15.855>links <00:26:16.030>or <00:26:16.205>anything <00:26:16.379>like <00:26:16.555>that.

554
00:26:17.815 --> 00:26:20.755
<00:26:17.815>So <00:26:18.015>they <00:26:18.215>need <00:26:18.415>content <00:26:18.615>not <00:26:18.815>even <00:26:19.015>as <00:26:19.215>HTML,

555
00:26:20.755 --> 00:26:23.315
<00:26:20.755>but <00:26:20.988>actually <00:26:21.221>they <00:26:21.455>prefer <00:26:21.688>content <00:26:21.921>as <00:26:22.155>markdown.

556
00:26:23.375 --> 00:26:26.195
<00:26:23.375>So <00:26:23.515>there's <00:26:23.655>a <00:26:23.795>lot <00:26:23.935>of <00:26:24.075>tools <00:26:24.215>that <00:26:24.355>turn <00:26:24.495>websites <00:26:24.635>into <00:26:24.775>markdown

557
00:26:26.415 --> 00:26:27.675
<00:26:26.415>for <00:26:26.793>ingesting <00:26:27.171>into <00:26:27.549>models.

558
00:26:28.415 --> 00:26:31.675
<00:26:28.415>So <00:26:28.542>it <00:26:28.669>feels <00:26:28.796>like <00:26:28.924>there's, <00:26:29.051>uh, <00:26:29.178>uh, <00:26:29.305>there's, <00:26:29.433>uh, <00:26:29.560>a <00:26:29.687>need <00:26:29.815>to,

559
00:26:32.255 --> 00:26:34.835
<00:26:32.255>uh, <00:26:32.488>to <00:26:32.721>publish <00:26:32.955>in <00:26:33.188>static <00:26:33.421>formats <00:26:33.655>again,

560
00:26:34.835 --> 00:26:36.675
<00:26:34.835>rather <00:26:35.185>than <00:26:35.535>like <00:26:35.885>in <00:26:36.235>JavaScript.

561
00:26:37.295 --> 00:26:38.555
<00:26:37.295>And <00:26:37.673>I <00:26:38.051>like <00:26:38.429>that

562
00:26:38.555 --> 00:26:42.115
<00:26:38.555>because <00:26:38.682>I, <00:26:38.809>I, <00:26:38.936>I, <00:26:39.064>I <00:26:39.191>think <00:26:39.318>JavaScript <00:26:39.445>is <00:26:39.573>still <00:26:39.700>flaky <00:26:39.827>in <00:26:39.955>terms

563
00:26:42.115 --> 00:26:44.790
<00:26:42.115>of <00:26:42.290>like <00:26:42.465>interaction <00:26:42.640>when <00:26:42.815>I'm <00:26:42.990>on <00:26:43.165>a <00:26:43.340>bad <00:26:43.515>connection,

564
00:26:44.905 --> 00:26:47.685
<00:26:44.905>but <00:26:45.032>it <00:26:45.159>feels <00:26:45.286>like <00:26:45.414>that <00:26:45.541>there <00:26:45.668>we <00:26:45.795>are, <00:26:45.923>we <00:26:46.050>are <00:26:46.177>back <00:26:46.305>in

565
00:26:48.325 --> 00:26:51.805
<00:26:48.325>pleasing <00:26:48.500>the <00:26:48.675>crawlers <00:26:48.850>in <00:26:49.025>2001 <00:26:49.200>with <00:26:49.375>those <00:26:49.550>AI <00:26:49.725>crawlers,

566
00:26:51.805 --> 00:26:53.445
<00:26:51.805>except <00:26:52.155>we <00:26:52.505>have <00:26:52.855>less <00:26:53.205>insight.

567
00:26:53.865 --> 00:26:56.085
<00:26:53.865>At <00:26:54.065>least <00:26:54.265>Google <00:26:54.465>had <00:26:54.665>their <00:26:54.865>webmaster, <00:26:55.065>uh, <00:26:55.265>portal

568
00:26:56.085 --> 00:26:58.725
<00:26:56.085>where <00:26:56.240>you <00:26:56.396>can <00:26:56.551>ask <00:26:56.707>questions <00:26:56.862>and <00:26:57.018>get <00:26:57.173>like, <00:26:57.329>uh, <00:26:57.485>information,

569
00:26:59.185 --> 00:27:01.605
<00:26:59.185>but <00:26:59.360>we <00:26:59.534>have <00:26:59.710>no <00:26:59.885>idea <00:27:00.060>how <00:27:00.235>these <00:27:00.409>crawlers <00:27:00.585>work

570
00:27:01.865 --> 00:27:04.285
<00:27:01.865>and <00:27:02.040>we <00:27:02.215>just <00:27:02.390>hope <00:27:02.565>that <00:27:02.740>they <00:27:02.915>index <00:27:03.090>our <00:27:03.265>stuff.

571
00:27:04.545 --> 00:27:07.085
<00:27:04.545>Is <00:27:04.720>there <00:27:04.895>any <00:27:05.070>way <00:27:05.245>we <00:27:05.420>can, <00:27:05.595>uh, <00:27:05.770>remediate <00:27:05.945>that?

572
00:27:07.515 --> 00:27:10.365
<00:27:07.515>Yeah, <00:27:07.690>I, <00:27:07.865>I <00:27:08.040>don't <00:27:08.215>know <00:27:08.390>the <00:27:08.565>solution <00:27:08.740>for <00:27:08.915>that.

573
00:27:10.545 --> 00:27:14.285
<00:27:10.545>Uh, <00:27:10.745>Chris, <00:27:10.945>which <00:27:11.145>doesn't <00:27:11.345>necessarily <00:27:11.545>mean <00:27:11.745>someone <00:27:11.945>hasn't

574
00:27:14.285 --> 00:27:16.765
<00:27:14.285>come <00:27:14.460>up <00:27:14.635>with <00:27:14.810>one, <00:27:14.985>but <00:27:15.160>people <00:27:15.335>aren't <00:27:15.510>gonna <00:27:15.685>want

575
00:27:16.765 --> 00:27:17.845
<00:27:16.765>to <00:27:17.008>give <00:27:17.251>up <00:27:17.494>their <00:27:17.737>JavaScript.

576
00:27:17.845 --> 00:27:21.125
<00:27:17.845>They're <00:27:18.000>wholly <00:27:18.156>UX <00:27:18.311>is <00:27:18.467>built <00:27:18.622>on <00:27:18.778>top <00:27:18.933>of <00:27:19.089>it <00:27:19.245>in

577
00:27:21.185 --> 00:27:22.685
<00:27:21.185>so <00:27:21.635>many <00:27:22.085>different <00:27:22.534>sites.

578
00:27:22.825 --> 00:27:25.405
<00:27:22.825>It, <00:27:23.025>it's <00:27:23.225>like <00:27:23.425>LLMs <00:27:23.625>are <00:27:23.825>gonna <00:27:24.025>be <00:27:24.225>forced

579
00:27:25.465 --> 00:27:27.845
<00:27:25.465>to <00:27:25.665>adapt <00:27:25.865>whether <00:27:26.064>they <00:27:26.264>want <00:27:26.465>to <00:27:26.665>or <00:27:26.865>not,

580
00:27:27.945 --> 00:27:30.365
<00:27:27.945>and <00:27:28.120>that <00:27:28.294>will <00:27:28.470>drive <00:27:28.645>the <00:27:28.820>processing <00:27:28.995>challenge <00:27:29.169>even <00:27:29.345>higher.

581
00:27:30.595 --> 00:27:33.205
<00:27:30.595>Well, <00:27:30.722>the <00:27:30.849>other <00:27:30.976>thing <00:27:31.104>was, <00:27:31.231>I <00:27:31.358>could <00:27:31.485>see <00:27:31.613>in <00:27:31.740>my <00:27:31.867>logs <00:27:31.995>when

582
00:27:33.205 --> 00:27:34.365
<00:27:33.205>Google <00:27:33.466>came <00:27:33.726>to <00:27:33.988>my <00:27:34.249>site,

583
00:27:34.685 --> 00:27:36.685
<00:27:34.685>I <00:27:34.885>cannot <00:27:35.085>see <00:27:35.284>if <00:27:35.485>my <00:27:35.685>stuff <00:27:35.885>has <00:27:36.085>been

584
00:27:36.685 --> 00:27:37.965
<00:27:36.685>indexed <00:27:36.973>have <00:27:37.261>become <00:27:37.549>a <00:27:37.837>model.

585
00:27:38.355 --> 00:27:40.765
<00:27:38.355>Like <00:27:38.495>how <00:27:38.635>can <00:27:38.775>I <00:27:38.915>even, <00:27:39.055>uh, <00:27:39.195>uh, <00:27:39.335>how <00:27:39.475>can <00:27:39.615>I <00:27:39.755>even

586
00:27:41.365 --> 00:27:44.165
<00:27:41.365>evaluate <00:27:41.565>my <00:27:41.765>content <00:27:41.965>being <00:27:42.165>used <00:27:42.365>by <00:27:42.565>an <00:27:42.765>LLM?

587
00:27:44.585 --> 00:27:45.925
<00:27:44.585>How <00:27:44.826>do <00:27:45.067>I <00:27:45.308>get <00:27:45.549>this <00:27:45.791>information?

588
00:27:46.435 --> 00:27:47.845
<00:27:46.435>It's <00:27:46.688>not <00:27:46.942>something <00:27:47.196>I've <00:27:47.450>dug <00:27:47.704>into.

589
00:27:47.865 --> 00:27:49.925
<00:27:47.865>So <00:27:48.040>it's <00:27:48.215>a <00:27:48.390>great <00:27:48.565>question. <00:27:48.740>I'd <00:27:48.915>be <00:27:49.090>really <00:27:49.265>interested

590
00:27:50.625 --> 00:27:52.085
<00:27:50.625>in <00:27:50.887>understanding <00:27:51.150>the <00:27:51.413>answer <00:27:51.676>to <00:27:51.939>that.

591
00:27:52.185 --> 00:27:55.125
<00:27:52.185>But, <00:27:52.385>uh, <00:27:52.585>it's <00:27:52.784>the, <00:27:52.985>there, <00:27:53.185>like <00:27:53.385>you <00:27:53.585>said,

592
00:27:55.155 --> 00:27:57.165
<00:27:55.155>it's <00:27:55.504>1998 <00:27:55.855>all <00:27:56.205>over <00:27:56.555>again.

593
00:27:57.745 --> 00:28:00.645
<00:27:57.745>So <00:27:57.861>in, <00:27:57.978>in <00:27:58.094>terms <00:27:58.211>of <00:27:58.328>like, <00:27:58.445>uh, <00:27:58.561>uh, <00:27:58.678>people <00:27:58.794>can <00:27:58.911>look <00:27:59.028>up <00:27:59.145>your,

594
00:28:00.745 --> 00:28:02.405
<00:28:00.745>uh, <00:28:01.024>your <00:28:01.304>article, <00:28:01.584>read <00:28:01.864>about <00:28:02.145>it.

595
00:28:02.405 --> 00:28:04.165
<00:28:02.405>And, <00:28:02.605>and, <00:28:02.805>uh, <00:28:03.004>I, <00:28:03.205>I <00:28:03.405>said, <00:28:03.605>I <00:28:03.805>like

596
00:28:04.165 --> 00:28:05.485
<00:28:04.165>that <00:28:04.462>you <00:28:04.759>basically <00:28:05.055>pointed <00:28:05.352>out

597
00:28:05.485 --> 00:28:07.885
<00:28:05.485>that <00:28:05.718>it's <00:28:05.951>not <00:28:06.185>all <00:28:06.418>negative <00:28:06.651>about <00:28:06.885>LLMs.

598
00:28:07.885 --> 00:28:09.685
<00:28:07.885>That <00:28:08.235>basically <00:28:08.585>it's <00:28:08.935>a, <00:28:09.285>uh,

599
00:28:10.065 --> 00:28:11.565
<00:28:10.065>it <00:28:10.290>seems <00:28:10.515>like <00:28:10.740>when <00:28:10.965>you <00:28:11.190>do <00:28:11.415>research,

600
00:28:11.635 --> 00:28:15.245
<00:28:11.635>it's <00:28:11.775>a <00:28:11.915>great <00:28:12.055>research <00:28:12.195>partner <00:28:12.335>to <00:28:12.475>throw <00:28:12.615>balls <00:28:12.754>back <00:28:12.895>and <00:28:13.035>forth,

601
00:28:16.045 --> 00:28:19.565
<00:28:16.045>but <00:28:16.161>you <00:28:16.278>still <00:28:16.395>have <00:28:16.511>to <00:28:16.628>finally, <00:28:16.745>uh, <00:28:16.861>uh, <00:28:16.978>to <00:28:17.095>do <00:28:17.211>the <00:28:17.328>grunt <00:28:17.445>work

602
00:28:19.665 --> 00:28:20.765
<00:28:19.665>for <00:28:19.995>you <00:28:20.325>of <00:28:20.655>research,

603
00:28:20.865 --> 00:28:22.565
<00:28:20.865>but <00:28:21.065>you <00:28:21.265>still <00:28:21.465>have <00:28:21.665>to <00:28:21.865>validate <00:28:22.065>it <00:28:22.265>yourself

604
00:28:22.625 --> 00:28:24.365
<00:28:22.625>and <00:28:22.858>then <00:28:23.091>write <00:28:23.325>the <00:28:23.558>content <00:28:23.791>yourself, <00:28:24.025>right?

605
00:28:25.255 --> 00:28:26.995
<00:28:25.255>That's <00:28:25.721>right. <00:28:26.188>Um, <00:28:26.655>and,

606
00:28:27.095 --> 00:28:30.595
<00:28:27.095>and <00:28:27.222>so <00:28:27.349>what <00:28:27.476>I <00:28:27.604>tried <00:28:27.731>to <00:28:27.858>do <00:28:27.985>with <00:28:28.113>the <00:28:28.240>article, <00:28:28.367>Chris, <00:28:28.495>is

607
00:28:31.135 --> 00:28:34.715
<00:28:31.135>rather <00:28:31.335>than <00:28:31.535>I <00:28:31.735>did <00:28:31.935>62 <00:28:32.135>queries, <00:28:32.335>I <00:28:32.535>evaluated

608
00:28:34.815 --> 00:28:36.795
<00:28:34.815>and <00:28:34.990>I <00:28:35.165>spent <00:28:35.340>about <00:28:35.515>an <00:28:35.690>hour <00:28:35.865>on <00:28:36.040>each <00:28:36.215>query

609
00:28:36.945 --> 00:28:38.155
<00:28:36.945>fact <00:28:37.308>checking <00:28:37.671>in <00:28:38.033>detail.

610
00:28:38.295 --> 00:28:41.955
<00:28:38.295>And, <00:28:38.435>um, <00:28:38.575>so <00:28:38.715>I <00:28:38.855>was <00:28:38.995>very <00:28:39.135>happy <00:28:39.275>when <00:28:39.415>there <00:28:39.555>were <00:28:39.695>queries

611
00:28:41.955 --> 00:28:43.115
<00:28:41.955>where <00:28:42.129>I <00:28:42.303>already <00:28:42.476>knew <00:28:42.651>all <00:28:42.825>the <00:28:42.999>answers,

612
00:28:43.305 --> 00:28:44.595
<00:28:43.305>like <00:28:43.537>the <00:28:43.769>one <00:28:44.001>I <00:28:44.233>shared <00:28:44.466>earlier.

613
00:28:45.175 --> 00:28:47.555
<00:28:45.175>Um, <00:28:45.315>because <00:28:45.455>those <00:28:45.595>were <00:28:45.735>a <00:28:45.875>little <00:28:46.014>bit <00:28:46.155>of <00:28:46.294>a <00:28:46.435>coffee <00:28:46.575>break

614
00:28:47.555 --> 00:28:48.875
<00:28:47.555>for <00:28:47.753>me, <00:28:47.951>it <00:28:48.149>was <00:28:48.347>like, <00:28:48.545>okay, <00:28:48.743>good.

615
00:28:49.415 --> 00:28:51.475
<00:28:49.415>But, <00:28:49.590>um, <00:28:49.764>but <00:28:49.940>it <00:28:50.115>was <00:28:50.290>a <00:28:50.465>lot <00:28:50.639>of <00:28:50.815>time.

616
00:28:51.715 --> 00:28:53.515
<00:28:51.715>I <00:28:51.889>spent <00:28:52.064>an <00:28:52.240>enormous <00:28:52.415>amount <00:28:52.590>of <00:28:52.764>time <00:28:52.939>into <00:28:53.115>it.

617
00:28:53.615 --> 00:28:57.875
<00:28:53.615>But <00:28:53.742>what <00:28:53.869>I <00:28:53.996>tried <00:28:54.124>to <00:28:54.251>do <00:28:54.378>was <00:28:54.505>just <00:28:54.633>give <00:28:54.760>examples <00:28:54.887>of <00:28:55.015>scenarios

618
00:28:57.895 --> 00:29:01.115
<00:28:57.895>and <00:28:58.035>explain <00:28:58.175>why <00:28:58.315>something <00:28:58.455>might <00:28:58.595>lean <00:28:58.735>one <00:28:58.875>way <00:28:59.014>or <00:28:59.155>the <00:28:59.295>other.

619
00:29:01.775 --> 00:29:04.075
<00:29:01.775>And <00:29:01.930>I'm, <00:29:02.086>I've <00:29:02.241>mentioned <00:29:02.397>a <00:29:02.552>couple <00:29:02.708>of <00:29:02.863>them <00:29:03.019>so <00:29:03.175>far

620
00:29:04.075 --> 00:29:05.955
<00:29:04.075>through <00:29:04.275>the <00:29:04.475>course <00:29:04.675>of <00:29:04.875>our <00:29:05.075>chat <00:29:05.275>here <00:29:05.475>today,

621
00:29:06.295 --> 00:29:07.955
<00:29:06.295>but <00:29:06.575>this <00:29:06.855>may <00:29:07.135>be, <00:29:07.415>uh, <00:29:07.695>eight

622
00:29:08.015 --> 00:29:11.795
<00:29:08.015>or <00:29:08.170>10 <00:29:08.326>different <00:29:08.481>scenarios <00:29:08.637>where <00:29:08.792>I <00:29:08.948>kind <00:29:09.103>of <00:29:09.259>say, <00:29:09.415>well,

623
00:29:11.875 --> 00:29:13.715
<00:29:11.875>for <00:29:12.030>this <00:29:12.186>kind <00:29:12.341>of <00:29:12.497>query, <00:29:12.652>here's <00:29:12.808>how <00:29:12.963>you, <00:29:13.119>I <00:29:13.275>need

624
00:29:13.715 --> 00:29:16.595
<00:29:13.715>to <00:29:13.842>think <00:29:13.969>about <00:29:14.096>it, <00:29:14.224>and <00:29:14.351>this <00:29:14.478>is <00:29:14.605>why <00:29:14.733>I <00:29:14.860>scored <00:29:14.987>Google <00:29:15.115>hire

625
00:29:16.595 --> 00:29:19.195
<00:29:16.595>versus <00:29:16.828>chat <00:29:17.061>GPT <00:29:17.295>hire <00:29:17.528>or <00:29:17.761>vice <00:29:17.995>versa.

626
00:29:19.715 --> 00:29:21.955
<00:29:19.715>I, <00:29:19.855>I <00:29:19.995>thought <00:29:20.135>it <00:29:20.274>was <00:29:20.415>the <00:29:20.554>right <00:29:20.695>way <00:29:20.834>to <00:29:20.975>approach <00:29:21.115>it

627
00:29:21.955 --> 00:29:23.515
<00:29:21.955>because <00:29:22.235>I <00:29:22.514>knew <00:29:22.794>I <00:29:23.074>couldn't <00:29:23.355>score

628
00:29:24.175 --> 00:29:27.595
<00:29:24.175>the <00:29:24.350>platforms <00:29:24.524>in <00:29:24.700>their <00:29:24.875>entirety <00:29:25.050>with <00:29:25.225>62 <00:29:25.399>queries, <00:29:25.575>right?

629
00:29:28.175 --> 00:29:32.155
<00:29:28.175>Uh, <00:29:28.302>but <00:29:28.429>what <00:29:28.556>I <00:29:28.684>could <00:29:28.811>do <00:29:28.938>is <00:29:29.065>illustrate <00:29:29.193>a <00:29:29.320>bunch <00:29:29.447>of <00:29:29.575>ways

630
00:29:32.255 --> 00:29:36.355
<00:29:32.255>to <00:29:32.410>think <00:29:32.566>about <00:29:32.721>it, <00:29:32.877>and <00:29:33.032>that <00:29:33.188>might <00:29:33.343>help <00:29:33.499>people <00:29:33.655>understand

631
00:29:36.655 --> 00:29:39.235
<00:29:36.655>as <00:29:36.782>they <00:29:36.909>start <00:29:37.036>thinking <00:29:37.164>about <00:29:37.291>how <00:29:37.418>they <00:29:37.545>want <00:29:37.673>to <00:29:37.800>use, <00:29:37.927>you <00:29:38.055>know,

632
00:29:39.335 --> 00:29:41.965
<00:29:39.335>gen <00:29:39.510>AI <00:29:39.685>tools <00:29:39.860>or, <00:29:40.035>or <00:29:40.210>your <00:29:40.385>chat <00:29:40.560>GPT <00:29:40.735>search

633
00:29:41.965 --> 00:29:44.805
<00:29:41.965>or <00:29:42.139>Google <00:29:42.314>how <00:29:42.490>they <00:29:42.665>should <00:29:42.840>think <00:29:43.014>about <00:29:43.189>approaching <00:29:43.365>it

634
00:29:44.805 --> 00:29:46.685
<00:29:44.805>and <00:29:44.932>why <00:29:45.059>they <00:29:45.186>might <00:29:45.314>decide <00:29:45.441>to <00:29:45.568>go <00:29:45.695>one <00:29:45.823>way <00:29:45.950>or <00:29:46.077>the <00:29:46.205>other.

635
00:29:47.105 --> 00:29:49.565
<00:29:47.105>One <00:29:47.245>thing <00:29:47.385>I've <00:29:47.525>found <00:29:47.665>is <00:29:47.805>that <00:29:47.945>people <00:29:48.085>that <00:29:48.225>I <00:29:48.365>talked <00:29:48.505>from,

636
00:29:49.565 --> 00:29:52.005
<00:29:49.565>people <00:29:49.765>from <00:29:49.965>nature, <00:29:50.165>for <00:29:50.365>example, <00:29:50.565>and <00:29:50.765>from <00:29:50.965>Reuters

637
00:29:52.065 --> 00:29:53.365
<00:29:52.065>and <00:29:52.455>like <00:29:52.845>news <00:29:53.235>agencies,

638
00:29:53.705 --> 00:29:55.605
<00:29:53.705>and <00:29:53.832>a <00:29:53.959>lot <00:29:54.086>of <00:29:54.214>them, <00:29:54.341>what <00:29:54.468>they <00:29:54.595>do <00:29:54.723>is <00:29:54.850>they <00:29:54.977>compare <00:29:55.105>different

639
00:29:55.605 --> 00:29:57.925
<00:29:55.605>models <00:29:55.780>against <00:29:55.955>each <00:29:56.130>other <00:29:56.305>and <00:29:56.480>actually <00:29:56.655>see <00:29:56.830>them <00:29:57.005>next

640
00:29:57.925 --> 00:30:00.525
<00:29:57.925>to <00:29:58.065>each <00:29:58.205>other <00:29:58.345>and <00:29:58.485>also <00:29:58.625>see <00:29:58.764>how <00:29:58.905>much <00:29:59.044>it <00:29:59.185>costs <00:29:59.325>them

641
00:30:00.585 --> 00:30:01.845
<00:30:00.585>to <00:30:00.811>actually <00:30:01.038>use <00:30:01.265>each <00:30:01.492>of <00:30:01.719>them.

642
00:30:02.185 --> 00:30:04.365
<00:30:02.185>Mm-hmm. <00:30:02.385>To, <00:30:02.585>uh, <00:30:02.784>to <00:30:02.985>basically <00:30:03.185>get, <00:30:03.385>help <00:30:03.585>them

643
00:30:04.365 --> 00:30:05.525
<00:30:04.365>with <00:30:04.713>the <00:30:05.061>research <00:30:05.409>faster.

644
00:30:06.225 --> 00:30:08.605
<00:30:06.225>And, <00:30:06.399>uh, <00:30:06.574>uh, <00:30:06.750>it's <00:30:06.925>interesting <00:30:07.100>with <00:30:07.274>Bing <00:30:07.449>like <00:30:07.625>doing,

645
00:30:08.605 --> 00:30:09.805
<00:30:08.605>giving <00:30:08.965>you <00:30:09.325>web <00:30:09.685>results

646
00:30:09.945 --> 00:30:13.005
<00:30:09.945>and <00:30:10.061>the <00:30:10.178>chat <00:30:10.294>at <00:30:10.411>the <00:30:10.528>same <00:30:10.645>time, <00:30:10.761>so <00:30:10.878>it <00:30:10.995>seems <00:30:11.111>like <00:30:11.228>they <00:30:11.345>want

647
00:30:13.005 --> 00:30:14.645
<00:30:13.005>to <00:30:13.205>help <00:30:13.405>you <00:30:13.605>with, <00:30:13.805>uh, <00:30:14.005>with, <00:30:14.205>uh, <00:30:14.405>doing

648
00:30:14.645 --> 00:30:16.285
<00:30:14.645>that <00:30:14.995>research <00:30:15.345>in <00:30:15.695>both <00:30:16.045>worlds.

649
00:30:17.105 --> 00:30:19.765
<00:30:17.105>Um, <00:30:17.260>but <00:30:17.416>yeah, <00:30:17.571>it's, <00:30:17.727>it's <00:30:17.882>still <00:30:18.038>an <00:30:18.193>interesting <00:30:18.349>one <00:30:18.505>that

650
00:30:20.285 --> 00:30:23.325
<00:30:20.285>I <00:30:20.401>think <00:30:20.518>a <00:30:20.635>lot <00:30:20.751>of <00:30:20.868>stuff <00:30:20.985>that <00:30:21.101>people <00:30:21.218>do <00:30:21.335>that <00:30:21.451>are, <00:30:21.568>uh, <00:30:21.685>uh,

651
00:30:23.325 --> 00:30:25.485
<00:30:23.325>that <00:30:23.558>are <00:30:23.791>experts, <00:30:24.025>that <00:30:24.258>are <00:30:24.491>basically <00:30:24.725>researchers.

652
00:30:25.995 --> 00:30:30.005
<00:30:25.995>They <00:30:26.135>use <00:30:26.274>local <00:30:26.415>models <00:30:26.554>instead <00:30:26.695>of <00:30:26.834>just <00:30:26.975>using <00:30:27.114>just <00:30:27.254>the <00:30:27.395>LLM,

653
00:30:30.075 --> 00:30:31.725
<00:30:30.075>like <00:30:30.355>the, <00:30:30.635>the, <00:30:30.915>the <00:30:31.195>local <00:30:31.475>models

654
00:30:31.725 --> 00:30:34.645
<00:30:31.725>that <00:30:31.925>have <00:30:32.125>been <00:30:32.324>trained <00:30:32.524>on <00:30:32.725>a <00:30:32.925>certain <00:30:33.125>subset

655
00:30:34.865 --> 00:30:37.645
<00:30:34.865>of <00:30:35.065>content <00:30:35.265>rather <00:30:35.465>than <00:30:35.665>just <00:30:35.865>giving <00:30:36.065>you, <00:30:36.265>uh,

656
00:30:37.645 --> 00:30:39.005
<00:30:37.645>the <00:30:37.889>whole <00:30:38.134>world <00:30:38.379>in <00:30:38.624>a <00:30:38.869>nutshell.

657
00:30:39.465 --> 00:30:41.805
<00:30:39.465>Do <00:30:39.605>you <00:30:39.745>think <00:30:39.885>that's <00:30:40.024>something <00:30:40.165>that <00:30:40.304>will <00:30:40.445>come <00:30:40.584>in <00:30:40.725>the <00:30:40.865>future,

658
00:30:41.915 --> 00:30:45.365
<00:30:41.915>that <00:30:42.042>we <00:30:42.169>go <00:30:42.296>away <00:30:42.424>from <00:30:42.551>these <00:30:42.678>all <00:30:42.805>knowing <00:30:42.933>LLMs <00:30:43.060>to <00:30:43.187>more <00:30:43.315>like,

659
00:30:45.505 --> 00:30:46.605
<00:30:45.505>uh, <00:30:46.000>specialist <00:30:46.495>terms?

660
00:30:47.165 --> 00:30:48.845
<00:30:47.165>I <00:30:47.514>absolutely <00:30:47.865>think <00:30:48.215>that's <00:30:48.565>coming.

661
00:30:49.085 --> 00:30:52.965
<00:30:49.085>I <00:30:49.240>I <00:30:49.396>actually <00:30:49.551>know <00:30:49.707>of <00:30:49.862>companies <00:30:50.018>that <00:30:50.173>are <00:30:50.329>going <00:30:50.485>down

662
00:30:52.965 --> 00:30:57.165
<00:30:52.965>that <00:30:53.165>exact <00:30:53.365>track <00:30:53.564>of <00:30:53.764>being <00:30:53.965>more <00:30:54.165>focused, <00:30:54.365>um,

663
00:30:58.065 --> 00:31:01.125
<00:30:58.065>on, <00:30:58.345>um, <00:30:58.625>uh, <00:30:58.905>specific <00:30:59.185>topic <00:30:59.465>areas.

664
00:31:01.905 --> 00:31:03.365
<00:31:01.905>Um, <00:31:02.562>smaller <00:31:03.219>problem

665
00:31:04.255 --> 00:31:08.485
<00:31:04.255>means <00:31:04.410>smaller <00:31:04.566>model <00:31:04.721>means <00:31:04.877>better <00:31:05.032>chance <00:31:05.188>of <00:31:05.343>a <00:31:05.499>higher, <00:31:05.655>uh,

666
00:31:08.485 --> 00:31:10.245
<00:31:08.485>level <00:31:08.951>of <00:31:09.418>accuracy, <00:31:09.885>um,

667
00:31:10.785 --> 00:31:14.405
<00:31:10.785>and <00:31:11.018>more <00:31:11.251>amenable <00:31:11.485>to <00:31:11.718>tuning <00:31:11.951>with, <00:31:12.185>uh,

668
00:31:15.045 --> 00:31:19.565
<00:31:15.045>a <00:31:15.220>rag <00:31:15.395>database, <00:31:15.570>uh, <00:31:15.745>to <00:31:15.920>limit <00:31:16.095>errors <00:31:16.270>even <00:31:16.445>further.

669
00:31:20.145 --> 00:31:23.085
<00:31:20.145>So <00:31:20.300>there's <00:31:20.456>a <00:31:20.611>lot <00:31:20.767>of <00:31:20.922>goodness <00:31:21.078>in <00:31:21.233>that, <00:31:21.389>you <00:31:21.545>know,

670
00:31:23.145 --> 00:31:27.085
<00:31:23.145>one <00:31:23.285>way <00:31:23.425>I <00:31:23.565>expressed <00:31:23.705>it <00:31:23.845>to <00:31:23.985>have <00:31:24.125>expressed <00:31:24.264>it <00:31:24.405>to <00:31:24.545>people,

671
00:31:27.135 --> 00:31:31.755
<00:31:27.135>Chris, <00:31:27.310>is <00:31:27.485>just <00:31:27.660>to <00:31:27.835>help <00:31:28.010>the <00:31:28.185>audience <00:31:28.360>understand <00:31:28.535>how

672
00:31:31.755 --> 00:31:33.235
<00:31:31.755>to <00:31:32.088>think <00:31:32.421>about <00:31:32.754>the <00:31:33.087>complexity.

673
00:31:33.785 --> 00:31:34.995
<00:31:33.785>Even <00:31:34.148>for <00:31:34.511>a <00:31:34.873>topic.

674
00:31:35.715 --> 00:31:38.115
<00:31:35.715>I <00:31:35.889>usually <00:31:36.064>say <00:31:36.240>the <00:31:36.415>geography <00:31:36.590>of <00:31:36.764>the <00:31:36.939>United <00:31:37.115>States,

675
00:31:38.295 --> 00:31:41.635
<00:31:38.295>but <00:31:38.450>since <00:31:38.606>you're <00:31:38.761>from <00:31:38.917>Germany, <00:31:39.072>I'll, <00:31:39.228>I'll <00:31:39.383>say <00:31:39.539>the <00:31:39.695>geography

676
00:31:41.635 --> 00:31:43.835
<00:31:41.635>of <00:31:41.868>Europe, <00:31:42.101>let's <00:31:42.335>just <00:31:42.568>take <00:31:42.801>that <00:31:43.035>topic.

677
00:31:44.615 --> 00:31:47.715
<00:31:44.615>Um, <00:31:44.790>and <00:31:44.965>if <00:31:45.140>you <00:31:45.315>asked <00:31:45.490>an <00:31:45.665>LLM, <00:31:45.840>you <00:31:46.015>know,

678
00:31:47.815 --> 00:31:50.515
<00:31:47.815>and <00:31:47.990>you <00:31:48.165>just <00:31:48.340>kept <00:31:48.515>running <00:31:48.690>queries <00:31:48.865>at <00:31:49.040>it, <00:31:49.215>uh,

679
00:31:50.935 --> 00:31:54.795
<00:31:50.935>my <00:31:51.110>working <00:31:51.284>guess <00:31:51.460>is <00:31:51.635>there's <00:31:51.810>probably <00:31:51.985>trillions <00:31:52.159>of <00:31:52.335>errors

680
00:31:54.795 --> 00:31:58.755
<00:31:54.795>that <00:31:54.950>it <00:31:55.106>can <00:31:55.261>still <00:31:55.417>make <00:31:55.572>about <00:31:55.728>that <00:31:55.883>contained <00:31:56.039>topic <00:31:56.195>trillions.

681
00:31:59.705 --> 00:32:02.685
<00:31:59.705>Um, <00:32:00.171>and, <00:32:00.638>um, <00:32:01.105>and,

682
00:32:02.785 --> 00:32:06.535
<00:32:02.785>and <00:32:02.960>so, <00:32:03.135>um, <00:32:03.310>now <00:32:03.485>you <00:32:03.660>try <00:32:03.835>to <00:32:04.010>think <00:32:04.185>about

683
00:32:06.535 --> 00:32:07.615
<00:32:06.535>that <00:32:06.729>across, <00:32:06.923>wait, <00:32:07.118>wait <00:32:07.312>a <00:32:07.507>minute.

684
00:32:07.615 --> 00:32:09.815
<00:32:07.615>That's <00:32:07.848>a <00:32:08.081>really <00:32:08.315>limited <00:32:08.548>simple <00:32:08.781>topic <00:32:09.015>area

685
00:32:10.405 --> 00:32:12.935
<00:32:10.405>that <00:32:10.605>helps <00:32:10.805>express, <00:32:11.004>again, <00:32:11.205>sort <00:32:11.405>of <00:32:11.605>the <00:32:11.805>complexity

686
00:32:12.935 --> 00:32:16.575
<00:32:12.935>of <00:32:13.090>the <00:32:13.246>broad <00:32:13.401>general <00:32:13.557>purpose, <00:32:13.712>you <00:32:13.868>know, <00:32:14.023>do <00:32:14.179>everything <00:32:14.335>model.

687
00:32:17.355 --> 00:32:21.095
<00:32:17.355>But <00:32:17.471>if <00:32:17.588>I <00:32:17.705>were <00:32:17.821>to <00:32:17.938>build <00:32:18.055>a <00:32:18.171>model <00:32:18.288>focused <00:32:18.405>just <00:32:18.521>on <00:32:18.638>the <00:32:18.755>geography

688
00:32:21.155 --> 00:32:23.695
<00:32:21.155>of <00:32:21.355>Europe, <00:32:21.555>I <00:32:21.754>could <00:32:21.955>use <00:32:22.155>a <00:32:22.355>rag <00:32:22.555>database

689
00:32:24.155 --> 00:32:28.775
<00:32:24.155>and, <00:32:24.295>uh, <00:32:24.435>implement <00:32:24.575>a <00:32:24.715>lot <00:32:24.855>of <00:32:24.995>constraints <00:32:25.135>around <00:32:25.274>that, <00:32:25.415>uh, <00:32:25.555>to

690
00:32:29.335 --> 00:32:31.215
<00:32:29.335>dramatically <00:32:29.615>reduce <00:32:29.895>the <00:32:30.175>level <00:32:30.455>of <00:32:30.735>errors.

691
00:32:31.775 --> 00:32:33.055
<00:32:31.775>I <00:32:31.967>don't <00:32:32.159>think <00:32:32.351>you <00:32:32.543>can <00:32:32.735>eliminate <00:32:32.927>them,

692
00:32:33.355 --> 00:32:34.895
<00:32:33.355>but <00:32:33.528>I <00:32:33.701>think <00:32:33.874>you <00:32:34.048>can <00:32:34.221>bring <00:32:34.394>it <00:32:34.567>way <00:32:34.741>down

693
00:32:35.515 --> 00:32:39.525
<00:32:35.515>and <00:32:35.690>certainly <00:32:35.865>the <00:32:36.040>most <00:32:36.215>common <00:32:36.390>ones, <00:32:36.565>um, <00:32:36.740>and, <00:32:36.915>uh,

694
00:32:39.525 --> 00:32:41.405
<00:32:39.525>and <00:32:39.725>think <00:32:39.925>it's <00:32:40.125>a <00:32:40.325>promising <00:32:40.525>direction <00:32:40.725>for <00:32:40.925>sure.

695
00:32:41.865 --> 00:32:44.885
<00:32:41.865>And <00:32:42.020>of <00:32:42.176>course, <00:32:42.331>the <00:32:42.487>other <00:32:42.642>thing <00:32:42.798>is <00:32:42.953>like <00:32:43.109>wasted <00:32:43.265>effort,

696
00:32:44.905 --> 00:32:46.845
<00:32:44.905>wasted <00:32:45.254>time <00:32:45.605>with <00:32:45.955>wasted <00:32:46.305>electricity.

697
00:32:47.465 --> 00:32:48.565
<00:32:47.465>It <00:32:47.663>was <00:32:47.860>interesting, <00:32:48.059>like <00:32:48.257>when <00:32:48.455>you,

698
00:32:48.565 --> 00:32:50.405
<00:32:48.565>when <00:32:48.765>you <00:32:48.965>think <00:32:49.165>about <00:32:49.365>search <00:32:49.565>engines <00:32:49.765>back <00:32:49.965>then

699
00:32:50.425 --> 00:32:51.925
<00:32:50.425>and <00:32:50.649>there <00:32:50.875>was <00:32:51.100>no <00:32:51.325>click <00:32:51.550>on <00:32:51.774>it,

700
00:32:52.235 --> 00:32:53.965
<00:32:52.235>then <00:32:52.468>they <00:32:52.701>basically <00:32:52.935>ranked <00:32:53.168>the <00:32:53.401>thing <00:32:53.635>lower

701
00:32:53.965 --> 00:32:56.245
<00:32:53.965>because <00:32:54.139>obviously <00:32:54.314>the <00:32:54.490>people <00:32:54.665>didn't <00:32:54.840>get <00:32:55.014>what <00:32:55.189>they <00:32:55.365>wanted.

702
00:32:56.905 --> 00:32:59.845
<00:32:56.905>But <00:32:57.032>I <00:32:57.159>found <00:32:57.286>that <00:32:57.414>there's, <00:32:57.541>uh, <00:32:57.668>the, <00:32:57.795>I <00:32:57.923>found <00:32:58.050>that <00:32:58.177>LLM <00:32:58.305>seem

703
00:32:59.845 --> 00:33:01.685
<00:32:59.845>to <00:33:00.000>be <00:33:00.156>the, <00:33:00.311>the <00:33:00.467>other <00:33:00.622>way <00:33:00.778>around, <00:33:00.933>like <00:33:01.089>saying <00:33:01.245>like,

704
00:33:01.685 --> 00:33:04.725
<00:33:01.685>if <00:33:01.825>people <00:33:01.965>have <00:33:02.105>no <00:33:02.245>more <00:33:02.385>questions, <00:33:02.524>then <00:33:02.665>the <00:33:02.804>answer <00:33:02.945>was <00:33:03.085>right,

705
00:33:05.065 --> 00:33:06.525
<00:33:05.065>and <00:33:05.327>then <00:33:05.590>they <00:33:05.853>rank <00:33:06.116>it <00:33:06.379>higher.

706
00:33:06.805 --> 00:33:09.605
<00:33:06.805>I <00:33:06.945>hope <00:33:07.085>it's <00:33:07.225>not <00:33:07.365>the <00:33:07.505>case, <00:33:07.645>but <00:33:07.785>it <00:33:07.925>might <00:33:08.065>be. <00:33:08.205>Right?

707
00:33:09.825 --> 00:33:11.245
<00:33:09.825>Uh, <00:33:10.080>yeah, <00:33:10.336>it's <00:33:10.591>a <00:33:10.847>great <00:33:11.102>question.

708
00:33:11.625 --> 00:33:14.525
<00:33:11.625>Um, <00:33:11.780>I <00:33:11.936>think <00:33:12.091>the <00:33:12.247>signal <00:33:12.402>is <00:33:12.558>a <00:33:12.713>little <00:33:12.869>more <00:33:13.025>difficult

709
00:33:14.945 --> 00:33:17.445
<00:33:14.945>to <00:33:15.294>parse <00:33:15.645>here <00:33:15.995>because, <00:33:16.345>uh,

710
00:33:17.585 --> 00:33:19.085
<00:33:17.585>and <00:33:17.753>I <00:33:17.922>think <00:33:18.091>this <00:33:18.260>is <00:33:18.428>your <00:33:18.597>point, <00:33:18.766>you <00:33:18.935>know,

711
00:33:19.085 --> 00:33:20.405
<00:33:19.085>you <00:33:19.382>have <00:33:19.679>this <00:33:19.976>texty <00:33:20.273>response

712
00:33:20.425 --> 00:33:24.005
<00:33:20.425>and <00:33:20.565>you <00:33:20.705>feel <00:33:20.845>like <00:33:20.985>you <00:33:21.125>got <00:33:21.264>your <00:33:21.405>answer, <00:33:21.544>you <00:33:21.685>leave, <00:33:21.825>um,

713
00:33:24.225 --> 00:33:25.485
<00:33:24.225>you <00:33:24.508>have <00:33:24.792>a <00:33:25.075>texty <00:33:25.359>response.

714
00:33:25.905 --> 00:33:28.285
<00:33:25.905>You <00:33:26.045>feel <00:33:26.185>like <00:33:26.325>it <00:33:26.465>didn't <00:33:26.605>help <00:33:26.745>you <00:33:26.885>at <00:33:27.024>all, <00:33:27.165>you <00:33:27.305>leave.

715
00:33:28.905 --> 00:33:31.565
<00:33:28.905>So <00:33:29.060>how <00:33:29.216>do <00:33:29.371>I <00:33:29.527>tell, <00:33:29.682>right, <00:33:29.838>how <00:33:29.993>do <00:33:30.149>I <00:33:30.305>measure

716
00:33:31.755 --> 00:33:32.885
<00:33:31.755>that <00:33:32.094>back, <00:33:32.433>you <00:33:32.772>know?

717
00:33:33.275 --> 00:33:35.965
<00:33:33.275>Well, <00:33:33.430>I <00:33:33.586>mean, <00:33:33.741>there <00:33:33.897>was <00:33:34.052>research <00:33:34.208>that <00:33:34.363>basically <00:33:34.519>said <00:33:34.675>like

718
00:33:35.965 --> 00:33:38.565
<00:33:35.965>that, <00:33:36.198>uh, <00:33:36.431>67% <00:33:36.665>of <00:33:36.898>clicks <00:33:37.131>on, <00:33:37.365>uh,

719
00:33:38.565 --> 00:33:41.285
<00:33:38.565>of <00:33:38.720>Google <00:33:38.876>search <00:33:39.031>result <00:33:39.187>pages <00:33:39.342>had <00:33:39.498>no <00:33:39.653>click <00:33:39.809>last <00:33:39.965>year.

720
00:33:41.795 --> 00:33:44.005
<00:33:41.795>Like <00:33:41.995>there <00:33:42.195>was <00:33:42.395>like <00:33:42.595>a, <00:33:42.795>a <00:33:42.995>a <00:33:43.195>basically

721
00:33:44.005 --> 00:33:46.525
<00:33:44.005>that <00:33:44.285>people <00:33:44.565>got <00:33:44.845>very <00:33:45.125>disenfranchised <00:33:45.405>with,

722
00:33:46.585 --> 00:33:47.725
<00:33:46.585>uh, <00:33:46.841>uh, <00:33:47.098>with <00:33:47.354>web <00:33:47.610>search.

723
00:33:47.985 --> 00:33:51.045
<00:33:47.985>And <00:33:48.092>that's <00:33:48.200>why <00:33:48.308>probably <00:33:48.415>the <00:33:48.523>l <00:33:48.631>LMS <00:33:48.738>got <00:33:48.846>like <00:33:48.954>a <00:33:49.061>lot <00:33:49.169>of, <00:33:49.277>uh, <00:33:49.385>uh,

724
00:33:51.085 --> 00:33:52.125
<00:33:51.085>a <00:33:51.319>lot <00:33:51.553>of, <00:33:51.787>uh, <00:33:52.021>gain.

725
00:33:52.625 --> 00:33:55.405
<00:33:52.625>Do <00:33:52.765>you <00:33:52.905>think <00:33:53.045>it's <00:33:53.185>a <00:33:53.325>it's <00:33:53.465>a, <00:33:53.605>uh, <00:33:53.745>uh, <00:33:53.885>it's <00:33:54.025>a,

726
00:33:55.465 --> 00:33:57.525
<00:33:55.465>um, <00:33:55.814>it's <00:33:56.165>an <00:33:56.514>age <00:33:56.865>thing.

727
00:33:57.525 --> 00:33:59.085
<00:33:57.525>It's <00:33:57.725>people <00:33:57.925>that <00:33:58.125>grew <00:33:58.325>up <00:33:58.525>with <00:33:58.725>the <00:33:58.925>web

728
00:33:59.105 --> 00:34:00.685
<00:33:59.105>and <00:33:59.385>saw <00:33:59.665>search <00:33:59.945>engines <00:34:00.225>come <00:34:00.505>up,

729
00:34:00.685 --> 00:34:02.245
<00:34:00.685>but <00:34:00.918>still <00:34:01.151>trust <00:34:01.385>them <00:34:01.618>more <00:34:01.851>than <00:34:02.085>people

730
00:34:02.245 --> 00:34:04.365
<00:34:02.245>that <00:34:02.385>just <00:34:02.524>take <00:34:02.665>out <00:34:02.804>their <00:34:02.945>phone <00:34:03.084>and <00:34:03.225>start <00:34:03.364>talking <00:34:03.504>to <00:34:03.645>it.

731
00:34:04.865 --> 00:34:06.525
<00:34:04.865>It <00:34:05.215>could <00:34:05.565>be, <00:34:05.915>so <00:34:06.265>yes.

732
00:34:06.905 --> 00:34:10.965
<00:34:06.905>Um, <00:34:07.105>I <00:34:07.305>think <00:34:07.504>that <00:34:07.705>might <00:34:07.905>drive <00:34:08.105>the <00:34:08.304>rate,

733
00:34:11.175 --> 00:34:14.165
<00:34:11.175>which <00:34:11.525>people <00:34:11.875>will <00:34:12.225>experiment <00:34:12.575>with

734
00:34:14.725 --> 00:34:16.205
<00:34:14.725>LLM <00:34:15.391>based <00:34:16.056>solutions.

735
00:34:17.025 --> 00:34:21.765
<00:34:17.025>The <00:34:17.225>long-term <00:34:17.425>driver <00:34:17.625>of <00:34:17.825>success, <00:34:18.025>I <00:34:18.225>hope, <00:34:18.425>uh,

736
00:34:21.995 --> 00:34:26.125
<00:34:21.995>will <00:34:22.150>be <00:34:22.306>that, <00:34:22.461>you <00:34:22.617>know, <00:34:22.772>what <00:34:22.928>was <00:34:23.083>ultimately <00:34:23.239>the <00:34:23.395>utility

737
00:34:26.625 --> 00:34:28.045
<00:34:26.625>of <00:34:27.051>what <00:34:27.476>you <00:34:27.903>got.

738
00:34:28.185 --> 00:34:32.205
<00:34:28.185>So <00:34:28.292>for <00:34:28.400>example, <00:34:28.508>if <00:34:28.615>you <00:34:28.723>have <00:34:28.831>a <00:34:28.938>paper <00:34:29.046>that <00:34:29.154>you <00:34:29.261>have <00:34:29.369>to <00:34:29.477>do <00:34:29.585>for

739
00:34:32.725 --> 00:34:35.885
<00:34:32.725>a <00:34:32.880>college <00:34:33.036>course <00:34:33.191>and <00:34:33.347>you <00:34:33.502>include <00:34:33.658>information <00:34:33.813>in <00:34:33.969>it, <00:34:34.125>um,

740
00:34:36.025 --> 00:34:37.165
<00:34:36.025>and <00:34:36.281>maybe <00:34:36.538>it's <00:34:36.794>all <00:34:37.051>accurate,

741
00:34:37.165 --> 00:34:39.285
<00:34:37.165>but <00:34:37.398>it's <00:34:37.631>just <00:34:37.864>missing <00:34:38.098>some <00:34:38.331>material <00:34:38.565>pieces

742
00:34:39.825 --> 00:34:41.285
<00:34:39.824>you <00:34:40.087>probably <00:34:40.350>should <00:34:40.613>have <00:34:40.876>included <00:34:41.138>or,

743
00:34:41.745 --> 00:34:44.445
<00:34:41.745>or <00:34:41.884>any <00:34:42.025>kind <00:34:42.165>of <00:34:42.304>problems, <00:34:42.444>and <00:34:42.585>you <00:34:42.725>get <00:34:42.864>dinged <00:34:43.005>on <00:34:43.145>it,

744
00:34:44.585 --> 00:34:45.925
<00:34:44.585>or <00:34:44.826>you're <00:34:45.067>in <00:34:45.308>a <00:34:45.549>commercial <00:34:45.791>setting

745
00:34:46.545 --> 00:34:49.805
<00:34:46.545>and <00:34:46.825>you <00:34:47.105>rely <00:34:47.385>on <00:34:47.665>something, <00:34:47.945>um,

746
00:34:50.145 --> 00:34:52.765
<00:34:50.145>and <00:34:50.320>then <00:34:50.495>it, <00:34:50.670>you <00:34:50.844>know, <00:34:51.020>doesn't <00:34:51.195>meet <00:34:51.370>the <00:34:51.545>need.

747
00:34:52.975 --> 00:34:54.525
<00:34:52.975>These <00:34:53.254>things <00:34:53.533>will <00:34:53.812>happen <00:34:54.091>to <00:34:54.370>people

748
00:34:54.705 --> 00:34:56.725
<00:34:54.705>who <00:34:55.171>aren't <00:34:55.638>critical <00:34:56.105>enough

749
00:34:57.065 --> 00:35:00.325
<00:34:57.065>and, <00:34:57.220>uh, <00:34:57.376>in <00:34:57.531>their <00:34:57.687>review <00:34:57.842>of <00:34:57.998>the <00:34:58.153>response <00:34:58.309>they <00:34:58.465>get,

750
00:35:00.625 --> 00:35:04.205
<00:35:00.625>people <00:35:00.825>will <00:35:01.025>eventually <00:35:01.225>get <00:35:01.425>forced <00:35:01.625>by <00:35:01.825>whatever <00:35:02.025>largely

751
00:35:04.755 --> 00:35:08.605
<00:35:04.755>call <00:35:04.988>'em <00:35:05.221>commercial <00:35:05.455>or <00:35:05.688>real <00:35:05.921>world <00:35:06.155>situations.

752
00:35:09.385 --> 00:35:13.805
<00:35:09.385>Um, <00:35:09.560>they'll, <00:35:09.735>they'll <00:35:09.910>get <00:35:10.085>pushed <00:35:10.260>into, <00:35:10.435>um, <00:35:10.610>using, <00:35:10.785>uh,

753
00:35:14.465 --> 00:35:17.605
<00:35:14.465>uh, <00:35:14.620>you <00:35:14.776>know, <00:35:14.931>a <00:35:15.087>more <00:35:15.242>discerning <00:35:15.398>eye <00:35:15.553>in <00:35:15.709>reviewing <00:35:15.865>things.

754
00:35:18.345 --> 00:35:19.805
<00:35:18.345>Um, <00:35:18.783>and <00:35:19.221>that <00:35:19.658>may

755
00:35:19.805 --> 00:35:22.205
<00:35:19.805>or <00:35:19.932>may <00:35:20.059>not <00:35:20.186>cause <00:35:20.314>them <00:35:20.441>to <00:35:20.568>go <00:35:20.695>back <00:35:20.823>to, <00:35:20.950>uh, <00:35:21.077>you <00:35:21.205>know,

756
00:35:22.205 --> 00:35:26.005
<00:35:22.205>another <00:35:22.380>approach <00:35:22.555>where <00:35:22.730>they <00:35:22.904>get <00:35:23.080>the, <00:35:23.255>the <00:35:23.430>result, <00:35:23.605>uh,

757
00:35:26.005 --> 00:35:28.765
<00:35:26.005>from <00:35:26.205>a <00:35:26.405>search <00:35:26.605>experience <00:35:26.805>to <00:35:27.005>your <00:35:27.205>original <00:35:27.405>question,

758
00:35:29.375 --> 00:35:32.485
<00:35:29.375>young <00:35:29.515>people <00:35:29.655>are <00:35:29.795>probably <00:35:29.935>gonna <00:35:30.075>be <00:35:30.215>much <00:35:30.355>more <00:35:30.495>faster <00:35:30.635>to, <00:35:30.775>to,

759
00:35:32.625 --> 00:35:35.565
<00:35:32.625>to, <00:35:32.780>you <00:35:32.936>know, <00:35:33.091>dry <00:35:33.247>a <00:35:33.402>check <00:35:33.558>DPT <00:35:33.713>or <00:35:33.869>something <00:35:34.025>else.

760
00:35:35.785 --> 00:35:38.165
<00:35:35.785>And, <00:35:35.984>but <00:35:36.185>we'll <00:35:36.384>know <00:35:36.585>five <00:35:36.785>years <00:35:36.984>from <00:35:37.185>now,

761
00:35:38.665 --> 00:35:39.805
<00:35:38.665>you <00:35:38.870>know, <00:35:39.075>how <00:35:39.280>many <00:35:39.485>people <00:35:39.691>stay.

762
00:35:40.565 --> 00:35:42.525
<00:35:40.565>Excellent. <00:35:40.740>Well, <00:35:40.915>thank <00:35:41.090>you <00:35:41.265>so <00:35:41.440>much <00:35:41.615>for <00:35:41.790>your <00:35:41.965>time.

763
00:35:42.665 --> 00:35:45.245
<00:35:42.665>Uh, <00:35:42.840>uh, <00:35:43.015>there's <00:35:43.190>hopefully <00:35:43.365>gonna <00:35:43.540>be <00:35:43.715>some <00:35:43.890>interesting <00:35:44.065>things

764
00:35:45.265 --> 00:35:46.845
<00:35:45.265>for <00:35:45.498>people <00:35:45.731>to <00:35:45.964>find <00:35:46.198>in <00:35:46.431>your <00:35:46.665>article

765
00:35:46.905 --> 00:35:48.765
<00:35:46.905>and <00:35:47.138>this <00:35:47.371>discussion <00:35:47.605>about <00:35:47.838>it <00:35:48.071>as <00:35:48.305>well.

766
00:35:49.545 --> 00:35:52.645
<00:35:49.545>So <00:35:49.672>I, <00:35:49.799>I <00:35:49.926>think <00:35:50.054>overall <00:35:50.181>it's <00:35:50.308>like, <00:35:50.435>uh, <00:35:50.563>we <00:35:50.690>have <00:35:50.817>to <00:35:50.945>deal

767
00:35:52.645 --> 00:35:54.245
<00:35:52.645>with <00:35:52.820>this <00:35:52.995>world <00:35:53.170>that <00:35:53.345>we <00:35:53.520>are <00:35:53.695>in <00:35:53.870>right <00:35:54.045>now.

768
00:35:54.305 --> 00:35:56.125
<00:35:54.305>We <00:35:54.585>have <00:35:54.865>to <00:35:55.145>deal <00:35:55.424>that <00:35:55.705>LLMs

769
00:35:56.125 --> 00:35:58.765
<00:35:56.125>and <00:35:56.300>like <00:35:56.475>chat <00:35:56.650>systems <00:35:56.825>are <00:35:57.000>the <00:35:57.175>new, <00:35:57.350>uh, <00:35:57.525>uh,

770
00:35:59.185 --> 00:36:02.565
<00:35:59.185>as <00:35:59.340>content <00:35:59.496>creators <00:35:59.651>are <00:35:59.807>a <00:35:59.962>new, <00:36:00.118>uh, <00:36:00.273>revenue <00:36:00.429>for <00:36:00.585>us

771
00:36:02.625 --> 00:36:03.765
<00:36:02.625>to <00:36:02.967>actually <00:36:03.308>cater <00:36:03.651>to.

772
00:36:04.505 --> 00:36:06.525
<00:36:04.505>Uh, <00:36:04.738>it <00:36:04.971>just <00:36:05.205>feels <00:36:05.438>kind <00:36:05.671>of <00:36:05.905>unfair

773
00:36:06.525 --> 00:36:10.285
<00:36:06.525>because <00:36:06.652>it's <00:36:06.779>really <00:36:06.906>hard <00:36:07.034>to <00:36:07.161>find <00:36:07.288>out <00:36:07.415>how <00:36:07.543>to <00:36:07.670>get <00:36:07.797>an <00:36:07.925>LLM

774
00:36:10.285 --> 00:36:12.725
<00:36:10.285>to <00:36:10.484>index, <00:36:10.685>index <00:36:10.884>your <00:36:11.085>stuff <00:36:11.285>above <00:36:11.484>something <00:36:11.685>else.

775
00:36:12.995 --> 00:36:15.645
<00:36:12.995>Like <00:36:13.134>in <00:36:13.275>SEO <00:36:13.415>we <00:36:13.555>had <00:36:13.694>dirty <00:36:13.835>tricks, <00:36:13.975>we <00:36:14.115>had <00:36:14.255>good <00:36:14.395>tricks,

776
00:36:15.785 --> 00:36:18.525
<00:36:15.785>but <00:36:15.960>I <00:36:16.134>always <00:36:16.310>found <00:36:16.484>that <00:36:16.660>like <00:36:16.835>great <00:36:17.009>content, <00:36:17.185>uh,

777
00:36:18.555 --> 00:36:19.965
<00:36:18.555>just <00:36:18.978>prevails <00:36:19.401>over <00:36:19.824>time.

778
00:36:20.395 --> 00:36:22.445
<00:36:20.395>Yeah. <00:36:20.628>Whereas <00:36:20.861>like, <00:36:21.095>uh, <00:36:21.328>with <00:36:21.561>an <00:36:21.795>LLM,

779
00:36:22.505 --> 00:36:24.245
<00:36:22.505>you <00:36:22.785>can't <00:36:23.065>actually <00:36:23.345>rely <00:36:23.625>on <00:36:23.905>that.

780
00:36:24.725 --> 00:36:26.325
<00:36:24.725>Excellent. <00:36:24.924>Well, <00:36:25.125>thank <00:36:25.325>you <00:36:25.525>very <00:36:25.725>much <00:36:25.924>and, <00:36:26.125>uh,

781
00:36:26.325 --> 00:36:28.245
<00:36:26.325>that <00:36:26.524>was <00:36:26.725>copied <00:36:26.924>with <00:36:27.125>developers <00:36:27.325>with <00:36:27.524>Eric <00:36:27.725>Enga.

782
00:36:28.435 --> 00:36:30.845
<00:36:28.435>Take <00:36:28.575>a <00:36:28.715>look <00:36:28.855>at <00:36:28.995>the <00:36:29.134>article, <00:36:29.275>take <00:36:29.415>it <00:36:29.555>apart, <00:36:29.695>run <00:36:29.835>it

783
00:36:30.845 --> 00:36:33.445
<00:36:30.845>through <00:36:30.972>an <00:36:31.099>LLM <00:36:31.226>or <00:36:31.354>ask <00:36:31.481>an <00:36:31.608>LLM <00:36:31.735>to <00:36:31.863>give <00:36:31.990>you <00:36:32.117>the, <00:36:32.245>the,

784
00:36:33.585 --> 00:36:35.725
<00:36:33.585>the <00:36:33.760>findings <00:36:33.935>in <00:36:34.110>it <00:36:34.285>rather <00:36:34.460>than <00:36:34.635>reading <00:36:34.810>it <00:36:34.985>yourself.

785
00:36:36.425 --> 00:36:38.245
<00:36:36.425>And <00:36:36.775>uh, <00:36:37.125>hopefully <00:36:37.475>there'll <00:36:37.825>be

786
00:36:38.245 --> 00:36:39.405
<00:36:38.245>something <00:36:38.453>in <00:36:38.662>there <00:36:38.871>for <00:36:39.080>you <00:36:39.289>as

787
00:36:39.405 --> 00:36:40.565
<00:36:39.405>well. <00:36:39.613>Thank <00:36:39.822>you <00:36:40.031>so <00:36:40.240>much, <00:36:40.449>Eric.

788
00:36:41.265 --> 00:36:42.605
<00:36:41.265>All <00:36:41.437>right. <00:36:41.609>Thank <00:36:41.781>you. <00:36:41.954>Thanks <00:36:42.126>for <00:36:42.298>having <00:36:42.471>me.