WEBVTT

1
00:00:05.205 --> 00:00:08.335
<00:00:05.205>Well <00:00:05.438>now <00:00:05.671>let's <00:00:05.905>get <00:00:06.138>into <00:00:06.371>our <00:00:06.605>session.

2
00:00:08.465 --> 00:00:11.695
<00:00:08.465>Today. <00:00:08.665>We <00:00:08.865>are <00:00:09.065>going <00:00:09.265>to <00:00:09.465>see <00:00:09.665>again <00:00:09.865>how

3
00:00:11.695 --> 00:00:14.335
<00:00:11.695>to <00:00:12.045>build <00:00:12.395>agent <00:00:12.745>AI <00:00:13.095>applications,

4
00:00:15.235 --> 00:00:19.455
<00:00:15.235>but <00:00:15.351>this <00:00:15.468>time <00:00:15.584>we <00:00:15.701>are <00:00:15.818>going <00:00:15.934>to <00:00:16.051>be <00:00:16.168>using <00:00:16.285>no <00:00:16.401>js <00:00:16.518>instead <00:00:16.634>of.net

5
00:00:19.555 --> 00:00:20.935
<00:00:19.555>or <00:00:19.969>other <00:00:20.383>programming <00:00:20.796>language.

6
00:00:21.035 --> 00:00:25.135
<00:00:21.035>And <00:00:21.162>I <00:00:21.289>hope <00:00:21.416>you <00:00:21.544>are <00:00:21.671>going <00:00:21.798>to <00:00:21.925>have <00:00:22.053>many, <00:00:22.180>many <00:00:22.307>other <00:00:22.435>options

7
00:00:25.195 --> 00:00:28.615
<00:00:25.195>during <00:00:25.322>this <00:00:25.449>event <00:00:25.576>'cause <00:00:25.704>this <00:00:25.831>is <00:00:25.958>a <00:00:26.085>very <00:00:26.213>hot <00:00:26.340>topic <00:00:26.467>right <00:00:26.595>now

8
00:00:29.155 --> 00:00:31.295
<00:00:29.155>and <00:00:29.435>a <00:00:29.715>lot <00:00:29.995>of <00:00:30.275>different <00:00:30.555>frameworks

9
00:00:31.295 --> 00:00:34.295
<00:00:31.295>and <00:00:31.495>companies <00:00:31.695>are <00:00:31.895>trying <00:00:32.095>to <00:00:32.295>show <00:00:32.495>people <00:00:32.695>how

10
00:00:34.295 --> 00:00:35.855
<00:00:34.295>to <00:00:34.761>build <00:00:35.228>these <00:00:35.695>applications.

11
00:00:38.135 --> 00:00:39.195
<00:00:38.135>My <00:00:38.373>name <00:00:38.612>is <00:00:38.850>Julian <00:00:39.089>Duque.

12
00:00:39.195 --> 00:00:41.475
<00:00:39.195>I'm <00:00:39.475>principal <00:00:39.755>developer <00:00:40.035>advocate <00:00:40.315>for <00:00:40.595>Roku

13
00:00:41.615 --> 00:00:46.315
<00:00:41.615>and <00:00:41.755>pretty <00:00:41.895>much <00:00:42.035>taking, <00:00:42.175>uh, <00:00:42.315>care <00:00:42.455>of <00:00:42.595>the <00:00:42.735>no <00:00:42.875>js, <00:00:43.015>uh,

14
00:00:46.315 --> 00:00:50.875
<00:00:46.315>developer <00:00:46.489>ecosystem <00:00:46.665>and <00:00:46.839>AI <00:00:47.015>that <00:00:47.190>like <00:00:47.364>my <00:00:47.540>social <00:00:47.714>network.

15
00:00:50.975 --> 00:00:51.995
<00:00:50.975>If <00:00:51.204>you <00:00:51.434>wanna <00:00:51.663>follow <00:00:51.893>me

16
00:00:52.495 --> 00:00:55.075
<00:00:52.495>and <00:00:52.845>let's <00:00:53.195>start <00:00:53.544>with <00:00:53.894>defining

17
00:00:55.865 --> 00:00:59.355
<00:00:55.865>what <00:00:56.065>is <00:00:56.265>an <00:00:56.465>AI <00:00:56.665>application <00:00:56.865>as <00:00:57.065>of <00:00:57.265>today.

18
00:01:00.055 --> 00:01:02.955
<00:01:00.055>AI <00:01:00.255>and <00:01:00.455>machine <00:01:00.655>learning <00:01:00.855>is <00:01:01.055>a <00:01:01.255>broader <00:01:01.455>term

19
00:01:03.095 --> 00:01:05.035
<00:01:03.095>and <00:01:03.269>you <00:01:03.445>can <00:01:03.620>have <00:01:03.795>like <00:01:03.970>a <00:01:04.144>lot <00:01:04.319>of <00:01:04.495>confusion.

20
00:01:05.655 --> 00:01:09.995
<00:01:05.655>Uh, <00:01:05.810>we <00:01:05.966>can <00:01:06.121>define <00:01:06.277>an <00:01:06.432>AI <00:01:06.588>application <00:01:06.743>as <00:01:06.899>an <00:01:07.055>application

21
00:01:09.995 --> 00:01:11.155
<00:01:09.995>that <00:01:10.517>uses <00:01:11.039>one

22
00:01:12.055 --> 00:01:16.595
<00:01:12.055>or <00:01:12.255>more <00:01:12.455>large <00:01:12.655>language <00:01:12.855>models <00:01:13.055>to <00:01:13.255>reason, <00:01:13.455>plan

23
00:01:16.695 --> 00:01:17.875
<00:01:16.695>and <00:01:17.226>execute <00:01:17.757>tasks.

24
00:01:18.845 --> 00:01:21.865
<00:01:18.845>It <00:01:19.125>runs <00:01:19.405>inference <00:01:19.685>across <00:01:19.965>different <00:01:20.245>modalities.

25
00:01:22.125 --> 00:01:26.665
<00:01:22.125>You <00:01:22.300>can <00:01:22.475>use <00:01:22.650>text <00:01:22.825>code, <00:01:23.000>audio <00:01:23.175>images, <00:01:23.350>et <00:01:23.525>cetera.

26
00:01:27.125 --> 00:01:30.625
<00:01:27.125>And <00:01:27.300>it <00:01:27.475>also <00:01:27.650>integrates <00:01:27.825>with <00:01:28.000>tools, <00:01:28.175>different <00:01:28.350>data <00:01:28.525>sources,

27
00:01:31.755 --> 00:01:32.905
<00:01:31.755>input <00:01:32.100>from <00:01:32.445>the <00:01:32.790>user

28
00:01:33.685 --> 00:01:37.345
<00:01:33.685>and <00:01:33.918>also <00:01:34.151>interacts <00:01:34.385>with <00:01:34.618>other <00:01:34.851>AI <00:01:35.085>applications.

29
00:01:38.485 --> 00:01:42.505
<00:01:38.485>For <00:01:38.625>the <00:01:38.765>purpose <00:01:38.905>of <00:01:39.045>this <00:01:39.185>session, <00:01:39.325>when <00:01:39.465>I <00:01:39.605>talk <00:01:39.745>about <00:01:39.885>ai,

30
00:01:43.165 --> 00:01:47.745
<00:01:43.164>I'm <00:01:43.320>going <00:01:43.476>to <00:01:43.631>be <00:01:43.787>mentioning <00:01:43.942>agen <00:01:44.098>AI <00:01:44.253>or <00:01:44.409>generative <00:01:44.565>ai.

31
00:01:48.265 --> 00:01:51.065
<00:01:48.265>I <00:01:48.440>am <00:01:48.615>not <00:01:48.790>covering <00:01:48.965>the <00:01:49.140>whole <00:01:49.315>ecosystem, <00:01:49.490>which <00:01:49.665>is

32
00:01:52.185 --> 00:01:53.185
<00:01:52.185>artificial <00:01:53.085>intelligence.

33
00:01:54.365 --> 00:01:58.105
<00:01:54.365>So <00:01:54.492>some <00:01:54.619>of <00:01:54.746>the <00:01:54.874>basic <00:01:55.001>concepts <00:01:55.128>I'm <00:01:55.255>going <00:01:55.383>to <00:01:55.510>be, <00:01:55.637>uh, <00:01:55.765>going

34
00:01:58.105 --> 00:01:59.745
<00:01:58.104>through <00:01:58.454>this <00:01:58.804>uh, <00:01:59.154>pretty <00:01:59.505>fast

35
00:01:59.745 --> 00:02:02.585
<00:01:59.745>because <00:01:59.945>they <00:02:00.145>uh, <00:02:00.345>people <00:02:00.545>have <00:02:00.745>already <00:02:00.945>explained <00:02:01.145>those.

36
00:02:03.205 --> 00:02:06.985
<00:02:03.205>Um, <00:02:03.312>what <00:02:03.420>is <00:02:03.528>a <00:02:03.635>large <00:02:03.743>language <00:02:03.851>model <00:02:03.958>is <00:02:04.066>a <00:02:04.174>type <00:02:04.281>of <00:02:04.389>ai, <00:02:04.497>a <00:02:04.605>type

37
00:02:06.985 --> 00:02:10.665
<00:02:06.985>of <00:02:07.160>artificial <00:02:07.335>intelligence <00:02:07.510>that <00:02:07.685>it's <00:02:07.860>strain <00:02:08.035>of <00:02:08.210>massive <00:02:08.384>text

38
00:02:11.485 --> 00:02:13.425
<00:02:11.485>and <00:02:11.765>in <00:02:12.045>it's <00:02:12.325>used <00:02:12.605>to <00:02:12.885>understand

39
00:02:13.525 --> 00:02:15.625
<00:02:13.525>and <00:02:13.875>generate <00:02:14.225>the <00:02:14.575>humanlike <00:02:14.925>language.

40
00:02:16.085 --> 00:02:19.865
<00:02:16.085>That's <00:02:16.240>pretty <00:02:16.396>much <00:02:16.551>what <00:02:16.707>a <00:02:16.862>generative <00:02:17.018>ai <00:02:17.173>uh, <00:02:17.329>model <00:02:17.485>does.

41
00:02:21.265 --> 00:02:22.545
<00:02:21.265>Generates <00:02:22.417>text.

42
00:02:23.415 --> 00:02:26.425
<00:02:23.415>What <00:02:23.614>is <00:02:23.815>the <00:02:24.015>difference <00:02:24.215>between <00:02:24.415>inference <00:02:24.614>and <00:02:24.815>training?

43
00:02:26.895 --> 00:02:31.185
<00:02:26.895>Inference <00:02:27.070>is <00:02:27.245>using <00:02:27.420>that <00:02:27.595>train <00:02:27.770>model <00:02:27.945>to <00:02:28.120>make <00:02:28.295>predictions

44
00:02:31.725 --> 00:02:36.305
<00:02:31.725>and <00:02:31.864>training <00:02:32.005>is <00:02:32.144>the <00:02:32.285>process <00:02:32.424>to <00:02:32.565>teach <00:02:32.704>that <00:02:32.845>model <00:02:32.984>with <00:02:33.125>data.

45
00:02:37.445 --> 00:02:39.745
<00:02:37.445>And <00:02:37.620>there's <00:02:37.795>another <00:02:37.970>concept <00:02:38.144>which <00:02:38.320>is <00:02:38.495>the <00:02:38.670>model <00:02:38.845>size.

46
00:02:39.925 --> 00:02:43.105
<00:02:39.925>You <00:02:40.080>can <00:02:40.236>see <00:02:40.391>that <00:02:40.547>there <00:02:40.702>are <00:02:40.858>like <00:02:41.013>different <00:02:41.169>uh, <00:02:41.325>models

47
00:02:43.215 --> 00:02:45.145
<00:02:43.215>that <00:02:43.448>have <00:02:43.681>like <00:02:43.915>or <00:02:44.148>a <00:02:44.381>seven <00:02:44.615>V

48
00:02:45.365 --> 00:02:50.345
<00:02:45.365>or <00:02:45.505>a <00:02:45.645>13 <00:02:45.785>B <00:02:45.925>70 <00:02:46.065>V <00:02:46.205>400 <00:02:46.345>B <00:02:46.485>is <00:02:46.625>the <00:02:46.765>number

49
00:02:50.605 --> 00:02:54.225
<00:02:50.605>of <00:02:50.780>parameters <00:02:50.954>that <00:02:51.130>this <00:02:51.304>model <00:02:51.480>has <00:02:51.655>been <00:02:51.829>trained <00:02:52.005>on.

50
00:02:54.695 --> 00:02:58.945
<00:02:54.695>That <00:02:54.822>means <00:02:54.949>that <00:02:55.076>for <00:02:55.204>example, <00:02:55.331>a <00:02:55.458>70 <00:02:55.585>B <00:02:55.713>model <00:02:55.840>was <00:02:55.967>trained <00:02:56.095>with

51
00:02:59.515 --> 00:03:01.405
<00:02:59.515>70 <00:03:00.214>billion <00:03:00.915>parameters

52
00:03:02.265 --> 00:03:05.165
<00:03:02.265>and <00:03:02.440>there <00:03:02.614>are <00:03:02.790>like <00:03:02.964>differences <00:03:03.140>between <00:03:03.315>like <00:03:03.489>having <00:03:03.665>active

53
00:03:05.425 --> 00:03:06.565
<00:03:05.425>or <00:03:05.938>passive <00:03:06.451>parameters

54
00:03:07.105 --> 00:03:10.845
<00:03:07.105>and <00:03:07.244>the <00:03:07.385>more <00:03:07.524>parameters <00:03:07.665>a <00:03:07.804>model <00:03:07.945>has, <00:03:08.084>it <00:03:08.225>means <00:03:08.364>it's <00:03:08.505>going

55
00:03:10.845 --> 00:03:12.325
<00:03:10.845>to <00:03:11.289>have <00:03:11.733>better <00:03:12.177>performance.

56
00:03:12.425 --> 00:03:16.245
<00:03:12.425>But <00:03:12.565>that <00:03:12.705>can <00:03:12.845>also <00:03:12.985>signify <00:03:13.125>that <00:03:13.265>it <00:03:13.405>might <00:03:13.545>be <00:03:13.685>a <00:03:13.825>slower

57
00:03:16.585 --> 00:03:17.645
<00:03:16.585>or <00:03:17.062>more <00:03:17.539>expensive.

58
00:03:17.755 --> 00:03:22.565
<00:03:17.755>This <00:03:17.894>is <00:03:18.035>why <00:03:18.174>we <00:03:18.315>see <00:03:18.454>recently <00:03:18.595>models <00:03:18.734>like <00:03:18.875>cloud <00:03:19.015>opus <00:03:19.155>are

59
00:03:22.565 --> 00:03:24.885
<00:03:22.565>like <00:03:22.845>expensive <00:03:23.125>than <00:03:23.405>sonet <00:03:23.685>for <00:03:23.965>example.

60
00:03:26.265 --> 00:03:29.605
<00:03:26.265>The <00:03:26.440>context <00:03:26.614>window <00:03:26.790>is <00:03:26.964>the <00:03:27.140>amount <00:03:27.315>of <00:03:27.489>input <00:03:27.665>tokens,

61
00:03:29.605 --> 00:03:31.365
<00:03:29.605>the <00:03:29.954>the <00:03:30.304>amount <00:03:30.655>of <00:03:31.005>information

62
00:03:32.075 --> 00:03:34.445
<00:03:32.075>that <00:03:32.250>the <00:03:32.424>model <00:03:32.600>can <00:03:32.774>handle <00:03:32.950>at <00:03:33.125>the <00:03:33.299>same <00:03:33.475>time.

63
00:03:35.275 --> 00:03:37.245
<00:03:35.275>This <00:03:35.475>is <00:03:35.675>when <00:03:35.875>we <00:03:36.075>are <00:03:36.275>using <00:03:36.475>an <00:03:36.675>application

64
00:03:37.265 --> 00:03:40.685
<00:03:37.265>and <00:03:37.392>we <00:03:37.519>are <00:03:37.646>like <00:03:37.774>sending <00:03:37.901>a <00:03:38.028>bunch <00:03:38.155>of <00:03:38.283>information <00:03:38.410>to <00:03:38.537>the <00:03:38.665>LLM.

65
00:03:41.015 --> 00:03:44.165
<00:03:41.015>There <00:03:41.154>is <00:03:41.295>a <00:03:41.434>moment <00:03:41.575>where <00:03:41.714>the <00:03:41.855>context <00:03:41.994>gets <00:03:42.135>bigger <00:03:42.274>than <00:03:42.415>the

66
00:03:44.165 --> 00:03:47.325
<00:03:44.165>model <00:03:44.364>can <00:03:44.565>support <00:03:44.765>and <00:03:44.965>the <00:03:45.165>model <00:03:45.364>starts <00:03:45.565>hallucinating

67
00:03:47.385 --> 00:03:48.965
<00:03:47.385>or <00:03:47.665>it <00:03:47.945>starts <00:03:48.225>like <00:03:48.505>guessing <00:03:48.785>things

68
00:03:48.965 --> 00:03:50.685
<00:03:48.965>that <00:03:49.198>are <00:03:49.431>not <00:03:49.665>part <00:03:49.898>of <00:03:50.131>the <00:03:50.365>context.

69
00:03:50.785 --> 00:03:51.925
<00:03:50.785>You <00:03:51.041>are <00:03:51.298>giving <00:03:51.554>the <00:03:51.811>model

70
00:03:52.865 --> 00:03:55.365
<00:03:52.865>and <00:03:53.098>some <00:03:53.331>other <00:03:53.565>context <00:03:53.798>like <00:03:54.031>fine <00:03:54.265>tuning

71
00:03:55.465 --> 00:03:59.165
<00:03:55.465>or <00:03:55.640>prompt <00:03:55.815>engineering's <00:03:55.990>pretty <00:03:56.165>much <00:03:56.340>adapt <00:03:56.515>an <00:03:56.690>existing <00:03:56.865>model,

72
00:03:59.825 --> 00:04:01.445
<00:03:59.825>uh, <00:04:00.291>with <00:04:00.758>different <00:04:01.225>data

73
00:04:01.825 --> 00:04:05.005
<00:04:01.825>or <00:04:02.024>using <00:04:02.225>different <00:04:02.424>type <00:04:02.625>of <00:04:02.825>prompts <00:04:03.024>to <00:04:03.225>guide

74
00:04:05.425 --> 00:04:06.485
<00:04:05.425>and <00:04:05.743>ground <00:04:06.061>the <00:04:06.379>model

75
00:04:06.585 --> 00:04:09.645
<00:04:06.585>to <00:04:06.785>give <00:04:06.985>a <00:04:07.185>more <00:04:07.385>accurate <00:04:07.585>response <00:04:07.785>And <00:04:07.985>evaluation.

76
00:04:09.695 --> 00:04:13.965
<00:04:09.695>Super <00:04:09.870>important <00:04:10.045>is <00:04:10.220>how <00:04:10.394>are <00:04:10.570>we <00:04:10.745>testing <00:04:10.920>our <00:04:11.095>models

77
00:04:14.185 --> 00:04:16.685
<00:04:14.185>and <00:04:14.465>systems <00:04:14.745>So <00:04:15.025>they <00:04:15.305>are <00:04:15.585>correct,

78
00:04:16.915 --> 00:04:19.565
<00:04:16.915>they <00:04:17.115>don't <00:04:17.315>have <00:04:17.515>any <00:04:17.715>bias, <00:04:17.915>they <00:04:18.115>are <00:04:18.315>robust.

79
00:04:19.745 --> 00:04:23.245
<00:04:19.745>And <00:04:19.900>also <00:04:20.056>when <00:04:20.211>we <00:04:20.367>are <00:04:20.522>uh, <00:04:20.678>doing <00:04:20.833>evaluation <00:04:20.989>of <00:04:21.144>agents

80
00:04:23.715 --> 00:04:26.685
<00:04:23.715>that <00:04:23.890>they <00:04:24.065>are <00:04:24.239>using <00:04:24.414>the <00:04:24.590>tools <00:04:24.765>that <00:04:24.940>they <00:04:25.114>are

81
00:04:27.255 --> 00:04:28.405
<00:04:27.255>completing <00:04:27.772>the <00:04:28.289>tasks

82
00:04:28.625 --> 00:04:30.725
<00:04:28.625>and <00:04:28.975>they <00:04:29.325>are <00:04:29.675>communicating <00:04:30.025>efficiently

83
00:04:31.315 --> 00:04:33.445
<00:04:31.315>with <00:04:31.781>other <00:04:32.248>different <00:04:32.715>agents.

84
00:04:35.625 --> 00:04:39.645
<00:04:35.625>So <00:04:35.752>now <00:04:35.879>let's <00:04:36.006>take <00:04:36.134>a <00:04:36.261>look <00:04:36.388>at <00:04:36.515>the <00:04:36.643>different <00:04:36.770>type <00:04:36.897>of <00:04:37.025>patterns

85
00:04:39.665 --> 00:04:42.525
<00:04:39.665>or <00:04:39.865>applications <00:04:40.065>that <00:04:40.265>I <00:04:40.465>can <00:04:40.665>build <00:04:40.865>with <00:04:41.065>ai.

86
00:04:43.225 --> 00:04:46.485
<00:04:43.225>We <00:04:43.380>have <00:04:43.536>chat. <00:04:43.691>It <00:04:43.847>is <00:04:44.002>kind <00:04:44.158>of <00:04:44.313>like <00:04:44.469>the <00:04:44.625>fundamental

87
00:04:46.625 --> 00:04:48.165
<00:04:46.625>or <00:04:47.087>foundational <00:04:47.549>use <00:04:48.011>case.

88
00:04:48.745 --> 00:04:49.805
<00:04:48.745>You <00:04:49.063>have <00:04:49.381>an <00:04:49.699>assistant

89
00:04:49.805 --> 00:04:51.725
<00:04:49.805>where <00:04:50.038>you <00:04:50.271>have <00:04:50.505>like <00:04:50.738>a <00:04:50.971>text <00:04:51.205>conversation

90
00:04:52.145 --> 00:04:53.245
<00:04:52.145>or <00:04:52.474>a <00:04:52.805>voice <00:04:53.135>conversation

91
00:04:53.265 --> 00:04:56.045
<00:04:53.265>and <00:04:53.498>it's <00:04:53.731>going <00:04:53.965>to <00:04:54.198>reply <00:04:54.431>with <00:04:54.664>information.

92
00:04:56.775 --> 00:04:58.845
<00:04:56.775>There <00:04:57.125>is <00:04:57.474>retrieval, <00:04:57.825>augmented <00:04:58.174>generation.

93
00:04:59.275 --> 00:05:03.165
<00:04:59.275>This <00:04:59.430>is <00:04:59.586>pretty <00:04:59.741>much <00:04:59.897>extending <00:05:00.052>the <00:05:00.208>context <00:05:00.363>of <00:05:00.519>an <00:05:00.674>LLM

94
00:05:03.585 --> 00:05:05.645
<00:05:03.585>by <00:05:03.818>retrieving <00:05:04.051>data <00:05:04.284>from <00:05:04.518>a <00:05:04.751>data <00:05:04.984>source

95
00:05:06.065 --> 00:05:10.645
<00:05:06.065>and <00:05:06.240>usually <00:05:06.415>it <00:05:06.590>also <00:05:06.765>relies <00:05:06.940>on <00:05:07.115>uh, <00:05:07.290>vector <00:05:07.465>databases.

96
00:05:11.385 --> 00:05:15.645
<00:05:11.385>And <00:05:11.540>we <00:05:11.696>have <00:05:11.851>agents <00:05:12.007>a <00:05:12.162>single <00:05:12.318>agent, <00:05:12.473>it's <00:05:12.629>an <00:05:12.784>agent

97
00:05:15.645 --> 00:05:17.725
<00:05:15.645>that <00:05:15.995>just <00:05:16.344>use <00:05:16.695>one <00:05:17.044>LLM

98
00:05:17.745 --> 00:05:20.525
<00:05:17.745>and <00:05:17.978>performs <00:05:18.211>all <00:05:18.445>of <00:05:18.678>the <00:05:18.911>operations <00:05:19.145>within

99
00:05:21.365 --> 00:05:22.685
<00:05:21.365>a <00:05:21.761>single <00:05:22.157>reasoning <00:05:22.553>loop

100
00:05:23.145 --> 00:05:24.765
<00:05:23.145>and <00:05:23.611>a <00:05:24.078>multi-agent <00:05:24.544>system,

101
00:05:24.815 --> 00:05:26.645
<00:05:24.815>which <00:05:25.094>is <00:05:25.375>the <00:05:25.655>more <00:05:25.935>recent <00:05:26.215>architecture

102
00:05:27.305 --> 00:05:29.685
<00:05:27.305>unlike <00:05:27.771>different <00:05:28.238>agents <00:05:28.705>communicating

103
00:05:29.825 --> 00:05:31.525
<00:05:29.825>and <00:05:30.175>passing <00:05:30.525>war <00:05:30.875>between <00:05:31.224>those.

104
00:05:33.985 --> 00:05:35.285
<00:05:33.985>So <00:05:34.219>there <00:05:34.453>are <00:05:34.687>like <00:05:34.921>some <00:05:35.155>differences

105
00:05:35.315 --> 00:05:37.325
<00:05:35.315>between <00:05:35.665>a <00:05:36.015>single <00:05:36.365>agent <00:05:36.715>architecture

106
00:05:37.425 --> 00:05:39.405
<00:05:37.425>and <00:05:37.891>multi <00:05:38.358>agent <00:05:38.825>architecture.

107
00:05:39.715 --> 00:05:42.965
<00:05:39.715>Usually <00:05:39.870>we <00:05:40.026>are <00:05:40.181>going <00:05:40.337>to <00:05:40.492>aim <00:05:40.648>for <00:05:40.803>single <00:05:40.959>agent <00:05:41.115>architecture

108
00:05:43.025 --> 00:05:46.525
<00:05:43.025>for <00:05:43.304>simple <00:05:43.585>tasks <00:05:43.864>or <00:05:44.145>user <00:05:44.424>queries

109
00:05:47.105 --> 00:05:49.525
<00:05:47.105>and <00:05:47.338>multi-agent <00:05:47.571>architecture <00:05:47.805>where <00:05:48.038>we <00:05:48.271>are <00:05:48.505>working

110
00:05:49.525 --> 00:05:53.685
<00:05:49.525>with <00:05:49.758>multi-domain <00:05:49.991>complex, <00:05:50.224>uh, <00:05:50.458>different <00:05:50.691>use <00:05:50.924>cases.

111
00:05:54.785 --> 00:05:58.885
<00:05:54.784>And <00:05:55.018>um, <00:05:55.251>there <00:05:55.484>are <00:05:55.718>like <00:05:55.951>different <00:05:56.184>ways

112
00:05:58.905 --> 00:06:02.885
<00:05:58.905>of <00:05:59.104>you <00:05:59.304>can <00:05:59.505>like <00:05:59.705>define <00:05:59.905>these <00:06:00.104>two <00:06:00.304>architectures.

113
00:06:02.885 --> 00:06:04.805
<00:06:02.885>And <00:06:03.060>we <00:06:03.235>are <00:06:03.409>going <00:06:03.585>to <00:06:03.760>show <00:06:03.935>some <00:06:04.110>examples <00:06:04.284>later.

114
00:06:08.095 --> 00:06:10.315
<00:06:08.095>The <00:06:08.375>LLM <00:06:08.655>stack <00:06:08.935>has <00:06:09.215>been <00:06:09.495>evolving

115
00:06:10.935 --> 00:06:14.355
<00:06:10.935>and <00:06:11.135>I <00:06:11.335>have <00:06:11.535>updated <00:06:11.735>this <00:06:11.935>graphic <00:06:12.135>multiple <00:06:12.335>times

116
00:06:14.355 --> 00:06:19.115
<00:06:14.355>because <00:06:14.495>every <00:06:14.635>month <00:06:14.775>we <00:06:14.915>have <00:06:15.055>a <00:06:15.195>new <00:06:15.335>tool, <00:06:15.475>a <00:06:15.615>new <00:06:15.755>paradigm.

117
00:06:19.975 --> 00:06:24.755
<00:06:19.975>So <00:06:20.102>this <00:06:20.229>is <00:06:20.356>like <00:06:20.484>my <00:06:20.611>attempt <00:06:20.738>of <00:06:20.865>define <00:06:20.993>the <00:06:21.120>cool <00:06:21.247>LLM <00:06:21.375>stack

118
00:06:25.255 --> 00:06:29.235
<00:06:25.255>as <00:06:25.382>of <00:06:25.509>today <00:06:25.636>at <00:06:25.764>the <00:06:25.891>center <00:06:26.018>we <00:06:26.145>have <00:06:26.273>the <00:06:26.400>agent <00:06:26.527>run <00:06:26.655>time,

119
00:06:29.285 --> 00:06:32.475
<00:06:29.285>which <00:06:29.412>is <00:06:29.539>the <00:06:29.666>brain, <00:06:29.794>the <00:06:29.921>one <00:06:30.048>that <00:06:30.175>takes <00:06:30.303>care <00:06:30.430>of <00:06:30.557>the <00:06:30.685>whole

120
00:06:32.535 --> 00:06:35.275
<00:06:32.534>or <00:06:32.885>orchestration <00:06:33.234>of <00:06:33.585>AI <00:06:33.934>applications.

121
00:06:35.735 --> 00:06:38.795
<00:06:35.735>And <00:06:35.875>here <00:06:36.015>is <00:06:36.155>where <00:06:36.295>we <00:06:36.435>are <00:06:36.575>going <00:06:36.715>to <00:06:36.855>use <00:06:36.995>our <00:06:37.135>orchestrator

122
00:06:39.585 --> 00:06:44.515
<00:06:39.585>long <00:06:39.760>chain <00:06:39.935>LAMA <00:06:40.109>index, <00:06:40.284>uh, <00:06:40.460>agent <00:06:40.635>SDK, <00:06:40.810>those <00:06:40.984>tools

123
00:06:44.515 --> 00:06:47.915
<00:06:44.515>that <00:06:44.670>allow <00:06:44.826>me <00:06:44.981>or <00:06:45.137>semantic <00:06:45.292>kernel, <00:06:45.448>the <00:06:45.603>one <00:06:45.759>that <00:06:45.914>uh,

124
00:06:47.915 --> 00:06:51.755
<00:06:47.915>the <00:06:48.070>previous <00:06:48.226>speaker <00:06:48.381>show <00:06:48.537>those <00:06:48.692>tools <00:06:48.848>that <00:06:49.003>take <00:06:49.159>care <00:06:49.315>of

125
00:06:52.475 --> 00:06:56.195
<00:06:52.475>creating <00:06:52.650>an <00:06:52.825>agent <00:06:53.000>and <00:06:53.175>delegate <00:06:53.350>and <00:06:53.525>use <00:06:53.700>the <00:06:53.875>tools.

126
00:06:57.335 --> 00:06:58.995
<00:06:57.335>We <00:06:57.614>also <00:06:57.895>have <00:06:58.174>a <00:06:58.455>new <00:06:58.734>layer,

127
00:06:59.005 --> 00:07:01.195
<00:06:59.005>which <00:06:59.284>is <00:06:59.565>the <00:06:59.844>inter <00:07:00.125>agent <00:07:00.405>communication.

128
00:07:01.695 --> 00:07:03.675
<00:07:01.695>How <00:07:01.928>can <00:07:02.161>I <00:07:02.395>communicate <00:07:02.628>with <00:07:02.861>other <00:07:03.094>agents?

129
00:07:03.965 --> 00:07:07.315
<00:07:03.965>There <00:07:04.104>is <00:07:04.244>a <00:07:04.385>new <00:07:04.525>protocol <00:07:04.664>called <00:07:04.804>a <00:07:04.945>two, <00:07:05.085>a <00:07:05.224>like <00:07:05.364>agent,

130
00:07:07.315 --> 00:07:10.875
<00:07:07.315>two <00:07:07.470>agent <00:07:07.626>protocol <00:07:07.781>that <00:07:07.937>allows <00:07:08.092>you <00:07:08.248>to <00:07:08.403>have <00:07:08.559>multiple <00:07:08.715>agents

131
00:07:10.875 --> 00:07:11.955
<00:07:10.875>to <00:07:11.118>talk <00:07:11.361>to <00:07:11.604>each <00:07:11.847>other.

132
00:07:12.615 --> 00:07:15.635
<00:07:12.615>And <00:07:12.770>then <00:07:12.926>we <00:07:13.081>have <00:07:13.237>some <00:07:13.392>other <00:07:13.548>different <00:07:13.703>uh, <00:07:13.859>boxes <00:07:14.015>here.

133
00:07:16.075 --> 00:07:18.775
<00:07:16.075>I <00:07:16.308>want <00:07:16.541>to <00:07:16.775>hang <00:07:17.008>to <00:07:17.241>highlight <00:07:17.474>obviously

134
00:07:18.775 --> 00:07:19.975
<00:07:18.775>the <00:07:19.135>most <00:07:19.495>important <00:07:19.855>one.

135
00:07:20.115 --> 00:07:22.815
<00:07:20.115>The <00:07:20.290>LLM <00:07:20.465>is <00:07:20.640>the <00:07:20.815>one <00:07:20.990>that <00:07:21.165>contains <00:07:21.340>the <00:07:21.515>model

136
00:07:23.155 --> 00:07:27.375
<00:07:23.155>and <00:07:23.294>that <00:07:23.434>like <00:07:23.575>different <00:07:23.715>model <00:07:23.854>providers <00:07:23.994>we <00:07:24.135>have <00:07:24.275>on <00:07:24.414>the <00:07:24.554>data,

137
00:07:27.875 --> 00:07:31.135
<00:07:27.875>uh, <00:07:28.108>box, <00:07:28.341>the <00:07:28.575>information <00:07:28.808>retrieval <00:07:29.041>here <00:07:29.275>is

138
00:07:31.135 --> 00:07:34.215
<00:07:31.135>where <00:07:31.414>we <00:07:31.695>have <00:07:31.974>vector <00:07:32.255>databases, <00:07:32.534>databases

139
00:07:34.215 --> 00:07:35.695
<00:07:34.215>where <00:07:34.548>you <00:07:34.881>can <00:07:35.214>start <00:07:35.547>information

140
00:07:35.755 --> 00:07:37.775
<00:07:35.755>as <00:07:36.034>embedding <00:07:36.315>some <00:07:36.594>perform <00:07:36.875>semantic <00:07:37.155>searches.

141
00:07:38.955 --> 00:07:42.335
<00:07:38.955>Um, <00:07:39.188>there <00:07:39.421>is <00:07:39.655>the <00:07:39.888>LLM <00:07:40.121>ops <00:07:40.354>box

142
00:07:42.925 --> 00:07:45.815
<00:07:42.925>when <00:07:43.125>we <00:07:43.325>have <00:07:43.525>the <00:07:43.725>observability <00:07:43.925>and <00:07:44.125>evaluation <00:07:44.325>tool.

143
00:07:45.825 --> 00:07:49.135
<00:07:45.825>Super <00:07:46.025>important <00:07:46.224>right <00:07:46.425>now <00:07:46.625>on <00:07:46.825>enterprise <00:07:47.025>AI <00:07:47.224>application

144
00:07:49.915 --> 00:07:54.455
<00:07:49.915>and <00:07:50.070>the <00:07:50.226>tools <00:07:50.381>box <00:07:50.537>where <00:07:50.692>you <00:07:50.848>can <00:07:51.003>communicate <00:07:51.159>an <00:07:51.315>agent

145
00:07:54.795 --> 00:07:59.615
<00:07:54.795>to <00:07:54.950>the <00:07:55.106>external <00:07:55.261>world <00:07:55.417>using <00:07:55.572>MCP, <00:07:55.728>other <00:07:55.883>APIs, <00:07:56.039>et <00:07:56.195>cetera.

146
00:08:00.795 --> 00:08:03.215
<00:08:00.795>And <00:08:00.922>for <00:08:01.049>the <00:08:01.176>front <00:08:01.304>end <00:08:01.431>is <00:08:01.558>what <00:08:01.685>I'm <00:08:01.813>going <00:08:01.940>to <00:08:02.067>be <00:08:02.195>using

147
00:08:03.235 --> 00:08:04.415
<00:08:03.235>to <00:08:03.589>consume <00:08:03.943>those <00:08:04.297>agents.

148
00:08:05.255 --> 00:08:07.695
<00:08:05.255>I <00:08:05.455>can <00:08:05.655>use <00:08:05.855>a <00:08:06.055>web <00:08:06.255>application, <00:08:06.455>mobile <00:08:06.655>application,

149
00:08:08.265 --> 00:08:10.295
<00:08:08.265>slack, <00:08:08.615>you, <00:08:08.965>you <00:08:09.315>name <00:08:09.664>it.

150
00:08:10.445 --> 00:08:13.935
<00:08:10.445>Like <00:08:10.600>the <00:08:10.756>interface <00:08:10.911>is <00:08:11.067>going <00:08:11.222>to <00:08:11.378>be <00:08:11.533>just <00:08:11.689>what <00:08:11.844>consumes

151
00:08:13.935 --> 00:08:15.215
<00:08:13.935>that <00:08:14.510>specific <00:08:15.087>agent.

152
00:08:16.975 --> 00:08:18.715
<00:08:16.975>Two <00:08:17.255>of <00:08:17.535>the <00:08:17.815>most <00:08:18.095>important <00:08:18.375>protocols

153
00:08:18.715 --> 00:08:21.955
<00:08:18.715>that <00:08:18.890>has <00:08:19.065>been <00:08:19.239>released <00:08:19.414>pretty <00:08:19.590>much <00:08:19.765>this <00:08:19.940>year <00:08:20.114>are

154
00:08:22.535 --> 00:08:23.955
<00:08:22.535>the <00:08:22.961>moral <00:08:23.387>context <00:08:23.813>protocol.

155
00:08:24.225 --> 00:08:26.115
<00:08:24.225>This <00:08:24.575>was <00:08:24.925>created <00:08:25.275>by <00:08:25.625>atropic.

156
00:08:26.775 --> 00:08:29.235
<00:08:26.775>It <00:08:27.125>defines <00:08:27.474>the <00:08:27.825>standard <00:08:28.174>for

157
00:08:30.175 --> 00:08:34.955
<00:08:30.175>how <00:08:30.350>agents <00:08:30.525>can <00:08:30.700>extend <00:08:30.875>their <00:08:31.050>context <00:08:31.225>by <00:08:31.400>consuming <00:08:31.575>resources,

158
00:08:35.545 --> 00:08:37.355
<00:08:35.544>prompts <00:08:36.011>or <00:08:36.478>executing <00:08:36.944>tools.

159
00:08:38.225 --> 00:08:40.205
<00:08:38.225>And <00:08:38.400>now <00:08:38.575>there <00:08:38.750>is <00:08:38.925>a <00:08:39.100>whole <00:08:39.275>boom <00:08:39.450>of <00:08:39.625>all

160
00:08:40.205 --> 00:08:44.485
<00:08:40.205>of <00:08:40.380>the <00:08:40.555>different <00:08:40.730>companies <00:08:40.905>creating <00:08:41.080>CPS <00:08:41.255>to <00:08:41.430>enable <00:08:41.605>agents

161
00:08:44.585 --> 00:08:45.885
<00:08:44.585>to <00:08:44.877>communicate <00:08:45.170>to <00:08:45.462>the <00:08:45.755>world.

162
00:08:47.015 --> 00:08:51.395
<00:08:47.015>You <00:08:47.131>can <00:08:47.248>think <00:08:47.365>of <00:08:47.481>NCP <00:08:47.598>as <00:08:47.715>the <00:08:47.831>kind <00:08:47.948>of <00:08:48.064>like <00:08:48.181>the <00:08:48.298>USBC <00:08:48.415>port

163
00:08:51.735 --> 00:08:52.875
<00:08:51.735>for <00:08:52.248>AI <00:08:52.761>applications.

164
00:08:53.895 --> 00:08:56.685
<00:08:53.895>And <00:08:54.069>then <00:08:54.245>we <00:08:54.420>have <00:08:54.595>the <00:08:54.770>agent <00:08:54.944>to <00:08:55.120>agent <00:08:55.295>protocol

165
00:08:56.915 --> 00:09:00.845
<00:08:56.915>that <00:08:57.089>was <00:08:57.265>created <00:08:57.439>by <00:08:57.615>Google, <00:08:57.790>which <00:08:57.964>allows <00:08:58.140>different <00:08:58.314>agents

166
00:09:00.945 --> 00:09:02.285
<00:09:00.945>to <00:09:01.246>communicate <00:09:01.548>to <00:09:01.849>each <00:09:02.151>other.

167
00:09:02.865 --> 00:09:07.365
<00:09:02.865>So <00:09:02.981>I <00:09:03.098>can <00:09:03.215>have <00:09:03.331>an <00:09:03.448>agent <00:09:03.565>build <00:09:03.681>with <00:09:03.798>the <00:09:03.915>Google <00:09:04.031>a <00:09:04.148>DK <00:09:04.265>framework,

168
00:09:07.555 --> 00:09:11.165
<00:09:07.555>another <00:09:07.729>agent <00:09:07.905>build <00:09:08.079>with <00:09:08.255>long <00:09:08.430>chain, <00:09:08.604>another <00:09:08.780>agent <00:09:08.954>build

169
00:09:11.165 --> 00:09:12.365
<00:09:11.165>with <00:09:11.704>Q <00:09:12.245>ai.

170
00:09:12.785 --> 00:09:16.165
<00:09:12.785>And <00:09:12.925>since <00:09:13.064>those <00:09:13.204>agents <00:09:13.344>can <00:09:13.485>speak <00:09:13.625>the <00:09:13.765>A <00:09:13.905>to <00:09:14.045>a <00:09:14.185>protocol,

171
00:09:16.725 --> 00:09:19.045
<00:09:16.725>I <00:09:16.958>can <00:09:17.191>just <00:09:17.425>delegate <00:09:17.658>work <00:09:17.891>to <00:09:18.125>those.

172
00:09:19.665 --> 00:09:23.085
<00:09:19.665>And <00:09:19.781>pretty <00:09:19.898>much <00:09:20.015>the <00:09:20.131>a <00:09:20.248>to <00:09:20.365>a <00:09:20.481>protocol <00:09:20.598>allows <00:09:20.714>me <00:09:20.831>to <00:09:20.948>define <00:09:21.064>kind

173
00:09:23.085 --> 00:09:25.485
<00:09:23.085>of <00:09:23.285>like <00:09:23.485>a <00:09:23.685>business <00:09:23.885>card <00:09:24.085>for <00:09:24.285>an <00:09:24.485>agent.

174
00:09:26.225 --> 00:09:29.685
<00:09:26.225>It <00:09:26.400>has <00:09:26.575>a <00:09:26.750>metadata <00:09:26.925>that <00:09:27.100>describes <00:09:27.275>the <00:09:27.450>agent <00:09:27.625>capabilities,

175
00:09:30.465 --> 00:09:33.805
<00:09:30.465>the <00:09:30.605>tools, <00:09:30.745>the <00:09:30.885>skills, <00:09:31.025>how <00:09:31.165>can <00:09:31.305>I <00:09:31.445>authenticate <00:09:31.585>with <00:09:31.725>the <00:09:31.865>agent

176
00:09:34.145 --> 00:09:39.005
<00:09:34.145>and <00:09:34.285>then <00:09:34.425>how <00:09:34.564>can <00:09:34.704>I <00:09:34.845>specify <00:09:34.985>work <00:09:35.125>to <00:09:35.265>start, <00:09:35.405>uh, <00:09:35.545>working

177
00:09:39.005 --> 00:09:40.285
<00:09:39.005>with <00:09:39.389>these <00:09:39.773>multiple <00:09:40.156>agents.

178
00:09:42.665 --> 00:09:45.725
<00:09:42.665>But <00:09:42.792>to <00:09:42.919>build <00:09:43.046>AI <00:09:43.174>applications, <00:09:43.301>we <00:09:43.428>need <00:09:43.555>to <00:09:43.683>use <00:09:43.810>the <00:09:43.937>right <00:09:44.064>tools

179
00:09:45.745 --> 00:09:48.045
<00:09:45.745>for <00:09:46.025>us <00:09:46.305>just <00:09:46.585>like <00:09:46.865>many <00:09:47.145>options

180
00:09:48.305 --> 00:09:52.205
<00:09:48.305>and <00:09:48.460>we <00:09:48.616>are <00:09:48.771>going <00:09:48.927>to <00:09:49.082>always <00:09:49.238>follow <00:09:49.393>on <00:09:49.549>on <00:09:49.704>this

181
00:09:52.265 --> 00:09:54.005
<00:09:52.265>uh, <00:09:52.965>choice <00:09:53.665>fatigue.

182
00:09:54.915 --> 00:09:56.045
<00:09:54.915>What <00:09:55.118>are <00:09:55.321>going <00:09:55.525>to <00:09:55.728>be <00:09:55.932>using

183
00:09:56.105 --> 00:09:57.885
<00:09:56.105>to <00:09:56.385>build <00:09:56.665>the <00:09:56.945>next <00:09:57.225>AI <00:09:57.505>applications.

184
00:09:58.545 --> 00:10:00.645
<00:09:58.545>So <00:09:58.719>use <00:09:58.895>the <00:09:59.069>ones <00:09:59.245>that <00:09:59.420>make <00:09:59.594>sense <00:09:59.770>for <00:09:59.944>you.

185
00:10:01.425 --> 00:10:03.365
<00:10:01.425>For <00:10:01.658>example, <00:10:01.891>what <00:10:02.125>is <00:10:02.358>your <00:10:02.591>programming <00:10:02.824>language?

186
00:10:04.505 --> 00:10:06.965
<00:10:04.505>Are <00:10:04.660>you <00:10:04.816>a <00:10:04.971>Python <00:10:05.127>developer? <00:10:05.282>Are <00:10:05.438>you <00:10:05.593>a <00:10:05.749>Java <00:10:05.905>developer?

187
00:10:07.465 --> 00:10:09.845
<00:10:07.465>Are <00:10:07.665>you <00:10:07.865>a <00:10:08.065>JavaScript <00:10:08.265>or <00:10:08.465>no <00:10:08.665>JS <00:10:08.865>developer?

188
00:10:10.145 --> 00:10:11.685
<00:10:10.145>So <00:10:10.491>depending <00:10:10.838>on <00:10:11.184>your <00:10:11.531>ecosystem,

189
00:10:11.685 --> 00:10:13.405
<00:10:11.685>there <00:10:11.918>are <00:10:12.151>like <00:10:12.385>a <00:10:12.618>specific <00:10:12.851>SD <00:10:13.084>case

190
00:10:13.405 --> 00:10:15.845
<00:10:13.405>that <00:10:13.638>will <00:10:13.871>solve <00:10:14.105>the <00:10:14.338>problem <00:10:14.571>for <00:10:14.805>you.

191
00:10:16.865 --> 00:10:19.085
<00:10:16.865>In <00:10:17.040>my <00:10:17.215>case, <00:10:17.390>I <00:10:17.565>am <00:10:17.740>a <00:10:17.915>no <00:10:18.090>JS <00:10:18.265>developer

192
00:10:19.145 --> 00:10:20.405
<00:10:19.145>and <00:10:19.334>this <00:10:19.523>is <00:10:19.712>why <00:10:19.901>today <00:10:20.089>I'm <00:10:20.279>going

193
00:10:20.405 --> 00:10:24.445
<00:10:20.405>to <00:10:20.545>be <00:10:20.685>showing <00:10:20.824>you <00:10:20.964>examples <00:10:21.105>using <00:10:21.245>long <00:10:21.385>chain <00:10:21.525>for <00:10:21.665>no <00:10:21.805>js.

194
00:10:26.715 --> 00:10:29.165
<00:10:26.715>Then <00:10:26.890>we <00:10:27.065>need <00:10:27.240>to <00:10:27.415>pick <00:10:27.590>a <00:10:27.765>large <00:10:27.940>language <00:10:28.115>model.

195
00:10:29.465 --> 00:10:33.205
<00:10:29.465>Two <00:10:29.605>of <00:10:29.745>the <00:10:29.885>most <00:10:30.025>popular <00:10:30.165>ones <00:10:30.305>for <00:10:30.445>AI <00:10:30.585>applications <00:10:30.725>are <00:10:30.865>going

196
00:10:33.205 --> 00:10:35.565
<00:10:33.205>to <00:10:33.485>be <00:10:33.765>GPT <00:10:34.045>from <00:10:34.325>open <00:10:34.605>AI

197
00:10:36.475 --> 00:10:38.295
<00:10:36.475>or <00:10:36.941>cloud <00:10:37.408>from <00:10:37.875>atropic.

198
00:10:38.675 --> 00:10:42.295
<00:10:38.675>You <00:10:38.849>can <00:10:39.025>also <00:10:39.199>use <00:10:39.375>Gemini, <00:10:39.550>uh, <00:10:39.724>masal <00:10:39.900>from <00:10:40.074>mytral.

199
00:10:42.295 --> 00:10:45.775
<00:10:42.295>They <00:10:42.495>like <00:10:42.694>many <00:10:42.895>other <00:10:43.094>models, <00:10:43.295>deep <00:10:43.495>seek, <00:10:43.694>um,

200
00:10:46.655 --> 00:10:47.935
<00:10:46.655>llama <00:10:47.806>grok.

201
00:10:48.475 --> 00:10:51.535
<00:10:48.475>But <00:10:48.615>these <00:10:48.755>are <00:10:48.895>the <00:10:49.035>two <00:10:49.175>that <00:10:49.315>I <00:10:49.455>have <00:10:49.595>worked <00:10:49.735>more <00:10:49.875>recently.

202
00:10:52.715 --> 00:10:55.655
<00:10:52.715>So <00:10:52.842>for <00:10:52.969>the <00:10:53.096>examples <00:10:53.224>that <00:10:53.351>I'm <00:10:53.478>going <00:10:53.605>to <00:10:53.733>show <00:10:53.860>you, <00:10:53.987>I'm <00:10:54.115>going

203
00:10:55.655 --> 00:10:59.695
<00:10:55.655>to <00:10:55.795>be <00:10:55.935>using <00:10:56.074>the <00:10:56.214>two <00:10:56.355>GPT <00:10:56.495>in <00:10:56.635>this <00:10:56.775>case <00:10:56.915>photo <00:10:57.055>mini

204
00:11:00.275 --> 00:11:02.015
<00:11:00.275>and <00:11:00.741>clo <00:11:01.208>uh, <00:11:01.675>sonnet.

205
00:11:03.915 --> 00:11:06.975
<00:11:03.915>And <00:11:04.089>then <00:11:04.265>if <00:11:04.439>we <00:11:04.615>are <00:11:04.790>working <00:11:04.964>with <00:11:05.140>augmented <00:11:05.314>generation,

206
00:11:07.355 --> 00:11:08.855
<00:11:07.355>we <00:11:07.580>need <00:11:07.805>to <00:11:08.030>pick <00:11:08.255>a <00:11:08.480>vector <00:11:08.705>database.

207
00:11:09.275 --> 00:11:10.855
<00:11:09.275>You <00:11:09.625>also <00:11:09.975>have <00:11:10.324>many <00:11:10.675>options.

208
00:11:11.515 --> 00:11:14.335
<00:11:11.515>In <00:11:11.748>my <00:11:11.981>case <00:11:12.215>I've <00:11:12.448>been <00:11:12.681>using <00:11:12.915>PostgreSQL

209
00:11:14.795 --> 00:11:18.255
<00:11:14.795>as <00:11:14.995>my <00:11:15.194>go-to <00:11:15.395>relational <00:11:15.594>database <00:11:15.795>for <00:11:15.995>a <00:11:16.194>while

210
00:11:18.875 --> 00:11:21.495
<00:11:18.875>and <00:11:19.155>PostgreSQL <00:11:19.435>has <00:11:19.715>a <00:11:19.995>vector <00:11:20.275>support,

211
00:11:21.945 --> 00:11:23.935
<00:11:21.945>which <00:11:22.225>is <00:11:22.505>the <00:11:22.785>PG <00:11:23.065>vector <00:11:23.345>extension.

212
00:11:24.515 --> 00:11:26.975
<00:11:24.515>So <00:11:24.795>you <00:11:25.074>can <00:11:25.355>enable <00:11:25.635>vector <00:11:25.915>support

213
00:11:26.975 --> 00:11:29.415
<00:11:26.975>and <00:11:27.325>embedding <00:11:27.675>support <00:11:28.025>to <00:11:28.375>PostgreSQL.

214
00:11:32.555 --> 00:11:34.975
<00:11:32.555>So <00:11:32.755>a <00:11:32.954>vector <00:11:33.155>database <00:11:33.354>pretty <00:11:33.555>much <00:11:33.755>allows <00:11:33.954>me

215
00:11:34.975 --> 00:11:37.655
<00:11:34.975>to <00:11:35.255>store <00:11:35.535>information <00:11:35.815>as <00:11:36.095>multidimensional <00:11:36.375>vectors.

216
00:11:37.925 --> 00:11:40.095
<00:11:37.925>This <00:11:38.125>is <00:11:38.324>just <00:11:38.525>an <00:11:38.724>array <00:11:38.925>of <00:11:39.125>multiple <00:11:39.324>numbers

217
00:11:40.635 --> 00:11:44.335
<00:11:40.635>and <00:11:40.810>I <00:11:40.985>generate <00:11:41.160>those <00:11:41.335>numbers <00:11:41.510>from <00:11:41.685>a <00:11:41.860>embedding <00:11:42.035>model.

218
00:11:44.655 --> 00:11:47.215
<00:11:44.655>I <00:11:44.810>need <00:11:44.966>to <00:11:45.121>use <00:11:45.277>an <00:11:45.432>AI <00:11:45.588>model <00:11:45.743>to <00:11:45.899>convert <00:11:46.055>text

219
00:11:47.635 --> 00:11:48.695
<00:11:47.635>to <00:11:48.112>these <00:11:48.589>embeddings.

220
00:11:48.995 --> 00:11:53.325
<00:11:48.995>And <00:11:49.195>then <00:11:49.395>I'm <00:11:49.595>using <00:11:49.795>semantic <00:11:49.995>operations <00:11:50.195>using <00:11:50.395>some

221
00:11:53.415 --> 00:11:57.165
<00:11:53.415>algorithms <00:11:53.648>to <00:11:53.881>search <00:11:54.115>similarities <00:11:54.348>between <00:11:54.581>the <00:11:54.814>text

222
00:11:57.595 --> 00:11:58.765
<00:11:57.595>that <00:11:58.121>I'm <00:11:58.648>querying

223
00:11:58.865 --> 00:12:02.645
<00:11:58.865>and <00:11:59.020>the <00:11:59.176>text <00:11:59.331>that <00:11:59.487>I <00:11:59.642>store <00:11:59.798>in <00:11:59.953>the <00:12:00.109>vector <00:12:00.265>database.

224
00:12:03.305 --> 00:12:05.845
<00:12:03.305>In <00:12:03.460>this <00:12:03.616>example, <00:12:03.771>I'm <00:12:03.927>performing <00:12:04.082>a <00:12:04.238>query <00:12:04.393>to <00:12:04.549>list <00:12:04.704>all

225
00:12:05.845 --> 00:12:08.765
<00:12:05.845>of <00:12:06.020>the <00:12:06.195>animals <00:12:06.370>that <00:12:06.545>are <00:12:06.720>similar <00:12:06.895>to <00:12:07.070>a <00:12:07.245>shark

226
00:12:09.465 --> 00:12:12.165
<00:12:09.465>and <00:12:09.620>it <00:12:09.776>is <00:12:09.931>returning <00:12:10.087>from <00:12:10.242>my <00:12:10.398>database <00:12:10.553>of, <00:12:10.709>of <00:12:10.865>animals

227
00:12:12.785 --> 00:12:14.685
<00:12:12.785>the <00:12:13.251>crocodile <00:12:13.718>dolphin <00:12:14.185>whale.

228
00:12:15.195 --> 00:12:18.645
<00:12:15.195>Even <00:12:15.335>though <00:12:15.475>these <00:12:15.615>are <00:12:15.755>not <00:12:15.895>part <00:12:16.035>of <00:12:16.175>like <00:12:16.315>the <00:12:16.455>same <00:12:16.595>species,

229
00:12:19.295 --> 00:12:21.325
<00:12:19.295>those <00:12:19.495>are <00:12:19.694>animals <00:12:19.895>that <00:12:20.094>live <00:12:20.295>on <00:12:20.495>the <00:12:20.694>water

230
00:12:21.625 --> 00:12:25.365
<00:12:21.625>and <00:12:21.800>it <00:12:21.975>is <00:12:22.150>finding <00:12:22.325>for <00:12:22.500>that <00:12:22.675>semantic, <00:12:22.850>uh, <00:12:23.025>relationship

231
00:12:25.675 --> 00:12:29.685
<00:12:25.675>between <00:12:25.830>water <00:12:25.986>and <00:12:26.141>where <00:12:26.297>the <00:12:26.452>shark <00:12:26.608>is <00:12:26.763>to <00:12:26.919>feed, <00:12:27.074>uh,

232
00:12:29.685 --> 00:12:31.285
<00:12:29.685>to <00:12:30.035>fetch <00:12:30.385>this <00:12:30.734>uh, <00:12:31.084>list.

233
00:12:33.995 --> 00:12:35.055
<00:12:33.995>And <00:12:34.313>finally <00:12:34.631>we <00:12:34.949>need

234
00:12:35.055 --> 00:12:38.135
<00:12:35.055>to <00:12:35.255>pick <00:12:35.454>an <00:12:35.655>orchestration <00:12:35.854>framework <00:12:36.055>for <00:12:36.255>no <00:12:36.454>js.

235
00:12:38.515 --> 00:12:42.295
<00:12:38.515>So <00:12:38.631>far <00:12:38.748>I <00:12:38.865>have <00:12:38.981>found <00:12:39.098>two <00:12:39.215>uh, <00:12:39.331>long <00:12:39.448>chain, <00:12:39.564>which <00:12:39.681>is <00:12:39.798>the <00:12:39.915>one

236
00:12:42.295 --> 00:12:44.575
<00:12:42.295>that <00:12:42.528>I <00:12:42.761>have <00:12:42.995>most <00:12:43.228>more <00:12:43.461>experience <00:12:43.694>with

237
00:12:44.875 --> 00:12:47.735
<00:12:44.875>and <00:12:45.050>recently <00:12:45.225>there <00:12:45.400>is <00:12:45.575>a <00:12:45.750>new <00:12:45.925>one <00:12:46.100>called <00:12:46.275>Mastro,

238
00:12:48.505 --> 00:12:51.495
<00:12:48.505>which <00:12:48.680>is <00:12:48.855>also <00:12:49.030>like <00:12:49.205>amazing <00:12:49.380>framework <00:12:49.555>to <00:12:49.730>build <00:12:49.905>agents.

239
00:12:51.835 --> 00:12:53.335
<00:12:51.835>But <00:12:52.003>today <00:12:52.172>I'm <00:12:52.341>going <00:12:52.510>to <00:12:52.678>be <00:12:52.847>showing <00:12:53.016>you <00:12:53.185>all

240
00:12:53.335 --> 00:12:55.175
<00:12:53.335>of <00:12:53.685>the <00:12:54.035>examples <00:12:54.385>on <00:12:54.735>launching.

241
00:12:55.925 --> 00:12:58.665
<00:12:55.925>So <00:12:56.099>my <00:12:56.275>choice <00:12:56.449>today <00:12:56.625>for <00:12:56.800>building <00:12:56.974>AI <00:12:57.150>applications <00:12:57.324>is

242
00:12:58.665 --> 00:13:01.785
<00:12:58.665>launching, <00:12:58.944>this <00:12:59.224>is <00:12:59.505>mostly <00:12:59.785>renowned <00:13:00.064>within

243
00:13:01.845 --> 00:13:02.865
<00:13:01.845>the <00:13:02.304>Python <00:13:02.763>ecosystem.

244
00:13:02.975 --> 00:13:06.465
<00:13:02.975>This <00:13:03.130>has <00:13:03.286>been <00:13:03.441>the, <00:13:03.597>the, <00:13:03.752>the, <00:13:03.908>the <00:13:04.063>facto <00:13:04.219>framework <00:13:04.375>for

245
00:13:06.985 --> 00:13:09.825
<00:13:06.985>building <00:13:07.218>AI <00:13:07.451>agents <00:13:07.685>in <00:13:07.918>the <00:13:08.151>Python <00:13:08.385>ecosystem.

246
00:13:10.365 --> 00:13:14.025
<00:13:10.365>But <00:13:10.492>it <00:13:10.619>has, <00:13:10.746>it <00:13:10.874>also <00:13:11.001>has <00:13:11.128>extensive <00:13:11.255>support <00:13:11.383>in <00:13:11.510>the <00:13:11.637>no <00:13:11.765>JS

247
00:13:14.025 --> 00:13:15.425
<00:13:14.025>and <00:13:14.655>JavaScript <00:13:15.285>ecosystem.

248
00:13:16.485 --> 00:13:20.945
<00:13:16.485>So <00:13:16.640>you <00:13:16.796>are <00:13:16.951>going <00:13:17.107>to <00:13:17.262>use <00:13:17.418>uh, <00:13:17.573>some <00:13:17.729>basic <00:13:17.885>libraries.

249
00:13:21.605 --> 00:13:24.105
<00:13:21.605>One <00:13:21.745>is <00:13:21.885>the <00:13:22.025>launching <00:13:22.165>core <00:13:22.305>that <00:13:22.445>has <00:13:22.585>all <00:13:22.725>of <00:13:22.865>the <00:13:23.005>basic

250
00:13:24.905 --> 00:13:28.145
<00:13:24.905>abstractions <00:13:25.138>and <00:13:25.371>the <00:13:25.605>long <00:13:25.838>chain <00:13:26.071>expression <00:13:26.305>language.

251
00:13:28.415 --> 00:13:31.065
<00:13:28.415>That <00:13:28.570>is <00:13:28.726>the <00:13:28.881>one <00:13:29.037>that <00:13:29.192>allows <00:13:29.348>you <00:13:29.503>to <00:13:29.659>compose <00:13:29.814>change

252
00:13:31.165 --> 00:13:32.345
<00:13:31.165>and <00:13:31.696>compose <00:13:32.227>agents.

253
00:13:33.485 --> 00:13:36.905
<00:13:33.485>You <00:13:33.640>have <00:13:33.796>the <00:13:33.951>long <00:13:34.107>chain <00:13:34.262>community <00:13:34.418>which <00:13:34.573>contains <00:13:34.729>a <00:13:34.885>lot

254
00:13:36.905 --> 00:13:39.465
<00:13:36.905>of <00:13:37.185>third <00:13:37.464>party <00:13:37.745>integrations, <00:13:38.025>document <00:13:38.305>loaders,

255
00:13:39.465 --> 00:13:42.465
<00:13:39.465>different <00:13:39.640>tools <00:13:39.815>that <00:13:39.990>you <00:13:40.165>can <00:13:40.340>integrate <00:13:40.515>with <00:13:40.690>long <00:13:40.865>chain.

256
00:13:43.725 --> 00:13:46.825
<00:13:43.725>One <00:13:43.880>of <00:13:44.036>the <00:13:44.191>most <00:13:44.347>recent <00:13:44.502>packages <00:13:44.658>is <00:13:44.813>the <00:13:44.969>MCP <00:13:45.125>adapters

257
00:13:47.255 --> 00:13:49.305
<00:13:47.255>that <00:13:47.605>allows <00:13:47.955>you <00:13:48.305>to <00:13:48.655>execute

258
00:13:50.005 --> 00:13:53.705
<00:13:50.005>CPS <00:13:50.238>model <00:13:50.471>context <00:13:50.705>protocol <00:13:50.938>applications <00:13:51.171>from <00:13:51.405>a

259
00:13:53.705 --> 00:13:54.745
<00:13:53.705>launch <00:13:54.173>chain <00:13:54.641>app.

260
00:13:55.365 --> 00:13:57.265
<00:13:55.365>And <00:13:55.598>then <00:13:55.831>you <00:13:56.065>have <00:13:56.298>the <00:13:56.531>partner <00:13:56.765>packages.

261
00:13:57.645 --> 00:14:00.825
<00:13:57.645>Launch <00:13:57.845>chain <00:13:58.045>can <00:13:58.245>work <00:13:58.444>with <00:13:58.645>many <00:13:58.845>LLM <00:13:59.045>provider

262
00:14:01.285 --> 00:14:04.425
<00:14:01.285>and <00:14:01.440>you <00:14:01.596>can <00:14:01.751>just <00:14:01.907>pretty <00:14:02.062>much <00:14:02.218>replace <00:14:02.373>the <00:14:02.529>LLM <00:14:02.685>provider

263
00:14:05.295 --> 00:14:06.665
<00:14:05.295>with <00:14:05.603>one <00:14:05.911>line <00:14:06.219>of <00:14:06.528>code

264
00:14:07.045 --> 00:14:10.305
<00:14:07.045>and <00:14:07.219>you <00:14:07.395>can <00:14:07.569>find <00:14:07.745>providers <00:14:07.920>for <00:14:08.094>open <00:14:08.270>ai, <00:14:08.444>tropic,

265
00:14:10.335 --> 00:14:12.465
<00:14:10.335>menstrual <00:14:10.801>Gemini, <00:14:11.268>et <00:14:11.735>cetera.

266
00:14:14.475 --> 00:14:16.015
<00:14:14.475>But <00:14:14.752>there <00:14:15.029>is <00:14:15.306>also <00:14:15.583>land <00:14:15.861>graph.

267
00:14:16.285 --> 00:14:18.335
<00:14:16.285>This <00:14:16.564>is <00:14:16.844>also <00:14:17.125>another <00:14:17.405>framework <00:14:17.685>created

268
00:14:18.515 --> 00:14:22.575
<00:14:18.515>by <00:14:18.689>the <00:14:18.865>long <00:14:19.040>chain <00:14:19.215>company, <00:14:19.390>which <00:14:19.564>is <00:14:19.740>mostly <00:14:19.915>to

269
00:14:23.195 --> 00:14:26.095
<00:14:23.195>create <00:14:23.661>more <00:14:24.128>complex <00:14:24.595>agents

270
00:14:26.195 --> 00:14:28.295
<00:14:26.195>and <00:14:26.895>multi-agent <00:14:27.595>architectures.

271
00:14:30.175 --> 00:14:33.945
<00:14:30.175>This <00:14:30.375>is <00:14:30.574>a <00:14:30.775>grave, <00:14:30.974>a <00:14:31.175>graph <00:14:31.375>based <00:14:31.574>framework.

272
00:14:34.005 --> 00:14:37.145
<00:14:34.005>So <00:14:34.160>you <00:14:34.316>are <00:14:34.471>going <00:14:34.627>to <00:14:34.782>compose <00:14:34.938>the <00:14:35.093>agents <00:14:35.249>as <00:14:35.405>graphs

273
00:14:37.885 --> 00:14:41.225
<00:14:37.885>and <00:14:38.012>then <00:14:38.139>you <00:14:38.266>are <00:14:38.394>going <00:14:38.521>to <00:14:38.648>start <00:14:38.775>like <00:14:38.903>defining <00:14:39.030>how <00:14:39.157>it <00:14:39.285>works.

274
00:14:41.845 --> 00:14:46.465
<00:14:41.845>It <00:14:42.045>has <00:14:42.245>support <00:14:42.445>for <00:14:42.645>catching <00:14:42.845>retry, <00:14:43.045>resume <00:14:43.245>streaming,

275
00:14:46.735 --> 00:14:48.185
<00:14:46.735>different <00:14:47.387>agent <00:14:48.040>loops.

276
00:14:48.285 --> 00:14:50.945
<00:14:48.285>It <00:14:48.564>is <00:14:48.844>for <00:14:49.125>more <00:14:49.405>complex <00:14:49.685>operations

277
00:14:51.625 --> 00:14:52.645
<00:14:51.625>and <00:14:51.854>you <00:14:52.084>can <00:14:52.313>install <00:14:52.543>it

278
00:14:52.645 --> 00:14:55.405
<00:14:52.645>by <00:14:52.800>using <00:14:52.956>just <00:14:53.111>the <00:14:53.267>land <00:14:53.422>graph <00:14:53.578>package <00:14:53.733>within <00:14:53.889>long <00:14:54.045>chain.

279
00:14:57.185 --> 00:14:59.845
<00:14:57.185>So <00:14:57.340>some <00:14:57.496>difference <00:14:57.651>when <00:14:57.807>to <00:14:57.962>use <00:14:58.118>one <00:14:58.273>over <00:14:58.429>the <00:14:58.584>other.

280
00:15:00.625 --> 00:15:02.645
<00:15:00.625>If <00:15:00.858>you <00:15:01.091>are <00:15:01.325>working <00:15:01.558>with <00:15:01.791>simple <00:15:02.025>chain,

281
00:15:02.705 --> 00:15:06.365
<00:15:02.705>simple <00:15:02.905>application <00:15:03.105>single <00:15:03.305>agents, <00:15:03.505>long <00:15:03.705>chain <00:15:03.905>is <00:15:04.105>going

282
00:15:06.365 --> 00:15:07.965
<00:15:06.365>to <00:15:06.645>be <00:15:06.925>your <00:15:07.205>your <00:15:07.485>best <00:15:07.765>choice.

283
00:15:09.225 --> 00:15:10.965
<00:15:09.225>If <00:15:09.505>you <00:15:09.785>are <00:15:10.065>working <00:15:10.345>with <00:15:10.625>retrieval,

284
00:15:10.965 --> 00:15:13.325
<00:15:10.965>augmented <00:15:11.315>generations <00:15:11.665>applications, <00:15:12.015>the <00:15:12.365>ones

285
00:15:13.325 --> 00:15:16.805
<00:15:13.325>that <00:15:13.452>mixes <00:15:13.579>chats <00:15:13.706>and <00:15:13.834>search, <00:15:13.961>you <00:15:14.088>can <00:15:14.215>use, <00:15:14.343>you <00:15:14.470>can <00:15:14.597>use <00:15:14.725>both.

286
00:15:17.625 --> 00:15:20.165
<00:15:17.625>The <00:15:17.825>same <00:15:18.025>fundamentals <00:15:18.225>from <00:15:18.425>land <00:15:18.625>graph <00:15:18.825>are <00:15:19.025>going

287
00:15:20.165 --> 00:15:21.285
<00:15:20.165>to <00:15:20.366>be <00:15:20.568>used <00:15:20.769>in <00:15:20.971>land <00:15:21.173>chain

288
00:15:21.465 --> 00:15:23.285
<00:15:21.465>or <00:15:21.698>other <00:15:21.931>different <00:15:22.165>framework <00:15:22.398>in <00:15:22.631>the <00:15:22.865>backend

289
00:15:24.105 --> 00:15:25.405
<00:15:24.105>for <00:15:24.495>agent <00:15:24.885>tool <00:15:25.275>use.

290
00:15:25.935 --> 00:15:28.005
<00:15:25.935>Basic <00:15:26.214>also <00:15:26.494>you <00:15:26.775>can <00:15:27.055>use <00:15:27.334>both.

291
00:15:28.665 --> 00:15:32.565
<00:15:28.665>But <00:15:28.820>now <00:15:28.976>when <00:15:29.131>you <00:15:29.287>start <00:15:29.442>adding <00:15:29.598>complex <00:15:29.753>logic <00:15:29.909>like <00:15:30.064>branching

292
00:15:32.945 --> 00:15:37.165
<00:15:32.945>making <00:15:33.100>decisions <00:15:33.256>what <00:15:33.411>agent <00:15:33.567>to <00:15:33.722>call <00:15:33.878>depending <00:15:34.033>of <00:15:34.189>an <00:15:34.345>output

293
00:15:37.165 --> 00:15:41.265
<00:15:37.165>of <00:15:37.320>a <00:15:37.476>previous <00:15:37.631>agent, <00:15:37.787>doing <00:15:37.942>that <00:15:38.098>on <00:15:38.253>launching <00:15:38.409>is <00:15:38.564>going

294
00:15:41.265 --> 00:15:42.305
<00:15:41.265>to <00:15:41.577>be <00:15:41.889>pretty <00:15:42.200>difficult.

295
00:15:42.525 --> 00:15:44.585
<00:15:42.525>So <00:15:42.680>this <00:15:42.836>is <00:15:42.991>why <00:15:43.147>land <00:15:43.302>graph <00:15:43.458>exists <00:15:43.613>to <00:15:43.769>be <00:15:43.925>able

296
00:15:44.585 --> 00:15:46.545
<00:15:44.585>to <00:15:44.935>manage <00:15:45.285>those <00:15:45.635>complex <00:15:45.985>workflows

297
00:15:47.005 --> 00:15:51.905
<00:15:47.005>and <00:15:47.160>it <00:15:47.316>also <00:15:47.471>supports <00:15:47.627>a <00:15:47.782>state, <00:15:47.938>uh, <00:15:48.093>retry <00:15:48.249>mechanisms, <00:15:48.405>uh,

298
00:15:51.935 --> 00:15:56.425
<00:15:51.935>concurrency <00:15:52.135>and <00:15:52.334>it <00:15:52.535>provides <00:15:52.734>a <00:15:52.935>better <00:15:53.135>developer <00:15:53.334>experience.

299
00:15:59.645 --> 00:16:03.585
<00:15:59.645>So <00:15:59.785>how <00:15:59.925>can <00:16:00.064>I <00:16:00.204>write <00:16:00.345>the <00:16:00.485>basic <00:16:00.625>hello <00:16:00.765>world <00:16:00.905>application <00:16:01.045>in

300
00:16:03.585 --> 00:16:08.505
<00:16:03.585>JavaScript <00:16:03.740>using <00:16:03.896>Chain <00:16:04.051>First <00:16:04.207>I <00:16:04.362>need <00:16:04.518>to <00:16:04.673>get <00:16:04.829>the <00:16:04.985>provider.

301
00:16:08.815 --> 00:16:10.745
<00:16:08.815>This <00:16:09.015>is <00:16:09.215>the <00:16:09.415>model <00:16:09.615>I <00:16:09.815>am <00:16:10.015>working <00:16:10.215>with.

302
00:16:11.825 --> 00:16:13.865
<00:16:11.825>I <00:16:12.058>create <00:16:12.291>an <00:16:12.525>instant <00:16:12.758>of <00:16:12.991>that <00:16:13.225>model.

303
00:16:14.585 --> 00:16:17.345
<00:16:14.585>I <00:16:14.712>specify <00:16:14.839>what <00:16:14.966>is <00:16:15.094>the <00:16:15.221>model <00:16:15.348>name <00:16:15.475>that <00:16:15.603>I'm <00:16:15.730>going <00:16:15.857>to <00:16:15.985>use

304
00:16:17.885 --> 00:16:21.265
<00:16:17.885>in <00:16:18.025>the <00:16:18.165>case <00:16:18.305>of <00:16:18.444>open <00:16:18.585>ai, <00:16:18.725>I <00:16:18.865>can <00:16:19.005>use <00:16:19.145>O <00:16:19.285>3G,

305
00:16:21.305 --> 00:16:23.345
<00:16:21.305>PT <00:16:21.655>four <00:16:22.005>O, <00:16:22.354>et <00:16:22.704>cetera.

306
00:16:23.965 --> 00:16:25.745
<00:16:23.965>And <00:16:24.198>there <00:16:24.431>are <00:16:24.665>like <00:16:24.898>some <00:16:25.131>other <00:16:25.365>parameters

307
00:16:25.745 --> 00:16:29.225
<00:16:25.745>that <00:16:25.885>I <00:16:26.025>can <00:16:26.165>pass <00:16:26.305>like <00:16:26.445>temperature <00:16:26.585>top <00:16:26.725>p <00:16:26.865>there <00:16:27.005>are <00:16:27.145>like

308
00:16:29.225 --> 00:16:31.225
<00:16:29.225>different <00:16:29.458>parameters <00:16:29.691>that <00:16:29.925>you <00:16:30.158>can <00:16:30.391>pass <00:16:30.625>to

309
00:16:32.495 --> 00:16:34.545
<00:16:32.495>tell <00:16:32.775>the <00:16:33.055>LLM <00:16:33.335>how <00:16:33.615>to <00:16:33.895>work.

310
00:16:35.285 --> 00:16:36.625
<00:16:35.285>And <00:16:35.526>then <00:16:35.767>I <00:16:36.008>am <00:16:36.249>invoking <00:16:36.491>it.

311
00:16:37.105 --> 00:16:39.225
<00:16:37.105>I <00:16:37.280>pass <00:16:37.455>a <00:16:37.630>query <00:16:37.805>and <00:16:37.980>I'm <00:16:38.155>getting <00:16:38.330>a <00:16:38.505>response.

312
00:16:39.565 --> 00:16:41.065
<00:16:39.565>That's <00:16:39.902>the <00:16:40.240>basic <00:16:40.577>halo <00:16:40.915>world.

313
00:16:41.685 --> 00:16:43.505
<00:16:41.685>But <00:16:41.918>launching <00:16:42.151>is <00:16:42.385>way <00:16:42.618>more <00:16:42.851>than <00:16:43.084>this.

314
00:16:43.785 --> 00:16:46.385
<00:16:43.785>I <00:16:43.925>kind <00:16:44.064>of <00:16:44.204>start <00:16:44.344>like <00:16:44.485>doing <00:16:44.625>a <00:16:44.765>little <00:16:44.905>bit <00:16:45.045>more <00:16:45.185>complex

315
00:16:46.385 --> 00:16:51.315
<00:16:46.385>applications <00:16:46.618>and <00:16:46.851>I <00:16:47.085>can <00:16:47.318>do <00:16:47.551>those <00:16:47.785>things

316
00:16:51.375 --> 00:16:53.115
<00:16:51.375>to <00:16:51.655>the <00:16:51.935>long <00:16:52.215>chain <00:16:52.495>expression <00:16:52.775>language.

317
00:16:53.265 --> 00:16:55.595
<00:16:53.265>This <00:16:53.545>allowed <00:16:53.824>me <00:16:54.105>to <00:16:54.385>write <00:16:54.665>chains

318
00:16:55.655 --> 00:16:58.555
<00:16:55.655>or <00:16:55.888>pipes <00:16:56.121>between <00:16:56.355>different <00:16:56.588>types <00:16:56.821>of <00:16:57.055>components

319
00:16:58.625 --> 00:17:03.035
<00:16:58.625>that <00:16:58.780>the <00:16:58.936>long <00:16:59.091>chain <00:16:59.247>framework <00:16:59.402>has <00:16:59.558>like <00:16:59.713>prompts, <00:16:59.869>the <00:17:00.025>models

320
00:17:03.105 --> 00:17:05.675
<00:17:03.105>that <00:17:03.455>we <00:17:03.805>already <00:17:04.155>saw, <00:17:04.505>parsers,

321
00:17:06.145 --> 00:17:08.875
<00:17:06.145>different <00:17:06.494>retrievers <00:17:06.845>tools, <00:17:07.194>et <00:17:07.545>cetera.

322
00:17:09.375 --> 00:17:12.955
<00:17:09.375>So <00:17:09.608>for <00:17:09.841>example, <00:17:10.075>here <00:17:10.308>I <00:17:10.541>am <00:17:10.775>chaining

323
00:17:13.475 --> 00:17:16.035
<00:17:13.474>a <00:17:13.754>prompt <00:17:14.034>template <00:17:14.314>with <00:17:14.594>a <00:17:14.875>model

324
00:17:16.335 --> 00:17:20.275
<00:17:16.335>and <00:17:16.490>I'm <00:17:16.646>parsing <00:17:16.801>the <00:17:16.957>output <00:17:17.112>as <00:17:17.268>a <00:17:17.423>specific <00:17:17.579>way <00:17:17.735>just

325
00:17:20.295 --> 00:17:21.515
<00:17:20.295>by <00:17:20.661>defining <00:17:21.027>a <00:17:21.393>chain

326
00:17:22.135 --> 00:17:24.355
<00:17:22.135>and <00:17:22.335>then <00:17:22.535>invoking <00:17:22.734>that <00:17:22.935>chain <00:17:23.135>with <00:17:23.335>an <00:17:23.535>input.

327
00:17:24.575 --> 00:17:27.035
<00:17:24.575>So <00:17:24.750>I'm <00:17:24.925>creating <00:17:25.100>a <00:17:25.275>little <00:17:25.450>bit <00:17:25.625>more <00:17:25.800>complex <00:17:25.975>workflow

328
00:17:29.725 --> 00:17:34.065
<00:17:29.725>In <00:17:29.852>this <00:17:29.979>example <00:17:30.106>I <00:17:30.234>have <00:17:30.361>a <00:17:30.488>prom <00:17:30.615>template <00:17:30.743>that <00:17:30.870>I <00:17:30.997>am <00:17:31.125>specifying

329
00:17:34.065 --> 00:17:36.065
<00:17:34.065>that <00:17:34.298>you <00:17:34.531>are <00:17:34.765>a <00:17:34.998>professional <00:17:35.231>software <00:17:35.465>developer

330
00:17:36.065 --> 00:17:39.425
<00:17:36.065>that <00:17:36.240>knows <00:17:36.415>about <00:17:36.590>certain <00:17:36.765>specific <00:17:36.940>language <00:17:37.115>that <00:17:37.290>I'm <00:17:37.465>going

331
00:17:39.425 --> 00:17:41.185
<00:17:39.425>to <00:17:39.705>pass <00:17:39.985>as <00:17:40.264>an <00:17:40.544>input <00:17:40.825>variable.

332
00:17:41.845 --> 00:17:45.185
<00:17:41.845>You <00:17:42.000>are <00:17:42.156>going <00:17:42.311>to <00:17:42.467>do <00:17:42.622>the <00:17:42.778>next <00:17:42.933>thing <00:17:43.089>return <00:17:43.245>code,

333
00:17:45.875 --> 00:17:48.855
<00:17:45.875>and <00:17:46.015>then <00:17:46.155>the <00:17:46.295>message <00:17:46.435>that <00:17:46.575>I'm <00:17:46.715>sending <00:17:46.855>is <00:17:46.995>you <00:17:47.135>are <00:17:47.275>going

334
00:17:48.855 --> 00:17:51.485
<00:17:48.855>to <00:17:49.030>generate <00:17:49.205>the <00:17:49.380>code <00:17:49.555>for <00:17:49.730>the <00:17:49.905>following <00:17:50.080>use <00:17:50.255>case.

335
00:17:51.825 --> 00:17:52.845
<00:17:51.825>That's <00:17:52.284>my <00:17:52.743>template.

336
00:17:53.595 --> 00:17:56.845
<00:17:53.595>Then <00:17:53.770>I <00:17:53.945>create <00:17:54.120>the <00:17:54.295>chain, <00:17:54.470>I <00:17:54.645>connect <00:17:54.820>the <00:17:54.995>template

337
00:17:57.115 --> 00:17:59.925
<00:17:57.115>with <00:17:57.348>the <00:17:57.581>model <00:17:57.815>with <00:17:58.048>the <00:17:58.281>output <00:17:58.515>parser.

338
00:18:00.145 --> 00:18:02.805
<00:18:00.145>In <00:18:00.272>this <00:18:00.399>case <00:18:00.526>I <00:18:00.654>am <00:18:00.781>telling <00:18:00.908>it <00:18:01.035>I <00:18:01.163>just <00:18:01.290>need <00:18:01.417>a <00:18:01.545>string

339
00:18:03.985 --> 00:18:07.285
<00:18:03.985>and <00:18:04.125>I <00:18:04.264>invoking <00:18:04.405>it <00:18:04.544>that <00:18:04.685>chain <00:18:04.824>with <00:18:04.965>two <00:18:05.104>with <00:18:05.245>two <00:18:05.385>variables,

340
00:18:07.665 --> 00:18:09.805
<00:18:07.665>Python <00:18:07.898>and <00:18:08.131>the <00:18:08.365>problem <00:18:08.598>that <00:18:08.831>I <00:18:09.065>want.

341
00:18:09.905 --> 00:18:14.045
<00:18:09.905>And <00:18:10.060>then <00:18:10.216>it's <00:18:10.371>going <00:18:10.527>to <00:18:10.682>return <00:18:10.838>specifically <00:18:10.993>what <00:18:11.149>I <00:18:11.305>need.

342
00:18:16.045 --> 00:18:18.535
<00:18:16.045>They're <00:18:16.395>like <00:18:16.745>different <00:18:17.095>agent <00:18:17.445>architectures

343
00:18:18.535 --> 00:18:20.495
<00:18:18.535>that <00:18:18.768>you <00:18:19.001>can <00:18:19.235>write <00:18:19.468>with <00:18:19.701>these <00:18:19.935>frameworks.

344
00:18:21.155 --> 00:18:23.655
<00:18:21.155>The <00:18:21.388>chart, <00:18:21.621>the <00:18:21.855>typical <00:18:22.088>chat <00:18:22.321>application <00:18:22.555>retrieval,

345
00:18:23.655 --> 00:18:26.935
<00:18:23.655>augmented <00:18:23.935>generation, <00:18:24.215>single <00:18:24.495>agent <00:18:24.774>and <00:18:25.055>multi-agent.

346
00:18:27.155 --> 00:18:30.375
<00:18:27.155>So <00:18:27.295>let's <00:18:27.435>take <00:18:27.575>a <00:18:27.715>look <00:18:27.855>at <00:18:27.995>what <00:18:28.135>are <00:18:28.274>the <00:18:28.415>basic <00:18:28.555>features

347
00:18:30.375 --> 00:18:32.055
<00:18:30.375>of <00:18:30.841>these <00:18:31.308>uh, <00:18:31.775>architectures.

348
00:18:33.845 --> 00:18:37.685
<00:18:33.845>A <00:18:34.020>chat <00:18:34.195>or <00:18:34.370>chatbot <00:18:34.545>can <00:18:34.720>be <00:18:34.895>stateless <00:18:35.070>or <00:18:35.245>stateful.

349
00:18:38.405 --> 00:18:41.445
<00:18:38.405>A <00:18:38.580>stateful <00:18:38.754>meaning <00:18:38.930>that <00:18:39.105>the <00:18:39.280>chat <00:18:39.455>knows <00:18:39.629>about <00:18:39.805>previous

350
00:18:41.445 --> 00:18:43.045
<00:18:41.445>conversation <00:18:41.794>so <00:18:42.145>it <00:18:42.495>has <00:18:42.845>memory

351
00:18:43.945 --> 00:18:47.245
<00:18:43.945>and <00:18:44.100>it <00:18:44.256>is <00:18:44.411>useful <00:18:44.567>for <00:18:44.722>assistance, <00:18:44.878>support <00:18:45.033>bots, <00:18:45.189>et <00:18:45.345>cetera.

352
00:18:48.305 --> 00:18:51.965
<00:18:48.305>So <00:18:48.480>there <00:18:48.655>are <00:18:48.830>like <00:18:49.005>different <00:18:49.180>artifacts <00:18:49.355>in <00:18:49.530>launch <00:18:49.705>chain

353
00:18:52.115 --> 00:18:55.685
<00:18:52.115>that <00:18:52.290>allows <00:18:52.465>you <00:18:52.640>to <00:18:52.815>work <00:18:52.990>with <00:18:53.165>a <00:18:53.340>chat <00:18:53.515>application

354
00:18:56.195 --> 00:18:59.685
<00:18:56.195>like <00:18:56.350>the <00:18:56.506>chat <00:18:56.661>message <00:18:56.817>history <00:18:56.972>class <00:18:57.128>that <00:18:57.283>allows <00:18:57.439>you <00:18:57.595>to

355
00:19:00.535 --> 00:19:03.045
<00:19:00.535>store <00:19:00.768>the <00:19:01.001>information <00:19:01.235>of <00:19:01.468>the <00:19:01.701>previous <00:19:01.935>conversation.

356
00:19:03.145 --> 00:19:07.565
<00:19:03.145>So <00:19:03.252>it's <00:19:03.360>going <00:19:03.468>to <00:19:03.575>be <00:19:03.683>sent <00:19:03.791>to <00:19:03.898>the <00:19:04.006>LLM <00:19:04.114>to <00:19:04.221>get <00:19:04.329>context <00:19:04.437>about <00:19:04.545>uh,

357
00:19:07.715 --> 00:19:12.645
<00:19:07.715>what <00:19:07.889>you <00:19:08.064>are <00:19:08.240>talking <00:19:08.415>with <00:19:08.590>the <00:19:08.764>assistant, <00:19:08.939>the <00:19:09.115>retrieval,

358
00:19:12.645 --> 00:19:16.365
<00:19:12.645>augmented <00:19:12.845>generation <00:19:13.045>launching <00:19:13.245>has <00:19:13.445>like <00:19:13.645>also <00:19:13.845>some <00:19:14.045>other

359
00:19:16.635 --> 00:19:19.165
<00:19:16.635>artifacts <00:19:16.835>I'm <00:19:17.035>going <00:19:17.235>to <00:19:17.435>be <00:19:17.635>sharing <00:19:17.835>code <00:19:18.035>later.

360
00:19:20.345 --> 00:19:23.165
<00:19:20.345>Um, <00:19:20.578>retrieval <00:19:20.811>augmented <00:19:21.045>generation <00:19:21.278>are <00:19:21.511>two <00:19:21.745>steps.

361
00:19:23.705 --> 00:19:26.205
<00:19:23.705>One <00:19:23.938>step <00:19:24.171>is <00:19:24.405>I <00:19:24.638>am <00:19:24.871>converting <00:19:25.105>text

362
00:19:26.755 --> 00:19:28.885
<00:19:26.755>into <00:19:27.035>embeddings <00:19:27.315>using <00:19:27.595>an <00:19:27.875>embedding <00:19:28.155>model

363
00:19:29.345 --> 00:19:32.165
<00:19:29.345>and <00:19:29.545>storing <00:19:29.745>that <00:19:29.945>information <00:19:30.145>into <00:19:30.345>the <00:19:30.545>vector <00:19:30.745>database.

364
00:19:32.625 --> 00:19:34.485
<00:19:32.625>And <00:19:32.825>the <00:19:33.025>other <00:19:33.225>one <00:19:33.425>is <00:19:33.625>the <00:19:33.825>retrieval <00:19:34.025>process.

365
00:19:34.995 --> 00:19:36.365
<00:19:34.995>When <00:19:35.241>I <00:19:35.488>am <00:19:35.734>passing <00:19:35.981>a <00:19:36.228>query,

366
00:19:36.595 --> 00:19:38.965
<00:19:36.595>getting <00:19:36.875>the <00:19:37.155>responses <00:19:37.435>from <00:19:37.715>the <00:19:37.995>database

367
00:19:39.385 --> 00:19:43.485
<00:19:39.385>and <00:19:39.560>adding <00:19:39.735>those <00:19:39.910>responses <00:19:40.085>as <00:19:40.260>context <00:19:40.435>to <00:19:40.610>the <00:19:40.785>LLM.

368
00:19:43.825 --> 00:19:46.885
<00:19:43.825>So <00:19:43.965>the <00:19:44.105>LLM <00:19:44.245>can <00:19:44.385>get <00:19:44.525>the <00:19:44.665>answer <00:19:44.805>from <00:19:44.945>its <00:19:45.085>own <00:19:45.225>context

369
00:19:47.425 --> 00:19:50.245
<00:19:47.425>to <00:19:47.774>reduce <00:19:48.125>errors <00:19:48.475>or <00:19:48.825>hallucinations

370
00:19:51.945 --> 00:19:56.325
<00:19:51.945>and <00:19:52.072>a <00:19:52.199>single <00:19:52.326>agent <00:19:52.454>is <00:19:52.581>a <00:19:52.708>way <00:19:52.835>I <00:19:52.963>can <00:19:53.090>give <00:19:53.217>tool <00:19:53.345>access

371
00:19:57.145 --> 00:19:59.765
<00:19:57.145>and <00:19:57.425>some <00:19:57.705>reasoning <00:19:57.985>to <00:19:58.264>an <00:19:58.545>agent.

372
00:20:00.265 --> 00:20:03.845
<00:20:00.265>So <00:20:00.440>in <00:20:00.615>this <00:20:00.790>example, <00:20:00.965>I'm <00:20:01.140>using <00:20:01.315>uh, <00:20:01.490>some <00:20:01.665>tools

373
00:20:03.845 --> 00:20:06.325
<00:20:03.845>that <00:20:04.045>are <00:20:04.245>available <00:20:04.445>within <00:20:04.645>the <00:20:04.845>line <00:20:05.045>chain <00:20:05.245>ecosystem.

374
00:20:06.945 --> 00:20:10.365
<00:20:06.945>The <00:20:07.120>Wikipedia <00:20:07.294>tool, <00:20:07.470>it's <00:20:07.645>going <00:20:07.820>to <00:20:07.995>perform <00:20:08.169>a <00:20:08.345>query

375
00:20:10.385 --> 00:20:13.445
<00:20:10.385>to <00:20:10.618>the <00:20:10.851>Wikipedia <00:20:11.085>dynamic <00:20:11.318>tool, <00:20:11.551>allows <00:20:11.785>you

376
00:20:13.445 --> 00:20:16.605
<00:20:13.445>to <00:20:13.600>create <00:20:13.756>your <00:20:13.911>own <00:20:14.067>custom <00:20:14.222>tools <00:20:14.378>with <00:20:14.533>your <00:20:14.689>own <00:20:14.845>code.

377
00:20:17.065 --> 00:20:19.005
<00:20:17.065>And <00:20:17.345>I'm <00:20:17.625>just <00:20:17.905>creating <00:20:18.185>an <00:20:18.465>agent

378
00:20:19.005 --> 00:20:21.765
<00:20:19.005>that <00:20:19.285>can <00:20:19.565>execute <00:20:19.845>those <00:20:20.125>two <00:20:20.405>tools.

379
00:20:22.315 --> 00:20:27.085
<00:20:22.315>When <00:20:22.442>I <00:20:22.569>pass <00:20:22.696>an <00:20:22.824>input, <00:20:22.951>it <00:20:23.078>will <00:20:23.205>decide <00:20:23.333>which <00:20:23.460>tool <00:20:23.587>to <00:20:23.715>execute

380
00:20:27.585 --> 00:20:28.685
<00:20:27.585>and <00:20:27.832>give <00:20:28.080>you <00:20:28.327>the <00:20:28.575>response.

381
00:20:28.985 --> 00:20:31.885
<00:20:28.985>Or <00:20:29.125>sometimes <00:20:29.264>it <00:20:29.405>can <00:20:29.544>execute <00:20:29.685>both <00:20:29.824>tools <00:20:29.965>at <00:20:30.104>the <00:20:30.245>same <00:20:30.385>time.

382
00:20:33.015 --> 00:20:34.555
<00:20:33.015>And <00:20:33.361>for <00:20:33.708>a <00:20:34.054>multi-agency <00:20:34.401>system,

383
00:20:34.695 --> 00:20:38.635
<00:20:34.695>we <00:20:34.850>have <00:20:35.006>different <00:20:35.161>architectures <00:20:35.317>like <00:20:35.472>if <00:20:35.628>it <00:20:35.783>is <00:20:35.939>a <00:20:36.095>network,

384
00:20:38.705 --> 00:20:40.955
<00:20:38.705>different <00:20:38.985>agents <00:20:39.264>communicating <00:20:39.544>with <00:20:39.824>each <00:20:40.105>other,

385
00:20:41.575 --> 00:20:44.515
<00:20:41.575>or <00:20:41.730>I <00:20:41.886>have <00:20:42.041>one <00:20:42.197>agent <00:20:42.352>that <00:20:42.508>is <00:20:42.663>supervising <00:20:42.819>the <00:20:42.975>work

386
00:20:45.375 --> 00:20:49.365
<00:20:45.375>or <00:20:45.515>uh, <00:20:45.655>a <00:20:45.795>hierarchical <00:20:45.935>architecture <00:20:46.075>where <00:20:46.215>I <00:20:46.355>have <00:20:46.495>a <00:20:46.635>main <00:20:46.775>agent

387
00:20:49.365 --> 00:20:50.645
<00:20:49.365>that <00:20:49.653>is <00:20:49.941>communicating <00:20:50.229>with <00:20:50.517>others.

388
00:20:52.545 --> 00:20:54.765
<00:20:52.545>So <00:20:52.825>you <00:20:53.105>can <00:20:53.385>compose <00:20:53.665>different <00:20:53.945>patterns

389
00:20:54.765 --> 00:20:56.045
<00:20:54.765>and <00:20:54.929>I <00:20:55.094>want <00:20:55.258>to <00:20:55.423>show <00:20:55.587>you <00:20:55.752>the <00:20:55.917>code.

390
00:20:56.065 --> 00:20:57.805
<00:20:56.065>So <00:20:56.531>let's <00:20:56.998>go <00:20:57.465>to

391
00:20:58.385 --> 00:21:01.525
<00:20:58.385>Um, <00:20:58.851>To <00:20:59.318>the <00:20:59.785>examples

392
00:21:02.425 --> 00:21:04.285
<00:21:02.425>and <00:21:02.705>I <00:21:02.985>will <00:21:03.264>share <00:21:03.544>the <00:21:03.825>slide.

393
00:21:04.515 --> 00:21:06.205
<00:21:04.515>It's <00:21:04.748>going <00:21:04.981>to <00:21:05.215>be <00:21:05.448>on <00:21:05.681>the <00:21:05.915>resources.

394
00:21:08.025 --> 00:21:11.805
<00:21:08.025>Uh, <00:21:08.200>you <00:21:08.375>can <00:21:08.550>go <00:21:08.725>to <00:21:08.900>the <00:21:09.075>build <00:21:09.250>ai <00:21:09.425>apps.code.com

395
00:21:11.825 --> 00:21:14.965
<00:21:11.825>or <00:21:12.000>scan <00:21:12.175>this <00:21:12.350>QR <00:21:12.525>code <00:21:12.700>for <00:21:12.875>the <00:21:13.050>learning <00:21:13.225>resources

396
00:21:15.065 --> 00:21:18.085
<00:21:15.065>and <00:21:15.205>the <00:21:15.345>playground <00:21:15.485>for <00:21:15.625>you <00:21:15.765>to <00:21:15.905>get <00:21:16.045>access <00:21:16.185>to <00:21:16.325>the <00:21:16.465>code

397
00:21:18.425 --> 00:21:19.645
<00:21:18.425>and <00:21:18.791>run <00:21:19.157>the <00:21:19.523>examples.

398
00:21:21.545 --> 00:21:23.485
<00:21:21.545>Or <00:21:21.778>in <00:21:22.011>my <00:21:22.245>Twitter <00:21:22.478>account <00:21:22.711>I'm <00:21:22.945>going

399
00:21:23.485 --> 00:21:25.685
<00:21:23.485>to <00:21:23.685>be <00:21:23.885>sharing <00:21:24.084>this <00:21:24.284>URL <00:21:24.485>with <00:21:24.685>the <00:21:24.885>slides.

400
00:21:26.305 --> 00:21:30.365
<00:21:26.305>So <00:21:26.505>I <00:21:26.705>don't <00:21:26.905>miss <00:21:27.105>this <00:21:27.305>previous <00:21:27.505>uh, <00:21:27.705>information

401
00:21:30.435 --> 00:21:31.645
<00:21:30.435>that <00:21:30.798>it's <00:21:31.161>very <00:21:31.524>important,

402
00:21:31.745 --> 00:21:33.165
<00:21:31.745>but <00:21:31.927>I <00:21:32.110>want <00:21:32.292>to <00:21:32.475>show <00:21:32.657>you <00:21:32.840>the <00:21:33.023>examples.

403
00:21:33.165 --> 00:21:34.885
<00:21:33.165>Time <00:21:33.865>is <00:21:34.565>pressing.

404
00:21:36.495 --> 00:21:39.275
<00:21:36.495>So <00:21:36.669>you <00:21:36.844>are <00:21:37.020>going <00:21:37.195>to <00:21:37.370>land <00:21:37.544>on <00:21:37.719>this <00:21:37.895>page.

405
00:21:39.505 --> 00:21:42.075
<00:21:39.505>It's <00:21:39.645>giving <00:21:39.785>you <00:21:39.925>different <00:21:40.065>links <00:21:40.205>for <00:21:40.345>you <00:21:40.485>to <00:21:40.625>learn <00:21:40.765>more <00:21:40.905>about

406
00:21:43.425 --> 00:21:45.195
<00:21:43.425>long <00:21:43.774>chain <00:21:44.125>and <00:21:44.475>different <00:21:44.825>applications.

407
00:21:45.975 --> 00:21:47.275
<00:21:45.975>But <00:21:46.169>if <00:21:46.365>you <00:21:46.560>click <00:21:46.755>on <00:21:46.950>the <00:21:47.145>title,

408
00:21:47.455 --> 00:21:50.315
<00:21:47.455>you <00:21:47.629>have <00:21:47.804>the <00:21:47.980>different <00:21:48.155>patterns <00:21:48.330>here <00:21:48.504>on <00:21:48.679>the <00:21:48.855>left

409
00:21:50.895 --> 00:21:54.035
<00:21:50.895>and <00:21:51.022>the <00:21:51.149>code <00:21:51.276>on <00:21:51.404>the <00:21:51.531>right <00:21:51.658>and <00:21:51.785>you <00:21:51.913>can <00:21:52.040>run <00:21:52.167>this <00:21:52.295>code.

410
00:21:55.095 --> 00:21:58.435
<00:21:55.095>For <00:21:55.328>example, <00:21:55.561>what <00:21:55.795>is <00:21:56.028>we <00:21:56.261>are <00:21:56.495>developers

411
00:21:59.255 --> 00:22:02.115
<00:21:59.255>and <00:21:59.382>this <00:21:59.509>is <00:21:59.636>executing <00:21:59.764>this <00:21:59.891>code <00:22:00.018>that <00:22:00.145>I <00:22:00.273>have <00:22:00.400>on <00:22:00.527>the <00:22:00.655>screen

412
00:22:02.895 --> 00:22:05.675
<00:22:02.895>is <00:22:03.128>passing <00:22:03.361>that <00:22:03.595>input <00:22:03.828>to <00:22:04.061>the <00:22:04.295>LLM

413
00:22:05.675 --> 00:22:07.875
<00:22:05.675>and <00:22:06.024>it's <00:22:06.375>returning <00:22:06.725>the <00:22:07.075>response.

414
00:22:08.575 --> 00:22:10.155
<00:22:08.575>And <00:22:08.808>in <00:22:09.041>this <00:22:09.275>case <00:22:09.508>for <00:22:09.741>the <00:22:09.975>provider,

415
00:22:10.375 --> 00:22:12.275
<00:22:10.375>I'm <00:22:10.655>using <00:22:10.935>the <00:22:11.215>Heroku <00:22:11.495>manage <00:22:11.775>inference,

416
00:22:12.275 --> 00:22:13.715
<00:22:12.275>which <00:22:12.491>is <00:22:12.707>the <00:22:12.923>service <00:22:13.139>that <00:22:13.355>we <00:22:13.571>have.

417
00:22:14.055 --> 00:22:18.315
<00:22:14.055>And <00:22:14.210>we <00:22:14.366>use <00:22:14.521>cloud <00:22:14.677>for <00:22:14.832>sonnet <00:22:14.988>as <00:22:15.143>our <00:22:15.299>eh <00:22:15.455>LLM.

418
00:22:19.985 --> 00:22:24.175
<00:22:19.985>There <00:22:20.140>is <00:22:20.296>other <00:22:20.451>ways <00:22:20.607>to, <00:22:20.762>uh, <00:22:20.918>write <00:22:21.073>applications <00:22:21.229>for <00:22:21.385>example,

419
00:22:24.635 --> 00:22:29.585
<00:22:24.635>um, <00:22:26.035>this

420
00:22:29.585 --> 00:22:31.545
<00:22:29.585>is <00:22:29.935>an <00:22:30.285>instructor <00:22:30.635>output <00:22:30.985>example.

421
00:22:32.105 --> 00:22:33.625
<00:22:32.105>I <00:22:32.447>am <00:22:32.789>defining <00:22:33.131>a <00:22:33.473>schema

422
00:22:33.965 --> 00:22:37.425
<00:22:33.965>and <00:22:34.120>telling <00:22:34.276>the <00:22:34.431>LLM <00:22:34.587>that <00:22:34.742>always <00:22:34.898>return <00:22:35.053>a <00:22:35.209>response <00:22:35.365>with

423
00:22:37.425 --> 00:22:38.785
<00:22:37.425>that <00:22:38.037>specific <00:22:38.649>schema.

424
00:22:39.685 --> 00:22:42.185
<00:22:39.685>So <00:22:40.034>the <00:22:40.385>output <00:22:40.735>is <00:22:41.085>going

425
00:22:42.185 --> 00:22:44.505
<00:22:42.185>to <00:22:42.385>be <00:22:42.585>adjacent <00:22:42.784>instead <00:22:42.985>of <00:22:43.185>just <00:22:43.385>a <00:22:43.585>text.

426
00:22:44.845 --> 00:22:48.865
<00:22:44.845>So <00:22:45.000>depending <00:22:45.156>if <00:22:45.311>your <00:22:45.467>application <00:22:45.622>needs <00:22:45.778>the <00:22:45.933>LLM <00:22:46.089>to <00:22:46.245>respond

427
00:22:48.935 --> 00:22:50.705
<00:22:48.935>with <00:22:49.284>just <00:22:49.635>a <00:22:49.985>specific <00:22:50.335>structure,

428
00:22:51.485 --> 00:22:53.185
<00:22:51.485>you <00:22:51.764>can <00:22:52.044>just <00:22:52.324>specify <00:22:52.604>the <00:22:52.885>schema.

429
00:22:53.185 --> 00:22:57.495
<00:22:53.185>Instead <00:22:53.325>of <00:22:53.465>writing <00:22:53.605>a <00:22:53.745>complex <00:22:53.885>prompt, <00:22:54.024>uh, <00:22:54.165>I <00:22:54.304>have <00:22:54.445>an <00:22:54.585>example

430
00:22:57.495 --> 00:22:58.855
<00:22:57.495>for <00:22:57.903>a <00:22:58.311>chat <00:22:58.719>application.

431
00:22:59.735 --> 00:23:02.535
<00:22:59.735>I <00:22:59.890>can <00:23:00.046>say <00:23:00.201>I'm <00:23:00.357>expert, <00:23:00.512>I'm <00:23:00.668>an <00:23:00.823>expert <00:23:00.979>in <00:23:01.135>note.

432
00:23:03.455 --> 00:23:04.855
<00:23:03.455>I <00:23:03.770>will <00:23:04.085>say, <00:23:04.400>hello, <00:23:04.715>I'm

433
00:23:04.855 --> 00:23:08.975
<00:23:04.855>Julian, <00:23:05.321>It <00:23:05.788>will <00:23:06.255>respond.

434
00:23:09.065 --> 00:23:12.415
<00:23:09.065>Hello <00:23:09.220>Julian. <00:23:09.376>And <00:23:09.531>I <00:23:09.687>will <00:23:09.842>ask, <00:23:09.998>what <00:23:10.153>is <00:23:10.309>my <00:23:10.465>name

435
00:23:13.645 --> 00:23:15.225
<00:23:13.645>to <00:23:13.878>see <00:23:14.111>if <00:23:14.345>it <00:23:14.578>has <00:23:14.811>some <00:23:15.045>memory.

436
00:23:15.925 --> 00:23:17.705
<00:23:15.925>So <00:23:16.125>in <00:23:16.325>note <00:23:16.524>that <00:23:16.725>my <00:23:16.925>name <00:23:17.125>is <00:23:17.325>Julian

437
00:23:18.565 --> 00:23:21.065
<00:23:18.565>and <00:23:18.740>here <00:23:18.915>is <00:23:19.090>the <00:23:19.265>example <00:23:19.440>how <00:23:19.615>I'm <00:23:19.790>enabling <00:23:19.965>memory

438
00:23:21.565 --> 00:23:23.745
<00:23:21.565>and <00:23:21.845>how <00:23:22.125>I'm <00:23:22.405>executing <00:23:22.685>this <00:23:22.965>agent.

439
00:23:25.155 --> 00:23:29.705
<00:23:25.155>Um, <00:23:25.388>some <00:23:25.621>examples <00:23:25.855>like <00:23:26.088>tool <00:23:26.321>usage <00:23:26.555>retrieval,

440
00:23:29.705 --> 00:23:30.745
<00:23:29.705>augmented <00:23:30.640>generation.

441
00:23:31.455 --> 00:23:35.545
<00:23:31.455>Here <00:23:31.610>I <00:23:31.766>am <00:23:31.921>fetching <00:23:32.077>repository <00:23:32.232>content <00:23:32.388>on <00:23:32.543>a <00:23:32.699>vector <00:23:32.855>database

442
00:23:36.085 --> 00:23:39.065
<00:23:36.085>and <00:23:36.260>I <00:23:36.435>can <00:23:36.610>ask <00:23:36.785>a <00:23:36.960>question <00:23:37.135>to <00:23:37.310>that <00:23:37.485>repository.

443
00:23:39.205 --> 00:23:42.745
<00:23:39.205>For <00:23:39.438>example, <00:23:39.671>what <00:23:39.905>language <00:23:40.138>does <00:23:40.371>this <00:23:40.605>project

444
00:23:44.785 --> 00:23:48.605
<00:23:44.785>Uses <00:23:44.985>and <00:23:45.185>is <00:23:45.385>going <00:23:45.585>to <00:23:45.785>query <00:23:45.985>the <00:23:46.185>database

445
00:23:48.865 --> 00:23:51.805
<00:23:48.865>and <00:23:49.020>see <00:23:49.176>if <00:23:49.331>it <00:23:49.487>has <00:23:49.642>any <00:23:49.798>information <00:23:49.953>about <00:23:50.109>the <00:23:50.265>programming

446
00:23:52.045 --> 00:23:54.965
<00:23:52.045>language <00:23:52.278>from <00:23:52.511>the <00:23:52.745>files <00:23:52.978>that <00:23:53.211>it <00:23:53.445>fetch.

447
00:23:55.545 --> 00:23:58.205
<00:23:55.545>So <00:23:55.672>it <00:23:55.799>is <00:23:55.926>telling <00:23:56.054>me, <00:23:56.181>yes, <00:23:56.308>this <00:23:56.435>project <00:23:56.563>is <00:23:56.690>written <00:23:56.817>in <00:23:56.945>Java

448
00:23:58.825 --> 00:24:00.605
<00:23:58.825>and <00:23:59.105>I <00:23:59.385>have <00:23:59.665>land <00:23:59.945>graph <00:24:00.225>examples.

449
00:24:01.045 --> 00:24:03.925
<00:24:01.045>I <00:24:01.200>wanted <00:24:01.356>to <00:24:01.511>show <00:24:01.667>like <00:24:01.822>one <00:24:01.978>of <00:24:02.133>the <00:24:02.289>complex <00:24:02.445>ones,

450
00:24:03.925 --> 00:24:08.045
<00:24:03.925>which <00:24:04.080>is <00:24:04.236>the <00:24:04.391>one <00:24:04.547>that <00:24:04.702>uses <00:24:04.858>the <00:24:05.013>supervisor, <00:24:05.169>uh, <00:24:05.325>architecture.

451
00:24:08.985 --> 00:24:11.565
<00:24:08.985>You <00:24:09.185>can <00:24:09.385>ask <00:24:09.584>questions <00:24:09.784>about <00:24:09.985>the <00:24:10.185>weather, <00:24:10.385>math

452
00:24:11.665 --> 00:24:12.845
<00:24:11.665>or <00:24:12.196>general <00:24:12.727>knowledge.

453
00:24:13.305 --> 00:24:16.565
<00:24:13.305>So <00:24:13.585>let's <00:24:13.865>say <00:24:14.145>what <00:24:14.425>is <00:24:14.705>pi?

454
00:24:17.265 --> 00:24:18.525
<00:24:17.265>It <00:24:17.548>is <00:24:17.832>a <00:24:18.115>mathematical <00:24:18.399>question.

455
00:24:19.385 --> 00:24:22.565
<00:24:19.385>So <00:24:19.525>this <00:24:19.665>agent <00:24:19.805>pretty <00:24:19.945>much <00:24:20.085>is <00:24:20.225>going <00:24:20.365>to <00:24:20.504>supervise <00:24:20.645>the <00:24:20.785>type

456
00:24:22.565 --> 00:24:25.245
<00:24:22.565>of <00:24:22.720>question <00:24:22.876>and <00:24:23.031>depending <00:24:23.187>of <00:24:23.342>the <00:24:23.498>context <00:24:23.653>of <00:24:23.809>the <00:24:23.965>question

457
00:24:25.905 --> 00:24:29.525
<00:24:25.905>is <00:24:26.105>going <00:24:26.305>to <00:24:26.504>send <00:24:26.705>the, <00:24:26.905>the, <00:24:27.105>the <00:24:27.305>task

458
00:24:30.265 --> 00:24:33.245
<00:24:30.265>to <00:24:30.465>either <00:24:30.665>the <00:24:30.865>general <00:24:31.065>agent, <00:24:31.265>the <00:24:31.465>math <00:24:31.665>agent

459
00:24:33.425 --> 00:24:34.565
<00:24:33.425>or <00:24:33.767>the <00:24:34.109>weather <00:24:34.451>agent.

460
00:24:35.235 --> 00:24:38.655
<00:24:35.235>So <00:24:35.362>this <00:24:35.489>is <00:24:35.616>the <00:24:35.744>graph <00:24:35.871>that <00:24:35.998>it <00:24:36.125>is <00:24:36.253>resulting <00:24:36.380>with <00:24:36.507>land <00:24:36.635>graph.

461
00:24:39.645 --> 00:24:43.935
<00:24:39.645>This <00:24:39.820>is <00:24:39.995>how <00:24:40.170>I <00:24:40.345>compose <00:24:40.520>the <00:24:40.695>graph <00:24:40.870>in <00:24:41.045>JavaScript,

462
00:24:44.195 --> 00:24:46.735
<00:24:44.195>adding <00:24:44.428>the <00:24:44.661>different <00:24:44.895>agents <00:24:45.128>and <00:24:45.361>the <00:24:45.595>supervisor.

463
00:24:48.475 --> 00:24:51.135
<00:24:48.475>And <00:24:48.615>you <00:24:48.754>can <00:24:48.895>get <00:24:49.034>all <00:24:49.175>of <00:24:49.314>the <00:24:49.455>examples <00:24:49.594>from <00:24:49.735>this <00:24:49.875>application.

464
00:24:51.895 --> 00:24:56.215
<00:24:51.895>MCP <00:24:52.095>example, <00:24:52.295>for <00:24:52.495>example, <00:24:52.695>this <00:24:52.895>is <00:24:53.095>accessing <00:24:53.295>a

465
00:24:56.725 --> 00:24:59.175
<00:24:56.725>PostGresQ <00:24:57.074>database <00:24:57.425>running <00:24:57.774>on <00:24:58.125>Roku.

466
00:24:59.795 --> 00:25:02.335
<00:24:59.795>So <00:25:00.145>lease <00:25:00.495>all <00:25:00.845>the <00:25:01.195>repositories

467
00:25:03.885 --> 00:25:07.225
<00:25:03.885>is <00:25:04.012>running <00:25:04.139>in <00:25:04.266>an <00:25:04.394>MCP, <00:25:04.521>it's <00:25:04.648>going <00:25:04.775>to <00:25:04.903>generate <00:25:05.030>an <00:25:05.157>SQL <00:25:05.285>query

468
00:25:07.925 --> 00:25:10.105
<00:25:07.925>and <00:25:08.158>that's <00:25:08.391>going <00:25:08.625>to <00:25:08.858>access <00:25:09.091>my <00:25:09.325>database

469
00:25:10.205 --> 00:25:11.785
<00:25:10.205>and <00:25:10.554>return <00:25:10.905>what <00:25:11.254>it <00:25:11.605>sees.

470
00:25:13.455 --> 00:25:14.915
<00:25:13.455>And <00:25:13.717>it's <00:25:13.980>giving <00:25:14.243>me <00:25:14.506>the <00:25:14.769>response

471
00:25:15.935 --> 00:25:19.875
<00:25:15.935>and <00:25:16.075>another <00:25:16.215>tool <00:25:16.355>that <00:25:16.495>it's <00:25:16.635>from <00:25:16.774>long <00:25:16.915>chain, <00:25:17.054>it's <00:25:17.195>Lang <00:25:17.335>meat

472
00:25:20.945 --> 00:25:24.715
<00:25:20.945>that <00:25:21.178>allows <00:25:21.411>you <00:25:21.645>to <00:25:21.878>perform <00:25:22.111>observability <00:25:22.345>evaluations.

473
00:25:25.575 --> 00:25:29.795
<00:25:25.575>So <00:25:25.702>here <00:25:25.829>they <00:25:25.956>have <00:25:26.084>all <00:25:26.211>of <00:25:26.338>those <00:25:26.465>executions <00:25:26.593>that <00:25:26.720>I <00:25:26.847>just <00:25:26.975>did.

474
00:25:37.875 --> 00:25:42.175
<00:25:37.875>If <00:25:38.075>it <00:25:38.275>works, <00:25:38.475>yeah, <00:25:38.675>all <00:25:38.875>of <00:25:39.075>those <00:25:39.275>executions

475
00:25:42.175 --> 00:25:46.005
<00:25:42.175>that <00:25:42.350>I <00:25:42.524>just <00:25:42.700>did, <00:25:42.875>I <00:25:43.050>can <00:25:43.225>de <00:25:43.399>book <00:25:43.575>them

476
00:25:46.345 --> 00:25:47.885
<00:25:46.345>or <00:25:46.807>evaluate <00:25:47.269>them <00:25:47.731>here.

477
00:25:48.385 --> 00:25:53.205
<00:25:48.385>For <00:25:48.618>example, <00:25:48.851>the <00:25:49.085>complex <00:25:49.318>supervisor, <00:25:49.551>supervisor, <00:25:49.785>agent,

478
00:25:53.675 --> 00:25:58.095
<00:25:53.675>when <00:25:53.830>I <00:25:53.986>ask <00:25:54.141>what <00:25:54.297>is <00:25:54.452>spy, <00:25:54.608>it <00:25:54.763>is <00:25:54.919>telling <00:25:55.075>me

479
00:25:59.075 --> 00:26:02.615
<00:25:59.075>all <00:25:59.215>the <00:25:59.355>graph <00:25:59.495>that <00:25:59.635>executed <00:25:59.775>the <00:25:59.915>different <00:26:00.055>calls <00:26:00.195>to <00:26:00.335>the <00:26:00.475>LLM

480
00:26:03.395 --> 00:26:06.975
<00:26:03.395>and <00:26:03.745>what <00:26:04.095>was <00:26:04.445>the <00:26:04.795>agent

481
00:26:07.005 --> 00:26:10.535
<00:26:07.005>that <00:26:07.205>the <00:26:07.405>supervisor <00:26:07.605>de <00:26:07.805>delegated <00:26:08.005>that <00:26:08.205>task <00:26:08.405>to.

482
00:26:11.715 --> 00:26:13.935
<00:26:11.715>It <00:26:11.889>is <00:26:12.064>telling <00:26:12.240>me <00:26:12.415>how <00:26:12.590>much <00:26:12.764>does <00:26:12.939>it <00:26:13.115>cost?

483
00:26:14.475 --> 00:26:18.215
<00:26:14.475>How <00:26:14.615>many <00:26:14.754>tokens, <00:26:14.895>how <00:26:15.034>much <00:26:15.175>time <00:26:15.314>does <00:26:15.455>it <00:26:15.594>take <00:26:15.735>for <00:26:15.875>retrieval,

484
00:26:18.215 --> 00:26:20.295
<00:26:18.215>augmented <00:26:18.681>degeneration <00:26:19.148>to <00:26:19.615>finalize?

485
00:26:22.245 --> 00:26:24.655
<00:26:22.245>It's <00:26:22.445>showing <00:26:22.645>you <00:26:22.844>all <00:26:23.044>of <00:26:23.245>the <00:26:23.445>different <00:26:23.645>steps.

486
00:26:24.715 --> 00:26:27.255
<00:26:24.715>So <00:26:24.855>these <00:26:24.995>are <00:26:25.135>like <00:26:25.274>very <00:26:25.415>important <00:26:25.554>tools <00:26:25.695>for <00:26:25.834>you <00:26:25.975>to <00:26:26.115>understand

487
00:26:27.315 --> 00:26:29.375
<00:26:27.315>how <00:26:27.665>these <00:26:28.015>agenda <00:26:28.365>applications <00:26:28.715>work.

488
00:26:30.395 --> 00:26:33.155
<00:26:30.395>And <00:26:30.745>that's <00:26:31.095>it <00:26:31.445>from <00:26:31.795>me.

489
00:26:34.645 --> 00:26:37.635
<00:26:34.645>Thank <00:26:34.845>you <00:26:35.045>very <00:26:35.245>much. <00:26:35.445>I'll <00:26:35.645>just <00:26:35.845>tell <00:26:36.045>you.