WEBVTT

1
00:00:03.195 --> 00:00:07.845
<00:00:03.195>Make <00:00:03.369>it <00:00:03.545>simple <00:00:03.719>using <00:00:03.894>generative <00:00:04.070>AI <00:00:04.244>to <00:00:04.420>accelerate <00:00:04.595>learning.

2
00:00:08.625 --> 00:00:12.445
<00:00:08.625>My <00:00:08.765>name <00:00:08.905>is <00:00:09.045>Dewan <00:00:09.185>Lightfoot. <00:00:09.325>I'm <00:00:09.465>a <00:00:09.605>developer <00:00:09.745>advocate <00:00:09.885>at <00:00:10.025>AWS.

3
00:00:15.685 --> 00:00:17.565
<00:00:15.685>Software <00:00:15.965>Development <00:00:16.245>is <00:00:16.525>a <00:00:16.805>learning <00:00:17.085>process.

4
00:00:18.595 --> 00:00:20.845
<00:00:18.595>Working <00:00:18.875>code <00:00:19.154>is <00:00:19.435>a <00:00:19.715>side <00:00:19.994>effect.

5
00:00:21.355 --> 00:00:23.645
<00:00:21.355>This <00:00:21.588>is <00:00:21.821>a <00:00:22.055>quote <00:00:22.288>from <00:00:22.521>Alberto <00:00:22.755>Bandini.

6
00:00:24.475 --> 00:00:25.525
<00:00:24.475>When <00:00:24.664>I <00:00:24.853>look <00:00:25.042>at <00:00:25.230>this <00:00:25.419>quote,

7
00:00:26.725 --> 00:00:28.525
<00:00:26.725>I <00:00:26.900>wanna <00:00:27.075>put <00:00:27.250>an <00:00:27.425>emphasis <00:00:27.600>on <00:00:27.775>the <00:00:27.950>word <00:00:28.125>learning

8
00:00:29.195 --> 00:00:31.005
<00:00:29.195>because <00:00:29.475>I <00:00:29.755>believe <00:00:30.035>there's <00:00:30.315>one <00:00:30.595>thing

9
00:00:31.675 --> 00:00:33.925
<00:00:31.675>that <00:00:31.955>brings <00:00:32.235>us <00:00:32.515>all <00:00:32.795>here <00:00:33.075>today.

10
00:00:34.485 --> 00:00:36.925
<00:00:34.485>Regardless <00:00:34.718>of <00:00:34.951>your <00:00:35.185>job <00:00:35.418>title, <00:00:35.651>regardless <00:00:35.885>of

11
00:00:36.925 --> 00:00:40.805
<00:00:36.925>where <00:00:37.065>you're <00:00:37.205>from, <00:00:37.345>and <00:00:37.485>regardless <00:00:37.625>if <00:00:37.765>we <00:00:37.904>can <00:00:38.044>agree <00:00:38.184>on <00:00:38.324>spaces

12
00:00:41.265 --> 00:00:42.325
<00:00:41.265>versus <00:00:42.219>tabs,

13
00:00:43.185 --> 00:00:46.285
<00:00:43.185>and <00:00:43.360>that's <00:00:43.535>that <00:00:43.710>we're <00:00:43.885>all <00:00:44.060>here <00:00:44.235>today <00:00:44.410>to <00:00:44.585>learn.

14
00:00:47.745 --> 00:00:50.805
<00:00:47.745>And <00:00:47.919>so <00:00:48.095>when <00:00:48.269>we <00:00:48.445>talk <00:00:48.620>about <00:00:48.794>using <00:00:48.970>general <00:00:49.144>AI

15
00:00:51.145 --> 00:00:54.245
<00:00:51.145>to <00:00:51.320>accelerate <00:00:51.495>learning, <00:00:51.670>the <00:00:51.845>one <00:00:52.020>thing <00:00:52.195>that <00:00:52.370>we <00:00:52.545>have

16
00:00:54.245 --> 00:00:57.485
<00:00:54.245>to <00:00:54.445>keep <00:00:54.644>in <00:00:54.845>mind <00:00:55.044>is <00:00:55.245>our <00:00:55.445>foundational <00:00:55.644>knowledge.

17
00:00:58.245 --> 00:01:01.485
<00:00:58.245>Regardless <00:00:58.419>if <00:00:58.595>you <00:00:58.769>are <00:00:58.945>a <00:00:59.120>developer <00:00:59.294>advocate, <00:00:59.470>like <00:00:59.644>myself,

18
00:01:02.445 --> 00:01:06.165
<00:01:02.445>a <00:01:02.620>developer, <00:01:02.795>a <00:01:02.970>DevOps <00:01:03.145>engineer, <00:01:03.320>whatever <00:01:03.495>your <00:01:03.670>title <00:01:03.845>is,

19
00:01:06.395 --> 00:01:09.365
<00:01:06.395>your <00:01:06.744>foundational <00:01:07.095>knowledge <00:01:07.445>is <00:01:07.795>important

20
00:01:09.905 --> 00:01:13.365
<00:01:09.905>and <00:01:10.060>still <00:01:10.216>remains <00:01:10.371>true <00:01:10.527>in <00:01:10.682>the <00:01:10.838>age <00:01:10.993>of <00:01:11.149>generative <00:01:11.305>ai.

21
00:01:14.425 --> 00:01:16.165
<00:01:14.425>So <00:01:14.658>now <00:01:14.891>that <00:01:15.125>we <00:01:15.358>have <00:01:15.591>that <00:01:15.825>understood,

22
00:01:17.535 --> 00:01:20.205
<00:01:17.535>let's <00:01:17.675>talk <00:01:17.815>about <00:01:17.955>something <00:01:18.095>that <00:01:18.235>we <00:01:18.375>all <00:01:18.515>kind <00:01:18.655>of <00:01:18.795>go <00:01:18.935>through

23
00:01:20.785 --> 00:01:21.805
<00:01:20.785>in <00:01:21.244>our <00:01:21.703>careers,

24
00:01:21.905 --> 00:01:23.485
<00:01:21.905>and <00:01:22.138>that's <00:01:22.371>what <00:01:22.605>I <00:01:22.838>call <00:01:23.071>the <00:01:23.305>technical

25
00:01:23.485 --> 00:01:25.125
<00:01:23.485>Professionals <00:01:24.185>learning <00:01:24.885>loop.

26
00:01:27.585 --> 00:01:29.565
<00:01:27.585>You <00:01:27.785>begin <00:01:27.985>with <00:01:28.185>a <00:01:28.385>problem <00:01:28.585>that <00:01:28.785>you <00:01:28.985>identify,

27
00:01:29.785 --> 00:01:32.525
<00:01:29.785>and <00:01:29.925>that <00:01:30.065>could <00:01:30.205>be <00:01:30.345>you <00:01:30.485>want <00:01:30.625>to <00:01:30.765>develop <00:01:30.905>a <00:01:31.045>new <00:01:31.185>feature,

28
00:01:33.075 --> 00:01:36.565
<00:01:33.075>achieve <00:01:33.230>a <00:01:33.386>IT <00:01:33.541>certification, <00:01:33.697>or <00:01:33.852>do <00:01:34.008>something <00:01:34.163>in <00:01:34.319>your <00:01:34.475>career

29
00:01:36.745 --> 00:01:39.485
<00:01:36.745>or <00:01:36.920>solve <00:01:37.095>a <00:01:37.270>problem <00:01:37.445>in <00:01:37.620>your <00:01:37.795>current <00:01:37.970>job <00:01:38.145>role,

30
00:01:40.385 --> 00:01:41.925
<00:01:40.384>and <00:01:40.731>then <00:01:41.077>you <00:01:41.424>gather <00:01:41.771>information.

31
00:01:42.695 --> 00:01:45.805
<00:01:42.695>After <00:01:42.895>you <00:01:43.095>gather <00:01:43.294>information, <00:01:43.494>you <00:01:43.695>study <00:01:43.895>that <00:01:44.095>information.

32
00:01:47.115 --> 00:01:49.445
<00:01:47.115>From <00:01:47.290>there, <00:01:47.465>you <00:01:47.640>take <00:01:47.815>the <00:01:47.990>information <00:01:48.165>that <00:01:48.340>you've <00:01:48.515>learned

33
00:01:49.785 --> 00:01:51.125
<00:01:49.785>and <00:01:50.026>you <00:01:50.267>go <00:01:50.508>to <00:01:50.749>apply <00:01:50.991>it.

34
00:01:51.595 --> 00:01:52.885
<00:01:51.595>This <00:01:51.788>could <00:01:51.982>be <00:01:52.175>a <00:01:52.369>bunch <00:01:52.562>of <00:01:52.755>testing,

35
00:01:53.585 --> 00:01:56.965
<00:01:53.585>and <00:01:53.740>then <00:01:53.896>once <00:01:54.051>it's <00:01:54.207>applied, <00:01:54.362>you <00:01:54.518>determine <00:01:54.673>if <00:01:54.829>it's <00:01:54.985>successful

36
00:01:57.225 --> 00:01:58.365
<00:01:57.225>and <00:01:57.430>then <00:01:57.635>what <00:01:57.840>to <00:01:58.045>do <00:01:58.251>next.

37
00:01:59.865 --> 00:02:01.125
<00:01:59.865>Now, <00:02:00.148>this <00:02:00.432>may <00:02:00.715>look <00:02:00.999>familiar

38
00:02:01.185 --> 00:02:03.365
<00:02:01.185>to <00:02:01.465>the <00:02:01.745>software <00:02:02.025>development <00:02:02.305>life <00:02:02.585>cycle

39
00:02:03.715 --> 00:02:05.685
<00:02:03.715>that <00:02:03.948>we've <00:02:04.181>all <00:02:04.415>seen <00:02:04.648>throughout <00:02:04.881>our <00:02:05.115>careers.

40
00:02:05.785 --> 00:02:08.005
<00:02:05.785>Now, <00:02:05.960>people <00:02:06.134>may <00:02:06.310>have <00:02:06.485>their <00:02:06.660>own <00:02:06.835>discussions <00:02:07.009>around <00:02:07.185>that,

41
00:02:08.425 --> 00:02:11.445
<00:02:08.425>but <00:02:08.552>we <00:02:08.679>all <00:02:08.806>know <00:02:08.934>that <00:02:09.061>learning <00:02:09.188>is <00:02:09.315>a <00:02:09.443>part <00:02:09.570>of <00:02:09.697>the <00:02:09.825>journey,

42
00:02:12.985 --> 00:02:15.525
<00:02:12.985>but <00:02:13.185>there's <00:02:13.385>challenges <00:02:13.585>to <00:02:13.785>this <00:02:13.985>at <00:02:14.185>each <00:02:14.385>phase,

43
00:02:16.025 --> 00:02:17.045
<00:02:16.025>but <00:02:16.208>I'm <00:02:16.392>gonna <00:02:16.575>call <00:02:16.759>out <00:02:16.943>three.

44
00:02:17.665 --> 00:02:19.165
<00:02:17.665>One <00:02:18.002>is <00:02:18.340>around <00:02:18.677>studying <00:02:19.015>information.

45
00:02:19.705 --> 00:02:21.405
<00:02:19.704>How <00:02:19.860>do <00:02:20.016>you <00:02:20.171>know <00:02:20.327>if <00:02:20.482>you <00:02:20.638>have <00:02:20.793>the <00:02:20.949>right <00:02:21.105>information?

46
00:02:21.825 --> 00:02:23.725
<00:02:21.825>How <00:02:22.000>do <00:02:22.174>you <00:02:22.350>know <00:02:22.524>if <00:02:22.700>that <00:02:22.875>information <00:02:23.049>is <00:02:23.225>outdated?

47
00:02:24.305 --> 00:02:27.685
<00:02:24.305>And <00:02:24.460>in <00:02:24.616>this <00:02:24.771>age, <00:02:24.927>in <00:02:25.082>2024, <00:02:25.238>when <00:02:25.393>the <00:02:25.549>information <00:02:25.705>age

48
00:02:27.685 --> 00:02:30.165
<00:02:27.685>of <00:02:27.965>abundance, <00:02:28.245>there's <00:02:28.525>so <00:02:28.805>much <00:02:29.085>information

49
00:02:31.585 --> 00:02:33.685
<00:02:31.585>and <00:02:31.818>then <00:02:32.051>you're <00:02:32.285>applying <00:02:32.518>what <00:02:32.751>you <00:02:32.985>learned.

50
00:02:34.265 --> 00:02:36.965
<00:02:34.265>But <00:02:34.404>what <00:02:34.545>happens <00:02:34.684>when <00:02:34.825>something <00:02:34.964>breaks? <00:02:35.105>How <00:02:35.244>do <00:02:35.385>you <00:02:35.524>fix <00:02:35.665>it?

51
00:02:38.065 --> 00:02:41.445
<00:02:38.065>Do <00:02:38.240>you <00:02:38.415>have <00:02:38.590>the <00:02:38.765>resiliency <00:02:38.940>to <00:02:39.115>actually <00:02:39.290>fix <00:02:39.465>it?

52
00:02:42.795 --> 00:02:46.565
<00:02:42.795>I've <00:02:42.935>developed <00:02:43.075>code <00:02:43.215>then <00:02:43.355>wrote <00:02:43.495>unit <00:02:43.635>tests <00:02:43.775>and <00:02:43.915>apply <00:02:44.055>the <00:02:44.195>code

53
00:02:46.565 --> 00:02:48.365
<00:02:46.565>and <00:02:46.704>realize <00:02:46.845>it <00:02:46.984>doesn't <00:02:47.125>do <00:02:47.265>what <00:02:47.405>I <00:02:47.545>thought <00:02:47.685>it <00:02:47.825>would <00:02:47.965>do.

54
00:02:49.185 --> 00:02:51.645
<00:02:49.185>How <00:02:49.385>do <00:02:49.585>I <00:02:49.785>fix <00:02:49.985>that? <00:02:50.185>And <00:02:50.385>then <00:02:50.585>finally,

55
00:02:52.865 --> 00:02:54.285
<00:02:52.865>how <00:02:53.120>do <00:02:53.376>I <00:02:53.631>even <00:02:53.887>measure <00:02:54.143>success?

56
00:02:55.855 --> 00:02:57.085
<00:02:55.855>These <00:02:56.076>are <00:02:56.297>some <00:02:56.519>of <00:02:56.740>the <00:02:56.962>challenges

57
00:02:57.085 --> 00:02:58.765
<00:02:57.085>that <00:02:57.318>we <00:02:57.551>all <00:02:57.785>face <00:02:58.018>on <00:02:58.251>this <00:02:58.485>journey,

58
00:03:00.025 --> 00:03:01.845
<00:03:00.025>but <00:03:00.258>that's <00:03:00.491>just <00:03:00.725>one <00:03:00.958>set <00:03:01.191>of <00:03:01.425>challenges.

59
00:03:01.955 --> 00:03:04.405
<00:03:01.955>There's <00:03:02.095>another <00:03:02.235>challenge <00:03:02.375>that <00:03:02.515>I <00:03:02.655>think <00:03:02.795>we <00:03:02.935>all <00:03:03.075>can <00:03:03.215>relate <00:03:03.355>to,

60
00:03:04.585 --> 00:03:05.925
<00:03:04.585>and <00:03:04.826>that's <00:03:05.067>the <00:03:05.308>pain <00:03:05.549>of <00:03:05.791>onboarding.

61
00:03:06.105 --> 00:03:07.765
<00:03:06.105>How <00:03:06.280>many <00:03:06.454>can <00:03:06.630>relate <00:03:06.804>to <00:03:06.980>the <00:03:07.155>pain <00:03:07.329>of <00:03:07.505>onboarding,

62
00:03:07.995 --> 00:03:10.285
<00:03:07.995>whether <00:03:08.195>it's <00:03:08.395>in <00:03:08.595>a <00:03:08.795>career, <00:03:08.995>a <00:03:09.195>new <00:03:09.395>job,

63
00:03:10.805 --> 00:03:12.565
<00:03:10.805>a <00:03:11.085>new <00:03:11.365>team, <00:03:11.645>a <00:03:11.925>new <00:03:12.205>project?

64
00:03:13.035 --> 00:03:14.165
<00:03:13.035>There's <00:03:13.374>pains <00:03:13.713>around <00:03:14.052>that.

65
00:03:14.515 --> 00:03:17.525
<00:03:14.515>Some <00:03:14.642>of <00:03:14.769>those <00:03:14.896>pains <00:03:15.024>is, <00:03:15.151>is <00:03:15.278>there <00:03:15.405>a <00:03:15.533>training <00:03:15.660>plan <00:03:15.787>in <00:03:15.915>place?

66
00:03:18.565 --> 00:03:20.405
<00:03:18.565>Possibly, <00:03:18.915>is <00:03:19.265>there <00:03:19.615>a <00:03:19.965>mentor?

67
00:03:21.615 --> 00:03:24.545
<00:03:21.615>Maybe <00:03:22.081>is <00:03:22.548>there <00:03:23.015>documentation?

68
00:03:25.095 --> 00:03:27.705
<00:03:25.095>Some, <00:03:25.270>some <00:03:25.445>of <00:03:25.620>us <00:03:25.795>are <00:03:25.970>really <00:03:26.145>good <00:03:26.320>at <00:03:26.495>documentation,

69
00:03:28.645 --> 00:03:29.945
<00:03:28.645>but <00:03:28.879>there's <00:03:29.113>a <00:03:29.347>challenge <00:03:29.581>with <00:03:29.815>keeping

70
00:03:29.945 --> 00:03:31.345
<00:03:29.945>that <00:03:30.575>documentation <00:03:31.204>updated.

71
00:03:32.085 --> 00:03:33.705
<00:03:32.085>That's <00:03:32.365>kind <00:03:32.645>of <00:03:32.925>as <00:03:33.205>hard <00:03:33.485>as

72
00:03:34.225 --> 00:03:35.905
<00:03:34.225>creating <00:03:34.505>a <00:03:34.785>documentation <00:03:35.065>if <00:03:35.345>not <00:03:35.625>harder,

73
00:03:36.335 --> 00:03:37.505
<00:03:36.335>because <00:03:36.686>we're <00:03:37.037>all <00:03:37.388>busy.

74
00:03:38.575 --> 00:03:42.105
<00:03:38.575>What <00:03:38.730>we <00:03:38.886>really <00:03:39.041>need <00:03:39.197>is <00:03:39.352>a <00:03:39.508>way <00:03:39.663>to <00:03:39.819>discover <00:03:39.975>query

75
00:03:43.215 --> 00:03:46.465
<00:03:43.215>gain <00:03:43.495>insights <00:03:43.775>from <00:03:44.055>our <00:03:44.335>documentation <00:03:44.615>using

76
00:03:46.525 --> 00:03:47.625
<00:03:46.525>our <00:03:47.020>natural <00:03:47.515>language.

77
00:03:49.145 --> 00:03:52.025
<00:03:49.145>I <00:03:49.300>see <00:03:49.456>so <00:03:49.611>many <00:03:49.767>opportunities <00:03:49.922>right <00:03:50.078>now <00:03:50.233>in <00:03:50.389>this <00:03:50.545>industry,

78
00:03:52.855 --> 00:03:56.185
<00:03:52.855>like <00:03:53.030>taking <00:03:53.204>all <00:03:53.380>of <00:03:53.554>our <00:03:53.730>documentation <00:03:53.905>is <00:03:54.079>centralizing <00:03:54.255>it.

79
00:03:56.405 --> 00:03:59.185
<00:03:56.405>And <00:03:56.580>then <00:03:56.755>once <00:03:56.930>we <00:03:57.105>have <00:03:57.280>it <00:03:57.455>centralized, <00:03:57.630>we're <00:03:57.805>able

80
00:03:59.185 --> 00:04:00.905
<00:03:59.185>to <00:03:59.535>determine <00:03:59.885>what's <00:04:00.235>the <00:04:00.585>source

81
00:04:00.925 --> 00:04:02.225
<00:04:00.925>of <00:04:01.217>truth <00:04:01.510>for <00:04:01.802>that <00:04:02.095>information.

82
00:04:03.005 --> 00:04:06.265
<00:04:03.005>And <00:04:03.160>then <00:04:03.316>we <00:04:03.471>can <00:04:03.627>identify <00:04:03.782>the <00:04:03.938>information <00:04:04.093>that <00:04:04.249>we <00:04:04.405>have

83
00:04:06.265 --> 00:04:08.425
<00:04:06.265>to <00:04:06.545>determine, <00:04:06.825>okay, <00:04:07.105>this <00:04:07.385>is <00:04:07.665>incorrect.

84
00:04:08.555 --> 00:04:11.305
<00:04:08.555>Let's <00:04:08.695>update <00:04:08.835>it. <00:04:08.975>So <00:04:09.115>the <00:04:09.255>next <00:04:09.395>time <00:04:09.535>we <00:04:09.675>ask <00:04:09.815>a <00:04:09.955>question,

85
00:04:11.685 --> 00:04:12.945
<00:04:11.685>we <00:04:11.911>can <00:04:12.138>get <00:04:12.365>a <00:04:12.592>valid <00:04:12.819>answer.

86
00:04:14.925 --> 00:04:17.105
<00:04:14.925>So <00:04:15.041>with <00:04:15.158>that <00:04:15.275>being <00:04:15.391>said, <00:04:15.508>there's, <00:04:15.625>it <00:04:15.741>is <00:04:15.858>time <00:04:15.975>for <00:04:16.091>us <00:04:16.208>of <00:04:16.325>all.

87
00:04:17.485 --> 00:04:19.465
<00:04:17.485>We <00:04:17.718>have <00:04:17.951>the <00:04:18.185>tools <00:04:18.418>to <00:04:18.651>do <00:04:18.885>this,

88
00:04:19.525 --> 00:04:21.265
<00:04:19.524>and <00:04:19.680>I <00:04:19.836>think <00:04:19.991>you <00:04:20.147>all <00:04:20.302>know <00:04:20.458>where <00:04:20.613>I'm <00:04:20.769>getting <00:04:20.924>to.

89
00:04:23.935 --> 00:04:28.045
<00:04:23.935>Generative <00:04:24.168>ai. <00:04:24.401>According <00:04:24.635>to <00:04:24.868>this <00:04:25.101>garner <00:04:25.335>report,

90
00:04:28.075 --> 00:04:32.045
<00:04:28.075>more <00:04:28.230>than <00:04:28.386>80% <00:04:28.541>of <00:04:28.697>enterprises <00:04:28.852>will <00:04:29.008>be <00:04:29.163>using <00:04:29.319>generative <00:04:29.474>AI

91
00:04:32.515 --> 00:04:35.685
<00:04:32.515>APIs <00:04:32.794>or <00:04:33.075>have <00:04:33.354>deployed <00:04:33.635>generative <00:04:33.914>AI

92
00:04:36.355 --> 00:04:37.645
<00:04:36.355>APIs <00:04:36.935>by <00:04:37.515>2026.

93
00:04:38.465 --> 00:04:40.285
<00:04:38.465>So <00:04:38.815>for <00:04:39.165>you, <00:04:39.515>the <00:04:39.865>developer,

94
00:04:40.315 --> 00:04:42.085
<00:04:40.315>architect, <00:04:40.594>engineer, <00:04:40.875>what <00:04:41.155>does <00:04:41.435>that <00:04:41.715>mean?

95
00:04:42.555 --> 00:04:44.445
<00:04:42.555>That <00:04:42.788>means <00:04:43.021>you're <00:04:43.255>either <00:04:43.488>gonna <00:04:43.721>be <00:04:43.955>developing

96
00:04:44.465 --> 00:04:46.565
<00:04:44.465>or <00:04:44.931>building <00:04:45.398>a <00:04:45.865>application

97
00:04:46.565 --> 00:04:48.645
<00:04:46.565>that <00:04:46.798>has <00:04:47.031>generative <00:04:47.265>AI <00:04:47.498>embedded <00:04:47.731>in <00:04:47.965>it,

98
00:04:48.785 --> 00:04:51.165
<00:04:48.784>or <00:04:49.018>you're <00:04:49.251>gonna <00:04:49.484>be <00:04:49.718>leveraging <00:04:49.951>generative <00:04:50.184>ai.

99
00:04:54.025 --> 00:04:57.805
<00:04:54.025>Now, <00:04:54.180>for <00:04:54.336>me, <00:04:54.491>working <00:04:54.647>for <00:04:54.802>AWS, <00:04:54.958>I've <00:04:55.113>been <00:04:55.269>doing <00:04:55.424>this

100
00:04:57.805 --> 00:04:59.605
<00:04:57.805>for <00:04:57.960>about <00:04:58.116>a <00:04:58.271>year <00:04:58.427>and <00:04:58.582>a <00:04:58.738>half <00:04:58.893>like <00:04:59.049>everybody <00:04:59.205>else

101
00:04:59.705 --> 00:05:01.645
<00:04:59.705>that's <00:04:59.938>been <00:05:00.171>doing <00:05:00.405>generative <00:05:00.638>ai, <00:05:00.871>how <00:05:01.104>many

102
00:05:01.665 --> 00:05:03.885
<00:05:01.665>of <00:05:01.865>you <00:05:02.065>have <00:05:02.265>been <00:05:02.465>building <00:05:02.665>generative <00:05:02.865>AI <00:05:03.065>applications

103
00:05:03.885 --> 00:05:05.485
<00:05:03.885>or <00:05:04.235>supporting <00:05:04.585>generative <00:05:04.935>AI <00:05:05.284>applications?

104
00:05:06.645 --> 00:05:10.765
<00:05:06.645>A <00:05:06.772>few <00:05:06.899>of <00:05:07.026>you, <00:05:07.154>right? <00:05:07.281>So <00:05:07.408>in <00:05:07.535>2023, <00:05:07.663>the <00:05:07.790>question <00:05:07.917>was <00:05:08.044>around

105
00:05:10.765 --> 00:05:11.805
<00:05:10.765>what <00:05:11.077>is <00:05:11.389>general <00:05:11.701>ai?

106
00:05:12.835 --> 00:05:14.085
<00:05:12.835>What <00:05:13.210>is <00:05:13.585>prompt <00:05:13.960>engineering?

107
00:05:14.595 --> 00:05:16.005
<00:05:14.595>What <00:05:14.848>is <00:05:15.102>the <00:05:15.356>large <00:05:15.610>language <00:05:15.864>model?

108
00:05:17.305 --> 00:05:20.085
<00:05:17.305>Now <00:05:17.655>in <00:05:18.005>2024, <00:05:18.355>for <00:05:18.705>those

109
00:05:20.085 --> 00:05:22.445
<00:05:20.085>that <00:05:20.435>have <00:05:20.784>been <00:05:21.135>developing <00:05:21.484>prototypes,

110
00:05:22.445 --> 00:05:23.565
<00:05:22.445>the <00:05:22.781>conversation <00:05:23.117>has <00:05:23.453>changed

111
00:05:23.905 --> 00:05:26.845
<00:05:23.905>and <00:05:24.060>that <00:05:24.216>conversation <00:05:24.371>around <00:05:24.527>is <00:05:24.682>how <00:05:24.838>do <00:05:24.993>I <00:05:25.149>prioritize <00:05:25.304>my,

112
00:05:27.105 --> 00:05:28.205
<00:05:27.105>my <00:05:27.600>my <00:05:28.094>projects?

113
00:05:28.705 --> 00:05:30.205
<00:05:28.705>How <00:05:29.042>do <00:05:29.380>I <00:05:29.717>evaluate <00:05:30.055>models

114
00:05:30.345 --> 00:05:32.965
<00:05:30.345>to <00:05:30.500>determine <00:05:30.656>what's <00:05:30.811>the <00:05:30.967>right <00:05:31.122>model <00:05:31.278>for <00:05:31.433>my <00:05:31.589>use <00:05:31.745>case?

115
00:05:33.585 --> 00:05:35.005
<00:05:33.585>How <00:05:33.840>do <00:05:34.096>I <00:05:34.351>scale <00:05:34.607>my <00:05:34.863>application?

116
00:05:35.435 --> 00:05:36.805
<00:05:35.435>Well, <00:05:35.743>I <00:05:36.051>have <00:05:36.359>this <00:05:36.668>prototype,

117
00:05:36.825 --> 00:05:39.525
<00:05:36.825>but <00:05:36.980>how <00:05:37.136>do <00:05:37.291>I <00:05:37.447>actually <00:05:37.602>bring <00:05:37.758>it <00:05:37.913>to <00:05:38.069>production <00:05:38.224>safely,

118
00:05:40.315 --> 00:05:42.485
<00:05:40.315>responsibly <00:05:40.594>with <00:05:40.875>the <00:05:41.155>security <00:05:41.435>in <00:05:41.715>mind

119
00:05:42.585 --> 00:05:43.725
<00:05:42.585>and <00:05:42.790>the <00:05:42.995>guardrails <00:05:43.200>that <00:05:43.405>I <00:05:43.611>need?

120
00:05:44.925 --> 00:05:46.265
<00:05:44.925>But <00:05:45.226>I'm <00:05:45.528>not <00:05:45.829>gonna <00:05:46.131>assume

121
00:05:46.265 --> 00:05:49.705
<00:05:46.265>that <00:05:46.405>everybody <00:05:46.544>is <00:05:46.685>in <00:05:46.825>2024 <00:05:46.965>when <00:05:47.104>it <00:05:47.245>comes <00:05:47.385>to <00:05:47.525>the <00:05:47.664>year

122
00:05:49.705 --> 00:05:51.865
<00:05:49.705>of <00:05:49.880>production <00:05:50.055>because <00:05:50.229>some <00:05:50.405>of <00:05:50.580>us <00:05:50.755>are <00:05:50.930>still <00:05:51.104>learning

123
00:05:52.125 --> 00:05:53.545
<00:05:52.125>and <00:05:52.444>still <00:05:52.764>on <00:05:53.083>this <00:05:53.403>journey

124
00:05:53.965 --> 00:05:55.745
<00:05:53.965>of <00:05:54.198>getting <00:05:54.431>started <00:05:54.665>with <00:05:54.898>gender <00:05:55.131>of <00:05:55.365>ai.

125
00:05:56.165 --> 00:05:59.365
<00:05:56.165>So <00:05:56.292>I'll <00:05:56.419>start <00:05:56.546>with <00:05:56.674>a <00:05:56.801>brief <00:05:56.928>overview <00:05:57.055>so <00:05:57.183>we <00:05:57.310>can <00:05:57.437>level <00:05:57.565>set.

126
00:06:00.355 --> 00:06:01.405
<00:06:00.355>What <00:06:00.591>is <00:06:00.827>general <00:06:01.063>of <00:06:01.299>ai?

127
00:06:02.115 --> 00:06:05.405
<00:06:02.115>General <00:06:02.242>of <00:06:02.369>AI <00:06:02.496>is <00:06:02.624>a <00:06:02.751>subset <00:06:02.878>of <00:06:03.005>deep <00:06:03.133>learning <00:06:03.260>that <00:06:03.387>is <00:06:03.515>powered

128
00:06:05.405 --> 00:06:07.725
<00:06:05.405>by <00:06:05.871>large <00:06:06.338>self-learning <00:06:06.804>models

129
00:06:08.035 --> 00:06:10.885
<00:06:08.035>that <00:06:08.210>are <00:06:08.385>pre-trained <00:06:08.560>on <00:06:08.735>a <00:06:08.910>vast <00:06:09.085>amount <00:06:09.260>of <00:06:09.435>information.

130
00:06:11.835 --> 00:06:13.605
<00:06:11.835>They <00:06:12.114>take <00:06:12.395>this <00:06:12.674>information, <00:06:12.955>they're <00:06:13.234>able

131
00:06:13.605 --> 00:06:15.725
<00:06:13.605>to <00:06:13.955>understand <00:06:14.305>things <00:06:14.655>like <00:06:15.005>language

132
00:06:16.145 --> 00:06:19.605
<00:06:16.145>and <00:06:16.344>the <00:06:16.544>connection <00:06:16.745>between <00:06:16.945>words <00:06:17.145>in <00:06:17.344>that <00:06:17.544>language

133
00:06:19.785 --> 00:06:21.525
<00:06:19.785>and <00:06:19.985>then <00:06:20.185>be <00:06:20.385>able <00:06:20.585>to <00:06:20.785>take <00:06:20.985>a <00:06:21.185>sentence

134
00:06:21.525 --> 00:06:24.725
<00:06:21.525>and <00:06:21.664>predict <00:06:21.804>the <00:06:21.945>next <00:06:22.085>word <00:06:22.224>with <00:06:22.364>some <00:06:22.505>type <00:06:22.645>of <00:06:22.784>text <00:06:22.924>generation

135
00:06:25.545 --> 00:06:28.925
<00:06:25.545>at <00:06:25.672>a <00:06:25.799>high <00:06:25.926>level, <00:06:26.054>how <00:06:26.181>that <00:06:26.308>looks <00:06:26.435>is <00:06:26.563>you <00:06:26.690>take <00:06:26.817>unlabeled <00:06:26.945>data.

136
00:06:29.195 --> 00:06:31.685
<00:06:29.195>This <00:06:29.322>could <00:06:29.449>be <00:06:29.576>a <00:06:29.704>vast <00:06:29.831>amount <00:06:29.958>of <00:06:30.085>public <00:06:30.213>data <00:06:30.340>on <00:06:30.467>the <00:06:30.594>internet.

137
00:06:32.265 --> 00:06:35.725
<00:06:32.265>You <00:06:32.465>pre-train <00:06:32.664>at <00:06:32.865>large, <00:06:33.065>a <00:06:33.265>large <00:06:33.465>language <00:06:33.664>model.

138
00:06:36.025 --> 00:06:38.085
<00:06:36.025>And <00:06:36.258>then <00:06:36.491>from <00:06:36.724>there, <00:06:36.958>after <00:06:37.191>the <00:06:37.424>pre-training,

139
00:06:38.225 --> 00:06:39.845
<00:06:38.225>the <00:06:38.458>the <00:06:38.691>model <00:06:38.925>is <00:06:39.158>able <00:06:39.391>to <00:06:39.625>adapt

140
00:06:39.845 --> 00:06:44.165
<00:06:39.845>to <00:06:40.045>perform <00:06:40.245>tasks <00:06:40.445>like <00:06:40.645>text <00:06:40.845>generation, <00:06:41.045>text <00:06:41.245>summarization,

141
00:06:44.915 --> 00:06:48.205
<00:06:44.915>information <00:06:45.055>extraction <00:06:45.195>q <00:06:45.335>and <00:06:45.475>a, <00:06:45.615>and <00:06:45.755>also <00:06:45.895>be <00:06:46.035>a <00:06:46.175>chat <00:06:46.315>bot.

142
00:06:49.465 --> 00:06:51.245
<00:06:49.465>Now <00:06:49.640>those <00:06:49.815>are <00:06:49.990>just <00:06:50.165>some <00:06:50.340>of <00:06:50.515>the <00:06:50.690>use <00:06:50.865>cases.

143
00:06:52.755 --> 00:06:56.325
<00:06:52.755>Then <00:06:52.955>now <00:06:53.155>it's <00:06:53.355>evolved <00:06:53.555>to <00:06:53.755>be <00:06:53.955>multimodal <00:06:54.155>to

144
00:06:56.325 --> 00:06:59.245
<00:06:56.325>where <00:06:56.500>large <00:06:56.675>language <00:06:56.849>models <00:06:57.025>are <00:06:57.200>able <00:06:57.375>to <00:06:57.550>generate <00:06:57.724>code,

145
00:07:00.385 --> 00:07:02.925
<00:07:00.385>un <00:07:00.664>understand <00:07:00.945>images <00:07:01.224>and <00:07:01.505>generate <00:07:01.784>images.

146
00:07:04.025 --> 00:07:06.005
<00:07:04.025>It <00:07:04.375>can <00:07:04.724>also <00:07:05.075>generate <00:07:05.424>music.

147
00:07:06.265 --> 00:07:07.805
<00:07:06.265>My <00:07:06.542>son <00:07:06.819>actually <00:07:07.096>wrote <00:07:07.373>a <00:07:07.651>prompt

148
00:07:07.945 --> 00:07:09.965
<00:07:07.945>and <00:07:08.178>develop <00:07:08.411>a <00:07:08.645>song <00:07:08.878>with <00:07:09.111>just <00:07:09.344>using

149
00:07:09.975 --> 00:07:11.565
<00:07:09.975>words <00:07:10.255>and <00:07:10.535>it <00:07:10.815>sound <00:07:11.095>pretty <00:07:11.375>good.

150
00:07:12.265 --> 00:07:15.045
<00:07:12.265>And <00:07:12.440>then <00:07:12.615>video <00:07:12.789>generation, <00:07:12.965>you <00:07:13.140>all <00:07:13.315>seen <00:07:13.490>the <00:07:13.664>picture

151
00:07:15.105 --> 00:07:17.445
<00:07:15.105>of <00:07:15.232>the <00:07:15.359>zebra <00:07:15.486>on <00:07:15.614>the <00:07:15.741>thumb <00:07:15.868>and <00:07:15.995>the <00:07:16.123>cats <00:07:16.250>on <00:07:16.377>the <00:07:16.505>thumb.

152
00:07:17.445 --> 00:07:19.845
<00:07:17.445>Have <00:07:17.645>you <00:07:17.844>seen <00:07:18.045>that? <00:07:18.245>They're <00:07:18.445>like <00:07:18.645>really <00:07:18.844>cool.

153
00:07:19.845 --> 00:07:22.485
<00:07:19.845>They're <00:07:20.078>like <00:07:20.311>really <00:07:20.545>cool <00:07:20.778>generative <00:07:21.011>AI <00:07:21.245>images.

154
00:07:22.995 --> 00:07:24.245
<00:07:22.995>I'll <00:07:23.182>share <00:07:23.370>'em <00:07:23.557>on <00:07:23.745>my <00:07:23.932>social <00:07:24.120>media.

155
00:07:25.625 --> 00:07:29.245
<00:07:25.625>Now, <00:07:25.780>generative <00:07:25.936>AI <00:07:26.091>for <00:07:26.247>a <00:07:26.402>lot <00:07:26.558>of <00:07:26.713>us <00:07:26.869>is <00:07:27.025>amazing,

156
00:07:30.065 --> 00:07:31.805
<00:07:30.065>but <00:07:30.265>once <00:07:30.465>you <00:07:30.665>use <00:07:30.865>it, <00:07:31.065>you <00:07:31.265>realize <00:07:31.465>some

157
00:07:31.805 --> 00:07:33.205
<00:07:31.805>of <00:07:32.015>the <00:07:32.225>challenges <00:07:32.435>that <00:07:32.645>you <00:07:32.855>run <00:07:33.065>into.

158
00:07:33.595 --> 00:07:36.245
<00:07:33.595>Some <00:07:33.750>of <00:07:33.906>the <00:07:34.061>common <00:07:34.217>challenges <00:07:34.372>that <00:07:34.528>we <00:07:34.683>run <00:07:34.839>into <00:07:34.995>is

159
00:07:36.245 --> 00:07:37.765
<00:07:36.245>around <00:07:37.613>hallucinations,

160
00:07:38.015 --> 00:07:40.045
<00:07:38.015>where <00:07:38.190>the <00:07:38.365>model <00:07:38.539>just <00:07:38.715>kind <00:07:38.890>of <00:07:39.065>makes <00:07:39.240>up <00:07:39.414>something.

161
00:07:40.555 --> 00:07:43.045
<00:07:40.555>Well, <00:07:40.755>some <00:07:40.955>of <00:07:41.155>those <00:07:41.355>challenges <00:07:41.555>just <00:07:41.755>come <00:07:41.955>around

162
00:07:43.045 --> 00:07:44.645
<00:07:43.045>because <00:07:43.278>of <00:07:43.511>the <00:07:43.745>lack <00:07:43.978>of <00:07:44.211>domain <00:07:44.445>knowledge.

163
00:07:45.095 --> 00:07:46.685
<00:07:45.095>Let's <00:07:45.375>say <00:07:45.655>you <00:07:45.935>have <00:07:46.215>business <00:07:46.495>logic

164
00:07:46.745 --> 00:07:49.845
<00:07:46.745>or <00:07:46.920>intellectual <00:07:47.095>property <00:07:47.270>where <00:07:47.445>you <00:07:47.620>wanna <00:07:47.795>leverage <00:07:47.970>general <00:07:48.145>AI

165
00:07:49.845 --> 00:07:50.925
<00:07:49.845>to <00:07:50.169>answer <00:07:50.493>those <00:07:50.817>questions.

166
00:07:51.435 --> 00:07:52.445
<00:07:51.435>Well, <00:07:51.738>if <00:07:52.041>the <00:07:52.344>questions

167
00:07:52.445 --> 00:07:54.205
<00:07:52.445>that <00:07:52.645>you're <00:07:52.844>asking <00:07:53.045>wasn't <00:07:53.245>in <00:07:53.445>the <00:07:53.645>training <00:07:53.844>data,

168
00:07:54.505 --> 00:07:56.485
<00:07:54.505>the <00:07:54.705>public <00:07:54.905>data <00:07:55.105>is <00:07:55.305>not <00:07:55.505>gonna <00:07:55.705>be <00:07:55.905>able

169
00:07:56.505 --> 00:07:58.365
<00:07:56.505>to <00:07:56.784>give <00:07:57.065>you <00:07:57.344>a <00:07:57.625>valid <00:07:57.905>response.

170
00:07:59.395 --> 00:08:01.805
<00:07:59.395>Another <00:07:59.570>challenge <00:07:59.745>is <00:07:59.919>when <00:08:00.094>you <00:08:00.270>train <00:08:00.445>these <00:08:00.620>large <00:08:00.794>language

171
00:08:02.085 --> 00:08:03.605
<00:08:02.085>language <00:08:02.313>models, <00:08:02.541>they <00:08:02.769>have <00:08:02.997>a <00:08:03.225>cutoff <00:08:03.453>date.

172
00:08:03.985 --> 00:08:05.485
<00:08:03.985>So <00:08:04.322>that <00:08:04.660>mean <00:08:04.997>any <00:08:05.335>date

173
00:08:05.535 --> 00:08:07.565
<00:08:05.535>after <00:08:05.815>the <00:08:06.095>training <00:08:06.375>of <00:08:06.655>that <00:08:06.935>model,

174
00:08:07.905 --> 00:08:11.245
<00:08:07.905>it <00:08:08.080>doesn't <00:08:08.255>have <00:08:08.429>information <00:08:08.604>or <00:08:08.780>context <00:08:08.955>after <00:08:09.130>that <00:08:09.304>date.

175
00:08:12.635 --> 00:08:14.325
<00:08:12.635>Another <00:08:12.914>challenge <00:08:13.195>we <00:08:13.474>run <00:08:13.755>into <00:08:14.034>is

176
00:08:14.325 --> 00:08:15.525
<00:08:14.325>around <00:08:14.685>privacy <00:08:15.044>and <00:08:15.405>security.

177
00:08:16.225 --> 00:08:18.045
<00:08:16.225>If <00:08:16.425>I'm <00:08:16.625>going <00:08:16.825>to <00:08:17.025>take <00:08:17.225>my <00:08:17.425>business <00:08:17.625>logic

178
00:08:18.145 --> 00:08:20.885
<00:08:18.145>and <00:08:18.272>put <00:08:18.399>it <00:08:18.526>into <00:08:18.654>a <00:08:18.781>large <00:08:18.908>language <00:08:19.035>model, <00:08:19.163>how <00:08:19.290>can <00:08:19.417>I <00:08:19.544>ensure

179
00:08:21.235 --> 00:08:22.605
<00:08:21.235>that <00:08:21.646>the <00:08:22.057>providers <00:08:22.468>of

180
00:08:22.605 --> 00:08:24.845
<00:08:22.605>that <00:08:22.745>large <00:08:22.885>language <00:08:23.025>model <00:08:23.165>isn't <00:08:23.305>going <00:08:23.445>to <00:08:23.585>train <00:08:23.725>on <00:08:23.865>my <00:08:24.005>data?

181
00:08:25.505 --> 00:08:27.925
<00:08:25.505>So <00:08:25.632>these <00:08:25.759>are <00:08:25.886>just <00:08:26.014>some <00:08:26.141>of <00:08:26.268>the <00:08:26.395>challenges <00:08:26.523>we <00:08:26.650>face <00:08:26.777>when <00:08:26.905>we're

182
00:08:27.925 --> 00:08:29.205
<00:08:27.925>leveraging <00:08:28.501>generat <00:08:29.077>ai.

183
00:08:30.385 --> 00:08:32.445
<00:08:30.385>Now, <00:08:30.735>I <00:08:31.085>talked <00:08:31.435>about <00:08:31.784>hallucinations.

184
00:08:33.505 --> 00:08:38.005
<00:08:33.505>One <00:08:33.660>way <00:08:33.816>to <00:08:33.971>train <00:08:34.127>a <00:08:34.282>model, <00:08:34.438>to <00:08:34.593>use <00:08:34.749>a <00:08:34.905>model,

185
00:08:38.565 --> 00:08:42.305
<00:08:38.565>leverage <00:08:38.692>a <00:08:38.819>model <00:08:38.946>is <00:08:39.074>to <00:08:39.201>customize <00:08:39.328>it <00:08:39.455>to <00:08:39.583>from <00:08:39.710>left <00:08:39.837>to <00:08:39.965>right.

186
00:08:42.735 --> 00:08:46.105
<00:08:42.735>When <00:08:42.909>you <00:08:43.085>customize <00:08:43.260>a <00:08:43.435>model, <00:08:43.610>the <00:08:43.784>complexity, <00:08:43.960>the <00:08:44.135>quality,

187
00:08:46.565 --> 00:08:49.345
<00:08:46.565>the <00:08:46.720>cost <00:08:46.876>increases <00:08:47.031>as <00:08:47.187>we <00:08:47.342>go <00:08:47.498>from <00:08:47.653>left <00:08:47.809>to <00:08:47.965>right.

188
00:08:50.125 --> 00:08:53.265
<00:08:50.125>Now, <00:08:50.325>prompt <00:08:50.525>engineer <00:08:50.725>starting <00:08:50.925>on <00:08:51.125>the <00:08:51.325>left <00:08:51.525>is

189
00:08:53.265 --> 00:08:55.165
<00:08:53.265>where <00:08:53.465>you <00:08:53.665>take <00:08:53.865>a <00:08:54.064>prompt, <00:08:54.265>you <00:08:54.465>send <00:08:54.665>it

190
00:08:55.165 --> 00:08:58.005
<00:08:55.165>to <00:08:55.305>a <00:08:55.444>large <00:08:55.584>language <00:08:55.724>model, <00:08:55.865>and <00:08:56.005>the <00:08:56.145>the <00:08:56.285>large <00:08:56.425>language <00:08:56.564>model

191
00:08:58.005 --> 00:08:59.805
<00:08:58.005>performs <00:08:58.285>a <00:08:58.564>task <00:08:58.845>in <00:08:59.125>that <00:08:59.405>prompt.

192
00:08:59.865 --> 00:09:02.445
<00:08:59.865>You <00:09:00.020>may <00:09:00.176>add <00:09:00.331>the <00:09:00.487>information <00:09:00.642>that <00:09:00.798>it, <00:09:00.953>that <00:09:01.109>it <00:09:01.265>needs.

193
00:09:02.745 --> 00:09:04.045
<00:09:02.745>For <00:09:02.940>example, <00:09:03.135>you <00:09:03.329>ask <00:09:03.525>it <00:09:03.720>a <00:09:03.915>question

194
00:09:04.225 --> 00:09:06.685
<00:09:04.225>and <00:09:04.380>then <00:09:04.536>perform <00:09:04.691>the <00:09:04.847>context <00:09:05.002>to <00:09:05.158>help <00:09:05.313>the <00:09:05.469>model <00:09:05.625>understand

195
00:09:07.025 --> 00:09:09.285
<00:09:07.025>and <00:09:07.225>to <00:09:07.425>be <00:09:07.625>able <00:09:07.824>to <00:09:08.025>perform <00:09:08.225>that <00:09:08.425>task.

196
00:09:10.215 --> 00:09:12.165
<00:09:10.215>After <00:09:10.448>that, <00:09:10.681>we <00:09:10.915>have <00:09:11.148>something <00:09:11.381>called <00:09:11.615>rag

197
00:09:12.225 --> 00:09:14.205
<00:09:12.225>or <00:09:12.575>retrieval, <00:09:12.925>augmented <00:09:13.275>gen <00:09:13.625>generation.

198
00:09:14.675 --> 00:09:16.325
<00:09:14.675>This <00:09:14.875>is <00:09:15.074>where <00:09:15.275>you <00:09:15.474>still <00:09:15.675>use <00:09:15.875>your <00:09:16.074>prompt,

199
00:09:16.665 --> 00:09:18.205
<00:09:16.665>but <00:09:16.896>now <00:09:17.127>you <00:09:17.358>use <00:09:17.589>a <00:09:17.820>vector <00:09:18.051>store

200
00:09:18.205 --> 00:09:21.045
<00:09:18.205>or <00:09:18.405>a <00:09:18.605>vector <00:09:18.805>database <00:09:19.005>to <00:09:19.205>grab <00:09:19.405>additional <00:09:19.605>information

201
00:09:21.065 --> 00:09:22.405
<00:09:21.065>to <00:09:21.366>give <00:09:21.668>the <00:09:21.969>model <00:09:22.271>additional

202
00:09:22.405 --> 00:09:24.125
<00:09:22.405>context <00:09:22.755>to <00:09:23.105>answer <00:09:23.454>your <00:09:23.805>question.

203
00:09:24.635 --> 00:09:27.085
<00:09:24.635>This <00:09:24.810>is <00:09:24.985>helpful <00:09:25.160>if <00:09:25.335>you <00:09:25.510>have <00:09:25.685>small <00:09:25.860>context <00:09:26.035>windows

204
00:09:27.505 --> 00:09:29.645
<00:09:27.505>and <00:09:27.705>really <00:09:27.905>large <00:09:28.105>documents <00:09:28.305>that <00:09:28.505>you <00:09:28.705>wanna <00:09:28.905>summarize

205
00:09:29.985 --> 00:09:32.725
<00:09:29.985>and <00:09:30.125>be <00:09:30.265>able <00:09:30.405>to <00:09:30.545>perform <00:09:30.685>a <00:09:30.825>task <00:09:30.965>leveraging <00:09:31.105>gen <00:09:31.245>generative <00:09:31.385>ai.

206
00:09:34.105 --> 00:09:36.405
<00:09:34.105>Now, <00:09:34.280>let's <00:09:34.455>say <00:09:34.630>you <00:09:34.805>find <00:09:34.980>a <00:09:35.155>large <00:09:35.330>language <00:09:35.505>model

207
00:09:36.405 --> 00:09:37.485
<00:09:36.405>that <00:09:36.599>works <00:09:36.793>for <00:09:36.988>your <00:09:37.182>use <00:09:37.377>case.

208
00:09:38.305 --> 00:09:40.005
<00:09:38.305>You <00:09:38.538>wanna <00:09:38.771>leverage <00:09:39.005>that <00:09:39.238>large <00:09:39.471>language <00:09:39.704>model.

209
00:09:40.385 --> 00:09:42.645
<00:09:40.385>But <00:09:40.585>rather <00:09:40.785>than <00:09:40.985>using <00:09:41.185>something <00:09:41.385>like <00:09:41.585>prompt <00:09:41.785>engineer

210
00:09:42.945 --> 00:09:44.805
<00:09:42.945>or <00:09:43.295>fine <00:09:43.645>tuning, <00:09:43.995>you <00:09:44.345>want

211
00:09:44.985 --> 00:09:49.165
<00:09:44.985>or <00:09:45.218>rag <00:09:45.451>SAR <00:09:45.685>rag <00:09:45.918>for <00:09:46.151>your <00:09:46.385>customization,

212
00:09:49.505 --> 00:09:50.725
<00:09:49.505>use <00:09:49.779>something <00:09:50.054>like <00:09:50.328>fine <00:09:50.603>tuning.

213
00:09:50.835 --> 00:09:52.525
<00:09:50.835>This <00:09:51.010>is <00:09:51.185>where <00:09:51.360>you <00:09:51.535>take <00:09:51.710>the <00:09:51.885>large <00:09:52.060>language <00:09:52.235>model

214
00:09:52.905 --> 00:09:56.045
<00:09:52.905>and <00:09:53.045>you <00:09:53.185>train <00:09:53.324>it <00:09:53.464>on <00:09:53.605>how <00:09:53.745>to <00:09:53.885>understand <00:09:54.025>your <00:09:54.165>business <00:09:54.305>logic,

215
00:09:56.275 --> 00:09:58.525
<00:09:56.275>your <00:09:56.449>code <00:09:56.625>base <00:09:56.800>or <00:09:56.975>the <00:09:57.150>questions <00:09:57.324>you <00:09:57.500>may <00:09:57.675>ask.

216
00:09:58.745 --> 00:10:01.125
<00:09:58.745>And <00:09:58.920>so <00:09:59.095>now, <00:09:59.270>rather <00:09:59.445>than <00:09:59.620>giving <00:09:59.795>it <00:09:59.970>additional <00:10:00.145>context,

217
00:10:01.665 --> 00:10:04.525
<00:10:01.665>you <00:10:01.805>just <00:10:01.944>send <00:10:02.084>your, <00:10:02.224>you <00:10:02.365>just <00:10:02.505>send <00:10:02.645>inference <00:10:02.785>to <00:10:02.925>the <00:10:03.064>model

218
00:10:04.545 --> 00:10:06.365
<00:10:04.545>and <00:10:04.778>it's <00:10:05.011>able <00:10:05.245>to <00:10:05.478>answer <00:10:05.711>your <00:10:05.944>question.

219
00:10:07.105 --> 00:10:09.805
<00:10:07.105>And <00:10:07.280>then <00:10:07.455>finally, <00:10:07.630>the <00:10:07.805>most <00:10:07.980>expensive, <00:10:08.155>the <00:10:08.330>most <00:10:08.505>complex,

220
00:10:10.145 --> 00:10:13.725
<00:10:10.145>the <00:10:10.300>most <00:10:10.456>time <00:10:10.611>consuming <00:10:10.767>is <00:10:10.922>going <00:10:11.078>to <00:10:11.233>be <00:10:11.389>the <00:10:11.545>training.

221
00:10:13.725 --> 00:10:17.845
<00:10:13.725>Your <00:10:13.958>model <00:10:14.191>and <00:10:14.425>the <00:10:14.658>the <00:10:14.891>vast <00:10:15.125>challenges

222
00:10:17.865 --> 00:10:20.085
<00:10:17.865>and <00:10:18.098>the <00:10:18.331>vast <00:10:18.565>amount <00:10:18.798>of <00:10:19.031>costs <00:10:19.265>doesn't,

223
00:10:20.185 --> 00:10:23.285
<00:10:20.185>is <00:10:20.340>not <00:10:20.496>given <00:10:20.651>justice <00:10:20.807>when <00:10:20.962>it <00:10:21.118>comes <00:10:21.273>to <00:10:21.429>this <00:10:21.584>diagram.

224
00:10:23.625 --> 00:10:26.485
<00:10:23.625>But <00:10:23.765>for <00:10:23.905>the <00:10:24.045>sake <00:10:24.185>of <00:10:24.325>the <00:10:24.465>slide, <00:10:24.605>this <00:10:24.745>is <00:10:24.885>kind <00:10:25.025>of

225
00:10:26.485 --> 00:10:27.685
<00:10:26.485>how <00:10:26.755>I <00:10:27.025>measured <00:10:27.295>it <00:10:27.564>out.

226
00:10:29.235 --> 00:10:31.055
<00:10:29.235>Now, <00:10:29.515>what <00:10:29.795>is <00:10:30.075>retrieval? <00:10:30.355>Augmented <00:10:30.635>generation,

227
00:10:31.895 --> 00:10:33.335
<00:10:31.895>I <00:10:32.111>mentioned <00:10:32.327>you <00:10:32.543>have <00:10:32.759>a <00:10:32.975>knowledge <00:10:33.191>base

228
00:10:33.385 --> 00:10:34.775
<00:10:33.385>where <00:10:33.697>you <00:10:34.010>store <00:10:34.323>your <00:10:34.636>information,

229
00:10:35.935 --> 00:10:37.995
<00:10:35.935>you <00:10:36.135>take <00:10:36.334>the <00:10:36.535>information <00:10:36.734>from <00:10:36.935>that <00:10:37.135>knowledge <00:10:37.334>base

230
00:10:38.015 --> 00:10:40.675
<00:10:38.015>or <00:10:38.170>retrieve <00:10:38.326>it, <00:10:38.481>you <00:10:38.637>augment <00:10:38.792>it, <00:10:38.948>meaning <00:10:39.103>you <00:10:39.259>add <00:10:39.415>it

231
00:10:40.675 --> 00:10:42.595
<00:10:40.675>to <00:10:40.849>the <00:10:41.025>prompt <00:10:41.199>to <00:10:41.375>say, <00:10:41.550>okay, <00:10:41.724>here's <00:10:41.900>my <00:10:42.074>question

232
00:10:42.855 --> 00:10:45.435
<00:10:42.855>to <00:10:43.030>answer <00:10:43.205>this <00:10:43.380>question, <00:10:43.555>here's <00:10:43.730>the <00:10:43.905>information <00:10:44.080>you <00:10:44.255>need.

233
00:10:45.855 --> 00:10:47.675
<00:10:45.855>And <00:10:46.010>then <00:10:46.166>you <00:10:46.321>send <00:10:46.477>that <00:10:46.632>to <00:10:46.788>a <00:10:46.943>large <00:10:47.099>language <00:10:47.255>model.

234
00:10:47.855 --> 00:10:50.035
<00:10:47.855>And <00:10:47.995>then <00:10:48.135>the <00:10:48.275>large <00:10:48.415>language <00:10:48.555>model <00:10:48.695>is <00:10:48.835>able <00:10:48.975>to <00:10:49.115>use <00:10:49.255>that

235
00:10:50.255 --> 00:10:51.395
<00:10:50.255>to <00:10:50.597>generate <00:10:50.939>a <00:10:51.281>response.

236
00:10:53.025 --> 00:10:55.635
<00:10:53.025>What <00:10:53.199>that <00:10:53.375>actually <00:10:53.550>looks <00:10:53.725>like <00:10:53.900>at <00:10:54.074>a <00:10:54.250>high <00:10:54.425>level,

237
00:10:55.825 --> 00:10:57.035
<00:10:55.825>there's <00:10:56.369>two <00:10:56.914>workflows.

238
00:10:57.535 --> 00:10:59.635
<00:10:57.535>The <00:10:57.735>first <00:10:57.935>workflow <00:10:58.135>at <00:10:58.334>the <00:10:58.535>bottom <00:10:58.735>is <00:10:58.935>going

239
00:10:59.635 --> 00:11:01.155
<00:10:59.635>to <00:10:59.908>be <00:11:00.182>the <00:11:00.455>data <00:11:00.729>ingestion <00:11:01.002>workflow.

240
00:11:01.665 --> 00:11:05.235
<00:11:01.665>This <00:11:01.805>is <00:11:01.944>where <00:11:02.084>you <00:11:02.224>take <00:11:02.365>your <00:11:02.505>new <00:11:02.645>data, <00:11:02.785>you <00:11:02.925>send <00:11:03.064>it

241
00:11:05.395 --> 00:11:07.555
<00:11:05.395>to <00:11:05.595>a <00:11:05.795>document <00:11:05.995>store, <00:11:06.194>which <00:11:06.395>could <00:11:06.595>be <00:11:06.795>S3.

242
00:11:08.175 --> 00:11:09.915
<00:11:08.175>And <00:11:08.375>then <00:11:08.574>from <00:11:08.775>there <00:11:08.974>you <00:11:09.175>chunk <00:11:09.375>that <00:11:09.574>data,

243
00:11:09.915 --> 00:11:13.715
<00:11:09.915>meaning <00:11:10.115>you <00:11:10.314>chunk <00:11:10.515>it <00:11:10.714>into <00:11:10.915>sentences <00:11:11.115>or <00:11:11.314>paragraphs,

244
00:11:14.015 --> 00:11:16.635
<00:11:14.015>and <00:11:14.170>then <00:11:14.326>you <00:11:14.481>send <00:11:14.637>those <00:11:14.792>chunks <00:11:14.948>to <00:11:15.103>an <00:11:15.259>embedding <00:11:15.415>models

245
00:11:16.705 --> 00:11:18.155
<00:11:16.705>that <00:11:17.140>takes <00:11:17.575>the <00:11:18.010>text

246
00:11:18.655 --> 00:11:19.875
<00:11:18.655>and <00:11:19.204>creates <00:11:19.753>vectors,

247
00:11:19.965 --> 00:11:22.715
<00:11:19.965>which <00:11:20.165>is <00:11:20.365>basically <00:11:20.565>numerical <00:11:20.765>representation <00:11:20.965>for <00:11:21.165>your <00:11:21.365>data.

248
00:11:23.055 --> 00:11:24.875
<00:11:23.055>And <00:11:23.229>then <00:11:23.405>you <00:11:23.579>store <00:11:23.755>that <00:11:23.930>in <00:11:24.104>a <00:11:24.280>vector <00:11:24.454>store.

249
00:11:25.375 --> 00:11:27.675
<00:11:25.375>So <00:11:25.530>now <00:11:25.686>when <00:11:25.841>you <00:11:25.997>get <00:11:26.152>to <00:11:26.308>the <00:11:26.463>text <00:11:26.619>generation <00:11:26.775>workflow

250
00:11:28.015 --> 00:11:30.275
<00:11:28.015>and <00:11:28.170>you <00:11:28.326>ask <00:11:28.481>the <00:11:28.637>question, <00:11:28.792>you <00:11:28.948>could <00:11:29.103>take <00:11:29.259>that <00:11:29.415>question,

251
00:11:30.305 --> 00:11:32.995
<00:11:30.305>turn <00:11:30.460>it <00:11:30.616>into <00:11:30.771>a <00:11:30.927>beddings <00:11:31.082>and <00:11:31.238>use <00:11:31.393>a <00:11:31.549>semantic <00:11:31.704>search

252
00:11:32.995 --> 00:11:36.355
<00:11:32.995>and <00:11:33.150>say, <00:11:33.306>give <00:11:33.461>me <00:11:33.617>the <00:11:33.772>related <00:11:33.928>chunks <00:11:34.083>to <00:11:34.239>this <00:11:34.395>information.

253
00:11:36.935 --> 00:11:38.475
<00:11:36.935>You. <00:11:37.212>You <00:11:37.489>provide <00:11:37.766>it <00:11:38.043>as <00:11:38.321>context

254
00:11:38.815 --> 00:11:40.755
<00:11:38.815>and <00:11:39.015>augment <00:11:39.215>it <00:11:39.415>into <00:11:39.615>your <00:11:39.815>prompt, <00:11:40.015>send <00:11:40.215>it

255
00:11:40.755 --> 00:11:41.795
<00:11:40.755>to <00:11:40.989>the <00:11:41.223>large <00:11:41.457>language <00:11:41.690>model,

256
00:11:41.815 --> 00:11:43.635
<00:11:41.815>and <00:11:42.048>it's <00:11:42.281>able <00:11:42.515>to <00:11:42.748>generate <00:11:42.981>a <00:11:43.215>response.

257
00:11:44.255 --> 00:11:46.115
<00:11:44.255>And <00:11:44.455>that's <00:11:44.655>pretty <00:11:44.855>much <00:11:45.055>rag <00:11:45.255>in <00:11:45.455>a <00:11:45.655>nutshell.

258
00:11:48.415 --> 00:11:51.875
<00:11:48.415>Now <00:11:48.570>when <00:11:48.726>we're <00:11:48.881>talking <00:11:49.037>about <00:11:49.192>this <00:11:49.348>on <00:11:49.503>AWS, <00:11:49.659>we <00:11:49.814>have

259
00:11:51.875 --> 00:11:55.285
<00:11:51.875>what <00:11:52.050>you <00:11:52.225>call <00:11:52.400>a <00:11:52.575>generative <00:11:52.750>AI <00:11:52.925>stack <00:11:53.100>for <00:11:53.275>developers.

260
00:11:55.305 --> 00:11:57.485
<00:11:55.305>And <00:11:55.444>those <00:11:55.584>of <00:11:55.724>you <00:11:55.864>that <00:11:56.005>wanna <00:11:56.145>get <00:11:56.285>up <00:11:56.425>to <00:11:56.564>speed <00:11:56.704>fast,

261
00:11:57.775 --> 00:12:00.405
<00:11:57.775>leveraging <00:11:58.008>generative <00:11:58.241>ai, <00:11:58.475>the <00:11:58.708>first, <00:11:58.941>the <00:11:59.175>top

262
00:12:00.405 --> 00:12:02.005
<00:12:00.405>of <00:12:00.605>the <00:12:00.805>stack <00:12:01.005>is <00:12:01.204>going <00:12:01.405>to <00:12:01.605>be <00:12:01.805>applications

263
00:12:02.625 --> 00:12:05.845
<00:12:02.625>for <00:12:02.858>your <00:12:03.091>business <00:12:03.325>like <00:12:03.558>Amazon <00:12:03.791>Q <00:12:04.025>Business.

264
00:12:05.845 --> 00:12:08.045
<00:12:05.845>Let's <00:12:06.000>say <00:12:06.156>you <00:12:06.311>wanna <00:12:06.467>build <00:12:06.622>a <00:12:06.778>quack, <00:12:06.933>a <00:12:07.089>chatbot <00:12:07.245>quickly

265
00:12:08.475 --> 00:12:10.005
<00:12:08.475>that <00:12:08.934>leverages <00:12:09.393>rag, <00:12:09.852>that's

266
00:12:10.005 --> 00:12:12.085
<00:12:10.005>where <00:12:10.238>you're <00:12:10.471>gonna <00:12:10.705>use <00:12:10.938>Amazon <00:12:11.171>Queue <00:12:11.405>business.

267
00:12:12.675 --> 00:12:16.325
<00:12:12.675>Another <00:12:12.849>amazing <00:12:13.025>tool <00:12:13.199>is <00:12:13.375>gonna <00:12:13.550>be <00:12:13.724>Amazon <00:12:13.900>Queue <00:12:14.074>Developer.

268
00:12:16.475 --> 00:12:19.925
<00:12:16.475>This <00:12:16.602>is <00:12:16.729>where <00:12:16.856>you <00:12:16.984>have <00:12:17.111>a <00:12:17.238>chat <00:12:17.365>assistant <00:12:17.493>inside <00:12:17.620>of <00:12:17.747>your <00:12:17.875>IDE

269
00:12:20.075 --> 00:12:22.085
<00:12:20.075>that <00:12:20.308>can <00:12:20.541>help <00:12:20.775>you <00:12:21.008>analyze <00:12:21.241>your <00:12:21.475>code

270
00:12:22.225 --> 00:12:24.805
<00:12:22.225>for <00:12:22.505>security <00:12:22.785>vulnerabilities, <00:12:23.065>explain <00:12:23.345>your <00:12:23.625>code,

271
00:12:24.825 --> 00:12:28.245
<00:12:24.825>and <00:12:24.965>help <00:12:25.105>you <00:12:25.245>write <00:12:25.385>and <00:12:25.525>generate <00:12:25.665>code <00:12:25.805>by <00:12:25.945>using <00:12:26.085>generate <00:12:26.225>ai.

272
00:12:29.625 --> 00:12:33.005
<00:12:29.625>Now <00:12:29.752>going <00:12:29.879>to <00:12:30.006>the <00:12:30.134>the <00:12:30.261>middle <00:12:30.388>layer <00:12:30.515>of <00:12:30.643>this <00:12:30.770>stack, <00:12:30.897>this <00:12:31.025>is

273
00:12:33.005 --> 00:12:36.445
<00:12:33.005>where <00:12:33.180>we <00:12:33.355>use <00:12:33.530>Amazon <00:12:33.705>Bedrock <00:12:33.880>to <00:12:34.055>help <00:12:34.230>you <00:12:34.405>quickly

274
00:12:36.665 --> 00:12:40.525
<00:12:36.665>and <00:12:36.865>easily <00:12:37.064>generate <00:12:37.265>and <00:12:37.464>build, <00:12:37.665>generate <00:12:37.865>AI <00:12:38.064>applications.

275
00:12:40.905 --> 00:12:44.485
<00:12:40.905>Now, <00:12:41.045>this <00:12:41.185>provides <00:12:41.324>a <00:12:41.464>API <00:12:41.605>in <00:12:41.745>order <00:12:41.885>for <00:12:42.025>you <00:12:42.165>to <00:12:42.305>use

276
00:12:45.245 --> 00:12:47.125
<00:12:45.245>multiple <00:12:45.525>large <00:12:45.805>language <00:12:46.085>models <00:12:46.365>on <00:12:46.645>AWS.

277
00:12:47.415 --> 00:12:50.045
<00:12:47.415>Those <00:12:47.648>large <00:12:47.881>language <00:12:48.115>models <00:12:48.348>live <00:12:48.581>on <00:12:48.814>AWS

278
00:12:50.465 --> 00:12:53.685
<00:12:50.465>and <00:12:50.640>allow <00:12:50.815>you <00:12:50.990>to <00:12:51.165>be <00:12:51.340>able <00:12:51.515>to <00:12:51.690>provide <00:12:51.865>guardrails,

279
00:12:53.685 --> 00:12:57.125
<00:12:53.685>build <00:12:53.859>agents, <00:12:54.035>and <00:12:54.209>provide <00:12:54.385>other <00:12:54.560>capabilities <00:12:54.734>when <00:12:54.910>you <00:12:55.084>build

280
00:12:57.125 --> 00:12:58.605
<00:12:57.125>your <00:12:57.569>general <00:12:58.013>AI <00:12:58.457>applications.

281
00:13:00.185 --> 00:13:03.685
<00:13:00.185>Now, <00:13:00.359>this <00:13:00.535>layer <00:13:00.709>here, <00:13:00.885>the <00:13:01.060>infrastructure <00:13:01.234>layer <00:13:01.410>on <00:13:01.584>AWS,

282
00:13:03.685 --> 00:13:05.805
<00:13:03.685>we <00:13:03.840>have <00:13:03.996>all <00:13:04.151>the <00:13:04.307>infrastructure <00:13:04.462>you <00:13:04.618>need <00:13:04.773>to <00:13:04.929>be <00:13:05.084>able

283
00:13:05.805 --> 00:13:06.965
<00:13:05.805>to <00:13:06.065>train <00:13:06.327>your <00:13:06.588>own <00:13:06.849>models,

284
00:13:07.425 --> 00:13:09.245
<00:13:07.425>but <00:13:07.580>we're <00:13:07.736>not <00:13:07.891>gonna <00:13:08.047>talk <00:13:08.202>about <00:13:08.358>this <00:13:08.513>in <00:13:08.669>this <00:13:08.824>talk.

285
00:13:10.885 --> 00:13:12.605
<00:13:10.885>I <00:13:11.118>wanted <00:13:11.351>to <00:13:11.585>talk <00:13:11.818>about <00:13:12.051>Amazon <00:13:12.285>Bedrock

286
00:13:12.605 --> 00:13:14.685
<00:13:12.605>because <00:13:12.732>right <00:13:12.859>now <00:13:12.986>what <00:13:13.114>we're <00:13:13.241>gonna <00:13:13.368>do <00:13:13.495>is <00:13:13.623>walk <00:13:13.750>through <00:13:13.877>a <00:13:14.005>demo

287
00:13:15.265 --> 00:13:17.965
<00:13:15.265>of <00:13:15.498>building <00:13:15.731>our <00:13:15.965>own <00:13:16.198>custom <00:13:16.431>chat <00:13:16.665>bot

288
00:13:17.965 --> 00:13:20.965
<00:13:17.965>to <00:13:18.165>help <00:13:18.365>us <00:13:18.565>accelerate <00:13:18.765>learning, <00:13:18.965>leveraging <00:13:19.165>generative <00:13:19.365>ai.

289
00:13:22.545 --> 00:13:26.325
<00:13:22.545>In <00:13:22.700>this <00:13:22.856>demo, <00:13:23.011>we're <00:13:23.167>gonna <00:13:23.322>combine <00:13:23.478>our <00:13:23.633>AI <00:13:23.789>capabilities <00:13:23.944>along

290
00:13:26.325 --> 00:13:27.605
<00:13:26.325>with <00:13:26.709>our <00:13:27.093>human <00:13:27.477>expertise.

291
00:13:28.275 --> 00:13:29.445
<00:13:28.275>This <00:13:28.538>is <00:13:28.801>where <00:13:29.064>I <00:13:29.328>mentioned

292
00:13:29.445 --> 00:13:31.285
<00:13:29.445>that <00:13:29.725>our <00:13:30.005>foundational <00:13:30.285>knowledge <00:13:30.565>is <00:13:30.845>important.

293
00:13:31.695 --> 00:13:34.205
<00:13:31.695>We're <00:13:31.870>also <00:13:32.045>going <00:13:32.220>to <00:13:32.395>implement <00:13:32.570>proper <00:13:32.745>guardrails <00:13:32.920>to <00:13:33.095>ensure

294
00:13:34.635 --> 00:13:38.165
<00:13:34.635>that <00:13:34.775>if <00:13:34.915>the <00:13:35.055>model <00:13:35.194>wants <00:13:35.335>to <00:13:35.475>hallucinate, <00:13:35.615>it's <00:13:35.755>not <00:13:35.895>gonna <00:13:36.035>do

295
00:13:38.165 --> 00:13:40.765
<00:13:38.165>that <00:13:38.339>because <00:13:38.515>we <00:13:38.689>are <00:13:38.865>giving <00:13:39.040>it <00:13:39.214>instructions <00:13:39.390>on <00:13:39.564>what

296
00:13:40.765 --> 00:13:43.805
<00:13:40.765>to <00:13:40.905>do <00:13:41.045>when <00:13:41.185>it <00:13:41.324>doesn't <00:13:41.465>have <00:13:41.605>the <00:13:41.745>information <00:13:41.885>that <00:13:42.025>it <00:13:42.165>needs.

297
00:13:44.785 --> 00:13:48.285
<00:13:44.785>And <00:13:44.959>then <00:13:45.135>finally, <00:13:45.310>we're <00:13:45.485>gonna <00:13:45.660>ensure <00:13:45.834>that <00:13:46.010>we're <00:13:46.185>able

298
00:13:48.305 --> 00:13:51.405
<00:13:48.305>to <00:13:48.432>create <00:13:48.559>a <00:13:48.686>custom <00:13:48.814>tool <00:13:48.941>for <00:13:49.068>whatever <00:13:49.195>use <00:13:49.323>case <00:13:49.450>that <00:13:49.577>we <00:13:49.704>need.

299
00:13:51.905 --> 00:13:55.845
<00:13:51.905>Now, <00:13:52.021>all <00:13:52.138>the <00:13:52.255>code <00:13:52.371>for <00:13:52.488>this <00:13:52.605>demo <00:13:52.721>will <00:13:52.838>be <00:13:52.954>available <00:13:53.071>at <00:13:53.188>the <00:13:53.305>end

300
00:13:55.845 --> 00:13:58.205
<00:13:55.845>of <00:13:56.045>this <00:13:56.245>presentation <00:13:56.445>where <00:13:56.645>you <00:13:56.845>can <00:13:57.045>deploy <00:13:57.245>it

301
00:13:58.265 --> 00:13:59.685
<00:13:58.265>and <00:13:58.447>set <00:13:58.630>it <00:13:58.812>up <00:13:58.995>in <00:13:59.177>your <00:13:59.360>own <00:13:59.542>account.

302
00:13:59.905 --> 00:14:02.525
<00:13:59.905>It <00:14:00.045>has <00:14:00.185>authentication <00:14:00.324>in <00:14:00.464>order <00:14:00.605>for <00:14:00.745>you <00:14:00.885>to <00:14:01.025>set <00:14:01.165>an <00:14:01.305>account

303
00:14:02.715 --> 00:14:04.445
<00:14:02.715>with <00:14:02.915>a <00:14:03.115>front <00:14:03.315>end <00:14:03.515>and <00:14:03.715>everything <00:14:03.915>is <00:14:04.115>there.

304
00:14:05.495 --> 00:14:06.765
<00:14:05.495>Let's <00:14:05.723>actually <00:14:05.952>hop <00:14:06.180>into <00:14:06.409>the <00:14:06.638>demo.

305
00:14:08.985 --> 00:14:12.205
<00:14:08.985>So <00:14:09.140>here <00:14:09.296>we <00:14:09.451>are <00:14:09.607>in <00:14:09.762>our <00:14:09.918>cloud <00:14:10.073>chat <00:14:10.229>chat <00:14:10.385>bot.

306
00:14:13.865 --> 00:14:16.605
<00:14:13.865>We <00:14:14.040>have <00:14:14.215>multiple <00:14:14.390>language <00:14:14.565>models <00:14:14.740>that <00:14:14.915>we <00:14:15.090>can <00:14:15.265>choose

307
00:14:16.625 --> 00:14:18.685
<00:14:16.625>and <00:14:16.975>evaluate <00:14:17.325>in <00:14:17.675>this <00:14:18.025>demo

308
00:14:19.935 --> 00:14:23.765
<00:14:19.935>Cloud <00:14:20.135>3.5 <00:14:20.334>Sonic <00:14:20.535>is <00:14:20.734>Anthropics <00:14:20.935>most <00:14:21.135>capable <00:14:21.334>model.

309
00:14:24.195 --> 00:14:27.445
<00:14:24.195>Then <00:14:24.350>we <00:14:24.506>have <00:14:24.661>Haiku, <00:14:24.817>which <00:14:24.972>is <00:14:25.128>a <00:14:25.283>fast, <00:14:25.439>lightweight <00:14:25.595>model.

310
00:14:28.315 --> 00:14:29.125
<00:14:28.315>It's <00:14:28.679>extremely <00:14:29.044>fast.

311
00:14:29.185 --> 00:14:30.525
<00:14:29.185>I'm <00:14:29.357>actually <00:14:29.529>gonna <00:14:29.701>show <00:14:29.874>you <00:14:30.046>in <00:14:30.218>this <00:14:30.391>demo.

312
00:14:30.755 --> 00:14:31.925
<00:14:30.755>Then <00:14:30.965>we <00:14:31.176>have <00:14:31.386>two <00:14:31.597>other <00:14:31.808>models

313
00:14:31.925 --> 00:14:33.285
<00:14:31.925>that <00:14:32.169>are <00:14:32.414>highly <00:14:32.659>capable <00:14:32.904>as <00:14:33.149>well.

314
00:14:33.655 --> 00:14:34.805
<00:14:33.655>We're <00:14:33.913>gonna <00:14:34.172>start <00:14:34.431>with <00:14:34.689>Haiku.

315
00:14:35.935 --> 00:14:38.925
<00:14:35.935>We're <00:14:36.090>gonna <00:14:36.246>ask <00:14:36.401>this <00:14:36.557>chat <00:14:36.712>bot, <00:14:36.868>what <00:14:37.023>is <00:14:37.179>today's <00:14:37.334>date?

316
00:14:41.635 --> 00:14:46.415
<00:14:41.635>When <00:14:41.810>we <00:14:41.985>ask <00:14:42.160>it, <00:14:42.335>notice <00:14:42.510>how <00:14:42.685>Haiku <00:14:42.860>is <00:14:43.035>able

317
00:14:46.415 --> 00:14:49.375
<00:14:46.415>to <00:14:46.589>smile <00:14:46.765>extremely <00:14:46.939>fast, <00:14:47.115>but <00:14:47.290>it <00:14:47.464>has <00:14:47.640>no <00:14:47.814>contextual

318
00:14:49.595 --> 00:14:51.780
<00:14:49.595>or <00:14:49.795>capabilities <00:14:49.995>to <00:14:50.195>be <00:14:50.395>able <00:14:50.595>to, <00:14:50.795>to <00:14:50.995>understand

319
00:14:51.780 --> 00:14:52.880
<00:14:51.780>what <00:14:52.110>today's <00:14:52.439>date <00:14:52.770>is.

320
00:14:54.515 --> 00:14:55.685
<00:14:54.515>This <00:14:54.725>is <00:14:54.936>something, <00:14:55.146>one <00:14:55.357>of <00:14:55.568>the

321
00:14:55.685 --> 00:14:57.085
<00:14:55.685>limitations <00:14:56.000>of <00:14:56.314>large <00:14:56.630>language <00:14:56.945>models.

322
00:14:58.625 --> 00:15:01.995
<00:14:58.625>Another <00:14:58.780>thing <00:14:58.936>we're <00:14:59.091>gonna <00:14:59.247>ask <00:14:59.402>you <00:14:59.558>is <00:14:59.713>to <00:14:59.869>generate <00:15:00.025>code

323
00:15:02.095 --> 00:15:05.675
<00:15:02.095>to <00:15:02.211>be <00:15:02.328>able <00:15:02.445>to <00:15:02.561>deploy <00:15:02.678>VPCs <00:15:02.795>or <00:15:02.911>list <00:15:03.028>of <00:15:03.145>VPCs <00:15:03.261>in <00:15:03.378>my <00:15:03.495>account.

324
00:15:07.815 --> 00:15:10.515
<00:15:07.815>Now, <00:15:07.970>it <00:15:08.126>does <00:15:08.281>this <00:15:08.437>extremely <00:15:08.592>fast. <00:15:08.748>It <00:15:08.903>looks <00:15:09.059>really <00:15:09.215>right.

325
00:15:10.865 --> 00:15:12.435
<00:15:10.865>It's <00:15:11.145>giving <00:15:11.425>us <00:15:11.705>a <00:15:11.985>valid <00:15:12.265>region.

326
00:15:12.745 --> 00:15:14.555
<00:15:12.745>It's <00:15:12.945>also <00:15:13.145>giving <00:15:13.345>us <00:15:13.545>the <00:15:13.745>right <00:15:13.945>service <00:15:14.145>name,

327
00:15:15.215 --> 00:15:17.195
<00:15:15.215>and <00:15:15.355>it's <00:15:15.495>giving <00:15:15.635>us <00:15:15.775>the <00:15:15.915>right <00:15:16.055>function <00:15:16.195>call <00:15:16.335>to <00:15:16.475>be <00:15:16.615>able

328
00:15:17.195 --> 00:15:18.475
<00:15:17.195>to <00:15:17.579>describe <00:15:17.963>those <00:15:18.347>VPCs.

329
00:15:18.655 --> 00:15:20.435
<00:15:18.655>And <00:15:18.888>then <00:15:19.121>it's <00:15:19.355>listing <00:15:19.588>out <00:15:19.821>those <00:15:20.055>VPCs

330
00:15:20.435 --> 00:15:21.435
<00:15:20.435>so <00:15:20.563>we <00:15:20.692>can <00:15:20.820>see <00:15:20.949>'em <00:15:21.077>on <00:15:21.206>the <00:15:21.334>screen.

331
00:15:22.055 --> 00:15:24.235
<00:15:22.055>And <00:15:22.255>then <00:15:22.454>it's <00:15:22.655>giving <00:15:22.854>us <00:15:23.055>all <00:15:23.255>the <00:15:23.454>instructions

332
00:15:24.235 --> 00:15:25.555
<00:15:24.235>and <00:15:24.532>understanding <00:15:24.829>of <00:15:25.126>the <00:15:25.423>code.

333
00:15:26.145 --> 00:15:28.195
<00:15:26.145>This <00:15:26.378>is <00:15:26.611>a <00:15:26.845>a <00:15:27.078>traditional <00:15:27.311>chat <00:15:27.545>bot,

334
00:15:28.375 --> 00:15:30.595
<00:15:28.375>but <00:15:28.575>what <00:15:28.775>happens <00:15:28.975>when <00:15:29.175>things <00:15:29.375>go <00:15:29.575>wrong <00:15:29.775>here?

335
00:15:30.655 --> 00:15:33.675
<00:15:30.655>I'm <00:15:30.810>asking <00:15:30.966>it <00:15:31.121>to <00:15:31.277>explain <00:15:31.432>the <00:15:31.588>Amazon <00:15:31.743>bedrock <00:15:31.899>Converse <00:15:32.055>API.

336
00:15:34.615 --> 00:15:35.995
<00:15:34.615>It <00:15:34.925>give <00:15:35.236>us <00:15:35.546>a <00:15:35.857>response.

337
00:15:36.775 --> 00:15:38.835
<00:15:36.775>Now, <00:15:36.949>the <00:15:37.125>first <00:15:37.300>thing <00:15:37.475>I <00:15:37.650>noticed <00:15:37.824>using <00:15:38.000>my <00:15:38.175>foundational

338
00:15:38.835 --> 00:15:42.515
<00:15:38.835>knowledge <00:15:39.035>is <00:15:39.235>that <00:15:39.435>the <00:15:39.635>Amazon <00:15:39.835>Bedrock <00:15:40.035>Conversional <00:15:40.235>AI

339
00:15:42.515 --> 00:15:45.435
<00:15:42.515>service, <00:15:42.795>conversational <00:15:43.074>AI <00:15:43.355>service <00:15:43.635>isn't <00:15:43.915>something

340
00:15:45.435 --> 00:15:46.555
<00:15:45.435>that's <00:15:45.939>valid, <00:15:46.443>right?

341
00:15:46.555 --> 00:15:47.675
<00:15:46.555>So <00:15:46.891>this <00:15:47.227>looks <00:15:47.563>weird.

342
00:15:48.455 --> 00:15:50.075
<00:15:48.455>Now <00:15:48.688>I'm <00:15:48.921>gonna <00:15:49.155>ask <00:15:49.388>an <00:15:49.621>additional <00:15:49.855>question.

343
00:15:50.095 --> 00:15:51.435
<00:15:50.095>I'm <00:15:50.296>gonna <00:15:50.497>ask <00:15:50.698>it <00:15:50.899>to <00:15:51.099>generate <00:15:51.300>code,

344
00:15:51.695 --> 00:15:53.715
<00:15:51.695>and <00:15:51.975>of <00:15:52.255>course <00:15:52.535>it <00:15:52.815>generates <00:15:53.095>code.

345
00:15:53.935 --> 00:15:56.915
<00:15:53.935>But <00:15:54.135>immediately <00:15:54.334>my <00:15:54.535>foundational <00:15:54.734>knowledge <00:15:54.935>lets <00:15:55.135>me <00:15:55.334>know

346
00:15:56.915 --> 00:15:57.915
<00:15:56.915>that <00:15:57.140>this <00:15:57.365>is <00:15:57.589>not <00:15:57.814>correct

347
00:15:58.105 --> 00:16:01.955
<00:15:58.105>because <00:15:58.280>there <00:15:58.455>is <00:15:58.630>no <00:15:58.805>service <00:15:58.980>name <00:15:59.155>Bear <00:15:59.330>Rock, <00:15:59.505>converse.

348
00:16:02.905 --> 00:16:06.035
<00:16:02.905>This <00:16:03.060>is <00:16:03.216>why <00:16:03.371>I <00:16:03.527>say <00:16:03.682>having <00:16:03.838>con <00:16:03.993>foundational <00:16:04.149>knowledge <00:16:04.305>is

349
00:16:06.035 --> 00:16:07.995
<00:16:06.035>important <00:16:06.314>because <00:16:06.594>a <00:16:06.875>large <00:16:07.155>language <00:16:07.435>model

350
00:16:07.995 --> 00:16:09.035
<00:16:07.995>will <00:16:08.307>give <00:16:08.619>you <00:16:08.930>information.

351
00:16:09.255 --> 00:16:11.475
<00:16:09.255>You <00:16:09.382>have <00:16:09.509>to <00:16:09.636>be <00:16:09.764>able <00:16:09.891>to <00:16:10.018>understand <00:16:10.145>if <00:16:10.273>it's <00:16:10.400>accurate <00:16:10.527>or <00:16:10.655>not.

352
00:16:12.305 --> 00:16:14.715
<00:16:12.305>Also, <00:16:12.460>with <00:16:12.616>this, <00:16:12.771>it <00:16:12.927>doesn't <00:16:13.082>give <00:16:13.238>us <00:16:13.393>a <00:16:13.549>source <00:16:13.704>of

353
00:16:14.715 --> 00:16:15.755
<00:16:14.715>where <00:16:14.949>it <00:16:15.183>got <00:16:15.417>the <00:16:15.651>information.

354
00:16:16.095 --> 00:16:18.555
<00:16:16.095>So <00:16:16.295>we're <00:16:16.495>able <00:16:16.695>to <00:16:16.895>assume <00:16:17.095>that <00:16:17.295>it's <00:16:17.495>correct,

355
00:16:18.775 --> 00:16:20.115
<00:16:18.775>but <00:16:18.925>that's <00:16:19.076>not <00:16:19.227>what <00:16:19.378>we <00:16:19.528>really <00:16:19.679>want <00:16:19.830>to <00:16:19.981>do.

356
00:16:20.895 --> 00:16:24.275
<00:16:20.895>So <00:16:21.022>as <00:16:21.149>we <00:16:21.276>go <00:16:21.404>through <00:16:21.531>this, <00:16:21.658>I <00:16:21.785>asked <00:16:21.913>it, <00:16:22.040>you <00:16:22.167>know <00:16:22.295>what?

357
00:16:24.385 --> 00:16:25.555
<00:16:24.385>This <00:16:24.648>actually <00:16:24.911>is <00:16:25.174>not <00:16:25.438>right.

358
00:16:26.065 --> 00:16:29.035
<00:16:26.065>Well, <00:16:26.265>I <00:16:26.465>elite, <00:16:26.665>the <00:16:26.865>large <00:16:27.065>language <00:16:27.265>model <00:16:27.465>responds

359
00:16:29.035 --> 00:16:30.235
<00:16:29.035>with, <00:16:29.395>you <00:16:29.755>know <00:16:30.115>what?

360
00:16:30.705 --> 00:16:33.435
<00:16:30.705>This <00:16:30.905>service <00:16:31.105>is <00:16:31.305>actually <00:16:31.505>in <00:16:31.705>preview, <00:16:31.905>it <00:16:32.105>makes

361
00:16:33.435 --> 00:16:34.875
<00:16:33.435>that <00:16:33.867>up <00:16:34.299>another <00:16:34.731>hallucination.

362
00:16:34.895 --> 00:16:36.635
<00:16:34.895>So <00:16:35.069>we're <00:16:35.245>going <00:16:35.420>kind <00:16:35.595>of <00:16:35.770>down <00:16:35.944>this <00:16:36.120>rabbit <00:16:36.295>hole.

363
00:16:37.175 --> 00:16:39.835
<00:16:37.175>So <00:16:37.302>I <00:16:37.429>asked <00:16:37.556>it <00:16:37.684>finally, <00:16:37.811>are <00:16:37.938>you <00:16:38.065>sure <00:16:38.193>this <00:16:38.320>is <00:16:38.447>in <00:16:38.574>preview?

364
00:16:40.055 --> 00:16:43.275
<00:16:40.055>And <00:16:40.229>the <00:16:40.405>large <00:16:40.579>language <00:16:40.755>model <00:16:40.930>listeners <00:16:41.104>know <00:16:41.280>that <00:16:41.454>it's,

365
00:16:43.275 --> 00:16:46.075
<00:16:43.275>it's <00:16:43.415>incorrect <00:16:43.555>and <00:16:43.694>it <00:16:43.834>will <00:16:43.975>not <00:16:44.115>make <00:16:44.255>this <00:16:44.395>mistake <00:16:44.535>next <00:16:44.675>time.

366
00:16:46.415 --> 00:16:49.355
<00:16:46.415>So <00:16:46.570>the <00:16:46.726>question <00:16:46.881>is, <00:16:47.037>how <00:16:47.192>can <00:16:47.348>we <00:16:47.503>prevent <00:16:47.659>this <00:16:47.814>hallucination?

367
00:16:49.615 --> 00:16:51.515
<00:16:49.615>How <00:16:49.790>can <00:16:49.965>we <00:16:50.140>prevent <00:16:50.315>things <00:16:50.490>like <00:16:50.665>this <00:16:50.840>from <00:16:51.015>happening?

368
00:16:51.945 --> 00:16:54.275
<00:16:51.945>What <00:16:52.100>we're <00:16:52.256>going <00:16:52.411>to <00:16:52.567>do <00:16:52.722>next <00:16:52.878>is <00:16:53.033>create <00:16:53.189>our <00:16:53.345>own

369
00:16:54.535 --> 00:16:55.595
<00:16:54.535>custom <00:16:55.012>chat <00:16:55.489>bot.

370
00:17:06.195 --> 00:17:08.055
<00:17:06.194>So <00:17:06.428>we'll <00:17:06.661>click <00:17:06.895>on <00:17:07.128>the <00:17:07.361>bot <00:17:07.595>console.

371
00:17:16.235 --> 00:17:17.855
<00:17:16.234>Now <00:17:16.409>that <00:17:16.584>we <00:17:16.760>ain't <00:17:16.935>here, <00:17:17.109>we'll <00:17:17.284>click <00:17:17.459>create <00:17:17.635>bot,

372
00:17:22.865 --> 00:17:26.135
<00:17:22.865>We'll <00:17:23.020>give <00:17:23.176>it <00:17:23.331>a <00:17:23.487>name, <00:17:23.642>bear, <00:17:23.798>right, <00:17:23.953>rat <00:17:24.109>Chapter <00:17:24.265>Chatbot.

373
00:17:26.135 --> 00:17:28.335
<00:17:26.135>We'll <00:17:26.368>give <00:17:26.601>it <00:17:26.835>a <00:17:27.068>description. <00:17:27.301>Now, <00:17:27.535>here's

374
00:17:28.335 --> 00:17:31.095
<00:17:28.335>where <00:17:28.535>we <00:17:28.735>actually <00:17:28.935>provide <00:17:29.135>our <00:17:29.335>guardrails <00:17:29.535>to <00:17:29.735>ensure

375
00:17:31.095 --> 00:17:33.775
<00:17:31.095>that <00:17:31.328>the <00:17:31.561>model <00:17:31.795>only <00:17:32.028>uses <00:17:32.261>official <00:17:32.495>information.

376
00:17:34.075 --> 00:17:36.415
<00:17:34.075>Rather <00:17:34.250>than <00:17:34.425>making <00:17:34.600>things <00:17:34.775>up, <00:17:34.950>we <00:17:35.125>give <00:17:35.300>it <00:17:35.475>instructions.

377
00:17:36.595 --> 00:17:38.615
<00:17:36.595>And <00:17:36.711>the <00:17:36.828>way <00:17:36.945>we're <00:17:37.061>gonna <00:17:37.178>do <00:17:37.295>that <00:17:37.411>is <00:17:37.528>we're <00:17:37.645>gonna <00:17:37.761>hop <00:17:37.878>into <00:17:37.995>the

378
00:17:38.615 --> 00:17:39.815
<00:17:38.615>Amazon <00:17:39.155>Bedrock <00:17:39.695>console

379
00:17:40.315 --> 00:17:42.575
<00:17:40.315>and <00:17:40.548>we <00:17:40.781>have <00:17:41.015>something <00:17:41.248>called <00:17:41.481>prompt <00:17:41.715>management,

380
00:17:42.745 --> 00:17:45.375
<00:17:42.745>where <00:17:42.900>I <00:17:43.056>actually <00:17:43.211>have <00:17:43.367>a <00:17:43.522>prompt <00:17:43.678>already <00:17:43.833>created <00:17:43.989>and <00:17:44.145>stored.

381
00:17:45.635 --> 00:17:47.695
<00:17:45.635>Prompt <00:17:45.868>management <00:17:46.101>allows <00:17:46.335>you <00:17:46.568>to <00:17:46.801>create <00:17:47.035>prompts,

382
00:17:48.045 --> 00:17:51.885
<00:17:48.045>save <00:17:48.200>prompts, <00:17:48.356>and <00:17:48.511>test <00:17:48.667>prompts <00:17:48.822>in <00:17:48.978>the <00:17:49.133>Amazon <00:17:49.289>Bare <00:17:49.445>rock.

383
00:17:51.945 --> 00:17:54.125
<00:17:51.945>You <00:17:52.225>also <00:17:52.504>can <00:17:52.784>use <00:17:53.064>the <00:17:53.345>SDKs

384
00:17:54.125 --> 00:17:55.525
<00:17:54.125>that <00:17:54.265>you're <00:17:54.405>used <00:17:54.545>to <00:17:54.685>to <00:17:54.825>be <00:17:54.965>able <00:17:55.105>to <00:17:55.245>do <00:17:55.385>that.

385
00:17:56.145 --> 00:17:57.525
<00:17:56.145>So <00:17:56.352>we'll <00:17:56.559>click <00:17:56.766>on <00:17:56.973>our <00:17:57.180>save <00:17:57.387>prompt,

386
00:18:00.195 --> 00:18:02.505
<00:18:00.195>we'll <00:18:00.428>open <00:18:00.661>edit <00:18:00.895>prompt <00:18:01.128>in <00:18:01.361>the <00:18:01.595>builder.

387
00:18:02.925 --> 00:18:04.825
<00:18:02.925>And <00:18:03.158>notice <00:18:03.391>I'm <00:18:03.625>giving <00:18:03.858>the <00:18:04.091>model <00:18:04.325>instructions

388
00:18:04.825 --> 00:18:06.705
<00:18:04.825>to <00:18:05.175>only <00:18:05.525>use <00:18:05.875>official <00:18:06.225>documentation

389
00:18:07.455 --> 00:18:09.265
<00:18:07.455>when <00:18:07.688>we're <00:18:07.921>building <00:18:08.155>out <00:18:08.388>our <00:18:08.621>chat <00:18:08.855>bot.

390
00:18:09.765 --> 00:18:13.345
<00:18:09.765>I'm <00:18:09.920>also <00:18:10.076>giving <00:18:10.231>the <00:18:10.387>additional <00:18:10.542>instructions <00:18:10.698>of <00:18:10.853>when <00:18:11.009>you <00:18:11.165>use

391
00:18:13.485 --> 00:18:16.665
<00:18:13.485>or <00:18:13.659>generate <00:18:13.834>code, <00:18:14.010>only <00:18:14.185>use <00:18:14.360>these <00:18:14.534>specific <00:18:14.709>model <00:18:14.885>IDs

392
00:18:17.015 --> 00:18:18.185
<00:18:17.015>when <00:18:17.366>you're <00:18:17.717>generating <00:18:18.068>code.

393
00:18:18.405 --> 00:18:21.745
<00:18:18.405>So <00:18:18.560>now <00:18:18.716>the <00:18:18.871>model <00:18:19.027>has <00:18:19.182>reference <00:18:19.338>and <00:18:19.493>context <00:18:19.649>and <00:18:19.805>guardrails

394
00:18:21.745 --> 00:18:23.345
<00:18:21.745>and <00:18:22.024>instructions <00:18:22.304>that <00:18:22.584>it <00:18:22.864>should <00:18:23.145>follow.

395
00:18:23.785 --> 00:18:25.865
<00:18:23.785>Whenever <00:18:23.985>I'm <00:18:24.185>asking <00:18:24.385>the <00:18:24.585>questions <00:18:24.785>in <00:18:24.985>the <00:18:25.185>prompt,

396
00:18:27.565 --> 00:18:29.465
<00:18:27.565>and <00:18:27.740>here's <00:18:27.915>where <00:18:28.090>we <00:18:28.265>talk <00:18:28.440>about <00:18:28.615>the <00:18:28.790>model <00:18:28.965>IDs.

397
00:18:30.175 --> 00:18:33.345
<00:18:30.175>Another <00:18:30.375>great <00:18:30.575>thing <00:18:30.774>about <00:18:30.975>this <00:18:31.175>prompt <00:18:31.375>management <00:18:31.575>is

398
00:18:33.345 --> 00:18:34.745
<00:18:33.345>that <00:18:33.597>you <00:18:33.849>can <00:18:34.101>actually <00:18:34.352>use <00:18:34.605>variables.

399
00:18:35.165 --> 00:18:36.745
<00:18:35.165>So <00:18:35.445>if <00:18:35.725>you <00:18:36.004>have <00:18:36.284>multiple <00:18:36.565>prompts

400
00:18:36.745 --> 00:18:38.385
<00:18:36.745>and <00:18:36.945>you're <00:18:37.145>gonna <00:18:37.344>be <00:18:37.544>passing <00:18:37.745>in <00:18:37.945>different <00:18:38.145>variables,

401
00:18:38.685 --> 00:18:40.545
<00:18:38.685>you <00:18:38.885>can <00:18:39.085>actually <00:18:39.284>do <00:18:39.485>that <00:18:39.685>via <00:18:39.885>prompt <00:18:40.085>management.

402
00:18:41.085 --> 00:18:43.945
<00:18:41.085>And <00:18:41.225>so <00:18:41.365>now <00:18:41.505>at <00:18:41.645>this <00:18:41.785>point, <00:18:41.925>we're <00:18:42.065>telling <00:18:42.205>it <00:18:42.345>not <00:18:42.485>to

403
00:18:44.615 --> 00:18:47.465
<00:18:44.615>make <00:18:44.770>up <00:18:44.926>things <00:18:45.081>in <00:18:45.237>this, <00:18:45.392>in <00:18:45.548>this <00:18:45.703>um, <00:18:45.859>system <00:18:46.015>prompt.

404
00:18:51.665 --> 00:18:53.525
<00:18:51.665>The <00:18:51.805>next <00:18:51.945>thing <00:18:52.085>we'll <00:18:52.225>do <00:18:52.365>is <00:18:52.504>we're <00:18:52.645>gonna <00:18:52.784>test <00:18:52.925>this <00:18:53.065>prompt

405
00:18:53.545 --> 00:18:56.925
<00:18:53.545>to <00:18:53.700>ensure <00:18:53.856>that <00:18:54.011>our <00:18:54.167>large <00:18:54.322>language <00:18:54.478>model <00:18:54.633>is <00:18:54.789>gonna <00:18:54.945>respond

406
00:18:56.925 --> 00:18:58.285
<00:18:56.925>accordingly <00:18:57.333>to <00:18:57.741>our <00:18:58.149>prompt.

407
00:18:59.145 --> 00:19:01.365
<00:18:59.145>So <00:18:59.300>we <00:18:59.456>click <00:18:59.611>apply, <00:18:59.767>we <00:18:59.922>select <00:19:00.078>the <00:19:00.233>model, <00:19:00.389>click <00:19:00.545>apply.

408
00:19:01.585 --> 00:19:02.605
<00:19:01.585>We <00:19:01.891>can <00:19:02.197>even <00:19:02.503>test

409
00:19:02.825 --> 00:19:05.645
<00:19:02.825>and <00:19:03.105>update <00:19:03.385>the <00:19:03.665>parameters <00:19:03.945>to <00:19:04.225>ensure

410
00:19:05.645 --> 00:19:07.125
<00:19:05.645>that <00:19:05.978>it <00:19:06.311>matches <00:19:06.644>our <00:19:06.977>application.

411
00:19:07.465 --> 00:19:11.835
<00:19:07.465>We <00:19:07.620>click <00:19:07.776>one <00:19:07.931>and <00:19:08.087>wait <00:19:08.242>for <00:19:08.398>the <00:19:08.553>large <00:19:08.709>language <00:19:08.865>model

412
00:19:11.835 --> 00:19:12.395
<00:19:11.835>to <00:19:12.339>respond

413
00:19:31.305 --> 00:19:33.245
<00:19:31.305>and <00:19:31.480>notice <00:19:31.655>the <00:19:31.830>response <00:19:32.005>from <00:19:32.180>the <00:19:32.355>large <00:19:32.530>language <00:19:32.705>model.

414
00:19:33.545 --> 00:19:36.045
<00:19:33.545>It <00:19:33.700>lets <00:19:33.856>us <00:19:34.011>know <00:19:34.167>that <00:19:34.322>it, <00:19:34.478>it <00:19:34.633>follows <00:19:34.789>the <00:19:34.945>instructions,

415
00:19:36.265 --> 00:19:38.925
<00:19:36.265>it <00:19:36.420>understands <00:19:36.576>fully, <00:19:36.731>and <00:19:36.887>we <00:19:37.042>can <00:19:37.198>just <00:19:37.353>copy <00:19:37.509>the <00:19:37.665>prompt

416
00:19:39.025 --> 00:19:40.565
<00:19:39.025>and <00:19:39.223>paste <00:19:39.421>it <00:19:39.619>into <00:19:39.817>our <00:19:40.015>instructions <00:19:40.213>in <00:19:40.411>our

417
00:19:40.565 --> 00:19:42.485
<00:19:40.565>model, <00:19:40.915>in <00:19:41.265>our <00:19:41.615>chat <00:19:41.965>bot.

418
00:19:42.705 --> 00:19:44.165
<00:19:42.705>And <00:19:42.892>once <00:19:43.080>we <00:19:43.268>do <00:19:43.455>that, <00:19:43.643>we'll <00:19:43.831>save <00:19:44.019>it.

419
00:19:47.185 --> 00:19:52.025
<00:19:47.185>We <00:19:47.312>click <00:19:47.439>create. <00:19:47.566>And <00:19:47.694>now <00:19:47.821>we're <00:19:47.948>gonna <00:19:48.075>open <00:19:48.203>up <00:19:48.330>our <00:19:48.457>chat <00:19:48.585>bot

420
00:19:52.025 --> 00:19:54.305
<00:19:52.025>and <00:19:52.180>I'm <00:19:52.336>gonna <00:19:52.491>ask <00:19:52.647>it <00:19:52.802>again <00:19:52.958>about <00:19:53.113>the <00:19:53.269>Amazon <00:19:53.425>bedrock

421
00:19:54.705 --> 00:19:55.745
<00:19:54.705>Converse <00:19:55.640>API.

422
00:20:02.585 --> 00:20:05.765
<00:20:02.585>And <00:20:02.740>this <00:20:02.896>time <00:20:03.051>when <00:20:03.207>I'm <00:20:03.362>asking, <00:20:03.518>what <00:20:03.673>I'm <00:20:03.829>expecting <00:20:03.985>is

423
00:20:05.765 --> 00:20:08.045
<00:20:05.765>that <00:20:05.940>it's <00:20:06.115>going <00:20:06.290>to <00:20:06.465>use <00:20:06.640>the <00:20:06.815>guardrails <00:20:06.990>in <00:20:07.165>place

424
00:20:08.825 --> 00:20:09.925
<00:20:08.825>and <00:20:09.072>not <00:20:09.320>make <00:20:09.567>up <00:20:09.815>something

425
00:20:10.105 --> 00:20:12.085
<00:20:10.105>and <00:20:10.385>notice <00:20:10.665>that <00:20:10.945>this <00:20:11.225>is <00:20:11.505>successful.

426
00:20:12.745 --> 00:20:14.605
<00:20:12.745>Now <00:20:12.945>you're <00:20:13.145>going <00:20:13.344>to <00:20:13.544>iterate <00:20:13.745>over <00:20:13.945>this <00:20:14.145>process.

427
00:20:14.665 --> 00:20:16.045
<00:20:14.665>This's <00:20:14.842>not <00:20:15.019>gonna <00:20:15.197>be <00:20:15.374>a <00:20:15.552>one <00:20:15.729>time <00:20:15.907>chat.

428
00:20:16.045 --> 00:20:17.845
<00:20:16.045>You're <00:20:16.325>gonna <00:20:16.605>test <00:20:16.885>and <00:20:17.165>test <00:20:17.445>ensure

429
00:20:17.845 --> 00:20:20.125
<00:20:17.845>that <00:20:18.045>it <00:20:18.245>is <00:20:18.445>meeting <00:20:18.645>those <00:20:18.845>guardrails <00:20:19.045>every <00:20:19.245>time.

430
00:20:20.705 --> 00:20:23.165
<00:20:20.705>So <00:20:20.860>now <00:20:21.016>we'll <00:20:21.171>go <00:20:21.327>back <00:20:21.482>into <00:20:21.638>our, <00:20:21.793>our <00:20:21.949>chat <00:20:22.105>bot

431
00:20:23.165 --> 00:20:24.725
<00:20:23.165>and <00:20:23.445>we're <00:20:23.725>gonna <00:20:24.004>add <00:20:24.284>additional <00:20:24.565>context

432
00:20:25.225 --> 00:20:26.565
<00:20:25.225>so <00:20:25.466>it <00:20:25.707>can <00:20:25.948>answer <00:20:26.189>our <00:20:26.431>questions.

433
00:20:26.945 --> 00:20:29.365
<00:20:26.945>And <00:20:27.061>the <00:20:27.178>way <00:20:27.294>we're <00:20:27.411>gonna <00:20:27.528>do <00:20:27.645>that <00:20:27.761>is <00:20:27.878>we're <00:20:27.995>gonna <00:20:28.111>use <00:20:28.228>the <00:20:28.345>PDF

434
00:20:29.785 --> 00:20:33.245
<00:20:29.785>and <00:20:30.018>add <00:20:30.251>it <00:20:30.485>to <00:20:30.718>our <00:20:30.951>knowledge <00:20:31.185>base.

435
00:20:33.905 --> 00:20:36.045
<00:20:33.905>So <00:20:34.105>we <00:20:34.305>open <00:20:34.504>up <00:20:34.705>the <00:20:34.905>Amazon <00:20:35.105>bedrock <00:20:35.305>documentation.

436
00:20:36.875 --> 00:20:38.645
<00:20:36.875>This <00:20:37.050>is <00:20:37.225>where <00:20:37.400>we <00:20:37.575>can <00:20:37.750>find <00:20:37.925>information <00:20:38.100>on <00:20:38.275>the,

437
00:20:38.945 --> 00:20:40.885
<00:20:38.945>the <00:20:39.294>Amazon <00:20:39.645>bedrock, <00:20:39.995>converse <00:20:40.345>API.

438
00:20:41.695 --> 00:20:43.805
<00:20:41.695>We'll <00:20:41.895>open <00:20:42.095>up <00:20:42.294>the <00:20:42.495>PDF, <00:20:42.695>copy <00:20:42.895>the <00:20:43.095>URL,

439
00:20:44.945 --> 00:20:46.485
<00:20:44.945>and <00:20:45.143>we'll <00:20:45.341>add <00:20:45.539>that <00:20:45.736>to <00:20:45.935>our <00:20:46.132>chat <00:20:46.331>bot.

440
00:20:48.745 --> 00:20:52.645
<00:20:48.745>And <00:20:48.885>now <00:20:49.024>we <00:20:49.165>have <00:20:49.304>the <00:20:49.445>ability <00:20:49.584>to <00:20:49.725>adjust <00:20:49.864>the <00:20:50.004>parameters <00:20:50.145>on

441
00:20:52.665 --> 00:20:53.965
<00:20:52.665>how <00:20:52.957>we <00:20:53.250>generate <00:20:53.542>a <00:20:53.835>response.

442
00:20:54.745 --> 00:20:56.525
<00:20:54.745>We <00:20:55.024>also <00:20:55.304>can <00:20:55.584>ingest <00:20:55.864>the <00:20:56.145>chunk

443
00:20:56.525 --> 00:20:59.085
<00:20:56.525>of <00:20:56.680>size <00:20:56.836>when <00:20:56.991>we <00:20:57.147>send <00:20:57.302>our <00:20:57.458>embeddings <00:20:57.613>to <00:20:57.769>the <00:20:57.925>model.

444
00:21:00.035 --> 00:21:02.495
<00:21:00.035>And <00:21:00.235>then <00:21:00.435>finally, <00:21:00.635>we <00:21:00.835>can <00:21:01.035>adjust <00:21:01.235>the <00:21:01.435>amount

445
00:21:02.495 --> 00:21:03.655
<00:21:02.495>of <00:21:02.842>documents <00:21:03.191>we <00:21:03.539>return.

446
00:21:03.655 --> 00:21:06.455
<00:21:03.655>When <00:21:03.830>we <00:21:04.004>gen, <00:21:04.180>when <00:21:04.355>we <00:21:04.530>query <00:21:04.705>the <00:21:04.879>knowledge <00:21:05.055>base,

447
00:21:08.165 --> 00:21:11.375
<00:21:08.165>it's <00:21:08.305>syncing <00:21:08.445>the <00:21:08.585>sink <00:21:08.725>complete, <00:21:08.865>we <00:21:09.004>open <00:21:09.145>up <00:21:09.284>the <00:21:09.425>chat <00:21:09.565>bot,

448
00:21:11.395 --> 00:21:12.455
<00:21:11.395>we <00:21:11.633>ask <00:21:11.871>the <00:21:12.110>question <00:21:12.349>again.

449
00:21:15.265 --> 00:21:16.635
<00:21:15.265>This <00:21:15.511>time <00:21:15.758>you <00:21:16.004>notice <00:21:16.251>that <00:21:16.498>it's

450
00:21:16.715 --> 00:21:17.835
<00:21:16.715>retrieving <00:21:16.966>from <00:21:17.219>the <00:21:17.471>knowledge <00:21:17.723>base.

451
00:21:18.095 --> 00:21:19.795
<00:21:18.095>It <00:21:18.235>lets <00:21:18.375>us <00:21:18.515>know <00:21:18.655>to <00:21:18.795>be <00:21:18.935>able <00:21:19.075>to <00:21:19.215>answer <00:21:19.355>our <00:21:19.495>question,

452
00:21:20.015 --> 00:21:22.875
<00:21:20.015>is <00:21:20.190>finding <00:21:20.365>the <00:21:20.540>documents <00:21:20.715>that <00:21:20.890>will <00:21:21.065>help <00:21:21.240>it <00:21:21.415>answer.

453
00:21:23.175 --> 00:21:27.675
<00:21:23.175>So <00:21:23.315>it's <00:21:23.455>generated <00:21:23.595>a <00:21:23.735>response <00:21:23.875>to <00:21:24.014>me <00:21:24.155>from <00:21:24.294>my <00:21:24.435>own <00:21:24.575>knowledge,

454
00:21:27.715 --> 00:21:28.955
<00:21:27.715>foundational <00:21:28.831>knowledge.

455
00:21:29.035 --> 00:21:30.475
<00:21:29.035>I <00:21:29.294>realized, <00:21:29.553>okay, <00:21:29.812>this <00:21:30.071>is <00:21:30.331>great,

456
00:21:30.815 --> 00:21:33.395
<00:21:30.815>but <00:21:30.970>I <00:21:31.126>also <00:21:31.281>can <00:21:31.437>reference <00:21:31.592>where <00:21:31.748>this <00:21:31.903>information <00:21:32.059>came <00:21:32.215>from

457
00:21:33.895 --> 00:21:36.555
<00:21:33.895>to <00:21:34.070>ensure <00:21:34.245>that <00:21:34.420>whatever <00:21:34.595>the <00:21:34.770>information <00:21:34.945>the <00:21:35.120>model <00:21:35.295>is

458
00:21:36.555 --> 00:21:37.875
<00:21:36.555>receiving <00:21:37.149>is <00:21:37.743>accurate.

459
00:21:39.015 --> 00:21:41.195
<00:21:39.015>Now <00:21:39.170>at <00:21:39.326>this <00:21:39.481>point, <00:21:39.637>I'm <00:21:39.792>gonna <00:21:39.948>ask <00:21:40.103>it <00:21:40.259>another <00:21:40.415>question

460
00:21:42.055 --> 00:21:45.675
<00:21:42.055>to <00:21:42.230>compare <00:21:42.405>the <00:21:42.580>Amazon <00:21:42.755>bedrock <00:21:42.930>Converse <00:21:43.105>API <00:21:43.280>versus <00:21:43.455>the

461
00:21:45.815 --> 00:21:47.435
<00:21:45.815>Invoke <00:21:47.215>API.

462
00:21:47.615 --> 00:21:50.235
<00:21:47.615>And <00:21:47.790>so <00:21:47.965>once <00:21:48.140>we <00:21:48.315>do <00:21:48.490>that, <00:21:48.665>I <00:21:48.840>realize, <00:21:49.015>okay,

463
00:21:50.235 --> 00:21:51.715
<00:21:50.235>it <00:21:50.568>has <00:21:50.900>full <00:21:51.234>contextual <00:21:51.567>understanding

464
00:21:51.785 --> 00:21:53.195
<00:21:51.785>because <00:21:52.208>now <00:21:52.631>it <00:21:53.053>understands

465
00:21:53.195 --> 00:21:55.315
<00:21:53.195>that <00:21:53.395>the <00:21:53.595>Converse <00:21:53.794>API <00:21:53.995>can <00:21:54.195>manage <00:21:54.395>our <00:21:54.595>conversation

466
00:21:55.775 --> 00:21:57.515
<00:21:55.775>and <00:21:56.055>it <00:21:56.335>provides <00:21:56.615>a <00:21:56.895>unified <00:21:57.175>interface.

467
00:21:57.775 --> 00:21:59.355
<00:21:57.775>So <00:21:57.975>we <00:21:58.175>can <00:21:58.375>just <00:21:58.575>change <00:21:58.775>out <00:21:58.975>our <00:21:59.175>models

468
00:21:59.355 --> 00:22:00.635
<00:21:59.355>rather <00:21:59.739>than <00:22:00.123>the <00:22:00.507>parameters.

469
00:22:00.785 --> 00:22:03.475
<00:22:00.785>When <00:22:00.940>we're <00:22:01.096>sending <00:22:01.251>an <00:22:01.407>API <00:22:01.562>call <00:22:01.718>to <00:22:01.873>Amazon <00:22:02.029>Bear <00:22:02.185>Rock.

470
00:22:04.375 --> 00:22:05.795
<00:22:04.375>The <00:22:04.557>next <00:22:04.740>thing <00:22:04.922>I'm <00:22:05.105>gonna <00:22:05.287>do, <00:22:05.470>I'm <00:22:05.653>going

471
00:22:05.795 --> 00:22:07.635
<00:22:05.795>to <00:22:05.995>generate <00:22:06.195>some <00:22:06.395>code <00:22:06.595>that <00:22:06.795>I <00:22:06.995>can <00:22:07.195>run.

472
00:22:07.935 --> 00:22:09.515
<00:22:07.935>So <00:22:08.215>it's <00:22:08.495>gonna <00:22:08.774>use <00:22:09.054>the <00:22:09.335>documentation

473
00:22:09.775 --> 00:22:10.995
<00:22:09.775>to <00:22:09.994>be <00:22:10.214>able <00:22:10.433>to <00:22:10.653>generate <00:22:10.872>code.

474
00:22:11.735 --> 00:22:14.555
<00:22:11.735>And <00:22:11.875>I'm <00:22:12.014>gonna <00:22:12.155>know <00:22:12.294>that <00:22:12.435>the <00:22:12.574>document, <00:22:12.715>the <00:22:12.854>code <00:22:12.995>is <00:22:13.135>correct

475
00:22:14.555 --> 00:22:16.955
<00:22:14.555>because <00:22:14.695>now <00:22:14.835>I <00:22:14.975>can <00:22:15.115>reference <00:22:15.255>where <00:22:15.395>it <00:22:15.535>got <00:22:15.675>the <00:22:15.815>examples <00:22:15.955>from.

476
00:22:17.765 --> 00:22:20.115
<00:22:17.765>First <00:22:17.940>thing <00:22:18.115>I <00:22:18.290>notice, <00:22:18.465>okay, <00:22:18.640>the <00:22:18.815>region <00:22:18.990>is <00:22:19.165>correct,

477
00:22:20.615 --> 00:22:21.755
<00:22:20.615>the <00:22:20.871>service <00:22:21.128>name <00:22:21.384>is <00:22:21.641>correct.

478
00:22:22.185 --> 00:22:24.715
<00:22:22.185>It's <00:22:22.465>using <00:22:22.745>the <00:22:23.024>correct <00:22:23.304>conversation <00:22:23.585>structure.

479
00:22:25.385 --> 00:22:27.395
<00:22:25.385>It's <00:22:25.618>also <00:22:25.851>passing <00:22:26.085>in <00:22:26.318>the <00:22:26.551>correct <00:22:26.785>parameters.

480
00:22:28.655 --> 00:22:30.515
<00:22:28.655>The <00:22:28.855>code <00:22:29.055>looks <00:22:29.254>great <00:22:29.455>and <00:22:29.655>it's <00:22:29.855>using <00:22:30.055>one

481
00:22:30.515 --> 00:22:31.635
<00:22:30.515>of <00:22:30.683>the <00:22:30.851>models <00:22:31.019>that <00:22:31.187>I <00:22:31.355>have <00:22:31.523>listed.

482
00:22:32.055 --> 00:22:33.715
<00:22:32.055>For <00:22:32.335>me, <00:22:32.615>it's <00:22:32.895>following <00:22:33.175>the <00:22:33.455>guardrails.

483
00:22:34.025 --> 00:22:35.995
<00:22:34.025>It's <00:22:34.225>referenced <00:22:34.425>the <00:22:34.625>information <00:22:34.825>that <00:22:35.025>I <00:22:35.225>gave <00:22:35.425>it.

484
00:22:36.415 --> 00:22:38.715
<00:22:36.415>And <00:22:36.615>from <00:22:36.815>my <00:22:37.014>foundational <00:22:37.215>knowledge, <00:22:37.415>I <00:22:37.615>can <00:22:37.815>understand

485
00:22:38.715 --> 00:22:40.715
<00:22:38.715>that <00:22:38.915>it's <00:22:39.115>accurate <00:22:39.314>and <00:22:39.514>I <00:22:39.715>get <00:22:39.915>a <00:22:40.115>better

486
00:22:40.715 --> 00:22:42.315
<00:22:40.715>understanding <00:22:41.181>of <00:22:41.648>some <00:22:42.115>information.

487
00:22:42.355 --> 00:22:45.075
<00:22:42.355>I <00:22:42.510>didn't <00:22:42.666>know <00:22:42.821>like <00:22:42.977>the <00:22:43.132>differences <00:22:43.288>between <00:22:43.443>the <00:22:43.599>two <00:22:43.755>APIs.

488
00:22:46.785 --> 00:22:49.005
<00:22:46.785>And <00:22:46.925>so <00:22:47.065>now <00:22:47.205>that <00:22:47.345>we <00:22:47.485>have <00:22:47.625>this, <00:22:47.765>what <00:22:47.905>we <00:22:48.045>can <00:22:48.185>do,

489
00:22:49.025 --> 00:22:50.165
<00:22:49.025>we <00:22:49.281>can <00:22:49.538>copy <00:22:49.794>this <00:22:50.051>code

490
00:22:51.665 --> 00:22:55.165
<00:22:51.665>and <00:22:51.781>then <00:22:51.898>we'll <00:22:52.014>open <00:22:52.131>up <00:22:52.248>VS <00:22:52.365>code <00:22:52.481>and <00:22:52.598>then <00:22:52.715>we'll <00:22:52.831>test <00:22:52.948>it <00:22:53.065>out.

491
00:23:05.165 --> 00:23:06.905
<00:23:05.165>And <00:23:05.445>if <00:23:05.725>it <00:23:06.004>works <00:23:06.284>correct <00:23:06.565>successfully,

492
00:23:07.205 --> 00:23:09.065
<00:23:07.205>we <00:23:07.360>should <00:23:07.516>get <00:23:07.671>a <00:23:07.827>response <00:23:07.982>from <00:23:08.138>the <00:23:08.293>large <00:23:08.449>language <00:23:08.605>model

493
00:23:10.005 --> 00:23:11.065
<00:23:10.005>and <00:23:10.482>it's <00:23:10.959>successful.

494
00:23:11.765 --> 00:23:13.145
<00:23:11.765>Now, <00:23:12.013>taking <00:23:12.261>it <00:23:12.510>one <00:23:12.758>step <00:23:13.007>further,

495
00:23:13.145 --> 00:23:14.505
<00:23:13.145>since <00:23:13.319>we're <00:23:13.494>talking <00:23:13.669>about <00:23:13.844>a <00:23:14.019>set <00:23:14.194>of <00:23:14.369>learning,

496
00:23:14.505 --> 00:23:17.665
<00:23:14.505>accelerated <00:23:14.705>learning, <00:23:14.905>Amazon <00:23:15.105>Q <00:23:15.305>developer <00:23:15.505>will <00:23:15.705>allow <00:23:15.905>us

497
00:23:17.665 --> 00:23:19.065
<00:23:17.665>to <00:23:18.085>analyze <00:23:18.505>our <00:23:18.925>code.

498
00:23:19.485 --> 00:23:20.985
<00:23:19.485>So <00:23:19.754>here <00:23:20.024>I <00:23:20.294>highlight <00:23:20.564>our <00:23:20.834>code

499
00:23:21.245 --> 00:23:24.585
<00:23:21.245>and <00:23:21.419>use <00:23:21.594>Amazon <00:23:21.770>Cube <00:23:21.945>to <00:23:22.120>actually <00:23:22.294>explain <00:23:22.469>our <00:23:22.645>code.

500
00:23:24.965 --> 00:23:27.145
<00:23:24.965>So <00:23:25.165>now <00:23:25.365>we <00:23:25.564>can <00:23:25.764>also <00:23:25.965>get <00:23:26.165>additional <00:23:26.365>context

501
00:23:27.285 --> 00:23:29.665
<00:23:27.285>and <00:23:27.460>understanding <00:23:27.635>from <00:23:27.810>the <00:23:27.985>code <00:23:28.160>in <00:23:28.335>our <00:23:28.510>code <00:23:28.685>base,

502
00:23:30.405 --> 00:23:34.105
<00:23:30.405>not <00:23:30.545>just <00:23:30.685>in <00:23:30.825>a <00:23:30.965>specific <00:23:31.105>file, <00:23:31.245>but <00:23:31.385>in <00:23:31.524>our <00:23:31.665>entire <00:23:31.805>workspace.

503
00:23:34.365 --> 00:23:36.665
<00:23:34.365>So <00:23:34.520>this <00:23:34.676>is <00:23:34.831>helpful <00:23:34.987>for <00:23:35.142>using <00:23:35.298>an <00:23:35.453>assistant <00:23:35.609>when <00:23:35.765>you're

504
00:23:36.665 --> 00:23:38.345
<00:23:36.665>developing <00:23:37.014>code <00:23:37.365>in <00:23:37.715>your <00:23:38.065>applications.

505
00:23:46.025 --> 00:23:47.285
<00:23:46.025>So <00:23:46.308>that <00:23:46.592>completes <00:23:46.875>our <00:23:47.159>demo.

506
00:23:48.115 --> 00:23:50.125
<00:23:48.115>This <00:23:48.348>demo <00:23:48.581>was <00:23:48.815>really <00:23:49.048>focused <00:23:49.281>on <00:23:49.515>the

507
00:23:50.125 --> 00:23:51.765
<00:23:50.125>capabilities <00:23:50.591>of <00:23:51.058>general <00:23:51.525>ai.

508
00:23:52.065 --> 00:23:55.005
<00:23:52.065>But <00:23:52.220>what <00:23:52.376>I <00:23:52.531>wanna <00:23:52.687>discuss <00:23:52.842>real <00:23:52.998>briefly <00:23:53.153>is <00:23:53.309>the <00:23:53.465>limitations.

509
00:23:55.065 --> 00:23:57.125
<00:23:55.065>And <00:23:55.345>that's <00:23:55.625>around <00:23:55.905>accuracy <00:23:56.185>and <00:23:56.465>hallucinations.

510
00:23:57.585 --> 00:23:59.685
<00:23:57.585>You <00:23:57.725>need <00:23:57.865>to <00:23:58.005>be <00:23:58.145>able <00:23:58.285>to <00:23:58.425>identify <00:23:58.565>when <00:23:58.705>things <00:23:58.845>go <00:23:58.985>wrong.

511
00:23:59.945 --> 00:24:02.445
<00:23:59.945>You <00:24:00.120>need <00:24:00.294>to <00:24:00.470>be <00:24:00.645>able <00:24:00.820>to <00:24:00.995>provide <00:24:01.169>updated <00:24:01.345>information.

512
00:24:02.755 --> 00:24:05.325
<00:24:02.755>There's <00:24:02.930>a <00:24:03.105>saying <00:24:03.280>that <00:24:03.455>you <00:24:03.630>can't <00:24:03.805>out-train <00:24:03.980>bad <00:24:04.155>data.

513
00:24:05.905 --> 00:24:08.445
<00:24:05.905>So <00:24:06.080>when <00:24:06.254>we <00:24:06.430>recognize <00:24:06.605>that <00:24:06.780>documentation <00:24:06.955>may <00:24:07.129>be <00:24:07.305>missing,

514
00:24:08.945 --> 00:24:11.525
<00:24:08.945>may <00:24:09.100>need <00:24:09.256>to <00:24:09.411>be <00:24:09.567>updated, <00:24:09.722>we <00:24:09.878>should <00:24:10.033>add <00:24:10.189>the <00:24:10.345>documentation,

515
00:24:11.525 --> 00:24:14.245
<00:24:11.525>we <00:24:11.665>should <00:24:11.805>update <00:24:11.945>it <00:24:12.085>to <00:24:12.225>be <00:24:12.365>able <00:24:12.505>to <00:24:12.645>leverage <00:24:12.785>Ative <00:24:12.925>AI

516
00:24:14.305 --> 00:24:15.325
<00:24:14.305>for <00:24:14.764>accelerated <00:24:15.223>learning.

517
00:24:16.075 --> 00:24:18.085
<00:24:16.075>Also, <00:24:16.275>all <00:24:16.475>of <00:24:16.675>these <00:24:16.875>models <00:24:17.075>that <00:24:17.275>we're <00:24:17.475>using

518
00:24:18.705 --> 00:24:20.485
<00:24:18.705>are <00:24:19.171>living <00:24:19.638>on <00:24:20.105>AWS.

519
00:24:20.825 --> 00:24:23.165
<00:24:20.825>So <00:24:21.025>now <00:24:21.225>you're <00:24:21.425>able <00:24:21.625>to <00:24:21.825>have <00:24:22.025>the <00:24:22.225>security

520
00:24:23.185 --> 00:24:26.925
<00:24:23.185>and <00:24:23.340>privacy <00:24:23.496>that <00:24:23.651>you're <00:24:23.807>used <00:24:23.962>to <00:24:24.118>when <00:24:24.273>leveraging <00:24:24.429>um, <00:24:24.585>AWS

521
00:24:27.185 --> 00:24:29.245
<00:24:27.185>and <00:24:27.465>finally, <00:24:27.745>human <00:24:28.024>in <00:24:28.304>the <00:24:28.585>loop.

522
00:24:29.595 --> 00:24:32.925
<00:24:29.595>When <00:24:29.770>we're <00:24:29.945>using <00:24:30.120>this <00:24:30.295>solution, <00:24:30.470>we're <00:24:30.645>testing <00:24:30.820>it <00:24:30.995>out.

523
00:24:32.925 --> 00:24:34.525
<00:24:32.925>We're <00:24:33.158>ensuring <00:24:33.391>we <00:24:33.625>have <00:24:33.858>the <00:24:34.091>right <00:24:34.325>guardrails.

524
00:24:34.525 --> 00:24:36.045
<00:24:34.525>We're <00:24:34.798>testing <00:24:35.072>our <00:24:35.345>prompts. <00:24:35.619>We're <00:24:35.893>ensuring

525
00:24:36.045 --> 00:24:37.925
<00:24:36.045>that <00:24:36.220>if <00:24:36.395>we're <00:24:36.570>building <00:24:36.745>this <00:24:36.920>out <00:24:37.095>for <00:24:37.270>our <00:24:37.445>sales

526
00:24:37.925 --> 00:24:40.965
<00:24:37.925>or <00:24:38.080>our <00:24:38.236>teams, <00:24:38.391>that <00:24:38.547>the <00:24:38.702>model <00:24:38.858>is <00:24:39.013>gonna <00:24:39.169>help <00:24:39.325>enable

527
00:24:40.995 --> 00:24:42.405
<00:24:40.995>them <00:24:41.418>to <00:24:41.841>accelerate <00:24:42.264>learning.

528
00:24:46.065 --> 00:24:48.085
<00:24:46.065>Now, <00:24:46.298>I <00:24:46.531>mentioned <00:24:46.765>we're <00:24:46.998>using <00:24:47.231>Amazon <00:24:47.465>Bedrock.

529
00:24:48.145 --> 00:24:50.325
<00:24:48.145>Amazon <00:24:48.378>Bedrock <00:24:48.611>comes <00:24:48.845>with <00:24:49.078>built <00:24:49.311>in <00:24:49.545>security

530
00:24:50.385 --> 00:24:51.725
<00:24:50.385>and <00:24:50.988>govern <00:24:51.591>governance.

531
00:24:51.945 --> 00:24:54.525
<00:24:51.945>So <00:24:52.085>it <00:24:52.225>has <00:24:52.365>all <00:24:52.504>the <00:24:52.645>team <00:24:52.784>tools <00:24:52.925>you <00:24:53.064>need <00:24:53.205>to <00:24:53.345>ensure

532
00:24:54.635 --> 00:24:57.485
<00:24:54.635>that <00:24:54.790>you <00:24:54.946>have <00:24:55.101>the <00:24:55.257>privacy <00:24:55.412>and <00:24:55.568>security <00:24:55.723>that <00:24:55.879>you <00:24:56.035>need

533
00:24:57.505 --> 00:24:59.005
<00:24:57.505>for <00:24:57.842>your <00:24:58.180>general <00:24:58.517>AI <00:24:58.855>applications.

534
00:24:59.545 --> 00:25:01.965
<00:24:59.545>For <00:24:59.745>example, <00:24:59.945>let's <00:25:00.145>say <00:25:00.345>you <00:25:00.545>have <00:25:00.745>a <00:25:00.945>compliance

535
00:25:02.265 --> 00:25:05.445
<00:25:02.265>or <00:25:02.615>security <00:25:02.965>requirement <00:25:03.315>in <00:25:03.665>place

536
00:25:05.455 --> 00:25:08.725
<00:25:05.455>where <00:25:05.629>you <00:25:05.804>can <00:25:05.980>only <00:25:06.155>access <00:25:06.330>large <00:25:06.504>language <00:25:06.679>models <00:25:06.855>privately,

537
00:25:08.725 --> 00:25:10.125
<00:25:08.725>meaning <00:25:09.040>not <00:25:09.355>over <00:25:09.670>the <00:25:09.985>internet.

538
00:25:10.385 --> 00:25:13.005
<00:25:10.385>So <00:25:10.560>what <00:25:10.735>you <00:25:10.910>could <00:25:11.085>actually <00:25:11.260>leverage <00:25:11.435>is <00:25:11.610>private <00:25:11.785>link

539
00:25:13.385 --> 00:25:17.045
<00:25:13.385>to <00:25:13.560>provide <00:25:13.735>a <00:25:13.910>secure, <00:25:14.085>secure <00:25:14.260>connectivity <00:25:14.435>from <00:25:14.610>your <00:25:14.785>VPCs

540
00:25:17.145 --> 00:25:19.085
<00:25:17.145>to <00:25:17.611>Amazon <00:25:18.078>Bedrock, <00:25:18.545>bedrock,

541
00:25:19.305 --> 00:25:22.045
<00:25:19.305>and <00:25:19.538>send <00:25:19.771>inference <00:25:20.005>over <00:25:20.238>through <00:25:20.471>your <00:25:20.705>VPC,

542
00:25:22.045 --> 00:25:24.405
<00:25:22.045>the <00:25:22.395>private <00:25:22.745>connection <00:25:23.095>without <00:25:23.445>having

543
00:25:24.405 --> 00:25:25.645
<00:25:24.405>to <00:25:24.591>worry <00:25:24.777>about <00:25:24.963>going <00:25:25.149>over <00:25:25.335>the <00:25:25.521>internet.

544
00:25:28.265 --> 00:25:30.565
<00:25:28.265>Now, <00:25:28.465>before <00:25:28.665>we <00:25:28.865>go, <00:25:29.065>let's <00:25:29.265>talk <00:25:29.465>about <00:25:29.665>some

545
00:25:30.565 --> 00:25:33.485
<00:25:30.565>of <00:25:30.740>the <00:25:30.915>best <00:25:31.090>practices <00:25:31.265>to <00:25:31.440>build <00:25:31.615>gender <00:25:31.790>AI <00:25:31.965>responsibility.

546
00:25:34.385 --> 00:25:36.565
<00:25:34.385>The <00:25:34.512>first <00:25:34.639>thing <00:25:34.766>we <00:25:34.894>need <00:25:35.021>to <00:25:35.148>do <00:25:35.275>is <00:25:35.403>define <00:25:35.530>our <00:25:35.657>use <00:25:35.785>cases.

547
00:25:37.305 --> 00:25:39.445
<00:25:37.305>The <00:25:37.538>more <00:25:37.771>narrow <00:25:38.005>the <00:25:38.238>scope, <00:25:38.471>the <00:25:38.705>better.

548
00:25:40.595 --> 00:25:43.525
<00:25:40.595>Also, <00:25:40.828>we <00:25:41.061>shouldn't <00:25:41.295>be <00:25:41.528>blocking <00:25:41.761>generative <00:25:41.995>ai.

549
00:25:44.545 --> 00:25:48.365
<00:25:44.545>We <00:25:44.672>should <00:25:44.799>be <00:25:44.926>figuring <00:25:45.054>out <00:25:45.181>how <00:25:45.308>to <00:25:45.435>train <00:25:45.563>our <00:25:45.690>teams, <00:25:45.817>our <00:25:45.945>users,

550
00:25:48.825 --> 00:25:51.405
<00:25:48.825>to <00:25:48.980>be <00:25:49.136>able <00:25:49.291>to <00:25:49.447>leverage <00:25:49.602>generative <00:25:49.758>AI <00:25:49.913>in <00:25:50.069>our <00:25:50.225>workplace.

551
00:25:51.875 --> 00:25:55.205
<00:25:51.875>Because <00:25:52.015>it's <00:25:52.155>a <00:25:52.295>tool <00:25:52.435>just <00:25:52.575>like <00:25:52.715>every <00:25:52.855>other <00:25:52.995>tool <00:25:53.135>like <00:25:53.275>Google

552
00:25:55.205 --> 00:25:57.325
<00:25:55.205>Search <00:25:55.379>and <00:25:55.554>all <00:25:55.730>these <00:25:55.905>other <00:25:56.080>tools <00:25:56.254>that <00:25:56.429>came <00:25:56.605>along,

553
00:25:58.145 --> 00:25:59.325
<00:25:58.145>we <00:25:58.410>should <00:25:58.676>figure <00:25:58.941>out, <00:25:59.207>okay,

554
00:25:59.505 --> 00:26:01.325
<00:25:59.505>how <00:25:59.738>can <00:25:59.971>we <00:26:00.205>implement <00:26:00.438>the <00:26:00.671>PRI <00:26:00.905>privacy

555
00:26:01.465 --> 00:26:02.965
<00:26:01.465>and <00:26:01.802>security <00:26:02.139>that <00:26:02.477>we <00:26:02.814>need?

556
00:26:07.085 --> 00:26:10.905
<00:26:07.085>Now, <00:26:07.285>some <00:26:07.485>key <00:26:07.685>takeaways, <00:26:07.885>build <00:26:08.085>on <00:26:08.285>your <00:26:08.485>foundation.

557
00:26:11.695 --> 00:26:16.375
<00:26:11.695>Embrace <00:26:11.928>AI <00:26:12.161>as <00:26:12.395>a <00:26:12.628>learning <00:26:12.861>companion, <00:26:13.095>Customize

558
00:26:16.395 --> 00:26:18.255
<00:26:16.395>for <00:26:16.675>context, <00:26:16.955>use <00:26:17.235>things <00:26:17.514>like <00:26:17.795>rad.

559
00:26:18.635 --> 00:26:21.375
<00:26:18.635>Im <00:26:18.835>prompt <00:26:19.035>engineering, <00:26:19.235>fine <00:26:19.435>tuning <00:26:19.635>to <00:26:19.835>be <00:26:20.035>able

560
00:26:21.375 --> 00:26:22.655
<00:26:21.375>to <00:26:21.605>help <00:26:21.835>you <00:26:22.066>accelerate <00:26:22.296>your <00:26:22.527>learning.

561
00:26:23.275 --> 00:26:25.415
<00:26:23.275>pri <00:26:23.625>prioritize <00:26:23.975>accuracy <00:26:24.325>and <00:26:24.675>security

562
00:26:26.035 --> 00:26:27.135
<00:26:26.035>and <00:26:26.365>collaborate <00:26:26.695>and <00:26:27.025>share.

563
00:26:27.155 --> 00:26:28.495
<00:26:27.155>We <00:26:27.396>are <00:26:27.637>at <00:26:27.878>we, <00:26:28.119>we <00:26:28.360>are.

564
00:26:28.795 --> 00:26:30.375
<00:26:28.795>We <00:26:29.075>are <00:26:29.355>at, <00:26:29.635>we <00:26:29.915>are <00:26:30.195>developers,

565
00:26:30.475 --> 00:26:31.935
<00:26:30.475>and <00:26:30.694>we <00:26:30.913>should <00:26:31.131>collaborate <00:26:31.351>while <00:26:31.570>we're <00:26:31.789>here

566
00:26:32.355 --> 00:26:33.535
<00:26:32.355>and <00:26:32.886>share <00:26:33.417>information.

567
00:26:33.955 --> 00:26:35.895
<00:26:33.955>And <00:26:34.421>finally, <00:26:34.888>technology <00:26:35.355>is

568
00:26:35.895 --> 00:26:37.215
<00:26:35.895>always <00:26:36.192>changing <00:26:36.489>and <00:26:36.785>always <00:26:37.082>evolving.

569
00:26:37.515 --> 00:26:40.535
<00:26:37.515>We <00:26:37.715>should <00:26:37.915>stay <00:26:38.115>adaptable. <00:26:38.315>That <00:26:38.515>completes <00:26:38.715>my <00:26:38.915>presentation.

570
00:26:41.155 --> 00:26:42.255
<00:26:41.155>All <00:26:41.485>of <00:26:41.815>the <00:26:42.145>slides

571
00:26:42.635 --> 00:26:44.135
<00:26:42.635>and <00:26:42.972>the <00:26:43.310>code <00:26:43.647>are <00:26:43.985>available

572
00:26:44.275 --> 00:26:46.015
<00:26:44.275>for <00:26:44.475>download <00:26:44.675>if <00:26:44.875>you <00:26:45.075>scan <00:26:45.275>the <00:26:45.475>QR <00:26:45.675>code.

573
00:26:46.315 --> 00:26:47.455
<00:26:46.315>My <00:26:46.571>name <00:26:46.828>is <00:26:47.084>Dewan <00:26:47.341>Lightfoot.

574
00:26:47.455 --> 00:26:49.375
<00:26:47.455>Feel <00:26:47.629>free <00:26:47.804>to <00:26:47.980>connect <00:26:48.155>with <00:26:48.330>me <00:26:48.504>at <00:26:48.679>lab <00:26:48.855>every

575
00:26:49.395 --> 00:26:50.575
<00:26:49.395>day <00:26:49.660>on <00:26:49.926>all <00:26:50.191>social <00:26:50.457>media.

576
00:26:50.865 --> 00:26:51.295
<00:26:50.865>Thank <00:26:51.252>you.