WEBVTT

1
00:00:02.635 --> 00:00:04.485
<00:00:02.635>That <00:00:02.914>is <00:00:03.195>a <00:00:03.474>very <00:00:03.755>cool <00:00:04.035>intro.

2
00:00:04.485 --> 00:00:08.365
<00:00:04.485>Thank <00:00:04.625>you <00:00:04.765>guys. <00:00:04.905>Um, <00:00:05.045>I <00:00:05.185>just <00:00:05.325>wanna <00:00:05.465>say <00:00:05.605>welcome <00:00:05.745>everybody <00:00:05.885>to,

3
00:00:08.825 --> 00:00:10.645
<00:00:08.825>uh, <00:00:09.000>what <00:00:09.174>I <00:00:09.350>believe <00:00:09.524>is <00:00:09.700>gonna <00:00:09.875>be <00:00:10.049>a <00:00:10.225>very

4
00:00:11.325 --> 00:00:12.445
<00:00:11.325>exciting <00:00:11.829>hands-on <00:00:12.333>session.

5
00:00:13.025 --> 00:00:14.485
<00:00:13.025>Uh, <00:00:13.287>my <00:00:13.550>name <00:00:13.813>is <00:00:14.076>Cedric <00:00:14.338>Clyburn.

6
00:00:14.725 --> 00:00:16.605
<00:00:14.725>I <00:00:14.924>am <00:00:15.125>a <00:00:15.325>developer <00:00:15.525>advocate <00:00:15.725>at <00:00:15.924>Red <00:00:16.125>Hat,

7
00:00:16.605 --> 00:00:19.845
<00:00:16.605>and <00:00:16.745>I, <00:00:16.885>I've <00:00:17.025>got <00:00:17.165>a <00:00:17.305>lot <00:00:17.445>in <00:00:17.585>store <00:00:17.725>for <00:00:17.865>you <00:00:18.005>today.

8
00:00:19.905 --> 00:00:21.525
<00:00:19.905>So <00:00:20.138>we're <00:00:20.371>gonna <00:00:20.605>be <00:00:20.838>talking <00:00:21.071>about <00:00:21.305>how

9
00:00:21.525 --> 00:00:24.605
<00:00:21.525>to <00:00:21.758>practically <00:00:21.991>integrate <00:00:22.224>generative <00:00:22.458>AI <00:00:22.691>into <00:00:22.924>your

10
00:00:24.605 --> 00:00:28.085
<00:00:24.605>applications, <00:00:24.760>uh, <00:00:24.916>working <00:00:25.071>in <00:00:25.227>a <00:00:25.382>cloud <00:00:25.538>native <00:00:25.693>way, <00:00:25.849>so, <00:00:26.005>uh,

11
00:00:28.085 --> 00:00:30.725
<00:00:28.085>working <00:00:28.285>with <00:00:28.485>containers <00:00:28.685>and <00:00:28.885>then <00:00:29.085>taking <00:00:29.285>those <00:00:29.485>containers

12
00:00:30.725 --> 00:00:32.605
<00:00:30.725>and, <00:00:30.958>and <00:00:31.191>deploying <00:00:31.425>to <00:00:31.658>a <00:00:31.891>Kubernetes <00:00:32.125>environment.

13
00:00:32.605 --> 00:00:34.525
<00:00:32.604>So <00:00:32.805>we're <00:00:33.004>going <00:00:33.205>to <00:00:33.404>have <00:00:33.605>some <00:00:33.805>Python <00:00:34.004>examples.

14
00:00:34.525 --> 00:00:35.805
<00:00:34.525>We've <00:00:34.813>got <00:00:35.101>some <00:00:35.388>Java <00:00:35.677>examples.

15
00:00:36.185 --> 00:00:40.005
<00:00:36.185>Any <00:00:36.385>Python <00:00:36.585>or <00:00:36.785>Java <00:00:36.985>developers <00:00:37.185>here. <00:00:37.385>Sweet. <00:00:37.585>Okay.

16
00:00:40.005 --> 00:00:42.525
<00:00:40.005>Alright, <00:00:40.132>perfect. <00:00:40.259>So <00:00:40.386>we've <00:00:40.514>got <00:00:40.641>a <00:00:40.768>lot <00:00:40.895>in <00:00:41.023>store <00:00:41.150>for <00:00:41.277>you <00:00:41.405>today,

17
00:00:42.665 --> 00:00:45.045
<00:00:42.665>and <00:00:42.820>I'm <00:00:42.976>gonna <00:00:43.131>have <00:00:43.287>the <00:00:43.442>source <00:00:43.598>code <00:00:43.753>for <00:00:43.909>the <00:00:44.065>demos.

18
00:00:45.065 --> 00:00:47.685
<00:00:45.065>I'm <00:00:45.298>doing <00:00:45.531>slides <00:00:45.765>resources <00:00:45.998>at <00:00:46.231>the <00:00:46.464>end.

19
00:00:47.745 --> 00:00:49.205
<00:00:47.745>So <00:00:47.964>if <00:00:48.183>you <00:00:48.402>want <00:00:48.620>to <00:00:48.839>check <00:00:49.059>out

20
00:00:49.205 --> 00:00:51.765
<00:00:49.205>what <00:00:49.345>I <00:00:49.485>did <00:00:49.625>follow <00:00:49.765>along <00:00:49.905>later, <00:00:50.045>feel <00:00:50.184>free <00:00:50.324>to <00:00:50.464>do <00:00:50.605>so.

21
00:00:51.765 --> 00:00:53.605
<00:00:51.765>We're <00:00:51.905>gonna <00:00:52.045>be <00:00:52.185>using <00:00:52.325>a <00:00:52.465>lot <00:00:52.605>of <00:00:52.745>different <00:00:52.885>open <00:00:53.025>source <00:00:53.165>tools

22
00:00:53.605 --> 00:00:57.005
<00:00:53.605>and <00:00:53.779>technologies <00:00:53.955>to <00:00:54.129>make <00:00:54.305>this <00:00:54.480>generative <00:00:54.654>AI <00:00:54.830>magic <00:00:55.004>work.

23
00:00:57.425 --> 00:01:00.485
<00:00:57.425>Um, <00:00:57.552>but <00:00:57.679>I <00:00:57.806>just <00:00:57.934>want <00:00:58.061>to <00:00:58.188>understand <00:00:58.315>you <00:00:58.443>guys <00:00:58.570>real <00:00:58.697>quick, <00:00:58.824>uh,

24
00:01:00.665 --> 00:01:01.885
<00:01:00.665>did <00:01:00.848>you <00:01:01.031>come <00:01:01.214>to <00:01:01.397>this <00:01:01.580>session, <00:01:01.763>perhaps

25
00:01:01.885 --> 00:01:04.685
<00:01:01.885>because <00:01:02.085>you <00:01:02.285>work <00:01:02.485>with <00:01:02.684>containers <00:01:02.885>or <00:01:03.085>Kubernetes <00:01:03.285>and,

26
00:01:04.685 --> 00:01:05.845
<00:01:04.685>and <00:01:04.893>you're <00:01:05.102>interested <00:01:05.311>in <00:01:05.520>that <00:01:05.729>part?

27
00:01:07.075 --> 00:01:09.885
<00:01:07.075>Cool. <00:01:07.202>Okay. <00:01:07.329>Maybe <00:01:07.456>did <00:01:07.584>you <00:01:07.711>come <00:01:07.838>to <00:01:07.965>the <00:01:08.093>session <00:01:08.220>to <00:01:08.347>learn <00:01:08.475>about

28
00:01:10.075 --> 00:01:11.445
<00:01:10.075>what <00:01:10.383>open <00:01:10.691>source <00:01:10.999>AI <00:01:11.308>means

29
00:01:11.445 --> 00:01:14.085
<00:01:11.445>and <00:01:11.678>how <00:01:11.911>to <00:01:12.145>deploy <00:01:12.378>these <00:01:12.611>models, <00:01:12.845>perhaps?

30
00:01:15.035 --> 00:01:17.405
<00:01:15.035>Okay, <00:01:15.190>cool. <00:01:15.346>And <00:01:15.501>then <00:01:15.657>how <00:01:15.812>many <00:01:15.968>of <00:01:16.123>us <00:01:16.279>are <00:01:16.435>developers?

31
00:01:19.075 --> 00:01:20.605
<00:01:19.075>Okay, <00:01:19.419>sweet. <00:01:19.763>I <00:01:20.107>love <00:01:20.452>it.

32
00:01:20.605 --> 00:01:21.845
<00:01:20.605>That's <00:01:20.791>what <00:01:20.977>I <00:01:21.163>love <00:01:21.349>about <00:01:21.535>this <00:01:21.721>conference.

33
00:01:21.845 --> 00:01:24.485
<00:01:21.845>Any <00:01:22.311>operations <00:01:22.778>folks? <00:01:23.245>Okay,

34
00:01:24.605 --> 00:01:25.765
<00:01:24.605>I <00:01:24.754>got <00:01:24.903>some <00:01:25.052>stuff <00:01:25.201>for <00:01:25.350>you <00:01:25.499>guys <00:01:25.649>too.

35
00:01:26.465 --> 00:01:29.525
<00:01:26.465>Um, <00:01:26.620>but <00:01:26.776>with <00:01:26.931>the <00:01:27.087>next <00:01:27.242>28 <00:01:27.398>minutes, <00:01:27.553>let's <00:01:27.709>go <00:01:27.865>ahead.

36
00:01:29.585 --> 00:01:32.205
<00:01:29.585>And <00:01:29.725>I <00:01:29.865>just <00:01:30.005>really <00:01:30.145>want <00:01:30.285>to <00:01:30.425>level <00:01:30.565>set <00:01:30.705>really <00:01:30.845>quickly <00:01:30.985>about

37
00:01:32.205 --> 00:01:34.805
<00:01:32.205>what <00:01:32.380>it <00:01:32.554>means <00:01:32.730>to <00:01:32.905>build <00:01:33.080>applications <00:01:33.255>with <00:01:33.429>generative <00:01:33.605>ai,

38
00:01:34.805 --> 00:01:37.645
<00:01:34.805>because <00:01:35.038>I'm <00:01:35.271>specifically <00:01:35.505>talking <00:01:35.738>about <00:01:35.971>building, <00:01:36.205>testing

39
00:01:37.785 --> 00:01:40.165
<00:01:37.785>and <00:01:37.985>deploying <00:01:38.185>these <00:01:38.384>applications <00:01:38.585>that <00:01:38.785>are <00:01:38.985>using <00:01:39.185>models

40
00:01:40.265 --> 00:01:42.645
<00:01:40.265>to <00:01:40.440>either <00:01:40.615>take <00:01:40.790>a <00:01:40.965>large <00:01:41.140>amount <00:01:41.315>of <00:01:41.490>information <00:01:41.665>in

41
00:01:42.705 --> 00:01:46.445
<00:01:42.705>and <00:01:42.821>produce <00:01:42.938>a <00:01:43.054>output <00:01:43.171>or <00:01:43.288>to <00:01:43.405>work <00:01:43.521>with <00:01:43.638>a <00:01:43.755>prompt, <00:01:43.871>uh, <00:01:43.988>and, <00:01:44.105>and,

42
00:01:46.585 --> 00:01:48.885
<00:01:46.585>and <00:01:46.785>create <00:01:46.985>new <00:01:47.185>information, <00:01:47.385>new <00:01:47.585>text, <00:01:47.785>new <00:01:47.985>content.

43
00:01:49.275 --> 00:01:52.725
<00:01:49.275>Because <00:01:49.475>generative <00:01:49.675>AI <00:01:49.875>is <00:01:50.075>in <00:01:50.275>the <00:01:50.475>past <00:01:50.675>year,

44
00:01:52.725 --> 00:01:54.365
<00:01:52.725>changed <00:01:53.191>so <00:01:53.658>much, <00:01:54.125>right?

45
00:01:54.615 --> 00:01:56.245
<00:01:54.615>Since <00:01:55.315>chat, <00:01:56.015>GPT

46
00:01:56.245 --> 00:01:58.765
<00:01:56.245>and <00:01:56.420>other <00:01:56.595>popular <00:01:56.770>models <00:01:56.945>have <00:01:57.120>came <00:01:57.295>out, <00:01:57.470>uh, <00:01:57.645>us

47
00:01:58.765 --> 00:02:01.445
<00:01:58.765>as <00:01:58.965>developers <00:01:59.165>have <00:01:59.365>had <00:01:59.565>a <00:01:59.765>really <00:01:59.965>exciting <00:02:00.165>opportunity

48
00:02:01.465 --> 00:02:03.285
<00:02:01.465>to <00:02:01.698>start <00:02:01.931>using <00:02:02.165>these <00:02:02.398>models <00:02:02.631>as <00:02:02.865>APIs.

49
00:02:03.285 --> 00:02:05.205
<00:02:03.285>And <00:02:03.440>we're <00:02:03.596>gonna <00:02:03.751>talk <00:02:03.907>about <00:02:04.062>how <00:02:04.218>you <00:02:04.373>realistically <00:02:04.529>do <00:02:04.685>that

50
00:02:05.205 --> 00:02:06.445
<00:02:05.205>with <00:02:05.577>Lang <00:02:05.949>Chain, <00:02:06.321>um,

51
00:02:06.545 --> 00:02:08.805
<00:02:06.545>and <00:02:06.720>a <00:02:06.895>variety <00:02:07.070>of <00:02:07.245>other <00:02:07.420>patterns <00:02:07.595>to <00:02:07.770>create <00:02:07.945>really,

52
00:02:09.185 --> 00:02:12.605
<00:02:09.185>really <00:02:09.384>cool, <00:02:09.585>useful, <00:02:09.785>uh, <00:02:09.985>enterprise <00:02:10.185>applications, <00:02:10.384>as <00:02:10.585>well

53
00:02:12.605 --> 00:02:13.805
<00:02:12.605>as <00:02:12.965>some <00:02:13.325>fun <00:02:13.685>examples

54
00:02:13.805 --> 00:02:15.365
<00:02:13.805>that <00:02:14.005>we're <00:02:14.205>gonna <00:02:14.405>show <00:02:14.605>with <00:02:14.805>these <00:02:15.005>AI <00:02:15.205>models.

55
00:02:15.825 --> 00:02:18.285
<00:02:15.825>Um, <00:02:15.964>but <00:02:16.105>you <00:02:16.244>might <00:02:16.385>have <00:02:16.524>already <00:02:16.665>been <00:02:16.804>using <00:02:16.945>tools <00:02:17.084>like <00:02:17.225>GitHub,

56
00:02:18.475 --> 00:02:21.645
<00:02:18.475>copilot, <00:02:18.674>um, <00:02:18.875>like <00:02:19.075>o <00:02:19.275>Lama, <00:02:19.475>any <00:02:19.674>other <00:02:19.875>tool

57
00:02:21.705 --> 00:02:23.325
<00:02:21.704>to <00:02:21.984>run <00:02:22.265>a <00:02:22.545>model <00:02:22.825>locally <00:02:23.105>so

58
00:02:23.325 --> 00:02:24.725
<00:02:23.325>that <00:02:23.505>you <00:02:23.685>can <00:02:23.864>integrate <00:02:24.045>it <00:02:24.225>into <00:02:24.405>your <00:02:24.584>application.

59
00:02:24.725 --> 00:02:27.365
<00:02:24.725>And <00:02:24.841>if <00:02:24.958>you <00:02:25.075>haven't <00:02:25.191>yet, <00:02:25.308>we're <00:02:25.424>gonna <00:02:25.541>show <00:02:25.658>how <00:02:25.775>you <00:02:25.891>can <00:02:26.008>do <00:02:26.125>all

60
00:02:27.365 --> 00:02:28.405
<00:02:27.365>of <00:02:27.552>that <00:02:27.739>from <00:02:27.926>my <00:02:28.113>system <00:02:28.301>here.

61
00:02:28.705 --> 00:02:31.045
<00:02:28.704>And <00:02:28.880>if <00:02:29.054>you're <00:02:29.230>not <00:02:29.404>already <00:02:29.579>working <00:02:29.755>with <00:02:29.929>generative <00:02:30.105>ai,

62
00:02:31.245 --> 00:02:33.845
<00:02:31.245>I <00:02:31.400>think, <00:02:31.556>uh, <00:02:31.711>we're <00:02:31.867>gonna <00:02:32.022>start <00:02:32.178>seeing <00:02:32.333>it <00:02:32.489>even <00:02:32.645>more.

63
00:02:33.845 --> 00:02:35.285
<00:02:33.845>Gartner <00:02:34.277>says <00:02:34.709>that <00:02:35.141>80%

64
00:02:35.285 --> 00:02:37.125
<00:02:35.285>of <00:02:35.518>enterprises <00:02:35.751>are <00:02:35.984>gonna <00:02:36.218>have <00:02:36.451>some <00:02:36.685>type

65
00:02:37.125 --> 00:02:39.765
<00:02:37.125>of <00:02:37.358>generative <00:02:37.591>AI <00:02:37.825>capabilities <00:02:38.058>in <00:02:38.291>their <00:02:38.525>applications.

66
00:02:39.765 --> 00:02:42.485
<00:02:39.765>So <00:02:39.881>the <00:02:39.998>big <00:02:40.114>question <00:02:40.231>I <00:02:40.348>have <00:02:40.464>for <00:02:40.581>you <00:02:40.698>is <00:02:40.815>how <00:02:40.931>are <00:02:41.048>you <00:02:41.165>going

67
00:02:42.485 --> 00:02:46.165
<00:02:42.485>to <00:02:42.660>learn <00:02:42.835>and <00:02:43.010>apply <00:02:43.185>generative <00:02:43.360>AI <00:02:43.535>into <00:02:43.710>your <00:02:43.885>applications

68
00:02:46.305 --> 00:02:47.525
<00:02:46.305>and <00:02:46.671>into <00:02:47.037>your <00:02:47.403>solutions?

69
00:02:47.905 --> 00:02:51.805
<00:02:47.905>So <00:02:48.012>this <00:02:48.120>brings <00:02:48.228>me <00:02:48.335>to <00:02:48.443>this <00:02:48.551>kind <00:02:48.658>of <00:02:48.766>slide <00:02:48.874>that <00:02:48.981>I <00:02:49.089>wanna <00:02:49.197>show <00:02:49.305>of

70
00:02:51.805 --> 00:02:55.365
<00:02:51.805>how <00:02:51.960>do <00:02:52.116>we <00:02:52.271>illustrate <00:02:52.427>the <00:02:52.582>AI <00:02:52.738>journey <00:02:52.893>for <00:02:53.049>an <00:02:53.205>enterprise,

71
00:02:55.385 --> 00:02:57.125
<00:02:55.385>but <00:02:55.665>also <00:02:55.945>for <00:02:56.225>us <00:02:56.505>as <00:02:56.785>developers?

72
00:02:57.185 --> 00:03:00.125
<00:02:57.185>How <00:02:57.340>do <00:02:57.496>we <00:02:57.651>actually <00:02:57.807>take <00:02:57.962>all <00:02:58.118>of <00:02:58.273>these <00:02:58.429>different <00:02:58.585>steps

73
00:03:00.125 --> 00:03:03.325
<00:03:00.125>that <00:03:00.265>we <00:03:00.405>need <00:03:00.545>to <00:03:00.685>think <00:03:00.825>about <00:03:00.965>when <00:03:01.105>working <00:03:01.245>with <00:03:01.385>AI <00:03:01.525>models

74
00:03:03.385 --> 00:03:04.565
<00:03:03.385>and <00:03:03.739>simplify <00:03:04.093>this, <00:03:04.447>right?

75
00:03:04.985 --> 00:03:06.645
<00:03:04.985>Um, <00:03:05.185>so <00:03:05.385>I <00:03:05.585>kind <00:03:05.785>of <00:03:05.985>wanna <00:03:06.185>break <00:03:06.385>down

76
00:03:06.645 --> 00:03:08.765
<00:03:06.645>what <00:03:06.820>we're <00:03:06.995>gonna <00:03:07.170>be <00:03:07.345>talking <00:03:07.520>about <00:03:07.695>in <00:03:07.870>today's <00:03:08.045>demo

77
00:03:09.245 --> 00:03:11.565
<00:03:09.245>specifically, <00:03:09.525>uh, <00:03:09.805>starting <00:03:10.085>from <00:03:10.365>the <00:03:10.645>ideation

78
00:03:11.565 --> 00:03:12.565
<00:03:11.565>and <00:03:12.015>prototyping <00:03:12.465>phase.

79
00:03:12.595 --> 00:03:14.725
<00:03:12.595>When <00:03:12.795>you <00:03:12.995>have <00:03:13.195>the <00:03:13.395>need <00:03:13.595>to <00:03:13.795>start <00:03:13.995>working

80
00:03:14.725 --> 00:03:16.685
<00:03:14.725>with <00:03:15.075>AI <00:03:15.424>in <00:03:15.775>your <00:03:16.125>applications,

81
00:03:16.705 --> 00:03:20.405
<00:03:16.704>and <00:03:16.844>you <00:03:16.984>need <00:03:17.124>to <00:03:17.265>start <00:03:17.404>working <00:03:17.545>with, <00:03:17.684>uh, <00:03:17.825>uh, <00:03:17.964>the <00:03:18.105>models

82
00:03:20.405 --> 00:03:22.605
<00:03:20.405>that <00:03:20.605>you <00:03:20.805>might <00:03:21.005>have <00:03:21.205>from <00:03:21.405>hugging <00:03:21.605>face, <00:03:21.805>uh,

83
00:03:22.605 --> 00:03:24.765
<00:03:22.605>right <00:03:22.885>now <00:03:23.165>there's <00:03:23.445>over <00:03:23.725>700,000 <00:03:24.005>models

84
00:03:24.835 --> 00:03:26.165
<00:03:24.835>that <00:03:25.134>are <00:03:25.433>on <00:03:25.732>that <00:03:26.031>repository.

85
00:03:26.225 --> 00:03:28.125
<00:03:26.225>So <00:03:26.380>how <00:03:26.536>do <00:03:26.691>you <00:03:26.847>kind <00:03:27.002>of <00:03:27.158>understand <00:03:27.313>which <00:03:27.469>one <00:03:27.625>is

86
00:03:28.175 --> 00:03:29.405
<00:03:28.175>right <00:03:28.451>for <00:03:28.728>your <00:03:29.005>use <00:03:29.282>case?

87
00:03:29.465 --> 00:03:32.405
<00:03:29.465>Are <00:03:29.605>you <00:03:29.745>gonna <00:03:29.885>be <00:03:30.025>working <00:03:30.165>with <00:03:30.305>text, <00:03:30.445>image, <00:03:30.585>audio, <00:03:30.725>et <00:03:30.865>cetera?

88
00:03:32.465 --> 00:03:35.005
<00:03:32.465>How <00:03:32.605>are <00:03:32.745>we <00:03:32.885>gonna <00:03:33.025>benchmark <00:03:33.165>these <00:03:33.305>models <00:03:33.445>to <00:03:33.585>see <00:03:33.725>which <00:03:33.865>one,

89
00:03:35.545 --> 00:03:39.005
<00:03:35.545>uh, <00:03:35.700>might <00:03:35.856>perform <00:03:36.011>better <00:03:36.167>for <00:03:36.322>our <00:03:36.478>specific <00:03:36.633>use <00:03:36.789>case, <00:03:36.945>um,

90
00:03:39.305 --> 00:03:40.925
<00:03:39.305>and <00:03:39.538>kind <00:03:39.771>of <00:03:40.005>experiment <00:03:40.238>with <00:03:40.471>our <00:03:40.705>data?

91
00:03:40.985 --> 00:03:42.965
<00:03:40.985>So <00:03:41.125>we're <00:03:41.265>gonna <00:03:41.405>learn <00:03:41.545>about <00:03:41.685>how <00:03:41.825>you <00:03:41.965>can <00:03:42.105>do <00:03:42.245>that <00:03:42.385>locally,

92
00:03:43.385 --> 00:03:45.525
<00:03:43.385>but <00:03:43.560>also <00:03:43.734>the <00:03:43.910>main <00:03:44.084>part <00:03:44.260>I <00:03:44.435>want <00:03:44.609>to <00:03:44.785>kind

93
00:03:45.525 --> 00:03:48.445
<00:03:45.525>of <00:03:45.700>talk <00:03:45.875>about <00:03:46.050>is <00:03:46.225>building <00:03:46.400>applications <00:03:46.575>with <00:03:46.750>generative <00:03:46.925>ai.

94
00:03:48.505 --> 00:03:52.045
<00:03:48.505>So <00:03:48.644>once <00:03:48.785>we <00:03:48.924>have <00:03:49.065>a <00:03:49.204>model <00:03:49.345>selected, <00:03:49.484>whether <00:03:49.625>it's <00:03:49.765>open <00:03:49.905>source,

95
00:03:52.045 --> 00:03:53.965
<00:03:52.045>whether <00:03:52.325>it's <00:03:52.605>hosted <00:03:52.885>with, <00:03:53.165>uh, <00:03:53.445>Claude

96
00:03:53.965 --> 00:03:56.725
<00:03:53.965>or <00:03:54.165>Chat <00:03:54.365>GBT, <00:03:54.565>how <00:03:54.765>do <00:03:54.965>we <00:03:55.165>actually <00:03:55.365>operation

97
00:03:56.785 --> 00:04:00.685
<00:03:56.785>or <00:03:56.924>put <00:03:57.065>this <00:03:57.204>into <00:03:57.345>our <00:03:57.484>application <00:03:57.625>using <00:03:57.765>patterns <00:03:57.905>such <00:03:58.045>as <00:03:58.185>RAG

98
00:04:00.685 --> 00:04:03.045
<00:04:00.685>to <00:04:00.860>work <00:04:01.035>with <00:04:01.210>more <00:04:01.385>information <00:04:01.560>to <00:04:01.735>enhance <00:04:01.910>the <00:04:02.085>model?

99
00:04:03.505 --> 00:04:06.965
<00:04:03.505>Um, <00:04:03.605>do <00:04:03.704>we <00:04:03.805>work <00:04:03.905>with, <00:04:04.005>uh, <00:04:04.105>fine <00:04:04.204>tuning <00:04:04.305>in <00:04:04.405>a, <00:04:04.505>in <00:04:04.605>a <00:04:04.704>in <00:04:04.805>a <00:04:04.905>way

100
00:04:07.065 --> 00:04:09.165
<00:04:07.065>to <00:04:07.265>specify <00:04:07.465>the <00:04:07.665>model <00:04:07.865>for <00:04:08.065>our <00:04:08.265>use <00:04:08.465>case?

101
00:04:09.385 --> 00:04:10.405
<00:04:09.385>Uh, <00:04:09.844>what <00:04:10.303>flows

102
00:04:10.405 --> 00:04:13.525
<00:04:10.405>or <00:04:10.560>agents <00:04:10.716>are <00:04:10.871>we <00:04:11.027>going <00:04:11.182>to <00:04:11.338>use <00:04:11.493>for <00:04:11.649>these <00:04:11.805>applications

103
00:04:13.585 --> 00:04:14.765
<00:04:13.585>to <00:04:13.939>enhance <00:04:14.293>the <00:04:14.647>capabilities?

104
00:04:14.825 --> 00:04:16.765
<00:04:14.825>So <00:04:15.058>we're <00:04:15.291>working <00:04:15.524>with <00:04:15.758>a <00:04:15.991>base <00:04:16.224>model,

105
00:04:16.785 --> 00:04:19.485
<00:04:16.785>but <00:04:16.960>also, <00:04:17.135>uh, <00:04:17.310>specifying <00:04:17.485>it <00:04:17.660>to <00:04:17.835>our <00:04:18.010>use <00:04:18.185>case.

106
00:04:19.905 --> 00:04:22.085
<00:04:19.904>And <00:04:20.060>then <00:04:20.216>finally, <00:04:20.371>we'll <00:04:20.527>also <00:04:20.682>take <00:04:20.838>a <00:04:20.993>look <00:04:21.149>at <00:04:21.304>the

107
00:04:22.085 --> 00:04:23.085
<00:04:22.084>operationalizing <00:04:22.984>part.

108
00:04:23.185 --> 00:04:26.005
<00:04:23.185>So <00:04:23.301>the <00:04:23.418>demo <00:04:23.535>that <00:04:23.651>I'm <00:04:23.768>showing <00:04:23.885>today <00:04:24.001>is <00:04:24.118>gonna <00:04:24.235>be <00:04:24.351>going <00:04:24.468>from <00:04:24.585>a

109
00:04:26.005 --> 00:04:28.565
<00:04:26.005>local <00:04:26.180>development <00:04:26.355>environment <00:04:26.530>on <00:04:26.705>my <00:04:26.880>computer <00:04:27.055>here <00:04:27.230>to <00:04:27.405>taking

110
00:04:28.565 --> 00:04:30.765
<00:04:28.565>that <00:04:29.265>application <00:04:29.965>containerized

111
00:04:30.985 --> 00:04:33.325
<00:04:30.985>to <00:04:31.265>a <00:04:31.545>production <00:04:31.825>environment <00:04:32.105>on <00:04:32.385>Kubernetes.

112
00:04:33.545 --> 00:04:35.525
<00:04:33.545>Uh, <00:04:33.685>and <00:04:33.825>I'm <00:04:33.965>gonna <00:04:34.105>talk <00:04:34.245>about <00:04:34.385>the <00:04:34.525>stack <00:04:34.665>for <00:04:34.805>that <00:04:34.945>too,

113
00:04:35.525 --> 00:04:37.205
<00:04:35.525>but <00:04:35.724>how <00:04:35.924>do <00:04:36.125>we <00:04:36.325>think <00:04:36.525>about <00:04:36.724>model <00:04:36.924>serving?

114
00:04:37.745 --> 00:04:39.685
<00:04:37.745>Not <00:04:38.095>just <00:04:38.445>using <00:04:38.795>Llama <00:04:39.145>locally,

115
00:04:39.905 --> 00:04:43.845
<00:04:39.905>but <00:04:40.080>um, <00:04:40.255>working <00:04:40.429>with, <00:04:40.604>um, <00:04:40.780>different <00:04:40.955>open <00:04:41.130>source <00:04:41.304>projects

116
00:04:43.905 --> 00:04:47.045
<00:04:43.905>to <00:04:44.080>ensure <00:04:44.255>that <00:04:44.429>we <00:04:44.604>have <00:04:44.780>the <00:04:44.955>production <00:04:45.130>ready <00:04:45.304>capabilities

117
00:04:47.185 --> 00:04:49.645
<00:04:47.185>for <00:04:47.418>Kubernetes <00:04:47.651>and <00:04:47.885>for <00:04:48.118>these <00:04:48.351>enterprise <00:04:48.585>applications.

118
00:04:49.945 --> 00:04:52.325
<00:04:49.945>How <00:04:50.178>do <00:04:50.411>we <00:04:50.645>access <00:04:50.878>work <00:04:51.111>with <00:04:51.344>tokens?

119
00:04:52.425 --> 00:04:53.685
<00:04:52.425>How <00:04:52.651>do <00:04:52.878>we <00:04:53.105>monitor <00:04:53.332>the <00:04:53.559>models

120
00:04:53.825 --> 00:04:55.045
<00:04:53.825>and <00:04:54.099>see <00:04:54.374>where <00:04:54.648>they're <00:04:54.923>performing

121
00:04:55.045 --> 00:04:56.205
<00:04:55.045>well <00:04:55.306>and <00:04:55.567>where <00:04:55.828>they're <00:04:56.089>performing?

122
00:04:56.225 --> 00:04:58.885
<00:04:56.225>Not? <00:04:56.352>There's <00:04:56.479>a <00:04:56.606>lot <00:04:56.734>of <00:04:56.861>things <00:04:56.988>that <00:04:57.115>we're <00:04:57.243>going <00:04:57.370>to <00:04:57.497>talk <00:04:57.625>about.

123
00:04:59.185 --> 00:05:02.205
<00:04:59.185>Um, <00:04:59.301>and <00:04:59.418>the <00:04:59.535>fun <00:04:59.651>part <00:04:59.768>is <00:04:59.885>that <00:05:00.001>as <00:05:00.118>a <00:05:00.235>developer, <00:05:00.351>you <00:05:00.468>don't <00:05:00.585>have

124
00:05:02.205 --> 00:05:04.885
<00:05:02.205>to <00:05:02.405>be <00:05:02.604>an <00:05:02.805>expert <00:05:03.005>in <00:05:03.205>AI <00:05:03.405>to <00:05:03.604>understand

125
00:05:04.885 --> 00:05:06.045
<00:05:04.885>and <00:05:05.146>use <00:05:05.407>these <00:05:05.668>models, <00:05:05.929>right?

126
00:05:06.045 --> 00:05:08.845
<00:05:06.045>We're <00:05:06.245>working <00:05:06.445>with <00:05:06.645>these <00:05:06.845>models, <00:05:07.045>uh, <00:05:07.245>through <00:05:07.445>APIs,

127
00:05:08.845 --> 00:05:11.125
<00:05:08.845>which <00:05:09.045>makes <00:05:09.245>it <00:05:09.445>much <00:05:09.645>easier <00:05:09.845>to <00:05:10.045>get <00:05:10.245>started.

128
00:05:11.585 --> 00:05:13.645
<00:05:11.585>Uh, <00:05:11.818>and <00:05:12.051>most <00:05:12.284>developers, <00:05:12.518>as <00:05:12.751>we <00:05:12.984>see,

129
00:05:13.665 --> 00:05:16.045
<00:05:13.665>are <00:05:13.820>already <00:05:13.976>using <00:05:14.131>these <00:05:14.287>AI <00:05:14.442>models <00:05:14.598>in <00:05:14.753>these <00:05:14.909>third <00:05:15.065>party,

130
00:05:16.545 --> 00:05:17.885
<00:05:16.545>um, <00:05:17.148>uh, <00:05:17.751>services.

131
00:05:18.065 --> 00:05:19.405
<00:05:18.065>So <00:05:18.266>being <00:05:18.467>able <00:05:18.668>to <00:05:18.869>use <00:05:19.070>Lang <00:05:19.270>Chain

132
00:05:19.405 --> 00:05:21.005
<00:05:19.405>to <00:05:19.604>just <00:05:19.804>call <00:05:20.005>'em <00:05:20.205>model, <00:05:20.405>which <00:05:20.604>is <00:05:20.804>amazing.

133
00:05:21.625 --> 00:05:24.725
<00:05:21.625>The <00:05:21.752>only <00:05:21.879>issue <00:05:22.006>if <00:05:22.134>we're <00:05:22.261>working <00:05:22.388>with <00:05:22.515>a <00:05:22.643>hosted <00:05:22.770>model, <00:05:22.897>uh, <00:05:23.025>is

134
00:05:24.725 --> 00:05:26.925
<00:05:24.725>that <00:05:25.005>these <00:05:25.285>APIs <00:05:25.565>are <00:05:25.845>costly, <00:05:26.125>right?

135
00:05:26.925 --> 00:05:29.525
<00:05:26.925>They're <00:05:27.125>not <00:05:27.325>free. <00:05:27.525>Someone's <00:05:27.725>paying <00:05:27.925>for <00:05:28.125>the, <00:05:28.325>the,

136
00:05:29.525 --> 00:05:31.725
<00:05:29.525>their <00:05:29.758>AWS <00:05:29.991>bills, <00:05:30.224>whatever <00:05:30.458>it <00:05:30.691>might <00:05:30.924>be.

137
00:05:32.105 --> 00:05:34.725
<00:05:32.105>Um, <00:05:32.260>and <00:05:32.416>there's <00:05:32.571>the <00:05:32.727>issue <00:05:32.882>that, <00:05:33.038>you <00:05:33.193>know, <00:05:33.349>every <00:05:33.505>token

138
00:05:34.725 --> 00:05:37.565
<00:05:34.725>that <00:05:34.925>we're <00:05:35.125>using <00:05:35.325>costs <00:05:35.525>a <00:05:35.725>certain <00:05:35.925>amount, <00:05:36.125>right?

139
00:05:37.585 --> 00:05:40.325
<00:05:37.585>So <00:05:37.740>the <00:05:37.896>larger <00:05:38.051>our <00:05:38.207>responses, <00:05:38.362>the <00:05:38.518>bigger <00:05:38.673>our <00:05:38.829>model <00:05:38.984>is,

140
00:05:40.325 --> 00:05:42.725
<00:05:40.325>the <00:05:40.465>more <00:05:40.604>our <00:05:40.745>costs <00:05:40.885>are <00:05:41.025>going <00:05:41.164>to <00:05:41.305>be <00:05:41.445>as <00:05:41.585>a <00:05:41.724>developer,

141
00:05:42.725 --> 00:05:44.005
<00:05:42.725>it <00:05:42.889>doesn't <00:05:43.054>really <00:05:43.218>matter <00:05:43.383>to <00:05:43.547>me, <00:05:43.712>but <00:05:43.877>maybe

142
00:05:44.665 --> 00:05:46.605
<00:05:44.665>my <00:05:44.820>boss <00:05:44.976>might <00:05:45.131>care <00:05:45.287>a <00:05:45.442>little <00:05:45.598>bit <00:05:45.753>more <00:05:45.909>about <00:05:46.065>it.

143
00:05:46.625 --> 00:05:50.085
<00:05:46.625>But <00:05:46.752>the <00:05:46.879>costs <00:05:47.006>keep <00:05:47.134>coming. <00:05:47.261>Not <00:05:47.388>only <00:05:47.515>are <00:05:47.643>we <00:05:47.770>paying <00:05:47.897>for <00:05:48.025>tokens

144
00:05:50.185 --> 00:05:53.245
<00:05:50.185>and <00:05:50.360>we're, <00:05:50.535>hey, <00:05:50.710>we're <00:05:50.885>paying <00:05:51.060>for <00:05:51.235>a <00:05:51.410>subscription <00:05:51.585>fee.

145
00:05:53.425 --> 00:05:54.805
<00:05:53.425>Uh, <00:05:53.632>there's <00:05:53.839>other <00:05:54.046>costs <00:05:54.253>that <00:05:54.460>we <00:05:54.667>need

146
00:05:54.805 --> 00:05:56.685
<00:05:54.805>to <00:05:55.005>take <00:05:55.205>into <00:05:55.405>consideration <00:05:55.605>when <00:05:55.805>we're <00:05:56.005>picking <00:05:56.205>out

147
00:05:57.035 --> 00:05:59.085
<00:05:57.034>what <00:05:57.210>model <00:05:57.385>we <00:05:57.559>want <00:05:57.734>to <00:05:57.909>use <00:05:58.085>for <00:05:58.260>our <00:05:58.434>application.

148
00:05:59.545 --> 00:06:03.365
<00:05:59.545>But <00:05:59.672>the <00:05:59.799>biggest <00:05:59.926>idea <00:06:00.054>is <00:06:00.181>that <00:06:00.308>it <00:06:00.435>all <00:06:00.563>starts <00:06:00.690>with <00:06:00.817>being <00:06:00.945>able

149
00:06:03.365 --> 00:06:05.565
<00:06:03.365>to <00:06:03.520>access <00:06:03.676>a <00:06:03.831>model, <00:06:03.987>being <00:06:04.142>able <00:06:04.298>to <00:06:04.453>use <00:06:04.609>a <00:06:04.765>model,

150
00:06:05.865 --> 00:06:08.125
<00:06:05.865>and <00:06:06.040>then <00:06:06.215>we'll <00:06:06.390>talk <00:06:06.565>about <00:06:06.740>the <00:06:06.915>production <00:06:07.090>part <00:06:07.265>afterwards.

151
00:06:08.785 --> 00:06:11.365
<00:06:08.785>But <00:06:08.940>why <00:06:09.096>would <00:06:09.251>you <00:06:09.407>want <00:06:09.562>to <00:06:09.718>run <00:06:09.873>a <00:06:10.029>model <00:06:10.185>locally?

152
00:06:12.065 --> 00:06:13.685
<00:06:12.065>So <00:06:12.415>being <00:06:12.765>able <00:06:13.115>to <00:06:13.465>access

153
00:06:14.245 --> 00:06:16.085
<00:06:14.245>a <00:06:14.525>model <00:06:14.805>on <00:06:15.085>my <00:06:15.365>local <00:06:15.645>machine

154
00:06:16.095 --> 00:06:17.365
<00:06:16.095>helps <00:06:16.285>in <00:06:16.476>a <00:06:16.666>lot <00:06:16.857>of <00:06:17.047>different <00:06:17.238>ways.

155
00:06:17.425 --> 00:06:20.965
<00:06:17.425>As <00:06:17.541>a <00:06:17.658>developer, <00:06:17.775>uh, <00:06:17.891>it's, <00:06:18.008>it's <00:06:18.125>nice <00:06:18.241>to <00:06:18.358>be <00:06:18.475>able <00:06:18.591>to <00:06:18.708>call, <00:06:18.825>uh,

156
00:06:21.025 --> 00:06:22.565
<00:06:21.025>an <00:06:21.198>API, <00:06:21.371>but <00:06:21.544>if <00:06:21.717>I <00:06:21.891>can <00:06:22.064>do <00:06:22.237>it <00:06:22.411>locally

157
00:06:22.625 --> 00:06:24.445
<00:06:22.625>and <00:06:22.825>I <00:06:23.025>don't <00:06:23.225>have <00:06:23.425>to <00:06:23.625>worry <00:06:23.825>about <00:06:24.025>authorization

158
00:06:24.785 --> 00:06:27.125
<00:06:24.785>or <00:06:25.018>latency, <00:06:25.251>it's <00:06:25.485>a <00:06:25.718>much <00:06:25.951>bigger <00:06:26.185>advantage

159
00:06:27.345 --> 00:06:30.045
<00:06:27.345>to <00:06:27.545>quickly <00:06:27.745>iterating <00:06:27.945>and <00:06:28.145>building <00:06:28.345>on <00:06:28.545>my <00:06:28.745>application.

160
00:06:30.225 --> 00:06:33.085
<00:06:30.225>And <00:06:30.400>for <00:06:30.575>my, <00:06:30.750>for, <00:06:30.925>uh, <00:06:31.100>a <00:06:31.275>business <00:06:31.450>use <00:06:31.625>case,

161
00:06:33.355 --> 00:06:36.445
<00:06:33.355>your <00:06:33.555>your <00:06:33.755>data <00:06:33.955>is <00:06:34.155>essentially <00:06:34.355>your <00:06:34.555>biggest <00:06:34.755>asset.

162
00:06:36.785 --> 00:06:38.605
<00:06:36.784>Uh, <00:06:37.018>and <00:06:37.251>there's <00:06:37.484>a <00:06:37.718>lot <00:06:37.951>of <00:06:38.184>restrictions

163
00:06:38.605 --> 00:06:40.925
<00:06:38.605>that <00:06:38.780>they <00:06:38.955>talked <00:06:39.130>about <00:06:39.305>in <00:06:39.480>the <00:06:39.655>keynote, <00:06:39.830>uh, <00:06:40.005>for

164
00:06:40.935 --> 00:06:42.045
<00:06:40.935>where <00:06:41.184>your <00:06:41.434>data <00:06:41.684>can <00:06:41.934>be,

165
00:06:42.045 --> 00:06:43.965
<00:06:42.045>especially <00:06:42.220>in <00:06:42.395>the <00:06:42.570>eu, <00:06:42.745>it's <00:06:42.920>a <00:06:43.095>little <00:06:43.270>bit <00:06:43.445>different.

166
00:06:44.345 --> 00:06:46.285
<00:06:44.345>Um, <00:06:44.545>but <00:06:44.745>we <00:06:44.945>wanna <00:06:45.145>be <00:06:45.345>able <00:06:45.545>to <00:06:45.745>control

167
00:06:46.505 --> 00:06:49.005
<00:06:46.505>and <00:06:46.738>have <00:06:46.971>our <00:06:47.205>confidential <00:06:47.438>data <00:06:47.671>secure, <00:06:47.905>uh,

168
00:06:49.005 --> 00:06:50.365
<00:06:49.005>local <00:06:49.311>models <00:06:49.617>allow <00:06:49.923>for <00:06:50.229>that.

169
00:06:50.425 --> 00:06:53.125
<00:06:50.425>So <00:06:50.600>all <00:06:50.775>of <00:06:50.950>these <00:06:51.125>open <00:06:51.300>source <00:06:51.475>models <00:06:51.650>allow <00:06:51.825>us

170
00:06:53.125 --> 00:06:54.645
<00:06:53.125>to <00:06:53.467>keep <00:06:53.808>our <00:06:54.151>information <00:06:54.493>secure,

171
00:06:55.065 --> 00:06:59.045
<00:06:55.065>but <00:06:55.220>also <00:06:55.376>to <00:06:55.531>set <00:06:55.687>up <00:06:55.842>this <00:06:55.998>easy <00:06:56.153>customization <00:06:56.309>for <00:06:56.465>working

172
00:06:59.045 --> 00:07:01.485
<00:06:59.045>with <00:06:59.200>a <00:06:59.356>model <00:06:59.511>temperature <00:06:59.667>top <00:06:59.822>K, <00:06:59.978>whatever <00:07:00.133>it <00:07:00.289>might <00:07:00.445>be.

173
00:07:02.025 --> 00:07:03.605
<00:07:02.025>So <00:07:02.258>I <00:07:02.491>wanna <00:07:02.724>start <00:07:02.958>off <00:07:03.191>the <00:07:03.424>demo

174
00:07:03.665 --> 00:07:05.445
<00:07:03.665>by <00:07:03.945>showing <00:07:04.225>a <00:07:04.505>really <00:07:04.785>cool <00:07:05.065>extension.

175
00:07:05.465 --> 00:07:08.325
<00:07:05.465>And <00:07:05.604>in <00:07:05.744>my <00:07:05.885>opinion, <00:07:06.025>I <00:07:06.164>believe <00:07:06.304>it's <00:07:06.445>the <00:07:06.585>most <00:07:06.724>comprehensive <00:07:06.864>way

176
00:07:08.625 --> 00:07:12.965
<00:07:08.625>to <00:07:08.752>start <00:07:08.879>working <00:07:09.006>with <00:07:09.134>AI <00:07:09.261>as <00:07:09.388>a <00:07:09.515>developer <00:07:09.643>on <00:07:09.770>my <00:07:09.897>local <00:07:10.025>machine.

177
00:07:13.145 --> 00:07:15.685
<00:07:13.145>And <00:07:13.320>it's <00:07:13.495>called <00:07:13.669>Pod <00:07:13.844>Man, <00:07:14.020>AI <00:07:14.195>Lab. <00:07:14.370>Has <00:07:14.544>it?

178
00:07:15.685 --> 00:07:17.885
<00:07:15.685>Have <00:07:15.825>any <00:07:15.965>of <00:07:16.105>us <00:07:16.245>heard <00:07:16.385>of <00:07:16.525>Pod <00:07:16.665>Man? <00:07:16.805>The <00:07:16.945>Container <00:07:17.085>Engine?

179
00:07:18.635 --> 00:07:19.765
<00:07:18.635>Alright, <00:07:18.889>I <00:07:19.143>love <00:07:19.397>you <00:07:19.652>guys.

180
00:07:20.225 --> 00:07:23.725
<00:07:20.225>So, <00:07:20.425>pod <00:07:20.625>Man, <00:07:20.825>recently, <00:07:21.025>uh, <00:07:21.225>in, <00:07:21.425>in <00:07:21.625>conjunction

181
00:07:23.725 --> 00:07:26.325
<00:07:23.725>with <00:07:23.900>the <00:07:24.075>Pod <00:07:24.250>Man <00:07:24.425>desktop <00:07:24.600>team <00:07:24.775>released <00:07:24.950>an <00:07:25.125>extension

182
00:07:26.785 --> 00:07:29.685
<00:07:26.785>and <00:07:26.925>this <00:07:27.065>is <00:07:27.205>a <00:07:27.345>completely <00:07:27.485>free <00:07:27.625>to <00:07:27.765>use <00:07:27.905>open <00:07:28.045>source <00:07:28.185>tool

183
00:07:30.305 --> 00:07:33.165
<00:07:30.305>for <00:07:30.480>working <00:07:30.655>with <00:07:30.830>generative <00:07:31.005>AI <00:07:31.180>to <00:07:31.355>get <00:07:31.530>set <00:07:31.705>up

184
00:07:33.165 --> 00:07:36.645
<00:07:33.165>with <00:07:33.340>different <00:07:33.515>use <00:07:33.690>cases, <00:07:33.865>learn <00:07:34.040>best <00:07:34.215>practices, <00:07:34.390>be <00:07:34.565>able

185
00:07:36.645 --> 00:07:39.525
<00:07:36.645>to <00:07:36.820>work <00:07:36.995>with <00:07:37.169>models <00:07:37.344>from <00:07:37.520>hugging <00:07:37.695>face, <00:07:37.870>uh, <00:07:38.044>work

186
00:07:39.525 --> 00:07:40.645
<00:07:39.525>with <00:07:39.861>them <00:07:40.197>as <00:07:40.532>services.

187
00:07:40.825 --> 00:07:42.805
<00:07:40.825>So <00:07:41.000>I <00:07:41.175>can <00:07:41.349>just <00:07:41.525>easily <00:07:41.700>integrate <00:07:41.875>them <00:07:42.050>into <00:07:42.224>my

188
00:07:42.805 --> 00:07:43.965
<00:07:42.805>application <00:07:43.066>with <00:07:43.327>a <00:07:43.588>local <00:07:43.849>host.

189
00:07:44.385 --> 00:07:47.405
<00:07:44.385>Uh, <00:07:44.540>define <00:07:44.696>the <00:07:44.851>port <00:07:45.007>and <00:07:45.162>call, <00:07:45.318>um, <00:07:45.473>call <00:07:45.629>the <00:07:45.784>model

190
00:07:47.665 --> 00:07:49.565
<00:07:47.665>and <00:07:47.898>playground <00:07:48.131>environments <00:07:48.365>to <00:07:48.598>test <00:07:48.831>things <00:07:49.065>out.

191
00:07:49.715 --> 00:07:51.605
<00:07:49.715>Without <00:07:49.890>further <00:07:50.065>ado, <00:07:50.240>are <00:07:50.415>we <00:07:50.590>excited <00:07:50.765>for <00:07:50.940>a <00:07:51.115>demo?

192
00:07:53.595 --> 00:07:54.885
<00:07:53.595>Alright, <00:07:53.827>so <00:07:54.059>let's <00:07:54.291>get <00:07:54.523>us <00:07:54.756>started.

193
00:07:55.065 --> 00:07:58.925
<00:07:55.065>So <00:07:55.181>this <00:07:55.298>is <00:07:55.415>kind <00:07:55.531>of <00:07:55.648>the <00:07:55.765>first <00:07:55.881>step <00:07:55.998>as <00:07:56.115>a <00:07:56.231>developer <00:07:56.348>for <00:07:56.465>me

194
00:07:58.925 --> 00:08:00.525
<00:07:58.925>to <00:07:59.205>get <00:07:59.485>started <00:07:59.765>with <00:08:00.045>generative <00:08:00.325>ai.

195
00:08:00.665 --> 00:08:01.965
<00:08:00.665>And <00:08:01.055>as <00:08:01.445>I <00:08:01.835>mentioned

196
00:08:01.965 --> 00:08:03.965
<00:08:01.965>before, <00:08:02.140>this <00:08:02.315>comes <00:08:02.489>from <00:08:02.664>the <00:08:02.840>Pod <00:08:03.015>Man <00:08:03.190>Container <00:08:03.364>Engine

197
00:08:03.965 --> 00:08:04.965
<00:08:03.965>and <00:08:04.145>the <00:08:04.325>Pod <00:08:04.505>Man <00:08:04.685>desktop <00:08:04.864>project.

198
00:08:05.025 --> 00:08:08.765
<00:08:05.025>If <00:08:05.141>you <00:08:05.258>go <00:08:05.375>to <00:08:05.491>Pod <00:08:05.608>man <00:08:05.724>desktop.io, <00:08:05.841>you <00:08:05.958>can <00:08:06.075>learn <00:08:06.191>how <00:08:06.308>to, <00:08:06.424>uh,

199
00:08:08.765 --> 00:08:12.045
<00:08:08.765>easily <00:08:08.940>install <00:08:09.115>this <00:08:09.289>for <00:08:09.465>Mac, <00:08:09.640>windows, <00:08:09.815>Linux, <00:08:09.990>uh, <00:08:10.164>and,

200
00:08:12.065 --> 00:08:14.885
<00:08:12.065>and <00:08:12.240>get <00:08:12.415>started <00:08:12.590>working <00:08:12.765>with <00:08:12.940>not <00:08:13.115>only <00:08:13.290>containers, <00:08:13.465>um,

201
00:08:14.945 --> 00:08:16.005
<00:08:14.945>but <00:08:15.421>generative <00:08:15.899>ai.

202
00:08:16.025 --> 00:08:19.765
<00:08:16.025>So <00:08:16.152>I'm <00:08:16.279>gonna <00:08:16.406>hop <00:08:16.534>back <00:08:16.661>over <00:08:16.788>here <00:08:16.915>to, <00:08:17.043>um, <00:08:17.170>pod <00:08:17.297>Man <00:08:17.424>ai.

203
00:08:19.825 --> 00:08:22.885
<00:08:19.825>And <00:08:19.941>so <00:08:20.058>in <00:08:20.175>the, <00:08:20.291>it's <00:08:20.408>an <00:08:20.525>extension <00:08:20.641>as <00:08:20.758>a <00:08:20.875>part <00:08:20.991>of <00:08:21.108>poman <00:08:21.224>desktop,

204
00:08:23.145 --> 00:08:27.085
<00:08:23.145>you <00:08:23.344>can <00:08:23.544>also <00:08:23.745>work <00:08:23.945>with <00:08:24.145>images, <00:08:24.344>containers, <00:08:24.544>pods,

205
00:08:27.645 --> 00:08:28.885
<00:08:27.645>Kubernetes, <00:08:27.924>which <00:08:28.203>is <00:08:28.482>really <00:08:28.760>neat.

206
00:08:29.185 --> 00:08:32.445
<00:08:29.185>Um, <00:08:29.325>but <00:08:29.465>specifically, <00:08:29.605>pod <00:08:29.745>Min <00:08:29.885>AI <00:08:30.025>lab <00:08:30.165>allows <00:08:30.305>me <00:08:30.445>to <00:08:30.585>work

207
00:08:32.445 --> 00:08:34.285
<00:08:32.445>with <00:08:32.911>my <00:08:33.378>containerized <00:08:33.845>applications

208
00:08:34.305 --> 00:08:36.285
<00:08:34.304>for <00:08:34.479>AI <00:08:34.655>apps <00:08:34.829>the <00:08:35.005>same <00:08:35.179>way <00:08:35.354>I <00:08:35.530>would <00:08:35.704>do

209
00:08:36.285 --> 00:08:37.445
<00:08:36.284>on <00:08:36.633>a <00:08:36.981>production <00:08:37.329>environment.

210
00:08:37.665 --> 00:08:40.245
<00:08:37.664>So <00:08:37.804>all <00:08:37.944>within <00:08:38.084>containers, <00:08:38.224>I <00:08:38.365>can <00:08:38.505>work <00:08:38.645>with <00:08:38.784>them <00:08:38.924>in <00:08:39.064>pods.

211
00:08:40.245 --> 00:08:41.365
<00:08:40.245>And <00:08:40.389>let's <00:08:40.533>go <00:08:40.677>ahead <00:08:40.821>and <00:08:40.965>see <00:08:41.109>that <00:08:41.253>here.

212
00:08:41.905 --> 00:08:44.325
<00:08:41.905>So <00:08:42.138>there's <00:08:42.371>a <00:08:42.605>variety <00:08:42.838>of <00:08:43.071>different <00:08:43.304>recipes,

213
00:08:44.345 --> 00:08:46.445
<00:08:44.345>and <00:08:44.545>these <00:08:44.745>are <00:08:44.945>kind <00:08:45.145>of <00:08:45.345>like <00:08:45.545>starter <00:08:45.745>applications

214
00:08:46.905 --> 00:08:49.085
<00:08:46.905>to <00:08:47.079>show <00:08:47.255>me <00:08:47.430>if <00:08:47.605>I <00:08:47.780>don't <00:08:47.954>have <00:08:48.130>any <00:08:48.305>experience

215
00:08:49.085 --> 00:08:50.645
<00:08:49.085>with <00:08:49.435>technologies <00:08:49.785>like <00:08:50.135>Lang <00:08:50.485>Chain

216
00:08:50.665 --> 00:08:52.685
<00:08:50.665>or <00:08:50.839>whatever <00:08:51.015>it <00:08:51.189>might <00:08:51.365>be <00:08:51.540>to <00:08:51.714>work <00:08:51.890>with <00:08:52.064>ai,

217
00:08:52.745 --> 00:08:54.165
<00:08:52.745>how <00:08:53.000>I <00:08:53.256>can <00:08:53.511>easily <00:08:53.767>get <00:08:54.022>started.

218
00:08:54.585 --> 00:08:57.765
<00:08:54.585>Um, <00:08:54.701>and <00:08:54.818>so <00:08:54.935>the <00:08:55.051>first <00:08:55.168>one <00:08:55.285>I'm <00:08:55.401>gonna <00:08:55.518>get <00:08:55.635>quickly <00:08:55.751>show <00:08:55.868>is <00:08:55.985>the

219
00:08:57.765 --> 00:08:59.365
<00:08:57.765>most <00:08:58.465>basic <00:08:59.165>application.

220
00:08:59.395 --> 00:09:00.525
<00:08:59.395>It's <00:08:59.649>a <00:08:59.903>chat <00:09:00.157>bot, <00:09:00.412>but

221
00:09:00.995 --> 00:09:04.765
<00:09:00.995>what <00:09:01.195>poman <00:09:01.395>Desktop <00:09:01.595>AI <00:09:01.795>Lab <00:09:01.995>provides <00:09:02.195>is <00:09:02.395>kind

222
00:09:04.765 --> 00:09:06.405
<00:09:04.765>of <00:09:05.115>this <00:09:05.465>boilerplate <00:09:05.814>starter <00:09:06.165>code

223
00:09:06.405 --> 00:09:08.765
<00:09:06.405>and <00:09:06.579>the <00:09:06.755>ability <00:09:06.930>to <00:09:07.105>quickly <00:09:07.280>start <00:09:07.454>up <00:09:07.630>this <00:09:07.805>application.

224
00:09:08.825 --> 00:09:11.125
<00:09:08.825>So <00:09:08.980>it's <00:09:09.136>going <00:09:09.291>to <00:09:09.447>clone <00:09:09.602>it <00:09:09.758>to <00:09:09.913>my <00:09:10.069>local <00:09:10.225>directory.

225
00:09:11.525 --> 00:09:13.965
<00:09:11.525>I <00:09:11.680>can <00:09:11.836>specify <00:09:11.991>which <00:09:12.147>model <00:09:12.302>that <00:09:12.458>I <00:09:12.613>want <00:09:12.769>to <00:09:12.925>use.

226
00:09:14.025 --> 00:09:18.205
<00:09:14.025>So <00:09:14.165>how <00:09:14.305>many <00:09:14.444>of <00:09:14.584>us <00:09:14.725>has <00:09:14.865>used <00:09:15.005>minstrel <00:09:15.145>before? <00:09:15.285>Sweet. <00:09:15.425>Okay.

227
00:09:18.305 --> 00:09:22.525
<00:09:18.305>So <00:09:18.432>Minstrel <00:09:18.559>is <00:09:18.686>a, <00:09:18.814>a <00:09:18.941>nice <00:09:19.068>open <00:09:19.195>source <00:09:19.323>model, <00:09:19.450>just <00:09:19.577>like <00:09:19.704>Llama.

228
00:09:22.785 --> 00:09:24.885
<00:09:22.785>Um, <00:09:22.985>but <00:09:23.185>there's <00:09:23.385>a <00:09:23.584>variety <00:09:23.785>of <00:09:23.985>different <00:09:24.185>models

229
00:09:24.885 --> 00:09:27.485
<00:09:24.885>that <00:09:25.040>you <00:09:25.196>could <00:09:25.351>use <00:09:25.507>and <00:09:25.662>import <00:09:25.818>into <00:09:25.973>Pod <00:09:26.129>Man <00:09:26.285>desktop.

230
00:09:27.485 --> 00:09:28.925
<00:09:27.485>And <00:09:27.670>I'll <00:09:27.855>show <00:09:28.040>that <00:09:28.225>here <00:09:28.410>in <00:09:28.595>a <00:09:28.781>second.

231
00:09:29.025 --> 00:09:31.805
<00:09:29.025>To <00:09:29.165>use <00:09:29.305>on <00:09:29.444>your <00:09:29.584>local <00:09:29.725>machine <00:09:29.865>and <00:09:30.005>start <00:09:30.145>an <00:09:30.285>inference <00:09:30.425>server.

232
00:09:32.305 --> 00:09:33.885
<00:09:32.305>So <00:09:32.479>I'm <00:09:32.655>gonna <00:09:32.829>go <00:09:33.005>ahead <00:09:33.180>and <00:09:33.354>start <00:09:33.530>this <00:09:33.704>here.

233
00:09:33.885 --> 00:09:35.965
<00:09:33.885>And <00:09:34.060>what <00:09:34.235>it's <00:09:34.410>gonna <00:09:34.585>do <00:09:34.760>is <00:09:34.935>clone <00:09:35.110>a <00:09:35.285>repository

234
00:09:35.965 --> 00:09:39.765
<00:09:35.965>with <00:09:36.140>source <00:09:36.315>code, <00:09:36.490>uh, <00:09:36.665>that's <00:09:36.840>using, <00:09:37.015>um, <00:09:37.190>uh, <00:09:37.365>uh,

235
00:09:40.005 --> 00:09:41.245
<00:09:40.005>streamli <00:09:40.377>as <00:09:40.749>a <00:09:41.121>ui.

236
00:09:41.375 --> 00:09:43.325
<00:09:41.375>We're <00:09:41.575>gonna <00:09:41.775>be <00:09:41.975>working <00:09:42.175>with <00:09:42.375>Lang <00:09:42.575>Chain, <00:09:42.775>uh,

237
00:09:43.385 --> 00:09:44.925
<00:09:43.385>and <00:09:43.731>this <00:09:44.078>builds <00:09:44.424>the <00:09:44.771>containers.

238
00:09:44.985 --> 00:09:48.005
<00:09:44.985>So <00:09:45.185>this <00:09:45.385>builds <00:09:45.585>a <00:09:45.785>streamli, <00:09:45.985>uh, <00:09:46.185>Python <00:09:46.385>application.

239
00:09:48.145 --> 00:09:50.685
<00:09:48.145>So <00:09:48.345>I <00:09:48.545>can <00:09:48.745>inference <00:09:48.944>my <00:09:49.145>actual, <00:09:49.345>uh, <00:09:49.545>model

240
00:09:51.105 --> 00:09:54.285
<00:09:51.105>and <00:09:51.245>llama <00:09:51.385>c <00:09:51.525>plus <00:09:51.665>plus, <00:09:51.805>which <00:09:51.945>is <00:09:52.085>an <00:09:52.225>inference <00:09:52.365>server, <00:09:52.505>uh,

241
00:09:54.345 --> 00:09:57.405
<00:09:54.345>to <00:09:54.520>be <00:09:54.695>able <00:09:54.870>to <00:09:55.045>mount <00:09:55.220>this, <00:09:55.395>um, <00:09:55.570>minstrel <00:09:55.745>model

242
00:09:57.785 --> 00:09:59.525
<00:09:57.785>to <00:09:57.959>the <00:09:58.135>container <00:09:58.310>so <00:09:58.485>that <00:09:58.660>I <00:09:58.834>can <00:09:59.010>start <00:09:59.185>making

243
00:09:59.525 --> 00:10:00.765
<00:09:59.525>calls <00:09:59.804>to <00:10:00.083>this <00:10:00.362>model <00:10:00.641>locally.

244
00:10:01.185 --> 00:10:02.765
<00:10:01.185>Uh, <00:10:01.359>and <00:10:01.535>let's <00:10:01.709>go <00:10:01.885>ahead <00:10:02.060>and <00:10:02.234>check <00:10:02.410>this <00:10:02.584>out.

245
00:10:02.825 --> 00:10:05.405
<00:10:02.825>So <00:10:03.025>it's <00:10:03.225>running <00:10:03.425>as, <00:10:03.625>uh, <00:10:03.825>pods, <00:10:04.025>so <00:10:04.225>one

246
00:10:05.405 --> 00:10:08.045
<00:10:05.405>or <00:10:05.605>more <00:10:05.805>containers <00:10:06.005>in <00:10:06.204>one, <00:10:06.405>uh, <00:10:06.605>isolated <00:10:06.805>unit.

247
00:10:08.485 --> 00:10:11.245
<00:10:08.485>I <00:10:08.660>can <00:10:08.835>see <00:10:09.010>the, <00:10:09.185>uh, <00:10:09.360>information <00:10:09.535>about <00:10:09.710>the <00:10:09.885>logs,

248
00:10:11.245 --> 00:10:12.965
<00:10:11.245>but <00:10:11.445>I'll <00:10:11.645>go <00:10:11.845>ahead <00:10:12.045>and <00:10:12.245>open <00:10:12.445>this, <00:10:12.645>uh,

249
00:10:12.985 --> 00:10:14.925
<00:10:12.985>in <00:10:13.160>my <00:10:13.335>local <00:10:13.510>browser <00:10:13.685>so <00:10:13.860>I <00:10:14.035>can <00:10:14.210>show <00:10:14.385>you.

250
00:10:15.195 --> 00:10:16.845
<00:10:15.195>What <00:10:15.395>we're <00:10:15.595>gonna <00:10:15.795>do <00:10:15.995>to <00:10:16.195>in <00:10:16.395>today's <00:10:16.595>demo,

251
00:10:16.845 --> 00:10:18.605
<00:10:16.845>and <00:10:17.000>I'll <00:10:17.156>give <00:10:17.311>you <00:10:17.467>a <00:10:17.622>little <00:10:17.778>teaser, <00:10:17.933>is <00:10:18.089>we're <00:10:18.245>going

252
00:10:18.605 --> 00:10:22.205
<00:10:18.605>to <00:10:18.780>turn <00:10:18.955>this <00:10:19.130>into <00:10:19.305>an <00:10:19.480>enterprise <00:10:19.655>application <00:10:19.830>by, <00:10:20.005>um,

253
00:10:22.345 --> 00:10:24.125
<00:10:22.345>adding <00:10:22.625>some <00:10:22.905>rag <00:10:23.185>capabilities <00:10:23.465>to <00:10:23.745>it.

254
00:10:24.145 --> 00:10:27.525
<00:10:24.145>So <00:10:24.378>ingesting <00:10:24.611>our <00:10:24.845>private <00:10:25.078>data, <00:10:25.311>ingesting, <00:10:25.545>uh,

255
00:10:27.605 --> 00:10:31.205
<00:10:27.605>information <00:10:27.838>about <00:10:28.071>our <00:10:28.305>company, <00:10:28.538>our <00:10:28.771>documentation <00:10:29.005>so

256
00:10:31.205 --> 00:10:33.605
<00:10:31.205>that <00:10:31.405>it <00:10:31.605>can <00:10:31.805>help <00:10:32.005>people <00:10:32.205>help <00:10:32.405>internally, <00:10:32.605>uh,

257
00:10:33.705 --> 00:10:35.605
<00:10:33.705>or <00:10:33.860>we <00:10:34.016>could, <00:10:34.171>uh, <00:10:34.327>open <00:10:34.482>it <00:10:34.638>up <00:10:34.793>to <00:10:34.949>the <00:10:35.105>public.

258
00:10:35.745 --> 00:10:38.925
<00:10:35.745>So <00:10:35.900>what's <00:10:36.056>happening <00:10:36.211>here <00:10:36.367>is <00:10:36.522>we've <00:10:36.678>got <00:10:36.833>a <00:10:36.989>simple <00:10:37.145>application

259
00:10:38.925 --> 00:10:40.805
<00:10:38.925>here, <00:10:39.052>and <00:10:39.179>I'll <00:10:39.306>show <00:10:39.434>you <00:10:39.561>the <00:10:39.688>source <00:10:39.815>code <00:10:39.943>at <00:10:40.070>the <00:10:40.197>same <00:10:40.324>time.

260
00:10:41.545 --> 00:10:44.005
<00:10:41.545>Uh, <00:10:41.661>if <00:10:41.778>I <00:10:41.895>go <00:10:42.011>back <00:10:42.128>to <00:10:42.245>this <00:10:42.361>recipes <00:10:42.478>catalog, <00:10:42.594>and <00:10:42.711>I'll <00:10:42.828>go <00:10:42.944>ahead

261
00:10:44.005 --> 00:10:47.925
<00:10:44.005>and <00:10:44.205>ask, <00:10:44.405>um, <00:10:44.605>why <00:10:44.805>is <00:10:45.005>the <00:10:45.205>sky <00:10:45.405>blue?

262
00:10:48.785 --> 00:10:51.365
<00:10:48.785>So <00:10:48.912>I'll <00:10:49.039>go <00:10:49.166>ahead <00:10:49.294>and <00:10:49.421>ask <00:10:49.548>the <00:10:49.675>model, <00:10:49.803>uh, <00:10:49.930>a <00:10:50.057>question <00:10:50.185>here

263
00:10:51.365 --> 00:10:53.685
<00:10:51.365>through <00:10:51.520>the <00:10:51.676>container <00:10:51.831>that's <00:10:51.987>being <00:10:52.142>ran, <00:10:52.298>and <00:10:52.453>I'll <00:10:52.609>go <00:10:52.765>ahead

264
00:10:53.685 --> 00:10:54.965
<00:10:53.685>and <00:10:53.849>show <00:10:54.014>you <00:10:54.178>that <00:10:54.343>at <00:10:54.507>the <00:10:54.672>same <00:10:54.837>time,

265
00:10:55.525 --> 00:10:57.245
<00:10:55.525>I <00:10:55.725>can <00:10:55.925>open <00:10:56.125>up <00:10:56.324>the <00:10:56.525>source <00:10:56.725>code <00:10:56.925>here.

266
00:10:57.825 --> 00:11:00.405
<00:10:57.825>Um, <00:10:58.058>and <00:10:58.291>I'll <00:10:58.525>open <00:10:58.758>this <00:10:58.991>up <00:10:59.225>here

267
00:11:00.825 --> 00:11:03.805
<00:11:00.825>and <00:11:01.000>show <00:11:01.175>that <00:11:01.350>we <00:11:01.525>have, <00:11:01.700>um, <00:11:01.875>essentially <00:11:02.050>a, <00:11:02.225>uh,

268
00:11:03.855 --> 00:11:05.685
<00:11:03.855>super <00:11:04.321>simple <00:11:04.788>Python <00:11:05.255>application.

269
00:11:05.685 --> 00:11:06.725
<00:11:05.685>I'll <00:11:05.841>make <00:11:05.997>this <00:11:06.153>a <00:11:06.309>little <00:11:06.465>bit <00:11:06.621>bigger

270
00:11:07.305 --> 00:11:08.605
<00:11:07.305>and <00:11:07.500>I'll <00:11:07.694>walk <00:11:07.890>you <00:11:08.085>through <00:11:08.280>the <00:11:08.475>steps.

271
00:11:08.875 --> 00:11:12.165
<00:11:08.875>This <00:11:09.030>is <00:11:09.186>a <00:11:09.341>really <00:11:09.497>nice <00:11:09.652>starter <00:11:09.808>place <00:11:09.963>for <00:11:10.119>getting <00:11:10.275>started

272
00:11:12.165 --> 00:11:15.325
<00:11:12.165>with <00:11:12.320>AI <00:11:12.476>applications <00:11:12.631>where <00:11:12.787>I <00:11:12.942>can <00:11:13.098>see <00:11:13.253>that <00:11:13.409>I'm <00:11:13.564>connecting

273
00:11:15.325 --> 00:11:18.045
<00:11:15.325>to <00:11:15.500>the <00:11:15.675>model <00:11:15.850>that's <00:11:16.025>running <00:11:16.200>locally <00:11:16.375>on <00:11:16.550>Port <00:11:16.725>8,001.

274
00:11:18.345 --> 00:11:21.845
<00:11:18.345>Um, <00:11:18.485>making <00:11:18.625>a <00:11:18.765>call <00:11:18.905>with <00:11:19.045>the <00:11:19.185>open <00:11:19.325>AI <00:11:19.465>compatible <00:11:19.605>API, <00:11:19.745>um,

275
00:11:21.945 --> 00:11:24.205
<00:11:21.945>and <00:11:22.100>essentially <00:11:22.256>determining <00:11:22.411>if <00:11:22.567>I <00:11:22.722>have <00:11:22.878>llama <00:11:23.033>c <00:11:23.189>plus <00:11:23.345>plus

276
00:11:24.425 --> 00:11:27.045
<00:11:24.425>as <00:11:24.625>an <00:11:24.824>inference <00:11:25.025>server <00:11:25.224>or, <00:11:25.425>um, <00:11:25.625>using <00:11:25.824>llama

277
00:11:27.045 --> 00:11:28.485
<00:11:27.045>as <00:11:27.304>abstraction <00:11:27.563>on <00:11:27.822>top <00:11:28.081>of <00:11:28.341>that.

278
00:11:28.985 --> 00:11:33.445
<00:11:28.985>Um, <00:11:29.140>checking <00:11:29.296>to, <00:11:29.451>uh, <00:11:29.607>have <00:11:29.762>state <00:11:29.918>control, <00:11:30.073>uh, <00:11:30.229>title, <00:11:30.385>uh,

279
00:11:33.445 --> 00:11:36.285
<00:11:33.445>making <00:11:33.678>the <00:11:33.911>call, <00:11:34.145>um, <00:11:34.378>a <00:11:34.611>prompt <00:11:34.845>template.

280
00:11:36.385 --> 00:11:40.725
<00:11:36.385>So <00:11:36.512>giving <00:11:36.639>the, <00:11:36.766>uh, <00:11:36.894>model, <00:11:37.021>you <00:11:37.148>know, <00:11:37.275>uh, <00:11:37.403>uh, <00:11:37.530>a <00:11:37.657>a <00:11:37.785>type

281
00:11:40.725 --> 00:11:43.245
<00:11:40.725>of <00:11:40.958>context <00:11:41.191>for <00:11:41.425>the <00:11:41.658>conversation <00:11:41.891>I'm <00:11:42.125>about

282
00:11:43.245 --> 00:11:44.965
<00:11:43.245>to <00:11:43.525>have <00:11:43.805>and <00:11:44.085>storing <00:11:44.365>the <00:11:44.645>chat.

283
00:11:45.145 --> 00:11:46.965
<00:11:45.145>So <00:11:45.378>this <00:11:45.611>is <00:11:45.845>a <00:11:46.078>super <00:11:46.311>simple <00:11:46.545>example.

284
00:11:47.145 --> 00:11:48.565
<00:11:47.145>Uh, <00:11:47.304>a <00:11:47.464>funny <00:11:47.624>one <00:11:47.784>that <00:11:47.943>I <00:11:48.103>kind <00:11:48.263>of <00:11:48.423>wanted

285
00:11:48.565 --> 00:11:51.165
<00:11:48.565>to <00:11:48.740>show <00:11:48.915>real <00:11:49.090>quick <00:11:49.265>is <00:11:49.440>the, <00:11:49.615>uh, <00:11:49.790>object <00:11:49.965>detection.

286
00:11:51.165 --> 00:11:52.565
<00:11:51.165>So <00:11:51.375>we're <00:11:51.585>using <00:11:51.795>a <00:11:52.005>different <00:11:52.215>model <00:11:52.425>here.

287
00:11:52.585 --> 00:11:53.925
<00:11:52.585>We <00:11:52.886>were <00:11:53.188>using <00:11:53.489>minstrel <00:11:53.790>before.

288
00:11:54.385 --> 00:11:57.765
<00:11:54.385>Um, <00:11:54.525>this <00:11:54.665>is <00:11:54.805>going <00:11:54.944>to <00:11:55.085>be <00:11:55.225>using <00:11:55.365>a, <00:11:55.505>uh, <00:11:55.645>Facebook, <00:11:55.785>uh,

289
00:11:57.765 --> 00:12:00.805
<00:11:57.765>open <00:11:57.998>source <00:11:58.231>model <00:11:58.465>to <00:11:58.698>identify <00:11:58.931>different <00:11:59.165>objects.

290
00:12:01.225 --> 00:12:02.845
<00:12:01.225>So <00:12:01.400>I <00:12:01.575>can <00:12:01.750>start <00:12:01.925>this <00:12:02.100>one <00:12:02.275>up <00:12:02.450>as <00:12:02.625>well.

291
00:12:02.905 --> 00:12:05.965
<00:12:02.905>So <00:12:03.045>it <00:12:03.185>checks <00:12:03.324>out, <00:12:03.464>the <00:12:03.605>repository <00:12:03.745>on <00:12:03.885>my <00:12:04.025>local <00:12:04.165>machine, <00:12:04.305>um,

292
00:12:06.335 --> 00:12:08.725
<00:12:06.335>spins <00:12:06.568>up, <00:12:06.801>uh, <00:12:07.035>these <00:12:07.268>containers, <00:12:07.501>uh, <00:12:07.735>one

293
00:12:08.725 --> 00:12:10.485
<00:12:08.725>for <00:12:08.900>an <00:12:09.075>inference <00:12:09.250>server <00:12:09.425>and <00:12:09.600>one <00:12:09.775>for <00:12:09.950>front <00:12:10.125>end.

294
00:12:10.865 --> 00:12:12.805
<00:12:10.865>Uh, <00:12:11.020>and <00:12:11.176>so <00:12:11.331>now <00:12:11.487>if <00:12:11.642>I <00:12:11.798>check <00:12:11.953>out <00:12:12.109>this <00:12:12.265>one,

295
00:12:13.155 --> 00:12:14.925
<00:12:13.155>I've <00:12:13.388>got <00:12:13.621>some <00:12:13.855>different <00:12:14.088>examples <00:12:14.321>of <00:12:14.555>images

296
00:12:14.925 --> 00:12:15.965
<00:12:14.925>that <00:12:15.112>I <00:12:15.299>wanna <00:12:15.486>show <00:12:15.673>real <00:12:15.861>quick.

297
00:12:16.345 --> 00:12:19.285
<00:12:16.345>Uh, <00:12:16.461>for <00:12:16.578>this <00:12:16.695>first <00:12:16.811>one, <00:12:16.928>this <00:12:17.045>is <00:12:17.161>me <00:12:17.278>at <00:12:17.395>the <00:12:17.511>booth <00:12:17.628>hanging <00:12:17.745>out.

298
00:12:19.545 --> 00:12:21.045
<00:12:19.545>You <00:12:19.737>should <00:12:19.930>visit <00:12:20.123>us <00:12:20.316>for <00:12:20.509>right <00:12:20.702>over <00:12:20.895>there.

299
00:12:21.585 --> 00:12:25.045
<00:12:21.585>Um, <00:12:21.740>So <00:12:21.896>okay, <00:12:22.051>it <00:12:22.207>looks <00:12:22.362>like <00:12:22.518>we <00:12:22.673>have <00:12:22.829>an <00:12:22.985>error.

300
00:12:25.045 --> 00:12:26.325
<00:12:25.045>Let's <00:12:25.333>do <00:12:25.621>some <00:12:25.909>live <00:12:26.197>debugging.

301
00:12:26.665 --> 00:12:29.645
<00:12:26.665>Um, <00:12:26.820>looks <00:12:26.976>like <00:12:27.131>it's <00:12:27.287>trying <00:12:27.442>to <00:12:27.598>connect <00:12:27.753>on <00:12:27.909>poor <00:12:28.064>8,000,

302
00:12:29.705 --> 00:12:32.205
<00:12:29.705>but <00:12:29.905>maybe <00:12:30.105>the <00:12:30.305>model <00:12:30.505>is <00:12:30.705>on <00:12:30.905>poor <00:12:31.105>8,001.

303
00:12:32.555 --> 00:12:33.565
<00:12:32.555>That <00:12:32.782>might <00:12:33.009>be <00:12:33.236>the <00:12:33.464>issue.

304
00:12:33.945 --> 00:12:35.325
<00:12:33.945>Uh, <00:12:34.193>let <00:12:34.441>me <00:12:34.690>check <00:12:34.938>real <00:12:35.187>quick

305
00:12:35.985 --> 00:12:37.965
<00:12:35.985>and <00:12:36.185>see <00:12:36.385>what <00:12:36.585>might <00:12:36.785>be <00:12:36.985>going <00:12:37.185>on <00:12:37.385>here.

306
00:12:38.395 --> 00:12:40.525
<00:12:38.395>This <00:12:38.535>is <00:12:38.675>a <00:12:38.814>great <00:12:38.954>use <00:12:39.095>case <00:12:39.235>for <00:12:39.375>me <00:12:39.515>to <00:12:39.655>be <00:12:39.795>able

307
00:12:40.525 --> 00:12:42.805
<00:12:40.525>to <00:12:40.699>open <00:12:40.875>up <00:12:41.050>the <00:12:41.225>logs <00:12:41.400>for <00:12:41.574>this <00:12:41.750>specific <00:12:41.925>application.

308
00:12:42.985 --> 00:12:45.205
<00:12:42.985>So <00:12:43.218>we've <00:12:43.451>got <00:12:43.685>this <00:12:43.918>object <00:12:44.151>detection, <00:12:44.385>uh,

309
00:12:45.205 --> 00:12:47.685
<00:12:45.205>and <00:12:45.380>we <00:12:45.555>can <00:12:45.730>see <00:12:45.905>specifically <00:12:46.080>what's <00:12:46.255>happening <00:12:46.430>here <00:12:46.605>is

310
00:12:47.685 --> 00:12:50.085
<00:12:47.685>that <00:12:47.918>we <00:12:48.151>might <00:12:48.385>have <00:12:48.618>a, <00:12:48.851>uh, <00:12:49.084>model

311
00:12:50.225 --> 00:12:52.045
<00:12:50.225>that's <00:12:50.425>being <00:12:50.625>hosted <00:12:50.825>on <00:12:51.025>a <00:12:51.225>different <00:12:51.425>port <00:12:51.625>than

312
00:12:52.045 --> 00:12:54.405
<00:12:52.045>what <00:12:52.245>the <00:12:52.444>actual <00:12:52.645>application <00:12:52.844>is, <00:12:53.045>uh, <00:12:53.245>looking <00:12:53.444>for.

313
00:12:54.705 --> 00:12:57.605
<00:12:54.705>So <00:12:54.880>this <00:12:55.055>brings <00:12:55.230>me <00:12:55.405>to, <00:12:55.580>uh, <00:12:55.755>not <00:12:55.930>being <00:12:56.105>able

314
00:12:57.605 --> 00:13:00.885
<00:12:57.605>to <00:12:57.760>show <00:12:57.916>you <00:12:58.071>the <00:12:58.227>specific <00:12:58.382>example, <00:12:58.538>but <00:12:58.693>to <00:12:58.849>the <00:12:59.005>services.

315
00:13:01.305 --> 00:13:03.045
<00:13:01.305>So <00:13:01.584>if <00:13:01.864>you've <00:13:02.145>worked <00:13:02.425>with, <00:13:02.704>um,

316
00:13:03.275 --> 00:13:05.685
<00:13:03.275>different <00:13:03.508>model <00:13:03.741>serving <00:13:03.975>tools <00:13:04.208>locally, <00:13:04.441>you <00:13:04.675>know

317
00:13:05.685 --> 00:13:09.085
<00:13:05.685>that <00:13:05.812>it's <00:13:05.939>very <00:13:06.066>easy <00:13:06.194>to <00:13:06.321>spin <00:13:06.448>up <00:13:06.575>a <00:13:06.703>service <00:13:06.830>based <00:13:06.957>on <00:13:07.084>a

318
00:13:09.285 --> 00:13:12.005
<00:13:09.285>specific, <00:13:09.518>um, <00:13:09.751>model <00:13:09.985>and <00:13:10.218>define <00:13:10.451>that <00:13:10.685>port.

319
00:13:12.145 --> 00:13:14.605
<00:13:12.145>So <00:13:12.300>we <00:13:12.456>can <00:13:12.611>easily <00:13:12.767>set <00:13:12.922>up <00:13:13.078>this <00:13:13.233>inference <00:13:13.389>server <00:13:13.545>just

320
00:13:14.605 --> 00:13:17.485
<00:13:14.605>as <00:13:14.721>we <00:13:14.838>were <00:13:14.955>doing <00:13:15.071>with <00:13:15.188>the <00:13:15.305>chat <00:13:15.421>bot, <00:13:15.538>uh, <00:13:15.655>on <00:13:15.771>a <00:13:15.888>specific <00:13:16.005>port.

321
00:13:17.505 --> 00:13:20.365
<00:13:17.505>And <00:13:17.680>here <00:13:17.855>we <00:13:18.030>have <00:13:18.205>starter <00:13:18.380>plate, <00:13:18.555>uh, <00:13:18.730>boilerplate <00:13:18.905>code

322
00:13:20.385 --> 00:13:23.125
<00:13:20.385>for <00:13:20.560>working, <00:13:20.735>uh, <00:13:20.910>with <00:13:21.085>a <00:13:21.260>variety <00:13:21.435>of <00:13:21.610>different <00:13:21.785>languages.

323
00:13:23.945 --> 00:13:25.845
<00:13:23.945>So <00:13:24.178>I <00:13:24.411>could <00:13:24.645>be <00:13:24.878>a <00:13:25.111>Java <00:13:25.345>developer,

324
00:13:25.845 --> 00:13:27.725
<00:13:25.845>and <00:13:26.020>if <00:13:26.195>I <00:13:26.370>want <00:13:26.545>to <00:13:26.720>use <00:13:26.895>Corcas <00:13:27.070>L <00:13:27.245>chain

325
00:13:27.725 --> 00:13:31.085
<00:13:27.725>for <00:13:27.865>JI <00:13:28.005>have <00:13:28.145>all <00:13:28.285>the <00:13:28.425>starter <00:13:28.565>boilerplate <00:13:28.705>code <00:13:28.845>that <00:13:28.985>I <00:13:29.125>need

326
00:13:31.085 --> 00:13:33.125
<00:13:31.085>to <00:13:31.285>get <00:13:31.485>AI <00:13:31.685>integrated <00:13:31.885>with <00:13:32.085>my <00:13:32.285>application, <00:13:32.485>right?

327
00:13:33.145 --> 00:13:34.205
<00:13:33.145>The <00:13:33.463>model's <00:13:33.781>being <00:13:34.099>served,

328
00:13:34.505 --> 00:13:37.605
<00:13:34.505>but <00:13:34.645>we <00:13:34.785>also <00:13:34.925>have <00:13:35.064>starter <00:13:35.205>plate <00:13:35.345>codes <00:13:35.485>in <00:13:35.625>order <00:13:35.765>to, <00:13:35.905>uh,

329
00:13:37.605 --> 00:13:40.205
<00:13:37.605>create <00:13:37.760>a <00:13:37.916>service <00:13:38.071>to, <00:13:38.227>uh, <00:13:38.382>make <00:13:38.538>requests <00:13:38.693>to <00:13:38.849>that <00:13:39.005>model.

330
00:13:40.225 --> 00:13:41.685
<00:13:40.225>And <00:13:40.389>it's <00:13:40.553>that <00:13:40.717>easy <00:13:40.882>to <00:13:41.046>get <00:13:41.210>started <00:13:41.374>in <00:13:41.539>a

331
00:13:41.685 --> 00:13:42.845
<00:13:41.685>variety <00:13:42.033>of <00:13:42.381>different <00:13:42.729>languages.

332
00:13:43.225 --> 00:13:44.765
<00:13:43.225>So <00:13:43.398>I'm <00:13:43.571>gonna <00:13:43.744>go <00:13:43.918>ahead <00:13:44.091>and <00:13:44.264>show <00:13:44.437>this <00:13:44.611>here.

333
00:13:44.825 --> 00:13:48.565
<00:13:44.825>So <00:13:44.952>I've <00:13:45.079>got, <00:13:45.206>um, <00:13:45.334>if <00:13:45.461>I <00:13:45.588>open <00:13:45.715>up <00:13:45.843>a <00:13:45.970>different <00:13:46.097>project <00:13:46.225>here.

334
00:13:49.665 --> 00:13:52.085
<00:13:49.665>Uh, <00:13:50.365>Let's <00:13:51.064>see.

335
00:13:52.425 --> 00:13:55.565
<00:13:52.425>So <00:13:52.541>I've <00:13:52.658>got <00:13:52.775>a <00:13:52.891>quick, <00:13:53.008>um, <00:13:53.125>Java <00:13:53.241>example <00:13:53.358>that <00:13:53.474>I <00:13:53.591>wanna <00:13:53.708>show <00:13:53.824>you

336
00:13:55.565 --> 00:13:56.965
<00:13:55.565>how <00:13:55.775>many <00:13:55.985>Java <00:13:56.195>developers <00:13:56.405>we <00:13:56.615>have <00:13:56.825>here.

337
00:13:57.715 --> 00:14:01.765
<00:13:57.715>Okay, <00:13:57.915>cool. <00:13:58.115>Anyone <00:13:58.315>use <00:13:58.515>corcas <00:13:58.715>before? <00:13:58.915>Awesome. <00:13:59.115>Sweet.

338
00:14:01.945 --> 00:14:03.725
<00:14:01.945>So, <00:14:02.225>um, <00:14:02.505>I'm <00:14:02.785>gonna <00:14:03.065>go <00:14:03.345>ahead

339
00:14:03.725 --> 00:14:05.765
<00:14:03.725>and <00:14:03.958>I'm <00:14:04.191>seeded <00:14:04.425>into <00:14:04.658>my <00:14:04.891>directory <00:14:05.125>here.

340
00:14:05.865 --> 00:14:07.885
<00:14:05.865>I'm <00:14:06.145>gonna <00:14:06.425>do <00:14:06.705>a <00:14:06.985>caucus <00:14:07.265>dev.

341
00:14:08.155 --> 00:14:10.525
<00:14:08.155>Essentially <00:14:08.355>what <00:14:08.555>I <00:14:08.755>have <00:14:08.954>here <00:14:09.155>is <00:14:09.355>a <00:14:09.555>example

342
00:14:10.545 --> 00:14:11.885
<00:14:10.545>of <00:14:10.947>an <00:14:11.348>insurance <00:14:11.751>application.

343
00:14:11.905 --> 00:14:14.205
<00:14:11.905>So <00:14:12.105>we <00:14:12.305>can <00:14:12.505>see <00:14:12.704>different <00:14:12.905>user <00:14:13.105>claims, <00:14:13.305>uh,

344
00:14:14.205 --> 00:14:16.285
<00:14:14.205>but <00:14:14.380>we <00:14:14.555>also <00:14:14.730>have <00:14:14.905>Lang <00:14:15.080>Chain <00:14:15.255>as <00:14:15.430>a <00:14:15.605>dependency.

345
00:14:16.285 --> 00:14:17.925
<00:14:16.285>So <00:14:16.485>we <00:14:16.685>can <00:14:16.885>easily <00:14:17.084>connect <00:14:17.285>to <00:14:17.485>this <00:14:17.685>application

346
00:14:18.305 --> 00:14:21.165
<00:14:18.305>or <00:14:18.479>this <00:14:18.655>model, <00:14:18.829>sorry, <00:14:19.005>based <00:14:19.180>on <00:14:19.354>the <00:14:19.530>port, <00:14:19.704>uh,

347
00:14:21.245 --> 00:14:22.285
<00:14:21.245>that <00:14:21.713>we're <00:14:22.180>assigning,

348
00:14:22.285 --> 00:14:24.645
<00:14:22.285>or <00:14:22.412>if <00:14:22.539>we <00:14:22.666>wanna <00:14:22.794>connect <00:14:22.921>to <00:14:23.048>chat <00:14:23.175>GPT, <00:14:23.303>we <00:14:23.430>could <00:14:23.557>do <00:14:23.685>that

349
00:14:24.645 --> 00:14:26.965
<00:14:24.645>with <00:14:24.845>a <00:14:25.045>bar <00:14:25.245>token <00:14:25.444>and <00:14:25.645>the <00:14:25.845>authentication <00:14:26.045>there.

350
00:14:27.025 --> 00:14:28.285
<00:14:27.025>So <00:14:27.251>it <00:14:27.478>has <00:14:27.705>a <00:14:27.932>front <00:14:28.159>end

351
00:14:28.285 --> 00:14:29.485
<00:14:28.285>that <00:14:28.464>I'm <00:14:28.645>gonna <00:14:28.825>show <00:14:29.005>you <00:14:29.185>really <00:14:29.365>quickly

352
00:14:29.955 --> 00:14:31.165
<00:14:29.955>once <00:14:30.318>this <00:14:30.681>is <00:14:31.044>compiled.

353
00:14:31.225 --> 00:14:32.605
<00:14:31.225>So <00:14:31.535>it <00:14:31.846>looks <00:14:32.156>like, <00:14:32.467>um,

354
00:14:32.975 --> 00:14:36.605
<00:14:32.975>we've <00:14:33.130>got <00:14:33.286>a <00:14:33.441>application <00:14:33.597>running <00:14:33.752>on <00:14:33.908>local <00:14:34.063>host <00:14:34.219>port <00:14:34.375>8,005.

355
00:14:37.065 --> 00:14:39.005
<00:14:37.065>If <00:14:37.240>I <00:14:37.415>open <00:14:37.590>this <00:14:37.765>up, <00:14:37.940>we've <00:14:38.115>added <00:14:38.290>an <00:14:38.465>example

356
00:14:39.025 --> 00:14:40.685
<00:14:39.025>of <00:14:39.305>an <00:14:39.584>application <00:14:39.865>we're <00:14:40.145>working <00:14:40.425>on.

357
00:14:40.995 --> 00:14:42.885
<00:14:40.995>What <00:14:41.170>I've <00:14:41.345>done, <00:14:41.520>and <00:14:41.695>you <00:14:41.870>can <00:14:42.045>see <00:14:42.220>this <00:14:42.395>here,

358
00:14:42.945 --> 00:14:45.445
<00:14:42.945>is <00:14:43.178>added <00:14:43.411>the <00:14:43.645>ability <00:14:43.878>for, <00:14:44.111>uh, <00:14:44.345>chatbot.

359
00:14:45.445 --> 00:14:46.965
<00:14:45.445>So <00:14:45.640>this <00:14:45.835>is <00:14:46.031>done <00:14:46.226>with <00:14:46.422>a <00:14:46.617>web <00:14:46.813>socket.

360
00:14:47.225 --> 00:14:49.685
<00:14:47.225>Uh, <00:14:47.380>this <00:14:47.536>is <00:14:47.691>kind <00:14:47.847>of <00:14:48.002>simple <00:14:48.158>to <00:14:48.313>set <00:14:48.469>up, <00:14:48.625>uh,

361
00:14:49.745 --> 00:14:50.885
<00:14:49.745>in <00:14:50.001>this <00:14:50.258>specific <00:14:50.514>use <00:14:50.771>case

362
00:14:50.925 --> 00:14:54.365
<00:14:50.925>because <00:14:51.064>I'm <00:14:51.204>using <00:14:51.344>a <00:14:51.484>dependency <00:14:51.625>like <00:14:51.765>L <00:14:51.905>chain <00:14:52.045>for <00:14:52.185>J <00:14:52.324>uh,

363
00:14:54.365 --> 00:14:56.845
<00:14:54.365>that <00:14:54.520>allows <00:14:54.676>me <00:14:54.831>to <00:14:54.987>essentially <00:14:55.142>just <00:14:55.298>create <00:14:55.453>a <00:14:55.609>simple <00:14:55.765>web

364
00:14:56.845 --> 00:14:58.285
<00:14:56.845>socket <00:14:57.104>to <00:14:57.363>chat <00:14:57.622>with <00:14:57.881>the <00:14:58.141>application.

365
00:14:58.705 --> 00:15:01.885
<00:14:58.705>Um, <00:14:58.812>so <00:14:58.920>what <00:14:59.028>we <00:14:59.135>can <00:14:59.243>do <00:14:59.351>in <00:14:59.458>a <00:14:59.566>specific <00:14:59.674>use <00:14:59.781>case <00:14:59.889>like <00:14:59.997>this <00:15:00.105>is

366
00:15:01.945 --> 00:15:03.805
<00:15:01.945>ask <00:15:02.145>it <00:15:02.345>a <00:15:02.545>question <00:15:02.745>about <00:15:02.945>this <00:15:03.145>specific <00:15:03.345>claim.

367
00:15:03.905 --> 00:15:05.805
<00:15:03.905>So <00:15:04.185>we've <00:15:04.464>got <00:15:04.745>information <00:15:05.025>already <00:15:05.305>summarized

368
00:15:05.805 --> 00:15:06.845
<00:15:05.805>with <00:15:05.992>the <00:15:06.179>model <00:15:06.366>about <00:15:06.553>the <00:15:06.741>date

369
00:15:06.845 --> 00:15:08.845
<00:15:06.845>and <00:15:07.078>time, <00:15:07.311>the <00:15:07.545>sentiment <00:15:07.778>of <00:15:08.011>the <00:15:08.245>customer.

370
00:15:09.185 --> 00:15:14.045
<00:15:09.185>I'm <00:15:09.359>gonna <00:15:09.535>ask, <00:15:09.709>uh, <00:15:09.885>provide <00:15:10.060>me <00:15:10.234>the <00:15:10.410>contact <00:15:10.584>details

371
00:15:14.665 --> 00:15:16.005
<00:15:14.665>for <00:15:15.268>the <00:15:15.871>customer.

372
00:15:17.145 --> 00:15:19.605
<00:15:17.145>And <00:15:17.261>what <00:15:17.378>we <00:15:17.495>can <00:15:17.611>do <00:15:17.728>is <00:15:17.845>ask <00:15:17.961>the <00:15:18.078>model <00:15:18.194>a <00:15:18.311>question <00:15:18.428>like <00:15:18.545>this,

373
00:15:20.985 --> 00:15:25.685
<00:15:20.985>if, <00:15:21.112>uh, <00:15:21.239>if <00:15:21.366>I <00:15:21.494>had <00:15:21.621>pasted <00:15:21.748>the <00:15:21.875>correct <00:15:22.003>port <00:15:22.130>for <00:15:22.257>this <00:15:22.385>model.

374
00:15:25.825 --> 00:15:29.685
<00:15:25.825>So <00:15:25.952>let <00:15:26.079>me <00:15:26.206>go <00:15:26.334>ahead <00:15:26.461>and, <00:15:26.588>um, <00:15:26.715>refresh <00:15:26.843>this <00:15:26.970>and <00:15:27.097>try <00:15:27.225>again.

375
00:15:29.785 --> 00:15:32.845
<00:15:29.785>So, <00:15:29.940>uh, <00:15:30.096>now <00:15:30.251>that <00:15:30.407>I've <00:15:30.562>connected <00:15:30.718>to <00:15:30.873>the <00:15:31.029>actual <00:15:31.185>port

376
00:15:32.845 --> 00:15:34.885
<00:15:32.845>for <00:15:33.020>the <00:15:33.195>model, <00:15:33.370>uh, <00:15:33.545>let <00:15:33.720>me <00:15:33.895>ask <00:15:34.070>a <00:15:34.245>question.

377
00:15:35.385 --> 00:15:39.925
<00:15:35.385>Uh, <00:15:35.735>contact <00:15:36.085>details <00:15:36.435>for <00:15:36.785>customers.

378
00:15:39.925 --> 00:15:42.325
<00:15:39.925>And <00:15:40.064>what's <00:15:40.204>great <00:15:40.344>is <00:15:40.484>using <00:15:40.625>AI <00:15:40.765>like <00:15:40.905>this <00:15:41.045>in <00:15:41.185>natural <00:15:41.324>language

379
00:15:42.325 --> 00:15:43.645
<00:15:42.325>to <00:15:42.523>make <00:15:42.721>a <00:15:42.919>call <00:15:43.117>to <00:15:43.314>the <00:15:43.513>model.

380
00:15:43.745 --> 00:15:47.605
<00:15:43.745>So <00:15:43.861>I'll <00:15:43.978>show <00:15:44.095>you <00:15:44.211>what <00:15:44.328>just <00:15:44.445>happened <00:15:44.561>as <00:15:44.678>I <00:15:44.795>made <00:15:44.911>that <00:15:45.028>claim, <00:15:45.145>is

381
00:15:47.605 --> 00:15:51.125
<00:15:47.605>that <00:15:47.760>we <00:15:47.916>provided <00:15:48.071>the <00:15:48.227>context <00:15:48.382>of <00:15:48.538>the <00:15:48.693>actual <00:15:48.849>application, <00:15:49.005>uh,

382
00:15:51.585 --> 00:15:53.165
<00:15:51.585>of <00:15:51.935>the <00:15:52.285>actual, <00:15:52.635>sorry, <00:15:52.985>claim

383
00:15:53.315 --> 00:15:55.125
<00:15:53.315>that <00:15:53.595>we <00:15:53.875>have <00:15:54.155>from <00:15:54.435>the <00:15:54.715>application.

384
00:15:55.225 --> 00:15:56.845
<00:15:55.225>So, <00:15:55.458>uh, <00:15:55.691>we <00:15:55.925>have <00:15:56.158>a <00:15:56.391>claim <00:15:56.625>summary.

385
00:15:56.945 --> 00:15:59.485
<00:15:56.945>All <00:15:57.085>that <00:15:57.225>data <00:15:57.365>that <00:15:57.505>you <00:15:57.645>already <00:15:57.785>saw <00:15:57.925>that <00:15:58.065>was <00:15:58.205>extracted, <00:15:58.345>uh,

386
00:15:59.485 --> 00:16:02.525
<00:15:59.485>we <00:15:59.601>can <00:15:59.718>see <00:15:59.835>here <00:15:59.951>as <00:16:00.068>long, <00:16:00.185>uh, <00:16:00.301>uh, <00:16:00.418>as <00:16:00.535>well <00:16:00.651>as <00:16:00.768>a, <00:16:00.885>uh,

387
00:16:02.525 --> 00:16:04.325
<00:16:02.525>system <00:16:02.725>pro <00:16:02.925>so <00:16:03.125>that <00:16:03.324>it <00:16:03.525>can <00:16:03.725>help <00:16:03.925>us

388
00:16:04.585 --> 00:16:06.565
<00:16:04.585>and <00:16:04.865>actually <00:16:05.145>determine <00:16:05.425>what's <00:16:05.705>going <00:16:05.985>on.

389
00:16:06.665 --> 00:16:09.685
<00:16:06.665>So <00:16:06.792>we <00:16:06.919>have <00:16:07.046>our <00:16:07.174>response <00:16:07.301>back <00:16:07.428>in <00:16:07.555>tokens <00:16:07.683>where <00:16:07.810>we <00:16:07.937>can <00:16:08.064>see

390
00:16:09.685 --> 00:16:12.005
<00:16:09.685>that <00:16:09.859>it <00:16:10.035>went <00:16:10.209>through <00:16:10.385>the <00:16:10.560>information <00:16:10.734>we <00:16:10.910>have, <00:16:11.084>uh,

391
00:16:12.325 --> 00:16:14.325
<00:16:12.325>provided <00:16:12.500>all <00:16:12.675>the <00:16:12.850>information, <00:16:13.025>and <00:16:13.200>it's <00:16:13.375>gonna <00:16:13.550>really <00:16:13.725>help

392
00:16:14.395 --> 00:16:16.045
<00:16:14.395>with <00:16:14.745>different <00:16:15.095>use <00:16:15.444>cases <00:16:15.795>of

393
00:16:16.265 --> 00:16:18.165
<00:16:16.265>how <00:16:16.498>do <00:16:16.731>we <00:16:16.965>save <00:16:17.198>our <00:16:17.431>customers <00:16:17.665>time,

394
00:16:18.165 --> 00:16:20.325
<00:16:18.165>and <00:16:18.365>how <00:16:18.564>do <00:16:18.765>we <00:16:18.964>save <00:16:19.165>our <00:16:19.365>employees <00:16:19.564>time.

395
00:16:20.425 --> 00:16:22.285
<00:16:20.425>So <00:16:20.625>you <00:16:20.824>can <00:16:21.025>use <00:16:21.224>different <00:16:21.425>frameworks <00:16:21.625>like <00:16:21.824>that.

396
00:16:22.385 --> 00:16:25.325
<00:16:22.385>But <00:16:22.560>in <00:16:22.735>the <00:16:22.910>interest <00:16:23.085>of <00:16:23.260>time, <00:16:23.435>um, <00:16:23.610>I've <00:16:23.785>kind

397
00:16:25.325 --> 00:16:27.165
<00:16:25.325>of <00:16:25.480>talked <00:16:25.636>a <00:16:25.791>little <00:16:25.947>bit <00:16:26.102>about <00:16:26.258>pod <00:16:26.413>man, <00:16:26.569>AI <00:16:26.725>lab.

398
00:16:27.165 --> 00:16:29.485
<00:16:27.165>There's <00:16:27.339>a <00:16:27.515>whole <00:16:27.689>session <00:16:27.865>about <00:16:28.040>it <00:16:28.214>later <00:16:28.390>on <00:16:28.564>today

399
00:16:29.535 --> 00:16:31.245
<00:16:29.535>where <00:16:29.768>you <00:16:30.001>can <00:16:30.235>learn <00:16:30.468>about <00:16:30.701>playground <00:16:30.935>environments,

400
00:16:31.505 --> 00:16:33.965
<00:16:31.505>how <00:16:31.705>you <00:16:31.905>can <00:16:32.105>import <00:16:32.305>models <00:16:32.505>such <00:16:32.705>as <00:16:32.905>GGUF,

401
00:16:34.165 --> 00:16:36.525
<00:16:34.165>quantized <00:16:34.444>formats <00:16:34.724>from <00:16:35.005>hugging <00:16:35.285>face, <00:16:35.564>um,

402
00:16:36.545 --> 00:16:37.685
<00:16:36.545>and <00:16:36.887>the <00:16:37.228>different <00:16:37.570>recipes.

403
00:16:37.985 --> 00:16:41.165
<00:16:37.985>Let <00:16:38.112>me <00:16:38.239>head <00:16:38.366>back <00:16:38.494>over <00:16:38.621>to, <00:16:38.748>um, <00:16:38.875>the <00:16:39.003>next <00:16:39.130>step, <00:16:39.257>which <00:16:39.385>is

404
00:16:41.545 --> 00:16:43.805
<00:16:41.545>how <00:16:41.661>do <00:16:41.778>we <00:16:41.895>take <00:16:42.011>a <00:16:42.128>chat <00:16:42.245>bot, <00:16:42.361>like <00:16:42.478>the <00:16:42.594>one <00:16:42.711>we <00:16:42.828>just <00:16:42.944>had

405
00:16:44.105 --> 00:16:45.685
<00:16:44.105>and <00:16:44.385>expand <00:16:44.665>capabilities <00:16:44.945>to <00:16:45.225>it, <00:16:45.505>right?

406
00:16:45.685 --> 00:16:47.405
<00:16:45.685>Because <00:16:45.885>it <00:16:46.084>knows <00:16:46.285>that <00:16:46.484>the <00:16:46.685>sky <00:16:46.885>is <00:16:47.084>blue,

407
00:16:47.405 --> 00:16:48.885
<00:16:47.405>but <00:16:47.738>it <00:16:48.071>doesn't <00:16:48.404>know, <00:16:48.737>uh,

408
00:16:49.115 --> 00:16:50.765
<00:16:49.115>different <00:16:49.465>information <00:16:49.815>about <00:16:50.165>my <00:16:50.515>company,

409
00:16:50.765 --> 00:16:52.085
<00:16:50.765>about <00:16:51.062>my <00:16:51.359>specific <00:16:51.656>use <00:16:51.953>case.

410
00:16:52.505 --> 00:16:54.565
<00:16:52.505>Um, <00:16:52.738>because <00:16:52.971>let's <00:16:53.205>be <00:16:53.438>frank, <00:16:53.671>I <00:16:53.905>mean,

411
00:16:54.565 --> 00:16:56.005
<00:16:54.565>data <00:16:54.750>is <00:16:54.935>one <00:16:55.120>of <00:16:55.305>our <00:16:55.490>most <00:16:55.675>important <00:16:55.861>assets.

412
00:16:56.005 --> 00:16:59.405
<00:16:56.005>That's <00:16:56.145>why <00:16:56.285>a <00:16:56.425>lot <00:16:56.564>of <00:16:56.705>people <00:16:56.845>end <00:16:56.985>up <00:16:57.125>using <00:16:57.265>chat <00:16:57.405>GBT

413
00:16:59.465 --> 00:17:01.725
<00:16:59.465>or <00:16:59.698>Perplexity <00:16:59.931>to <00:17:00.165>answer <00:17:00.398>their <00:17:00.631>day-to-Day <00:17:00.865>questions,

414
00:17:01.725 --> 00:17:04.565
<00:17:01.725>because <00:17:01.865>we <00:17:02.005>can <00:17:02.145>use <00:17:02.285>these <00:17:02.425>models <00:17:02.565>in <00:17:02.705>order <00:17:02.845>to <00:17:02.985>work <00:17:03.125>with

415
00:17:04.705 --> 00:17:06.925
<00:17:04.704>so <00:17:04.905>much <00:17:05.105>data <00:17:05.304>that <00:17:05.504>a <00:17:05.704>regular <00:17:05.905>person <00:17:06.105>couldn't.

416
00:17:07.185 --> 00:17:08.845
<00:17:07.185>I'm <00:17:07.385>talking <00:17:07.585>about <00:17:07.784>things <00:17:07.984>in <00:17:08.185>our <00:17:08.385>enterprise, <00:17:08.585>such

417
00:17:08.845 --> 00:17:10.445
<00:17:08.845>as <00:17:09.311>technical <00:17:09.778>docs, <00:17:10.245>q

418
00:17:10.445 --> 00:17:14.325
<00:17:10.444>and <00:17:10.619>a <00:17:10.794>support <00:17:10.970>forms, <00:17:11.145>financial <00:17:11.319>documents <00:17:11.494>so <00:17:11.669>much <00:17:11.845>more

419
00:17:14.325 --> 00:17:17.285
<00:17:14.325>that <00:17:14.452>it <00:17:14.579>would <00:17:14.706>be <00:17:14.834>impossible <00:17:14.961>for <00:17:15.088>a <00:17:15.215>regular <00:17:15.343>human <00:17:15.470>to <00:17:15.597>be <00:17:15.725>able

420
00:17:17.285 --> 00:17:18.965
<00:17:17.285>to <00:17:17.635>understand <00:17:17.985>all <00:17:18.335>this <00:17:18.685>information.

421
00:17:19.145 --> 00:17:21.765
<00:17:19.145>So <00:17:19.345>what <00:17:19.545>we're <00:17:19.744>gonna <00:17:19.944>do <00:17:20.145>is <00:17:20.345>apply <00:17:20.545>RAG

422
00:17:21.765 --> 00:17:24.685
<00:17:21.765>to <00:17:21.920>our <00:17:22.076>application <00:17:22.231>Rag <00:17:22.387>is <00:17:22.542>a <00:17:22.698>pattern <00:17:22.853>that <00:17:23.009>allows <00:17:23.165>us

423
00:17:24.745 --> 00:17:26.245
<00:17:24.744>to <00:17:25.194>prompt <00:17:25.645>engineer, <00:17:26.094>which

424
00:17:26.995 --> 00:17:28.405
<00:17:26.994>it's <00:17:27.176>a <00:17:27.357>cool <00:17:27.538>title, <00:17:27.720>I <00:17:27.901>would <00:17:28.082>like <00:17:28.263>that.

425
00:17:28.865 --> 00:17:31.365
<00:17:28.865>Um, <00:17:29.065>but <00:17:29.265>we <00:17:29.465>can <00:17:29.665>essentially <00:17:29.865>take <00:17:30.065>more <00:17:30.265>information

426
00:17:31.435 --> 00:17:32.485
<00:17:31.435>from <00:17:31.907>a <00:17:32.379>database.

427
00:17:32.485 --> 00:17:34.085
<00:17:32.485>This <00:17:32.659>is <00:17:32.834>a <00:17:33.010>vector <00:17:33.185>database, <00:17:33.360>so <00:17:33.534>we <00:17:33.709>can <00:17:33.885>sort

428
00:17:34.365 --> 00:17:35.485
<00:17:34.365>documents <00:17:34.701>by <00:17:35.037>similarity <00:17:35.372>score.

429
00:17:35.585 --> 00:17:38.205
<00:17:35.585>We <00:17:35.725>could <00:17:35.865>also <00:17:36.005>use <00:17:36.145>a <00:17:36.285>SQL <00:17:36.425>database, <00:17:36.565>whatever <00:17:36.705>it <00:17:36.845>might <00:17:36.985>be

430
00:17:38.545 --> 00:17:40.685
<00:17:38.545>to <00:17:38.825>ingest <00:17:39.105>those <00:17:39.385>documents <00:17:39.665>initially, <00:17:39.945>right?

431
00:17:40.785 --> 00:17:41.965
<00:17:40.785>So <00:17:41.050>it <00:17:41.316>could <00:17:41.581>be <00:17:41.847>documentation,

432
00:17:41.965 --> 00:17:44.245
<00:17:41.965>it <00:17:42.139>could <00:17:42.314>be <00:17:42.490>financial <00:17:42.665>documents, <00:17:42.840>whatever <00:17:43.014>it <00:17:43.189>might <00:17:43.365>be.

433
00:17:44.705 --> 00:17:47.085
<00:17:44.705>Add <00:17:44.845>that <00:17:44.985>to <00:17:45.125>the <00:17:45.264>prompt <00:17:45.405>and <00:17:45.544>then <00:17:45.685>get <00:17:45.824>that <00:17:45.965>response <00:17:46.105>back.

434
00:17:47.085 --> 00:17:48.805
<00:17:47.085>That <00:17:47.365>is <00:17:47.645>augmented <00:17:47.925>by <00:17:48.205>the <00:17:48.485>LLM

435
00:17:48.805 --> 00:17:50.565
<00:17:48.805>to <00:17:49.085>provide <00:17:49.365>information <00:17:49.645>about <00:17:49.925>my <00:17:50.205>company,

436
00:17:51.065 --> 00:17:52.245
<00:17:51.065>my <00:17:51.419>information, <00:17:51.773>my <00:17:52.127>people.

437
00:17:52.665 --> 00:17:54.285
<00:17:52.665>Uh, <00:17:52.865>and <00:17:53.065>it's <00:17:53.264>a <00:17:53.465>really, <00:17:53.665>really <00:17:53.865>neat <00:17:54.065>pattern

438
00:17:54.285 --> 00:17:55.645
<00:17:54.285>because <00:17:54.591>it's <00:17:54.897>very <00:17:55.203>cost <00:17:55.509>effective.

439
00:17:55.645 --> 00:17:57.725
<00:17:55.645>We <00:17:55.820>can <00:17:55.995>use <00:17:56.170>a <00:17:56.345>base <00:17:56.520>foundation <00:17:56.695>model <00:17:56.870>like <00:17:57.045>Lamo

440
00:17:57.725 --> 00:17:58.845
<00:17:57.725>or <00:17:57.893>Mistral <00:17:58.061>as <00:17:58.229>we're <00:17:58.397>about <00:17:58.565>to <00:17:58.733>do.

441
00:17:59.265 --> 00:18:00.445
<00:17:59.265>And <00:17:59.442>we're <00:17:59.619>gonna <00:17:59.796>show <00:17:59.973>this <00:18:00.149>in <00:18:00.327>action.

442
00:18:00.505 --> 00:18:03.165
<00:18:00.505>So <00:18:00.632>I'm <00:18:00.759>gonna <00:18:00.886>have <00:18:01.014>to <00:18:01.141>speed <00:18:01.268>through <00:18:01.395>this <00:18:01.523>as, <00:18:01.650>uh, <00:18:01.777>I <00:18:01.905>kind

443
00:18:03.165 --> 00:18:06.365
<00:18:03.165>of <00:18:03.281>talked <00:18:03.398>too <00:18:03.514>long <00:18:03.631>about <00:18:03.748>Poin <00:18:03.865>AI <00:18:03.981>lab, <00:18:04.098>um, <00:18:04.215>but <00:18:04.331>I <00:18:04.448>love <00:18:04.565>it.

444
00:18:06.385 --> 00:18:08.845
<00:18:06.385>So <00:18:06.585>it's <00:18:06.785>okay. <00:18:06.985>And <00:18:07.185>I <00:18:07.385>showed <00:18:07.585>the <00:18:07.785>beginning

445
00:18:08.845 --> 00:18:11.405
<00:18:08.845>where <00:18:08.985>we <00:18:09.125>were <00:18:09.265>working <00:18:09.405>with <00:18:09.545>Poman <00:18:09.685>AI <00:18:09.825>Lab <00:18:09.965>as <00:18:10.105>a <00:18:10.245>developer,

446
00:18:11.625 --> 00:18:13.445
<00:18:11.625>but <00:18:11.780>what <00:18:11.936>does <00:18:12.091>it <00:18:12.247>mean <00:18:12.402>to <00:18:12.558>move <00:18:12.713>it <00:18:12.869>into <00:18:13.025>production?

447
00:18:13.445 --> 00:18:16.125
<00:18:13.445>Because <00:18:13.678>we're <00:18:13.911>gonna <00:18:14.145>show <00:18:14.378>using <00:18:14.611>OpenShift <00:18:14.845>ai,

448
00:18:16.125 --> 00:18:18.325
<00:18:16.125>which <00:18:16.280>is <00:18:16.436>a <00:18:16.591>collection <00:18:16.747>of <00:18:16.902>open <00:18:17.058>source <00:18:17.213>projects <00:18:17.369>for <00:18:17.525>AI

449
00:18:18.665 --> 00:18:20.085
<00:18:18.665>to <00:18:18.984>deploy <00:18:19.304>our <00:18:19.623>chat <00:18:19.943>app.

450
00:18:20.225 --> 00:18:24.205
<00:18:20.225>Now <00:18:20.380>we're <00:18:20.536>gonna <00:18:20.691>add, <00:18:20.847>um, <00:18:21.002>uh, <00:18:21.158>capabilities <00:18:21.313>for <00:18:21.469>rag, <00:18:21.625>uh,

451
00:18:24.205 --> 00:18:27.325
<00:18:24.205>working <00:18:24.485>with <00:18:24.764>Elasticsearch <00:18:25.044>as <00:18:25.324>a <00:18:25.605>database

452
00:18:27.425 --> 00:18:29.325
<00:18:27.425>and <00:18:27.600>importing <00:18:27.774>a <00:18:27.950>model <00:18:28.125>just <00:18:28.300>as <00:18:28.475>we <00:18:28.649>were <00:18:28.825>doing

453
00:18:29.435 --> 00:18:31.285
<00:18:29.435>with <00:18:29.784>our <00:18:30.135>local <00:18:30.485>development <00:18:30.835>environment.

454
00:18:31.665 --> 00:18:33.565
<00:18:31.665>So <00:18:31.820>I <00:18:31.976>want <00:18:32.131>to <00:18:32.287>quickly <00:18:32.442>talk <00:18:32.598>about <00:18:32.753>what <00:18:32.909>it <00:18:33.065>means

455
00:18:33.565 --> 00:18:34.605
<00:18:33.565>for <00:18:33.799>the <00:18:34.033>path <00:18:34.267>to <00:18:34.501>production.

456
00:18:34.605 --> 00:18:36.565
<00:18:34.605>It's <00:18:34.760>fun <00:18:34.916>to <00:18:35.071>work <00:18:35.227>with <00:18:35.382>this <00:18:35.538>on <00:18:35.693>my <00:18:35.849>local <00:18:36.005>machine,

457
00:18:36.985 --> 00:18:38.085
<00:18:36.985>but <00:18:37.232>when <00:18:37.480>we <00:18:37.727>actually <00:18:37.975>go

458
00:18:38.085 --> 00:18:40.325
<00:18:38.085>and <00:18:38.318>deploy <00:18:38.551>these <00:18:38.785>applications <00:18:39.018>to <00:18:39.251>production <00:18:39.485>environments,

459
00:18:40.325 --> 00:18:43.125
<00:18:40.325>we're <00:18:40.480>thinking <00:18:40.636>about <00:18:40.791>not <00:18:40.947>just <00:18:41.102>this <00:18:41.258>fun <00:18:41.413>part <00:18:41.569>down <00:18:41.725>here,

460
00:18:43.625 --> 00:18:45.365
<00:18:43.625>but <00:18:43.825>we're <00:18:44.025>thinking <00:18:44.225>about <00:18:44.425>how <00:18:44.625>are <00:18:44.825>we <00:18:45.025>working

461
00:18:45.365 --> 00:18:47.965
<00:18:45.365>with <00:18:45.598>different <00:18:45.831>streams <00:18:46.065>of <00:18:46.298>data <00:18:46.531>logs <00:18:46.765>information,

462
00:18:47.985 --> 00:18:49.765
<00:18:47.985>and <00:18:48.218>how <00:18:48.451>are <00:18:48.685>we <00:18:48.918>storing <00:18:49.151>this <00:18:49.385>and,

463
00:18:49.785 --> 00:18:52.205
<00:18:49.785>and <00:18:49.960>ingesting <00:18:50.135>this <00:18:50.310>so <00:18:50.485>that <00:18:50.660>we <00:18:50.835>can <00:18:51.010>build <00:18:51.185>models,

464
00:18:52.345 --> 00:18:54.525
<00:18:52.345>we <00:18:52.695>can <00:18:53.045>update <00:18:53.395>vector <00:18:53.745>databases,

465
00:18:54.545 --> 00:18:57.925
<00:18:54.545>we <00:18:54.685>can <00:18:54.825>build <00:18:54.965>out <00:18:55.105>rag <00:18:55.245>pipelines <00:18:55.385>to <00:18:55.525>then <00:18:55.665>deploy <00:18:55.805>those <00:18:55.945>models

466
00:18:58.025 --> 00:18:59.245
<00:18:58.025>or <00:18:58.391>deploy <00:18:58.757>those <00:18:59.122>applications

467
00:18:59.265 --> 00:19:03.605
<00:18:59.265>and <00:18:59.392>kind <00:18:59.519>of <00:18:59.646>have <00:18:59.774>this <00:18:59.901>whole <00:19:00.028>ML <00:19:00.155>lops <00:19:00.283>flow <00:19:00.410>of <00:19:00.537>deploying, <00:19:00.665>uh,

468
00:19:03.865 --> 00:19:05.085
<00:19:03.865>AI <00:19:04.414>enabled <00:19:04.963>applications.

469
00:19:05.105 --> 00:19:07.565
<00:19:05.105>But <00:19:05.338>with <00:19:05.571>all <00:19:05.805>the, <00:19:06.038>uh, <00:19:06.271>enterprise <00:19:06.505>features

470
00:19:07.585 --> 00:19:09.085
<00:19:07.585>and <00:19:07.855>production <00:19:08.125>features <00:19:08.395>that <00:19:08.665>we <00:19:08.935>need

471
00:19:09.085 --> 00:19:10.085
<00:19:09.085>for <00:19:09.535>actual <00:19:09.985>applications.

472
00:19:10.185 --> 00:19:11.765
<00:19:10.185>And <00:19:10.418>we <00:19:10.651>kind <00:19:10.885>of <00:19:11.118>show <00:19:11.351>this <00:19:11.585>before,

473
00:19:11.785 --> 00:19:13.885
<00:19:11.785>but <00:19:12.065>it's <00:19:12.345>not <00:19:12.625>just <00:19:12.905>the <00:19:13.185>containers

474
00:19:13.885 --> 00:19:15.605
<00:19:13.885>and <00:19:14.040>the <00:19:14.196>Python <00:19:14.351>code <00:19:14.507>that <00:19:14.662>we <00:19:14.818>have <00:19:14.973>to <00:19:15.129>think <00:19:15.285>about.

475
00:19:15.605 --> 00:19:18.005
<00:19:15.605>We <00:19:15.780>have <00:19:15.955>to <00:19:16.130>think <00:19:16.305>about <00:19:16.480>the <00:19:16.655>machine <00:19:16.830>learning <00:19:17.005>libraries,

476
00:19:18.145 --> 00:19:19.805
<00:19:18.145>the <00:19:18.378>IDs <00:19:18.611>that <00:19:18.845>we <00:19:19.078>might <00:19:19.311>be <00:19:19.545>using

477
00:19:19.865 --> 00:19:21.245
<00:19:19.865>or <00:19:20.072>our <00:19:20.279>data <00:19:20.485>scientists <00:19:20.693>might <00:19:20.899>be <00:19:21.107>using.

478
00:19:21.585 --> 00:19:24.445
<00:19:21.585>How <00:19:21.712>we <00:19:21.839>can <00:19:21.966>work <00:19:22.094>with <00:19:22.221>large <00:19:22.348>amounts <00:19:22.475>of <00:19:22.603>data <00:19:22.730>for <00:19:22.857>rag <00:19:22.985>pipeline,

479
00:19:24.445 --> 00:19:26.605
<00:19:24.445>like <00:19:24.725>tools <00:19:25.004>like <00:19:25.284>Ray <00:19:25.564>or <00:19:25.845>Airflow

480
00:19:26.605 --> 00:19:28.445
<00:19:26.605>or <00:19:27.071>Spark, <00:19:27.538>uh, <00:19:28.005>experimentation,

481
00:19:28.445 --> 00:19:30.765
<00:19:28.445>and <00:19:28.600>how <00:19:28.756>we <00:19:28.911>can <00:19:29.067>actually <00:19:29.222>run <00:19:29.378>these <00:19:29.533>under <00:19:29.689>Kubernetes <00:19:29.845>cluster

482
00:19:30.765 --> 00:19:32.605
<00:19:30.765>with <00:19:30.965>tools <00:19:31.165>like <00:19:31.365>KU <00:19:31.565>Flow <00:19:31.765>and <00:19:31.965>ML <00:19:32.165>flow

483
00:19:32.625 --> 00:19:35.965
<00:19:32.625>and <00:19:32.765>serve <00:19:32.905>the <00:19:33.045>models <00:19:33.185>with <00:19:33.325>Kerv <00:19:33.465>at <00:19:33.605>the <00:19:33.745>other <00:19:33.885>side, <00:19:34.025>right?

484
00:19:36.105 --> 00:19:37.565
<00:19:36.105>All <00:19:36.367>of <00:19:36.630>this <00:19:36.893>is <00:19:37.156>Linux <00:19:37.419>processes.

485
00:19:37.565 --> 00:19:40.765
<00:19:37.565>So <00:19:37.720>we <00:19:37.876>need <00:19:38.031>to <00:19:38.187>think <00:19:38.342>about <00:19:38.498>acceleration, <00:19:38.653>think <00:19:38.809>about, <00:19:38.965>uh,

486
00:19:41.005 --> 00:19:42.485
<00:19:41.005>Linux <00:19:41.338>to <00:19:41.671>run <00:19:42.004>these <00:19:42.337>processes.

487
00:19:42.545 --> 00:19:44.245
<00:19:42.545>I'm <00:19:42.745>on <00:19:42.945>a <00:19:43.145>Mac, <00:19:43.345>but <00:19:43.545>these <00:19:43.745>containers <00:19:43.945>inherently

488
00:19:44.345 --> 00:19:45.485
<00:19:44.345>are <00:19:44.858>Linux <00:19:45.370>containers.

489
00:19:45.865 --> 00:19:49.005
<00:19:45.865>Uh, <00:19:45.992>am <00:19:46.119>I <00:19:46.246>using <00:19:46.374>a <00:19:46.501>a <00:19:46.628>container <00:19:46.755>engine <00:19:46.883>like <00:19:47.010>Poin <00:19:47.137>or <00:19:47.265>Docker?

490
00:19:49.305 --> 00:19:51.965
<00:19:49.305>How <00:19:49.505>are <00:19:49.705>we <00:19:49.905>orchestrating <00:19:50.105>these <00:19:50.305>containerized <00:19:50.505>applications <00:19:50.705>in

491
00:19:51.965 --> 00:19:53.565
<00:19:51.965>a <00:19:52.198>way <00:19:52.431>that <00:19:52.665>we <00:19:52.898>can <00:19:53.131>scale, <00:19:53.365>right?

492
00:19:53.625 --> 00:19:55.325
<00:19:53.625>Not <00:19:53.825>just <00:19:54.025>one <00:19:54.225>application <00:19:54.425>on <00:19:54.625>my <00:19:54.825>local <00:19:55.025>machine,

493
00:19:55.625 --> 00:19:57.405
<00:19:55.625>but <00:19:55.975>thousands <00:19:56.325>of <00:19:56.675>different <00:19:57.025>microservices

494
00:19:57.405 --> 00:19:59.325
<00:19:57.405>that <00:19:57.685>are <00:19:57.965>all <00:19:58.245>working <00:19:58.524>together, <00:19:58.805>uh,

495
00:19:59.385 --> 00:20:01.125
<00:19:59.385>to <00:19:59.665>make <00:19:59.945>really <00:20:00.225>cool <00:20:00.504>applications <00:20:00.785>work.

496
00:20:01.505 --> 00:20:04.125
<00:20:01.505>Um, <00:20:01.680>we <00:20:01.855>also <00:20:02.030>think <00:20:02.205>about <00:20:02.380>how <00:20:02.555>we <00:20:02.730>can <00:20:02.905>visualize

497
00:20:04.425 --> 00:20:06.965
<00:20:04.425>and <00:20:04.658>understand <00:20:04.891>the <00:20:05.125>performance <00:20:05.358>of <00:20:05.591>our <00:20:05.825>applications

498
00:20:06.965 --> 00:20:09.205
<00:20:06.965>and <00:20:07.165>models, <00:20:07.365>how <00:20:07.564>we <00:20:07.764>automate <00:20:07.965>the <00:20:08.165>software <00:20:08.365>delivery

499
00:20:09.205 --> 00:20:10.445
<00:20:09.205>with <00:20:09.577>Teton <00:20:09.948>and <00:20:10.321>Argo.

500
00:20:10.825 --> 00:20:13.045
<00:20:10.825>Um, <00:20:11.058>and <00:20:11.291>think <00:20:11.525>about <00:20:11.758>software <00:20:11.991>design <00:20:12.225>storage.

501
00:20:13.055 --> 00:20:14.845
<00:20:13.055>Where <00:20:13.288>do <00:20:13.521>our, <00:20:13.755>where's <00:20:13.988>our <00:20:14.221>data <00:20:14.455>lie?

502
00:20:15.145 --> 00:20:17.685
<00:20:15.145>Um, <00:20:15.320>we <00:20:15.495>need <00:20:15.670>to <00:20:15.845>have <00:20:16.020>it <00:20:16.195>locally <00:20:16.370>on <00:20:16.545>premise,

503
00:20:17.825 --> 00:20:20.325
<00:20:17.825>or <00:20:18.000>can <00:20:18.175>we <00:20:18.350>have <00:20:18.525>it <00:20:18.700>somewhere <00:20:18.875>else <00:20:19.050>at <00:20:19.225>integration?

504
00:20:20.385 --> 00:20:21.805
<00:20:20.385>So <00:20:20.640>it's <00:20:20.896>a <00:20:21.151>whole <00:20:21.407>big <00:20:21.663>stack,

505
00:20:22.065 --> 00:20:23.765
<00:20:22.065>and <00:20:22.240>I <00:20:22.415>know <00:20:22.590>it <00:20:22.765>seems <00:20:22.940>a <00:20:23.115>little <00:20:23.290>bit <00:20:23.465>overwhelming,

506
00:20:23.825 --> 00:20:26.245
<00:20:23.825>but <00:20:24.025>what's <00:20:24.225>really <00:20:24.425>nice <00:20:24.625>is, <00:20:24.825>uh, <00:20:25.025>how <00:20:25.225>many

507
00:20:26.245 --> 00:20:28.165
<00:20:26.245>of <00:20:26.478>us <00:20:26.711>know <00:20:26.945>about <00:20:27.178>Fedora <00:20:27.411>for <00:20:27.645>Linux?

508
00:20:29.035 --> 00:20:32.605
<00:20:29.035>Cool. <00:20:29.162>So <00:20:29.289>Fedora, <00:20:29.416>you <00:20:29.544>know, <00:20:29.671>I, <00:20:29.798>I <00:20:29.925>haven't <00:20:30.053>used <00:20:30.180>it <00:20:30.307>too <00:20:30.435>much,

509
00:20:32.785 --> 00:20:34.085
<00:20:32.785>but <00:20:33.175>I <00:20:33.565>understand <00:20:33.955>that

510
00:20:34.085 --> 00:20:37.085
<00:20:34.085>what <00:20:34.260>Red <00:20:34.435>Hat <00:20:34.610>has <00:20:34.785>done <00:20:34.960>is <00:20:35.135>taken <00:20:35.310>a <00:20:35.485>variety

511
00:20:37.105 --> 00:20:38.365
<00:20:37.105>of <00:20:37.483>open <00:20:37.861>source <00:20:38.239>projects,

512
00:20:38.385 --> 00:20:40.485
<00:20:38.385>and <00:20:38.540>this <00:20:38.696>has <00:20:38.851>been <00:20:39.007>going <00:20:39.162>on <00:20:39.318>for <00:20:39.473>20, <00:20:39.629>30 <00:20:39.785>years

513
00:20:40.945 --> 00:20:42.285
<00:20:40.945>and <00:20:41.347>essentially <00:20:41.749>supported <00:20:42.151>them

514
00:20:42.285 --> 00:20:44.685
<00:20:42.285>and <00:20:42.518>productize <00:20:42.751>them <00:20:42.985>into <00:20:43.218>one <00:20:43.451>single <00:20:43.685>distribution.

515
00:20:44.945 --> 00:20:47.605
<00:20:44.945>And <00:20:45.072>what <00:20:45.199>we've <00:20:45.326>done <00:20:45.454>is <00:20:45.581>taken <00:20:45.708>all <00:20:45.835>the <00:20:45.963>tools <00:20:46.090>that <00:20:46.217>you <00:20:46.345>need

516
00:20:47.625 --> 00:20:49.445
<00:20:47.625>for, <00:20:47.975>uh, <00:20:48.325>an <00:20:48.675>application <00:20:49.025>and,

517
00:20:49.545 --> 00:20:52.925
<00:20:49.545>and <00:20:49.778>AI <00:20:50.011>enabled <00:20:50.245>platform <00:20:50.478>into <00:20:50.711>one <00:20:50.945>distribution.

518
00:20:53.065 --> 00:20:55.325
<00:20:53.065>And <00:20:53.220>now <00:20:53.376>you <00:20:53.531>have <00:20:53.687>a <00:20:53.842>way <00:20:53.998>and <00:20:54.153>a <00:20:54.309>supported <00:20:54.465>way.

519
00:20:55.505 --> 00:20:57.725
<00:20:55.505>And <00:20:55.660>this <00:20:55.816>is <00:20:55.971>an <00:20:56.127>open <00:20:56.282>source <00:20:56.438>project <00:20:56.593>as <00:20:56.749>well, <00:20:56.905>uh,

520
00:20:57.725 --> 00:20:59.445
<00:20:57.725>called <00:20:58.004>Open <00:20:58.284>Data <00:20:58.564>Hub <00:20:58.844>to, <00:20:59.125>uh,

521
00:20:59.625 --> 00:21:02.365
<00:20:59.625>run <00:20:59.825>these <00:21:00.025>AI <00:21:00.225>workloads <00:21:00.425>on <00:21:00.625>top <00:21:00.825>of <00:21:01.025>Kubernetes.

522
00:21:02.705 --> 00:21:04.285
<00:21:02.705>So <00:21:02.905>we're <00:21:03.105>gonna <00:21:03.304>show <00:21:03.504>this <00:21:03.705>in <00:21:03.905>action <00:21:04.105>here.

523
00:21:04.945 --> 00:21:06.605
<00:21:04.945>The, <00:21:05.411>uh, <00:21:05.878>ability <00:21:06.345>to

524
00:21:07.115 --> 00:21:09.285
<00:21:07.115>essentially <00:21:07.348>set <00:21:07.581>up <00:21:07.815>a <00:21:08.048>super <00:21:08.281>basic <00:21:08.515>rag

525
00:21:09.605 --> 00:21:10.965
<00:21:09.605>pipeline <00:21:09.911>to <00:21:10.216>serve <00:21:10.523>a <00:21:10.829>model.

526
00:21:10.975 --> 00:21:12.565
<00:21:10.975>We're <00:21:11.175>gonna <00:21:11.375>be <00:21:11.574>serving <00:21:11.774>the <00:21:11.975>same <00:21:12.175>exact <00:21:12.375>model

527
00:21:12.565 --> 00:21:14.325
<00:21:12.565>that <00:21:12.798>we <00:21:13.031>had <00:21:13.265>on <00:21:13.498>hugging <00:21:13.731>face, <00:21:13.965>um,

528
00:21:14.465 --> 00:21:16.365
<00:21:14.465>and, <00:21:14.745>uh, <00:21:15.024>work <00:21:15.304>with <00:21:15.584>collaboration <00:21:15.865>and,

529
00:21:16.365 --> 00:21:17.405
<00:21:16.365>and <00:21:16.677>import <00:21:16.989>other <00:21:17.301>users,

530
00:21:17.505 --> 00:21:19.165
<00:21:17.505>but <00:21:17.971>also, <00:21:18.438>uh, <00:21:18.905>ensure

531
00:21:19.165 --> 00:21:20.925
<00:21:19.165>that <00:21:19.398>we <00:21:19.631>have <00:21:19.865>lifecycle <00:21:20.098>for <00:21:20.331>this <00:21:20.565>application.

532
00:21:21.065 --> 00:21:23.245
<00:21:21.065>So <00:21:21.265>without <00:21:21.465>further <00:21:21.665>ado, <00:21:21.865>I <00:21:22.065>think <00:21:22.265>it's <00:21:22.465>time

533
00:21:23.245 --> 00:21:24.285
<00:21:23.245>for <00:21:23.557>the <00:21:23.869>second <00:21:24.181>demo.

534
00:21:24.585 --> 00:21:27.085
<00:21:24.585>Uh, <00:21:24.760>and <00:21:24.935>I'm <00:21:25.110>really <00:21:25.285>excited <00:21:25.460>to <00:21:25.635>show <00:21:25.810>you, <00:21:25.985>uh,

535
00:21:27.085 --> 00:21:28.205
<00:21:27.085>this <00:21:27.421>second <00:21:27.757>phase, <00:21:28.092>right?

536
00:21:28.205 --> 00:21:30.885
<00:21:28.205>We <00:21:28.379>were <00:21:28.554>working <00:21:28.730>with <00:21:28.905>these <00:21:29.080>local <00:21:29.254>applications <00:21:29.429>in <00:21:29.605>containers,

537
00:21:31.185 --> 00:21:32.405
<00:21:31.185>in <00:21:31.734>pods, <00:21:32.283>uh,

538
00:21:32.405 --> 00:21:33.845
<00:21:32.405>but <00:21:32.590>what <00:21:32.775>does <00:21:32.960>it <00:21:33.145>mean <00:21:33.330>to <00:21:33.515>actually <00:21:33.701>work

539
00:21:33.845 --> 00:21:35.525
<00:21:33.845>with <00:21:34.125>this <00:21:34.405>in <00:21:34.685>a <00:21:34.965>production <00:21:35.245>environment?

540
00:21:35.625 --> 00:21:38.725
<00:21:35.625>So, <00:21:35.780>uh, <00:21:35.936>here <00:21:36.091>is, <00:21:36.247>uh, <00:21:36.402>what <00:21:36.558>I <00:21:36.713>was <00:21:36.869>talking <00:21:37.025>about

541
00:21:38.745 --> 00:21:39.885
<00:21:38.745>as <00:21:39.258>OpenShift <00:21:39.771>ai.

542
00:21:39.905 --> 00:21:42.165
<00:21:39.905>So <00:21:40.060>it's <00:21:40.216>a <00:21:40.371>collection <00:21:40.527>of <00:21:40.682>these <00:21:40.838>different <00:21:40.993>open <00:21:41.149>source <00:21:41.305>projects

543
00:21:42.165 --> 00:21:43.205
<00:21:42.165>that <00:21:42.399>you <00:21:42.633>probably <00:21:42.867>heard <00:21:43.101>about.

544
00:21:43.225 --> 00:21:47.205
<00:21:43.225>So <00:21:43.380>kerv, <00:21:43.536>uh, <00:21:43.691>support <00:21:43.847>for <00:21:44.002>Jupiter <00:21:44.158>Hub <00:21:44.313>for <00:21:44.469>different, <00:21:44.625>uh,

545
00:21:47.205 --> 00:21:48.565
<00:21:47.205>libraries <00:21:47.817>like <00:21:48.429>PyTorch.

546
00:21:48.865 --> 00:21:51.925
<00:21:48.865>Um, <00:21:48.992>and <00:21:49.119>I've <00:21:49.246>set <00:21:49.374>up <00:21:49.501>this <00:21:49.628>project <00:21:49.755>so <00:21:49.883>that <00:21:50.010>we <00:21:50.137>have, <00:21:50.265>um,

547
00:21:52.025 --> 00:21:54.645
<00:21:52.025>the <00:21:52.225>ability <00:21:52.425>to <00:21:52.625>kind <00:21:52.825>of, <00:21:53.025>uh, <00:21:53.225>start <00:21:53.425>off

548
00:21:54.665 --> 00:21:57.205
<00:21:54.665>by <00:21:54.898>importing <00:21:55.131>objects <00:21:55.365>into <00:21:55.598>a <00:21:55.831>vector <00:21:56.065>database.

549
00:21:57.205 --> 00:21:59.365
<00:21:57.205>So <00:21:57.360>we <00:21:57.516>have <00:21:57.671>it <00:21:57.827>running <00:21:57.982>as <00:21:58.138>a, <00:21:58.293>uh, <00:21:58.449>elastic <00:21:58.605>search

550
00:21:59.365 --> 00:22:01.805
<00:21:59.365>as <00:21:59.598>a <00:21:59.831>operator <00:22:00.065>on <00:22:00.298>top <00:22:00.531>of <00:22:00.765>Kubernetes.

551
00:22:02.185 --> 00:22:03.685
<00:22:02.185>And <00:22:02.455>I'm <00:22:02.725>not <00:22:02.995>a <00:22:03.264>data <00:22:03.534>scientist,

552
00:22:03.685 --> 00:22:06.085
<00:22:03.685>but <00:22:03.825>I'm <00:22:03.965>gonna <00:22:04.105>quickly <00:22:04.245>kind <00:22:04.385>of <00:22:04.524>break <00:22:04.665>down <00:22:04.804>how <00:22:04.945>this <00:22:05.085>happens

553
00:22:06.265 --> 00:22:08.885
<00:22:06.265>for <00:22:06.545>ingesting <00:22:06.825>our <00:22:07.105>confidential <00:22:07.385>and, <00:22:07.665>and,

554
00:22:09.025 --> 00:22:10.645
<00:22:09.025>and, <00:22:09.491>uh, <00:22:09.958>company <00:22:10.425>data.

555
00:22:10.785 --> 00:22:13.285
<00:22:10.785>So <00:22:10.940>essentially <00:22:11.096>what <00:22:11.251>we've <00:22:11.407>done <00:22:11.562>is <00:22:11.718>set <00:22:11.873>up <00:22:12.029>a <00:22:12.185>connection

556
00:22:13.285 --> 00:22:15.285
<00:22:13.285>to <00:22:13.635>Elasticsearch <00:22:13.985>within <00:22:14.335>this <00:22:14.685>Jupiter

557
00:22:15.565 --> 00:22:16.605
<00:22:15.565>notebook <00:22:15.799>that's <00:22:16.033>on <00:22:16.267>the <00:22:16.501>cluster.

558
00:22:17.225 --> 00:22:20.845
<00:22:17.225>Um, <00:22:17.365>and <00:22:17.504>so <00:22:17.645>we <00:22:17.784>have <00:22:17.925>this <00:22:18.064>connection <00:22:18.205>here, <00:22:18.344>we've <00:22:18.485>verified <00:22:18.625>it,

559
00:22:20.845 --> 00:22:23.525
<00:22:20.845>and <00:22:21.045>we're <00:22:21.245>gonna <00:22:21.445>import <00:22:21.645>these <00:22:21.845>different, <00:22:22.045>um, <00:22:22.245>uh,

560
00:22:23.525 --> 00:22:26.685
<00:22:23.525>dependencies <00:22:23.665>in <00:22:23.805>order <00:22:23.945>to <00:22:24.085>break <00:22:24.225>up <00:22:24.365>our <00:22:24.505>data <00:22:24.645>into <00:22:24.785>chunks <00:22:24.925>so

561
00:22:26.685 --> 00:22:28.045
<00:22:26.685>that <00:22:26.929>the <00:22:27.174>model <00:22:27.419>can <00:22:27.664>ingest <00:22:27.909>it.

562
00:22:28.265 --> 00:22:30.525
<00:22:28.265>Uh, <00:22:28.498>a <00:22:28.731>popular <00:22:28.965>one <00:22:29.198>is <00:22:29.431>PI <00:22:29.665>PDF,

563
00:22:30.525 --> 00:22:31.845
<00:22:30.525>but <00:22:30.723>there's <00:22:30.921>a <00:22:31.119>variety <00:22:31.317>of <00:22:31.515>other <00:22:31.713>ways

564
00:22:31.845 --> 00:22:33.245
<00:22:31.845>that <00:22:32.025>you <00:22:32.205>can <00:22:32.385>set <00:22:32.565>up <00:22:32.745>a <00:22:32.925>rag <00:22:33.105>pipeline

565
00:22:33.245 --> 00:22:34.645
<00:22:33.245>and <00:22:33.496>kind <00:22:33.749>of <00:22:34.001>ingest <00:22:34.253>this <00:22:34.504>documentation.

566
00:22:34.975 --> 00:22:37.885
<00:22:34.975>We've <00:22:35.102>got <00:22:35.229>a <00:22:35.356>lot <00:22:35.484>of <00:22:35.611>documents <00:22:35.738>that <00:22:35.865>we're <00:22:35.993>gonna <00:22:36.120>be <00:22:36.247>using, <00:22:36.375>uh,

567
00:22:37.905 --> 00:22:39.725
<00:22:37.905>and <00:22:38.185>these <00:22:38.465>are <00:22:38.745>actually <00:22:39.024>publicly <00:22:39.305>accessible,

568
00:22:39.755 --> 00:22:41.285
<00:22:39.755>nothing <00:22:40.099>private <00:22:40.443>going <00:22:40.787>on <00:22:41.132>here.

569
00:22:41.585 --> 00:22:44.125
<00:22:41.585>Um, <00:22:41.725>and <00:22:41.865>so <00:22:42.005>we <00:22:42.145>can <00:22:42.285>see <00:22:42.425>that <00:22:42.565>we <00:22:42.705>have <00:22:42.845>a <00:22:42.985>lot

570
00:22:44.125 --> 00:22:46.245
<00:22:44.125>of <00:22:44.405>different <00:22:44.685>documentation <00:22:44.965>about <00:22:45.245>OpenShift <00:22:45.525>ai.

571
00:22:46.385 --> 00:22:48.285
<00:22:46.385>So <00:22:46.560>this <00:22:46.735>is <00:22:46.910>all <00:22:47.085>in <00:22:47.260>the <00:22:47.435>form <00:22:47.610>of <00:22:47.785>PDFs.

572
00:22:48.355 --> 00:22:49.805
<00:22:48.355>Your <00:22:48.616>data <00:22:48.877>could <00:22:49.138>be <00:22:49.399>something <00:22:49.660>different.

573
00:22:50.115 --> 00:22:53.885
<00:22:50.115>What <00:22:50.290>we're <00:22:50.465>doing <00:22:50.640>is <00:22:50.815>essentially <00:22:50.990>going <00:22:51.165>to <00:22:51.340>chunk <00:22:51.515>them

574
00:22:53.905 --> 00:22:55.285
<00:22:53.905>and <00:22:54.112>split <00:22:54.319>them <00:22:54.526>up <00:22:54.733>into <00:22:54.940>different <00:22:55.147>pieces,

575
00:22:55.705 --> 00:22:58.285
<00:22:55.705>and <00:22:55.905>also <00:22:56.105>include <00:22:56.304>references <00:22:56.504>to <00:22:56.705>the <00:22:56.905>website <00:22:57.105>so

576
00:22:58.285 --> 00:23:01.605
<00:22:58.285>that <00:22:58.425>when <00:22:58.565>I <00:22:58.705>ask <00:22:58.845>the <00:22:58.985>chat <00:22:59.125>bot, <00:22:59.265>um, <00:22:59.405>for <00:22:59.545>example, <00:22:59.685>uh,

577
00:23:01.605 --> 00:23:03.805
<00:23:01.605>this <00:23:01.838>same <00:23:02.071>one <00:23:02.305>information, <00:23:02.538>it's <00:23:02.771>now <00:23:03.005>going

578
00:23:03.805 --> 00:23:06.565
<00:23:03.805>to <00:23:04.005>have <00:23:04.205>the <00:23:04.405>information <00:23:04.605>from <00:23:04.805>my <00:23:05.005>enterprise <00:23:05.205>data.

579
00:23:06.825 --> 00:23:11.085
<00:23:06.825>Uh, <00:23:06.952>so <00:23:07.079>we <00:23:07.206>can <00:23:07.334>do <00:23:07.461>this <00:23:07.588>in, <00:23:07.715>um, <00:23:07.843>in <00:23:07.970>this <00:23:08.097>specific, <00:23:08.225>uh,

580
00:23:11.325 --> 00:23:12.565
<00:23:11.325>rag <00:23:11.548>pipeline <00:23:11.771>that <00:23:11.994>I'm <00:23:12.217>setting <00:23:12.441>up,

581
00:23:12.625 --> 00:23:14.605
<00:23:12.625>but <00:23:12.858>we <00:23:13.091>would <00:23:13.325>wanna <00:23:13.558>automate <00:23:13.791>this, <00:23:14.025>right?

582
00:23:14.605 --> 00:23:17.565
<00:23:14.605>Theoretically, <00:23:14.780>uh, <00:23:14.955>what <00:23:15.130>we're <00:23:15.305>gonna <00:23:15.480>do <00:23:15.655>is <00:23:15.830>split <00:23:16.005>documents.

583
00:23:17.565 --> 00:23:21.285
<00:23:17.565>We're <00:23:17.705>going <00:23:17.845>to, <00:23:17.985>uh, <00:23:18.125>create <00:23:18.265>an <00:23:18.405>index <00:23:18.545>in <00:23:18.685>our <00:23:18.825>vector <00:23:18.965>database.

584
00:23:21.415 --> 00:23:23.125
<00:23:21.415>We're <00:23:21.648>gonna <00:23:21.881>use <00:23:22.115>hugging <00:23:22.348>face <00:23:22.581>embedding <00:23:22.815>so

585
00:23:23.125 --> 00:23:24.605
<00:23:23.125>that <00:23:23.391>we <00:23:23.657>can <00:23:23.924>understand <00:23:24.190>the <00:23:24.457>similarity

586
00:23:24.605 --> 00:23:26.365
<00:23:24.605>between <00:23:24.838>different <00:23:25.071>documents <00:23:25.305>and <00:23:25.538>sort <00:23:25.771>that <00:23:26.005>later.

587
00:23:26.825 --> 00:23:30.365
<00:23:26.825>Uh, <00:23:26.952>and <00:23:27.079>we're <00:23:27.206>going <00:23:27.334>to <00:23:27.461>create, <00:23:27.588>uh, <00:23:27.715>this <00:23:27.843>huge <00:23:27.970>array <00:23:28.097>with <00:23:28.225>all

588
00:23:30.365 --> 00:23:32.525
<00:23:30.365>of <00:23:30.520>the <00:23:30.676>documents <00:23:30.831>that <00:23:30.987>we've <00:23:31.142>adjusted, <00:23:31.298>all <00:23:31.453>of <00:23:31.609>these <00:23:31.765>PDFs

589
00:23:32.665 --> 00:23:35.765
<00:23:32.665>to <00:23:32.820>finally <00:23:32.976>be <00:23:33.131>able <00:23:33.287>to <00:23:33.442>search <00:23:33.598>with <00:23:33.753>a <00:23:33.909>similarity <00:23:34.065>score,

590
00:23:36.185 --> 00:23:37.405
<00:23:36.185>uh, <00:23:36.734>natural <00:23:37.283>language.

591
00:23:37.465 --> 00:23:39.885
<00:23:37.465>So <00:23:37.605>my <00:23:37.745>query <00:23:37.885>here <00:23:38.024>is <00:23:38.165>how <00:23:38.304>can <00:23:38.445>I <00:23:38.584>work <00:23:38.725>with <00:23:38.865>GPU

592
00:23:39.885 --> 00:23:41.085
<00:23:39.885>and <00:23:40.155>Tain <00:23:40.425>and <00:23:40.695>OpenShift <00:23:40.965>ai?

593
00:23:41.425 --> 00:23:43.485
<00:23:41.425>Uh, <00:23:41.600>we're <00:23:41.774>doing <00:23:41.950>a <00:23:42.125>search <00:23:42.300>for <00:23:42.475>a <00:23:42.649>similarity <00:23:42.825>score,

594
00:23:43.505 --> 00:23:45.485
<00:23:43.505>and <00:23:43.680>we <00:23:43.855>have <00:23:44.030>all <00:23:44.205>of <00:23:44.380>the <00:23:44.555>information <00:23:44.730>down <00:23:44.905>here.

595
00:23:45.985 --> 00:23:48.205
<00:23:45.985>Uh, <00:23:46.185>of <00:23:46.385>course <00:23:46.584>this <00:23:46.784>isn't <00:23:46.985>formatted <00:23:47.185>well, <00:23:47.385>uh,

596
00:23:48.205 --> 00:23:49.565
<00:23:48.205>but <00:23:48.511>related <00:23:48.817>to <00:23:49.123>our <00:23:49.429>search.

597
00:23:49.745 --> 00:23:52.325
<00:23:49.745>And <00:23:49.872>when <00:23:49.999>we <00:23:50.126>pass <00:23:50.254>that <00:23:50.381>to <00:23:50.508>the <00:23:50.635>model, <00:23:50.763>it's <00:23:50.890>gonna <00:23:51.017>be <00:23:51.145>able

598
00:23:52.325 --> 00:23:53.885
<00:23:52.325>to <00:23:52.605>understand, <00:23:52.885>okay, <00:23:53.165>what <00:23:53.445>is <00:23:53.725>relevant

599
00:23:53.885 --> 00:23:55.125
<00:23:53.885>for <00:23:54.257>this <00:23:54.629>specific <00:23:55.001>situation?

600
00:23:55.425 --> 00:23:58.445
<00:23:55.425>And <00:23:55.532>pass <00:23:55.640>that <00:23:55.748>back <00:23:55.855>to <00:23:55.963>me <00:23:56.071>in <00:23:56.178>the <00:23:56.286>form <00:23:56.394>of <00:23:56.501>this <00:23:56.609>chat <00:23:56.717>bot, <00:23:56.825>uh,

601
00:23:58.445 --> 00:23:59.605
<00:23:58.445>but <00:23:58.653>now <00:23:58.862>in <00:23:59.071>a <00:23:59.280>production <00:23:59.489>sense.

602
00:23:59.865 --> 00:24:00.885
<00:23:59.865>So <00:24:00.171>I'll <00:24:00.477>go <00:24:00.783>ahead

603
00:24:00.885 --> 00:24:03.525
<00:24:00.885>and <00:24:01.040>show <00:24:01.196>you <00:24:01.351>really <00:24:01.507>quickly <00:24:01.662>what <00:24:01.818>it <00:24:01.973>means <00:24:02.129>to, <00:24:02.285>now

604
00:24:03.685 --> 00:24:05.605
<00:24:03.685>that <00:24:03.918>we <00:24:04.151>have <00:24:04.385>an <00:24:04.618>a <00:24:04.851>Vector <00:24:05.085>database,

605
00:24:05.705 --> 00:24:07.965
<00:24:05.705>and <00:24:05.860>now <00:24:06.016>that <00:24:06.171>we <00:24:06.327>have, <00:24:06.482>um, <00:24:06.638>I'll <00:24:06.793>show <00:24:06.949>you <00:24:07.105>the,

606
00:24:08.025 --> 00:24:09.245
<00:24:08.025>the <00:24:08.299>model <00:24:08.574>that <00:24:08.848>we've <00:24:09.122>uploaded.

607
00:24:09.465 --> 00:24:12.245
<00:24:09.465>So, <00:24:09.620>um, <00:24:09.776>we <00:24:09.931>have <00:24:10.087>Minio <00:24:10.242>here <00:24:10.398>as <00:24:10.553>a <00:24:10.709>object <00:24:10.865>store.

608
00:24:12.555 --> 00:24:15.605
<00:24:12.555>I've <00:24:12.710>gone <00:24:12.866>ahead <00:24:13.021>and <00:24:13.177>uploaded <00:24:13.332>a <00:24:13.488>menstrual <00:24:13.643>seven <00:24:13.799>B <00:24:13.955>quantized,

609
00:24:15.785 --> 00:24:19.925
<00:24:15.785>uh, <00:24:15.912>format, <00:24:16.039>uh, <00:24:16.166>model <00:24:16.294>here <00:24:16.421>in <00:24:16.548>the, <00:24:16.675>um, <00:24:16.803>in <00:24:16.930>the <00:24:17.057>bucket <00:24:17.185>so

610
00:24:19.925 --> 00:24:21.805
<00:24:19.925>that <00:24:20.125>we <00:24:20.325>can <00:24:20.524>access <00:24:20.725>that <00:24:20.925>from <00:24:21.125>OpenShift <00:24:21.325>ai.

611
00:24:22.005 --> 00:24:25.205
<00:24:22.005>And <00:24:22.160>so <00:24:22.316>it <00:24:22.471>uses, <00:24:22.627>um, <00:24:22.782>a <00:24:22.938>variety <00:24:23.093>of <00:24:23.249>different <00:24:23.405>runtimes.

612
00:24:25.785 --> 00:24:30.005
<00:24:25.785>So <00:24:25.892>I <00:24:26.000>could <00:24:26.108>use <00:24:26.215>VLLM, <00:24:26.323>I <00:24:26.431>could <00:24:26.538>use <00:24:26.646>LAMA <00:24:26.754>c <00:24:26.861>plus <00:24:26.969>plus, <00:24:27.077>open <00:24:27.185>vno,

613
00:24:30.165 --> 00:24:32.845
<00:24:30.165>whatever <00:24:30.320>it <00:24:30.476>might <00:24:30.631>be, <00:24:30.787>uh, <00:24:30.942>to <00:24:31.098>essentially <00:24:31.253>create <00:24:31.409>an <00:24:31.565>endpoint

614
00:24:32.945 --> 00:24:34.445
<00:24:32.945>for <00:24:33.169>us <00:24:33.395>to <00:24:33.620>be <00:24:33.845>able <00:24:34.070>to <00:24:34.294>invoke.

615
00:24:34.625 --> 00:24:37.045
<00:24:34.625>And <00:24:34.741>I <00:24:34.858>could <00:24:34.975>take <00:24:35.091>this <00:24:35.208>and <00:24:35.325>open <00:24:35.441>up <00:24:35.558>my <00:24:35.675>terminal, <00:24:35.791>do <00:24:35.908>a <00:24:36.025>curl,

616
00:24:37.425 --> 00:24:40.405
<00:24:37.425>or <00:24:37.552>I <00:24:37.679>could <00:24:37.806>add <00:24:37.934>authentication <00:24:38.061>to <00:24:38.188>it, <00:24:38.315>whatever <00:24:38.443>we <00:24:38.570>want <00:24:38.697>to <00:24:38.825>do.

617
00:24:40.745 --> 00:24:42.525
<00:24:40.745>But <00:24:40.978>we <00:24:41.211>have <00:24:41.445>a <00:24:41.678>model <00:24:41.911>running <00:24:42.145>just

618
00:24:42.525 --> 00:24:44.085
<00:24:42.525>as <00:24:42.758>we <00:24:42.991>would <00:24:43.225>in <00:24:43.458>a <00:24:43.691>local <00:24:43.925>environment.

619
00:24:44.085 --> 00:24:46.765
<00:24:44.085>But <00:24:44.318>now, <00:24:44.551>uh, <00:24:44.785>with, <00:24:45.018>um, <00:24:45.251>the <00:24:45.485>ability

620
00:24:46.825 --> 00:24:48.285
<00:24:46.825>to <00:24:47.263>have <00:24:47.701>serverless <00:24:48.139>functions.

621
00:24:48.285 --> 00:24:50.365
<00:24:48.285>So <00:24:48.485>if <00:24:48.685>we <00:24:48.885>have <00:24:49.085>more <00:24:49.285>requests, <00:24:49.485>uh, <00:24:49.685>the,

622
00:24:50.465 --> 00:24:52.125
<00:24:50.465>the <00:24:50.814>environment's <00:24:51.165>gonna <00:24:51.514>scale <00:24:51.865>up

623
00:24:52.125 --> 00:24:54.245
<00:24:52.125>and <00:24:52.325>it's <00:24:52.525>very <00:24:52.725>helpful <00:24:52.925>for <00:24:53.125>these <00:24:53.325>production <00:24:53.525>applications.

624
00:24:54.665 --> 00:24:58.125
<00:24:54.665>Um, <00:24:54.792>I <00:24:54.919>want <00:24:55.046>to <00:24:55.174>quickly <00:24:55.301>talk <00:24:55.428>about <00:24:55.555>what <00:24:55.683>it <00:24:55.810>means <00:24:55.937>to, <00:24:56.065>um,

625
00:24:58.985 --> 00:25:00.885
<00:24:58.985>update <00:24:59.264>my <00:24:59.544>code <00:24:59.824>for <00:25:00.104>this <00:25:00.385>functionality.

626
00:25:01.105 --> 00:25:04.725
<00:25:01.105>So, <00:25:01.221>um, <00:25:01.338>this <00:25:01.455>is <00:25:01.571>the <00:25:01.688>same <00:25:01.805>chat <00:25:01.921>bot <00:25:02.038>that <00:25:02.155>we <00:25:02.271>were <00:25:02.388>using <00:25:02.505>before.

627
00:25:04.825 --> 00:25:06.525
<00:25:04.825>So <00:25:05.025>we <00:25:05.225>were <00:25:05.425>connecting <00:25:05.625>to <00:25:05.825>a <00:25:06.025>model <00:25:06.225>endpoint.

628
00:25:06.825 --> 00:25:08.685
<00:25:06.825>Um, <00:25:07.025>I <00:25:07.225>wanna <00:25:07.425>show <00:25:07.625>you <00:25:07.825>what <00:25:08.025>it <00:25:08.225>means

629
00:25:08.705 --> 00:25:12.205
<00:25:08.705>to <00:25:08.905>add <00:25:09.105>very <00:25:09.304>briefly <00:25:09.504>the <00:25:09.705>capabilities <00:25:09.905>for, <00:25:10.105>um,

630
00:25:12.335 --> 00:25:13.525
<00:25:12.335>being <00:25:12.549>able <00:25:12.763>to <00:25:12.977>work <00:25:13.191>with <00:25:13.406>rag.

631
00:25:13.525 --> 00:25:14.965
<00:25:13.525>So <00:25:13.687>the <00:25:13.849>first <00:25:14.011>thing, <00:25:14.173>and <00:25:14.335>I'm <00:25:14.497>just <00:25:14.658>gonna <00:25:14.821>have

632
00:25:14.965 --> 00:25:18.205
<00:25:14.965>to <00:25:15.072>paste <00:25:15.180>this <00:25:15.288>over <00:25:15.395>'cause <00:25:15.503>it's <00:25:15.611>a <00:25:15.718>lot <00:25:15.826>of <00:25:15.934>code, <00:25:16.041>is <00:25:16.149>that <00:25:16.257>I <00:25:16.365>want

633
00:25:18.205 --> 00:25:19.725
<00:25:18.205>to <00:25:18.478>add <00:25:18.752>in <00:25:19.025>some <00:25:19.299>environment <00:25:19.572>variables.

634
00:25:19.785 --> 00:25:21.365
<00:25:19.785>So <00:25:20.065>the <00:25:20.345>ones <00:25:20.625>I'm <00:25:20.905>gonna <00:25:21.185>ask

635
00:25:21.585 --> 00:25:25.045
<00:25:21.585>or <00:25:21.712>add <00:25:21.839>are <00:25:21.966>the <00:25:22.094>ability <00:25:22.221>to <00:25:22.348>connect <00:25:22.475>to <00:25:22.603>a <00:25:22.730>model <00:25:22.857>endpoint, <00:25:22.985>the,

636
00:25:25.265 --> 00:25:27.845
<00:25:25.265>uh, <00:25:25.545>authentication <00:25:25.825>for <00:25:26.105>our <00:25:26.385>elastic <00:25:26.665>search.

637
00:25:28.345 --> 00:25:31.525
<00:25:28.345>And, <00:25:28.520>um, <00:25:28.695>now <00:25:28.870>when <00:25:29.045>we <00:25:29.220>pass <00:25:29.395>that <00:25:29.570>in, <00:25:29.745>uh,

638
00:25:31.625 --> 00:25:33.605
<00:25:31.625>and <00:25:31.800>we <00:25:31.975>run <00:25:32.150>this <00:25:32.325>container <00:25:32.500>on <00:25:32.675>top <00:25:32.850>of <00:25:33.025>Kubernetes,

639
00:25:33.605 --> 00:25:35.685
<00:25:33.605>we're <00:25:33.885>gonna <00:25:34.165>pull <00:25:34.445>in <00:25:34.725>the <00:25:35.005>URL,

640
00:25:35.865 --> 00:25:37.765
<00:25:35.865>the <00:25:36.020>same <00:25:36.176>one <00:25:36.331>here <00:25:36.487>and <00:25:36.642>be <00:25:36.798>able <00:25:36.953>to <00:25:37.109>run <00:25:37.265>that.

641
00:25:38.185 --> 00:25:41.165
<00:25:38.185>Um, <00:25:38.325>I <00:25:38.465>also <00:25:38.605>want <00:25:38.745>to <00:25:38.885>kind <00:25:39.024>of <00:25:39.165>set <00:25:39.304>up, <00:25:39.445>um, <00:25:39.585>uh,

642
00:25:41.185 --> 00:25:42.485
<00:25:41.185>an <00:25:41.574>elastic <00:25:41.965>search <00:25:42.355>connection.

643
00:25:42.865 --> 00:25:43.925
<00:25:42.865>So <00:25:43.103>I'll <00:25:43.342>go <00:25:43.580>down <00:25:43.819>here

644
00:25:44.225 --> 00:25:48.805
<00:25:44.225>and <00:25:44.352>I'll <00:25:44.479>add <00:25:44.606>this, <00:25:44.734>um, <00:25:44.861>probably <00:25:44.988>down <00:25:45.115>here <00:25:45.243>to <00:25:45.370>be <00:25:45.497>able <00:25:45.625>to,

645
00:25:48.865 --> 00:25:50.725
<00:25:48.865>and <00:25:49.020>I'm <00:25:49.176>gonna <00:25:49.331>have <00:25:49.487>to <00:25:49.642>paste <00:25:49.798>this <00:25:49.953>in <00:25:50.109>real <00:25:50.265>quickly,

646
00:25:50.985 --> 00:25:54.325
<00:25:50.985>set <00:25:51.159>up <00:25:51.334>a <00:25:51.510>connection <00:25:51.685>with <00:25:51.860>Elasticsearch <00:25:52.034>as <00:25:52.209>a <00:25:52.385>dependency,

647
00:25:54.325 --> 00:25:56.765
<00:25:54.325>and <00:25:54.480>I'll <00:25:54.636>have <00:25:54.791>to <00:25:54.947>update <00:25:55.102>my <00:25:55.258>requirements <00:25:55.413>TXT <00:25:55.569>as <00:25:55.725>well.

648
00:25:57.305 --> 00:25:59.685
<00:25:57.305>Um, <00:25:57.480>so <00:25:57.655>what <00:25:57.830>we're <00:25:58.005>gonna <00:25:58.180>do <00:25:58.355>here <00:25:58.530>is <00:25:58.705>just

649
00:25:59.685 --> 00:26:01.565
<00:25:59.685>as <00:25:59.860>we <00:26:00.034>were <00:26:00.210>doing <00:26:00.385>in <00:26:00.560>the <00:26:00.735>notebook, <00:26:00.909>we're <00:26:01.085>going

650
00:26:01.565 --> 00:26:04.245
<00:26:01.565>to <00:26:01.692>set <00:26:01.819>up <00:26:01.946>a <00:26:02.074>connection <00:26:02.201>to <00:26:02.328>our <00:26:02.455>elastic <00:26:02.583>search, <00:26:02.710>URL <00:26:02.837>with <00:26:02.965>our,

651
00:26:04.265 --> 00:26:07.525
<00:26:04.265>our <00:26:04.440>credentials <00:26:04.615>set <00:26:04.790>up <00:26:04.965>a <00:26:05.140>new <00:26:05.315>embeddings, <00:26:05.490>um, <00:26:05.665>so

652
00:26:07.525 --> 00:26:09.605
<00:26:07.525>that <00:26:07.700>we <00:26:07.875>can <00:26:08.050>search, <00:26:08.225>uh, <00:26:08.400>from <00:26:08.575>this <00:26:08.750>vector <00:26:08.925>database.

653
00:26:09.905 --> 00:26:12.845
<00:26:09.905>Uh, <00:26:10.105>we're <00:26:10.305>gonna <00:26:10.504>use <00:26:10.705>this <00:26:10.905>same <00:26:11.105>prompt <00:26:11.305>template.

654
00:26:13.225 --> 00:26:15.005
<00:26:13.225>Um, <00:26:13.691>but <00:26:14.158>now <00:26:14.625>essentially

655
00:26:15.005 --> 00:26:17.925
<00:26:15.005>what <00:26:15.145>we <00:26:15.285>can <00:26:15.425>do <00:26:15.565>is <00:26:15.705>we <00:26:15.845>have <00:26:15.985>the <00:26:16.125>prompt <00:26:16.265>functionality <00:26:16.405>right

656
00:26:17.925 --> 00:26:21.245
<00:26:17.925>here <00:26:18.052>of, <00:26:18.179>Hey, <00:26:18.306>I <00:26:18.434>want <00:26:18.561>you <00:26:18.688>to <00:26:18.815>respond <00:26:18.943>back <00:26:19.070>to <00:26:19.197>my <00:26:19.325>context,

657
00:26:21.585 --> 00:26:23.765
<00:26:21.585>but <00:26:21.712>we <00:26:21.839>need <00:26:21.966>to <00:26:22.094>add <00:26:22.221>the <00:26:22.348>capabilities <00:26:22.475>to, <00:26:22.603>Hey, <00:26:22.730>I <00:26:22.857>want <00:26:22.985>you

658
00:26:23.765 --> 00:26:26.165
<00:26:23.765>to <00:26:23.965>retrieve <00:26:24.165>documents <00:26:24.365>as <00:26:24.565>you <00:26:24.765>understand <00:26:24.965>the <00:26:25.165>context.

659
00:26:26.825 --> 00:26:29.725
<00:26:26.825>Um, <00:26:26.941>and <00:26:27.058>so <00:26:27.175>the <00:26:27.291>last <00:26:27.408>part <00:26:27.525>I <00:26:27.641>have <00:26:27.758>to <00:26:27.875>add <00:26:27.991>is <00:26:28.108>the <00:26:28.225>ability

660
00:26:29.785 --> 00:26:33.365
<00:26:29.785>to <00:26:29.901>work <00:26:30.018>with <00:26:30.135>those <00:26:30.251>URLs <00:26:30.368>just <00:26:30.485>as <00:26:30.601>we <00:26:30.718>were <00:26:30.835>doing <00:26:30.951>in <00:26:31.068>that, <00:26:31.185>uh,

661
00:26:33.785 --> 00:26:35.325
<00:26:33.785>um, <00:26:34.478>Jupiter <00:26:35.171>notebook.

662
00:26:35.705 --> 00:26:39.405
<00:26:35.705>Um, <00:26:35.860>so <00:26:36.016>what's <00:26:36.171>going <00:26:36.327>on <00:26:36.482>here <00:26:36.638>is <00:26:36.793>that <00:26:36.949>essentially, <00:26:37.105>um,

663
00:26:39.695 --> 00:26:42.725
<00:26:39.695>we're <00:26:39.850>adding <00:26:40.006>the <00:26:40.161>ability <00:26:40.317>to <00:26:40.472>extract <00:26:40.628>links <00:26:40.783>from <00:26:40.939>the <00:26:41.095>database.

664
00:26:42.735 --> 00:26:45.405
<00:26:42.735>We're <00:26:42.968>adding <00:26:43.201>the <00:26:43.435>ability <00:26:43.668>to, <00:26:43.901>uh, <00:26:44.135>work

665
00:26:45.405 --> 00:26:48.925
<00:26:45.405>with <00:26:45.580>the <00:26:45.754>source <00:26:45.930>documents, <00:26:46.105>uh, <00:26:46.280>combine <00:26:46.455>the <00:26:46.629>source <00:26:46.805>text

666
00:26:49.105 --> 00:26:51.685
<00:26:49.105>and <00:26:49.305>the <00:26:49.505>link <00:26:49.705>text <00:26:49.905>into <00:26:50.105>our <00:26:50.305>response, <00:26:50.505>uh,

667
00:26:51.825 --> 00:26:53.765
<00:26:51.825>and <00:26:51.980>be <00:26:52.136>able <00:26:52.291>to <00:26:52.447>provide <00:26:52.602>that <00:26:52.758>as <00:26:52.913>a <00:26:53.069>response <00:26:53.225>back.

668
00:26:53.825 --> 00:26:55.365
<00:26:53.825>So <00:26:54.171>we've <00:26:54.518>kind <00:26:54.864>of <00:26:55.211>enhanced

669
00:26:55.385 --> 00:26:57.485
<00:26:55.385>and <00:26:55.735>supercharged <00:26:56.085>essentially <00:26:56.435>the <00:26:56.785>application

670
00:26:57.485 --> 00:27:00.685
<00:26:57.485>to <00:26:57.659>have <00:26:57.834>the <00:26:58.010>capabilities <00:26:58.185>to <00:26:58.360>work <00:26:58.534>with <00:26:58.709>a <00:26:58.885>model,

671
00:27:00.685 --> 00:27:03.925
<00:27:00.685>whether <00:27:00.801>it's <00:27:00.918>local <00:27:01.034>or <00:27:01.151>remote, <00:27:01.268>to <00:27:01.385>be <00:27:01.501>able <00:27:01.618>to <00:27:01.735>work <00:27:01.851>with <00:27:01.968>a, <00:27:02.085>uh,

672
00:27:03.925 --> 00:27:05.605
<00:27:03.925>elastic <00:27:04.391>search, <00:27:04.858>uh, <00:27:05.325>environment,

673
00:27:05.605 --> 00:27:07.085
<00:27:05.605>whether <00:27:05.795>it <00:27:05.985>could <00:27:06.175>be <00:27:06.366>running <00:27:06.556>on <00:27:06.746>a <00:27:06.937>local

674
00:27:07.085 --> 00:27:08.525
<00:27:07.085>container <00:27:07.517>or <00:27:07.949>in <00:27:08.381>production.

675
00:27:08.945 --> 00:27:11.725
<00:27:08.945>Um, <00:27:09.085>and <00:27:09.225>what <00:27:09.365>we <00:27:09.504>could <00:27:09.645>do <00:27:09.784>is <00:27:09.925>just <00:27:10.064>essentially <00:27:10.205>build <00:27:10.345>this

676
00:27:11.865 --> 00:27:13.405
<00:27:11.865>as <00:27:12.096>a <00:27:12.327>container <00:27:12.558>and <00:27:12.789>deploy <00:27:13.020>it, <00:27:13.251>right?

677
00:27:13.745 --> 00:27:16.285
<00:27:13.745>Uh, <00:27:13.900>it's <00:27:14.056>a <00:27:14.211>simple <00:27:14.367>container <00:27:14.522>file <00:27:14.678>that <00:27:14.833>I <00:27:14.989>have <00:27:15.145>here

678
00:27:16.285 --> 00:27:19.165
<00:27:16.285>that <00:27:16.460>I <00:27:16.635>could <00:27:16.810>build <00:27:16.985>or <00:27:17.160>I <00:27:17.335>could, <00:27:17.510>um, <00:27:17.685>uh,

679
00:27:19.165 --> 00:27:21.525
<00:27:19.165>essentially <00:27:19.365>use <00:27:19.565>OpenShift <00:27:19.764>to <00:27:19.965>build <00:27:20.165>it <00:27:20.365>for <00:27:20.565>me,

680
00:27:21.845 --> 00:27:23.205
<00:27:21.845>whatever <00:27:22.019>I <00:27:22.194>might <00:27:22.369>wanna <00:27:22.544>do <00:27:22.719>to <00:27:22.894>deploy <00:27:23.069>it.

681
00:27:23.545 --> 00:27:27.765
<00:27:23.545>Um, <00:27:23.652>but <00:27:23.760>what <00:27:23.868>I'm <00:27:23.975>going <00:27:24.083>to <00:27:24.191>also <00:27:24.298>show <00:27:24.406>is <00:27:24.514>that, <00:27:24.621>um, <00:27:24.729>I <00:27:24.837>could <00:27:24.945>use

682
00:27:27.765 --> 00:27:30.125
<00:27:27.765>what <00:27:27.965>Natalia <00:27:28.165>was <00:27:28.365>doing <00:27:28.565>earlier <00:27:28.765>with <00:27:28.965>that, <00:27:29.165>uh,

683
00:27:30.125 --> 00:27:33.965
<00:27:30.125>developer <00:27:30.280>hub <00:27:30.436>in <00:27:30.591>order <00:27:30.747>to, <00:27:30.902>um, <00:27:31.058>uh, <00:27:31.213>think <00:27:31.369>about <00:27:31.525>all

684
00:27:33.965 --> 00:27:36.645
<00:27:33.965>of <00:27:34.198>the <00:27:34.431>different <00:27:34.665>capabilities <00:27:34.898>for <00:27:35.131>operations <00:27:35.365>team.

685
00:27:36.745 --> 00:27:39.405
<00:27:36.745>So <00:27:36.900>I'm <00:27:37.056>not <00:27:37.211>a <00:27:37.367>developer, <00:27:37.522>but <00:27:37.678>I <00:27:37.833>do <00:27:37.989>know <00:27:38.145>coding,

686
00:27:39.505 --> 00:27:40.725
<00:27:39.505>and <00:27:39.661>I <00:27:39.818>do <00:27:39.975>know <00:27:40.132>a <00:27:40.289>little <00:27:40.446>bit <00:27:40.602>about

687
00:27:40.725 --> 00:27:42.245
<00:27:40.725>deployments <00:27:41.067>on <00:27:41.408>top <00:27:41.751>of <00:27:42.092>Kubernetes.

688
00:27:42.685 --> 00:27:45.845
<00:27:42.685>I <00:27:42.825>don't <00:27:42.965>know <00:27:43.105>about <00:27:43.245>ci, <00:27:43.385>I <00:27:43.524>don't <00:27:43.665>know <00:27:43.804>about <00:27:43.945>CI <00:27:44.085>ICD

689
00:27:46.065 --> 00:27:49.765
<00:27:46.065>or, <00:27:46.240>um, <00:27:46.415>the <00:27:46.590>different, <00:27:46.765>you <00:27:46.940>know, <00:27:47.115>abstractions <00:27:47.290>in <00:27:47.465>Kubernetes.

690
00:27:50.145 --> 00:27:52.645
<00:27:50.145>Um, <00:27:50.345>I <00:27:50.545>don't <00:27:50.745>know <00:27:50.945>about <00:27:51.145>all <00:27:51.345>the <00:27:51.545>APIs

691
00:27:52.645 --> 00:27:54.565
<00:27:52.645>that <00:27:52.820>exist <00:27:52.995>in <00:27:53.170>my <00:27:53.345>organization, <00:27:53.520>but <00:27:53.695>I <00:27:53.870>could <00:27:54.045>kind

692
00:27:54.565 --> 00:27:56.205
<00:27:54.565>of <00:27:55.031>use <00:27:55.498>this <00:27:55.965>platform.

693
00:27:56.265 --> 00:27:58.365
<00:27:56.265>And <00:27:56.420>that's <00:27:56.576>what <00:27:56.731>Natalia's <00:27:56.887>next <00:27:57.042>talk <00:27:57.198>is <00:27:57.353>gonna <00:27:57.509>be <00:27:57.665>on

694
00:27:58.385 --> 00:28:00.325
<00:27:58.385>to <00:27:58.560>abstract <00:27:58.735>all <00:27:58.910>this <00:27:59.085>for <00:27:59.260>me <00:27:59.435>as <00:27:59.610>a <00:27:59.785>developer.

695
00:28:00.345 --> 00:28:03.165
<00:28:00.345>So <00:28:00.485>I <00:28:00.625>think <00:28:00.765>about <00:28:00.905>my <00:28:01.045>container, <00:28:01.185>I <00:28:01.325>think <00:28:01.465>about <00:28:01.605>my <00:28:01.745>application,

696
00:28:03.165 --> 00:28:06.165
<00:28:03.165>I <00:28:03.292>think <00:28:03.419>about <00:28:03.546>my <00:28:03.674>source <00:28:03.801>code, <00:28:03.928>then <00:28:04.055>I <00:28:04.183>can <00:28:04.310>take <00:28:04.437>this <00:28:04.565>and,

697
00:28:06.265 --> 00:28:08.285
<00:28:06.265>and <00:28:06.498>push <00:28:06.731>it, <00:28:06.965>uh, <00:28:07.198>as <00:28:07.431>a <00:28:07.665>container

698
00:28:08.305 --> 00:28:10.765
<00:28:08.305>or <00:28:08.480>as <00:28:08.655>just <00:28:08.830>source <00:28:09.005>code <00:28:09.180>to <00:28:09.355>somewhere <00:28:09.530>that's <00:28:09.705>going

699
00:28:10.765 --> 00:28:13.285
<00:28:10.765>to <00:28:10.920>perform <00:28:11.076>all <00:28:11.231>those <00:28:11.387>checks <00:28:11.542>for, <00:28:11.698>uh, <00:28:11.853>that <00:28:12.009>we <00:28:12.165>need

700
00:28:13.285 --> 00:28:14.485
<00:28:13.285>for <00:28:13.825>production <00:28:14.365>environments.

701
00:28:14.985 --> 00:28:17.565
<00:28:14.985>But <00:28:15.185>essentially <00:28:15.385>what <00:28:15.584>we've <00:28:15.784>done <00:28:15.985>is <00:28:16.185>I've <00:28:16.385>already

702
00:28:17.565 --> 00:28:18.685
<00:28:17.565>done <00:28:17.817>this <00:28:18.069>in, <00:28:18.321>in <00:28:18.572>advance.

703
00:28:18.785 --> 00:28:22.645
<00:28:18.785>And <00:28:18.892>so <00:28:19.000>if <00:28:19.108>I <00:28:19.215>go <00:28:19.323>over <00:28:19.431>to, <00:28:19.538>um, <00:28:19.646>my <00:28:19.754>local <00:28:19.861>environment, <00:28:19.969>so <00:28:20.077>let <00:28:20.185>me,

704
00:28:22.705 --> 00:28:26.325
<00:28:22.705>or <00:28:22.879>not <00:28:23.054>local <00:28:23.230>environment, <00:28:23.405>but <00:28:23.580>production, <00:28:23.754>uh, <00:28:23.929>uh, <00:28:24.105>namespace.

705
00:28:26.545 --> 00:28:28.325
<00:28:26.545>So <00:28:26.685>I'm <00:28:26.825>gonna <00:28:26.965>show <00:28:27.105>you <00:28:27.245>that <00:28:27.385>I've <00:28:27.525>already <00:28:27.665>set <00:28:27.805>this <00:28:27.945>up.

706
00:28:28.325 --> 00:28:30.925
<00:28:28.325>We <00:28:28.452>have <00:28:28.579>the <00:28:28.706>min <00:28:28.834>store, <00:28:28.961>we <00:28:29.088>have <00:28:29.215>the <00:28:29.343>model <00:28:29.470>being <00:28:29.597>served, <00:28:29.725>um,

707
00:28:30.945 --> 00:28:32.125
<00:28:30.945>in <00:28:31.299>a <00:28:31.653>serverless <00:28:32.007>fashion.

708
00:28:32.825 --> 00:28:35.125
<00:28:32.825>And, <00:28:33.025>um, <00:28:33.225>what <00:28:33.425>we've <00:28:33.625>done <00:28:33.825>is <00:28:34.025>actually <00:28:34.225>pushed

709
00:28:35.155 --> 00:28:39.645
<00:28:35.155>that <00:28:35.295>container <00:28:35.435>here <00:28:35.575>that <00:28:35.715>we <00:28:35.855>had <00:28:35.995>to <00:28:36.135>the, <00:28:36.274>to <00:28:36.415>a <00:28:36.555>repository

710
00:28:39.865 --> 00:28:41.565
<00:28:39.865>and <00:28:40.215>added <00:28:40.565>those <00:28:40.915>environment <00:28:41.265>variables.

711
00:28:41.745 --> 00:28:44.885
<00:28:41.745>So <00:28:41.852>this <00:28:41.960>is <00:28:42.068>the <00:28:42.175>last <00:28:42.283>part, <00:28:42.391>and <00:28:42.498>then <00:28:42.606>I'll <00:28:42.714>kind <00:28:42.821>of <00:28:42.929>wrap <00:28:43.037>up <00:28:43.145>and,

712
00:28:44.905 --> 00:28:47.125
<00:28:44.905>and <00:28:45.032>give <00:28:45.159>you <00:28:45.286>some <00:28:45.414>cool <00:28:45.541>resources <00:28:45.668>and <00:28:45.795>how <00:28:45.923>you <00:28:46.050>can <00:28:46.177>get <00:28:46.305>started

713
00:28:47.425 --> 00:28:48.445
<00:28:47.425>or <00:28:47.654>do <00:28:47.884>this <00:28:48.113>same <00:28:48.342>demo.

714
00:28:48.785 --> 00:28:50.125
<00:28:48.785>So <00:28:48.986>we <00:28:49.187>have <00:28:49.388>this <00:28:49.589>as <00:28:49.790>an <00:28:49.991>application.

715
00:28:50.125 --> 00:28:53.165
<00:28:50.125>You <00:28:50.265>could <00:28:50.405>use <00:28:50.545>a <00:28:50.685>deployment <00:28:50.825>yaml, <00:28:50.965>we <00:28:51.105>have <00:28:51.245>this <00:28:51.385>pod <00:28:51.525>running,

716
00:28:53.165 --> 00:28:54.325
<00:28:53.165>this <00:28:53.373>is <00:28:53.582>the <00:28:53.791>same <00:28:54.000>chat <00:28:54.209>app,

717
00:28:54.325 --> 00:28:55.405
<00:28:54.325>but <00:28:54.568>now <00:28:54.811>with <00:28:55.054>those <00:28:55.297>capabilities,

718
00:28:55.785 --> 00:28:58.565
<00:28:55.785>it <00:28:55.925>also <00:28:56.065>has <00:28:56.205>the <00:28:56.345>environment <00:28:56.485>variables <00:28:56.625>that <00:28:56.765>I <00:28:56.905>needed <00:28:57.045>in <00:28:57.185>order

719
00:28:58.565 --> 00:29:00.005
<00:28:58.565>to <00:28:58.824>connect <00:28:59.083>to <00:28:59.342>this <00:28:59.601>remote <00:28:59.861>model.

720
00:29:00.425 --> 00:29:01.685
<00:29:00.425>Uh, <00:29:00.651>and <00:29:00.878>I'm <00:29:01.105>gonna <00:29:01.332>go <00:29:01.559>ahead

721
00:29:01.685 --> 00:29:04.805
<00:29:01.685>and <00:29:01.792>just <00:29:01.900>open <00:29:02.008>this <00:29:02.115>up <00:29:02.223>so <00:29:02.331>we <00:29:02.438>can <00:29:02.546>give <00:29:02.654>it <00:29:02.761>a <00:29:02.869>question <00:29:02.977>about <00:29:03.085>our

722
00:29:05.085 --> 00:29:06.605
<00:29:05.085>documentation <00:29:05.313>and <00:29:05.541>see <00:29:05.769>this <00:29:05.997>in <00:29:06.225>real <00:29:06.453>time.

723
00:29:06.945 --> 00:29:08.485
<00:29:06.945>So <00:29:07.143>we've <00:29:07.341>added <00:29:07.539>a <00:29:07.736>route <00:29:07.935>to <00:29:08.132>this <00:29:08.331>service

724
00:29:09.025 --> 00:29:10.885
<00:29:09.025>and <00:29:09.258>I'll <00:29:09.491>open <00:29:09.725>up <00:29:09.958>this <00:29:10.191>chat <00:29:10.425>application.

725
00:29:11.505 --> 00:29:15.285
<00:29:11.505>Um, <00:29:11.632>I'll <00:29:11.759>give <00:29:11.886>it <00:29:12.014>a <00:29:12.141>quick, <00:29:12.268>uh, <00:29:12.395>quick <00:29:12.523>question <00:29:12.650>here <00:29:12.777>and, <00:29:12.905>um,

726
00:29:15.385 --> 00:29:17.285
<00:29:15.385>and <00:29:15.560>let's <00:29:15.735>see <00:29:15.910>what <00:29:16.085>the <00:29:16.260>response <00:29:16.435>is <00:29:16.610>based <00:29:16.785>on

727
00:29:17.285 --> 00:29:18.525
<00:29:17.285>that <00:29:17.508>new <00:29:17.731>information <00:29:17.954>that <00:29:18.177>we <00:29:18.401>have.

728
00:29:19.105 --> 00:29:21.885
<00:29:19.105>Um, <00:29:19.245>and <00:29:19.385>fingers <00:29:19.525>crossed <00:29:19.665>the <00:29:19.805>network <00:29:19.945>allows <00:29:20.085>me <00:29:20.225>to <00:29:20.365>do <00:29:20.505>this

729
00:29:21.885 --> 00:29:24.165
<00:29:21.885>because <00:29:22.235>really, <00:29:22.585>really <00:29:22.935>cool <00:29:23.285>example.

730
00:29:24.425 --> 00:29:28.245
<00:29:24.425>So <00:29:24.541>we've <00:29:24.658>got <00:29:24.774>the <00:29:24.891>new, <00:29:25.008>uh, <00:29:25.125>new, <00:29:25.241>um, <00:29:25.358>well <00:29:25.475>the <00:29:25.591>same <00:29:25.708>chat <00:29:25.825>bot,

731
00:29:28.305 --> 00:29:29.365
<00:29:28.305>new <00:29:28.782>functionality, <00:29:29.259>right?

732
00:29:30.385 --> 00:29:34.645
<00:29:30.385>Um, <00:29:30.585>what <00:29:30.785>model <00:29:30.985>servers <00:29:31.185>can <00:29:31.385>I <00:29:31.585>use <00:29:31.785>with,

733
00:29:36.465 --> 00:29:39.085
<00:29:36.465>and <00:29:36.620>you'll <00:29:36.776>notice <00:29:36.931>I <00:29:37.087>kind <00:29:37.242>of <00:29:37.398>just <00:29:37.553>abbreviated <00:29:37.709>OpenShift <00:29:37.865>ai.

734
00:29:39.225 --> 00:29:41.340
<00:29:39.225>What's <00:29:39.380>great <00:29:39.536>about <00:29:39.691>models <00:29:39.847>is <00:29:40.002>we <00:29:40.158>can <00:29:40.313>use <00:29:40.469>natural <00:29:40.625>text

735
00:29:41.340 --> 00:29:43.365
<00:29:41.340>and <00:29:41.620>it's <00:29:41.899>gonna <00:29:42.179>understand <00:29:42.459>exactly <00:29:42.740>or,

736
00:29:43.425 --> 00:29:45.245
<00:29:43.425>or <00:29:43.625>kind <00:29:43.825>of <00:29:44.024>relatively <00:29:44.225>what <00:29:44.425>we're <00:29:44.625>talking <00:29:44.825>about.

737
00:29:45.545 --> 00:29:48.445
<00:29:45.545>So <00:29:45.700>it's <00:29:45.856>going <00:29:46.011>to <00:29:46.167>kind <00:29:46.322>of <00:29:46.478>query <00:29:46.633>that <00:29:46.789>Elasticsearch <00:29:46.945>database.

738
00:29:48.745 --> 00:29:51.125
<00:29:48.745>Uh, <00:29:48.872>and <00:29:48.999>I'll <00:29:49.126>kind <00:29:49.254>of <00:29:49.381>move <00:29:49.508>this <00:29:49.635>here <00:29:49.763>so <00:29:49.890>I <00:29:50.017>can <00:29:50.145>kind

739
00:29:51.125 --> 00:29:52.285
<00:29:51.125>of <00:29:51.299>break <00:29:51.473>down <00:29:51.647>everything <00:29:51.821>that <00:29:51.995>we've <00:29:52.169>done.

740
00:29:52.285 --> 00:29:55.445
<00:29:52.285>We've <00:29:52.485>worked <00:29:52.685>with, <00:29:52.885>uh, <00:29:53.085>local <00:29:53.285>containers <00:29:53.485>for <00:29:53.685>working

741
00:29:55.445 --> 00:29:56.845
<00:29:55.445>with <00:29:55.760>models <00:29:56.075>and <00:29:56.390>inferencing <00:29:56.705>them.

742
00:29:57.305 --> 00:29:59.885
<00:29:57.305>Uh, <00:29:57.505>we've <00:29:57.705>been <00:29:57.905>able <00:29:58.105>to <00:29:58.305>serve <00:29:58.505>them, <00:29:58.705>uh,

743
00:29:59.885 --> 00:30:01.965
<00:29:59.885>in <00:30:00.085>a <00:30:00.285>local <00:30:00.485>fashion <00:30:00.685>work <00:30:00.885>with <00:30:01.085>the <00:30:01.285>recipes.

744
00:30:02.305 --> 00:30:04.245
<00:30:02.305>Uh, <00:30:02.538>we <00:30:02.771>could <00:30:03.005>import <00:30:03.238>more <00:30:03.471>models <00:30:03.705>locally

745
00:30:04.505 --> 00:30:05.885
<00:30:04.505>or <00:30:04.815>to <00:30:05.126>our <00:30:05.436>production <00:30:05.747>cluster.

746
00:30:06.465 --> 00:30:09.205
<00:30:06.465>Um, <00:30:06.605>and, <00:30:06.745>uh, <00:30:06.885>I'll <00:30:07.024>kind <00:30:07.165>of <00:30:07.304>wait <00:30:07.445>for <00:30:07.584>this <00:30:07.725>real <00:30:07.865>quick

747
00:30:09.205 --> 00:30:11.085
<00:30:09.205>and <00:30:09.379>then <00:30:09.554>we'll <00:30:09.730>kind <00:30:09.905>of <00:30:10.080>wrap <00:30:10.254>up <00:30:10.429>in <00:30:10.605>some

748
00:30:11.085 --> 00:30:12.325
<00:30:11.085>cool <00:30:11.457>resources <00:30:11.829>and <00:30:12.201>everything.

749
00:30:12.745 --> 00:30:14.085
<00:30:12.745>But <00:30:12.917>this <00:30:13.089>is <00:30:13.261>kind <00:30:13.434>of <00:30:13.606>the <00:30:13.778>flow <00:30:13.951>in

750
00:30:14.085 --> 00:30:17.085
<00:30:14.085>how <00:30:14.212>we <00:30:14.339>can <00:30:14.466>go <00:30:14.594>from <00:30:14.721>a <00:30:14.848>local <00:30:14.975>environment <00:30:15.103>with <00:30:15.230>a <00:30:15.357>local <00:30:15.485>stack,

751
00:30:17.185 --> 00:30:19.925
<00:30:17.185>but <00:30:17.312>keep <00:30:17.439>that <00:30:17.566>same <00:30:17.694>stack <00:30:17.821>in <00:30:17.948>the <00:30:18.075>same <00:30:18.203>model <00:30:18.330>that <00:30:18.457>we're <00:30:18.585>using

752
00:30:19.985 --> 00:30:22.845
<00:30:19.985>to <00:30:20.185>have <00:30:20.385>predictability <00:30:20.584>going <00:30:20.784>from <00:30:20.985>my <00:30:21.185>local <00:30:21.385>development

753
00:30:22.845 --> 00:30:25.205
<00:30:22.845>environment <00:30:23.078>here <00:30:23.311>on <00:30:23.545>the <00:30:23.778>right, <00:30:24.011>uh, <00:30:24.245>left

754
00:30:25.865 --> 00:30:28.685
<00:30:25.865>or, <00:30:26.065>uh, <00:30:26.265>production <00:30:26.465>environment <00:30:26.665>here <00:30:26.865>on <00:30:27.065>the <00:30:27.265>right.

755
00:30:28.825 --> 00:30:29.925
<00:30:28.825>So <00:30:29.023>we'll <00:30:29.221>give <00:30:29.419>it <00:30:29.617>two <00:30:29.815>seconds.

756
00:30:30.205 --> 00:30:32.925
<00:30:30.205>I <00:30:30.379>didn't <00:30:30.554>give <00:30:30.730>GPU <00:30:30.905>access <00:30:31.080>to <00:30:31.254>the, <00:30:31.429>the <00:30:31.605>model.

757
00:30:33.045 --> 00:30:35.645
<00:30:33.045>I, <00:30:33.185>I <00:30:33.325>probably <00:30:33.465>should <00:30:33.605>have <00:30:33.745>done <00:30:33.885>that, <00:30:34.025>but <00:30:34.165>GPUs <00:30:34.305>are <00:30:34.445>expensive

758
00:30:35.645 --> 00:30:36.805
<00:30:35.645>and <00:30:35.853>it's <00:30:36.062>hard <00:30:36.271>times <00:30:36.480>right <00:30:36.689>now.

759
00:30:37.345 --> 00:30:40.325
<00:30:37.345>So, <00:30:37.520>um, <00:30:37.695>we'll <00:30:37.870>just <00:30:38.045>give <00:30:38.220>it <00:30:38.395>two <00:30:38.570>more <00:30:38.745>seconds

760
00:30:40.825 --> 00:30:42.085
<00:30:40.825>and <00:30:41.051>hopefully <00:30:41.278>it's <00:30:41.505>gonna <00:30:41.732>be <00:30:41.959>able

761
00:30:42.085 --> 00:30:43.405
<00:30:42.085>to <00:30:42.481>retrieve <00:30:42.877>the <00:30:43.273>information.

762
00:30:43.625 --> 00:30:45.525
<00:30:43.625>Now, <00:30:43.825>if <00:30:44.025>I <00:30:44.225>had, <00:30:44.425>you <00:30:44.625>know, <00:30:44.825>a <00:30:45.025>100,

763
00:30:45.705 --> 00:30:46.925
<00:30:45.705>it <00:30:45.924>would <00:30:46.144>be <00:30:46.363>a <00:30:46.583>different <00:30:46.803>story.

764
00:30:47.425 --> 00:30:51.965
<00:30:47.425>Um, <00:30:47.625>but, <00:30:47.825>um, <00:30:48.024>let's <00:30:48.225>see, <00:30:48.425>two <00:30:48.625>seconds, <00:30:48.825>hopefully.

765
00:30:52.945 --> 00:30:54.965
<00:30:52.945>In <00:30:53.100>the <00:30:53.256>meantime, <00:30:53.411>let <00:30:53.567>me <00:30:53.722>just <00:30:53.878>kind <00:30:54.033>of <00:30:54.189>talk <00:30:54.345>about

766
00:30:55.205 --> 00:30:57.925
<00:30:55.205>how <00:30:55.345>you <00:30:55.485>can <00:30:55.625>get <00:30:55.764>started <00:30:55.905>because <00:30:56.044>I've <00:30:56.185>used <00:30:56.324>pod <00:30:56.465>man <00:30:56.605>desktop

767
00:30:57.925 --> 00:30:59.845
<00:30:57.925>here, <00:30:58.205>uh, <00:30:58.485>to <00:30:58.764>work <00:30:59.044>with <00:30:59.325>containers.

768
00:30:59.845 --> 00:31:02.085
<00:30:59.845>But <00:30:59.985>Poman <00:31:00.125>AI <00:31:00.265>Lab <00:31:00.405>allows <00:31:00.545>you <00:31:00.685>to <00:31:00.825>work <00:31:00.965>with <00:31:01.105>the <00:31:01.245>models,

769
00:31:02.425 --> 00:31:04.325
<00:31:02.425>allows <00:31:02.658>you <00:31:02.891>to <00:31:03.125>work <00:31:03.358>with <00:31:03.591>playground <00:31:03.825>environments

770
00:31:04.325 --> 00:31:06.645
<00:31:04.325>to <00:31:04.525>assess <00:31:04.725>out <00:31:04.925>temperature <00:31:05.125>and <00:31:05.325>top <00:31:05.525>k, <00:31:05.725>um,

771
00:31:06.865 --> 00:31:08.165
<00:31:06.865>and <00:31:07.157>also <00:31:07.450>import <00:31:07.742>new <00:31:08.034>models.

772
00:31:08.745 --> 00:31:11.765
<00:31:08.745>Um, <00:31:08.885>and <00:31:09.024>I <00:31:09.165>wanna <00:31:09.304>point <00:31:09.445>to <00:31:09.584>some <00:31:09.725>other <00:31:09.864>really <00:31:10.004>cool <00:31:10.145>talks

773
00:31:11.765 --> 00:31:13.805
<00:31:11.765>that <00:31:11.920>are <00:31:12.076>be <00:31:12.231>going, <00:31:12.387>going <00:31:12.542>to <00:31:12.698>be <00:31:12.853>going <00:31:13.009>on <00:31:13.165>today.

774
00:31:13.905 --> 00:31:17.165
<00:31:13.905>So <00:31:14.045>if <00:31:14.185>you <00:31:14.325>like <00:31:14.465>the, <00:31:14.605>the, <00:31:14.745>the, <00:31:14.885>uh, <00:31:15.024>platform <00:31:15.165>engineering <00:31:15.305>side,

775
00:31:17.165 --> 00:31:18.565
<00:31:17.165>the <00:31:17.375>talk <00:31:17.585>after <00:31:17.795>this <00:31:18.005>is <00:31:18.215>about <00:31:18.425>that.

776
00:31:18.785 --> 00:31:20.005
<00:31:18.785>If <00:31:19.059>you <00:31:19.334>like <00:31:19.608>Poman <00:31:19.883>desktop,

777
00:31:20.145 --> 00:31:21.565
<00:31:20.145>we <00:31:20.358>have <00:31:20.571>a <00:31:20.784>whole <00:31:20.997>session <00:31:21.210>about <00:31:21.423>that.

778
00:31:21.905 --> 00:31:23.605
<00:31:21.905>If <00:31:22.080>you <00:31:22.254>wanna <00:31:22.430>learn <00:31:22.605>about <00:31:22.780>how <00:31:22.955>to <00:31:23.129>model <00:31:23.305>tune

779
00:31:23.625 --> 00:31:24.925
<00:31:23.625>and <00:31:23.917>not <00:31:24.210>just <00:31:24.502>use <00:31:24.795>rag,

780
00:31:24.945 --> 00:31:27.125
<00:31:24.945>but <00:31:25.100>enhance <00:31:25.256>the <00:31:25.411>model <00:31:25.567>itself, <00:31:25.722>we've <00:31:25.878>gotta <00:31:26.033>talk <00:31:26.189>for <00:31:26.345>that.

781
00:31:27.425 --> 00:31:28.605
<00:31:27.425>And <00:31:27.690>for <00:31:27.956>your <00:31:28.221>Java <00:31:28.487>developers,

782
00:31:28.605 --> 00:31:30.165
<00:31:28.605>we've <00:31:28.805>gotta <00:31:29.005>talk, <00:31:29.205>uh, <00:31:29.405>for <00:31:29.605>you <00:31:29.805>as <00:31:30.005>well.

783
00:31:30.555 --> 00:31:33.245
<00:31:30.555>Finally, <00:31:30.755>the <00:31:30.955>application <00:31:31.155>gave <00:31:31.355>us <00:31:31.555>a <00:31:31.755>nice <00:31:31.955>response.

784
00:31:33.825 --> 00:31:36.325
<00:31:33.825>Um, <00:31:33.980>and <00:31:34.136>so <00:31:34.291>not <00:31:34.447>only <00:31:34.602>are <00:31:34.758>we <00:31:34.913>invoking <00:31:35.069>the <00:31:35.225>model,

785
00:31:36.345 --> 00:31:39.125
<00:31:36.345>but <00:31:36.578>we're <00:31:36.811>working <00:31:37.045>with <00:31:37.278>that <00:31:37.511>Elasticsearch <00:31:37.745>database

786
00:31:39.465 --> 00:31:42.125
<00:31:39.465>to <00:31:39.665>have <00:31:39.865>similarity <00:31:40.064>score <00:31:40.264>for <00:31:40.465>the <00:31:40.665>documents, <00:31:40.865>um,

787
00:31:42.275 --> 00:31:43.845
<00:31:42.275>that <00:31:42.555>are <00:31:42.835>relative <00:31:43.115>to <00:31:43.395>our <00:31:43.675>question.

788
00:31:44.065 --> 00:31:45.165
<00:31:44.065>And <00:31:44.263>we <00:31:44.461>get <00:31:44.659>the <00:31:44.857>links <00:31:45.055>here

789
00:31:45.305 --> 00:31:47.845
<00:31:45.305>and <00:31:45.480>a <00:31:45.655>document <00:31:45.830>with <00:31:46.005>just <00:31:46.180>200 <00:31:46.355>lines <00:31:46.530>of <00:31:46.705>code.

790
00:31:48.025 --> 00:31:50.605
<00:31:48.025>So <00:31:48.165>I <00:31:48.305>wanna <00:31:48.445>say <00:31:48.585>thank <00:31:48.725>you <00:31:48.865>so <00:31:49.005>much <00:31:49.145>for <00:31:49.285>your <00:31:49.425>time.

791
00:31:51.065 --> 00:31:52.605
<00:31:51.065>Uh, <00:31:51.296>I <00:31:51.527>hope <00:31:51.758>you <00:31:51.989>enjoyed <00:31:52.220>the <00:31:52.451>session.

792
00:31:52.795 --> 00:31:54.805
<00:31:52.795>Here <00:31:53.028>are <00:31:53.261>some <00:31:53.495>resources, <00:31:53.728>the <00:31:53.961>slide <00:31:54.195>links,

793
00:31:55.105 --> 00:31:57.685
<00:31:55.105>and, <00:31:55.232>uh, <00:31:55.359>a <00:31:55.486>link <00:31:55.614>to <00:31:55.741>get <00:31:55.868>started <00:31:55.995>with <00:31:56.123>OpenShift <00:31:56.250>AI <00:31:56.377>for <00:31:56.505>free,

794
00:31:57.985 --> 00:32:00.885
<00:31:57.985>no <00:31:58.125>cost, <00:31:58.264>30 <00:31:58.405>days, <00:31:58.544>uh, <00:31:58.685>and <00:31:58.824>you <00:31:58.965>can <00:31:59.104>renew <00:31:59.245>the <00:31:59.385>subscription.

795
00:32:00.945 --> 00:32:02.605
<00:32:00.945>So, <00:32:01.411>unlimited <00:32:01.878>usage <00:32:02.345>of

796
00:32:02.795 --> 00:32:04.805
<00:32:02.795>what <00:32:02.995>the <00:32:03.195>tools <00:32:03.395>I <00:32:03.595>just <00:32:03.795>used <00:32:03.995>today <00:32:04.195>were.

797
00:32:04.935 --> 00:32:06.845
<00:32:04.935>Thank <00:32:05.110>you <00:32:05.284>very <00:32:05.460>much. <00:32:05.635>My <00:32:05.810>name <00:32:05.985>is <00:32:06.159>Cedric <00:32:06.335>Clyburn.

798
00:32:06.845 --> 00:32:07.725
<00:32:06.845>Enjoy <00:32:07.241>the <00:32:07.637>conference.