WEBVTT

1
00:00:03.225 --> 00:00:03.975
<00:00:03.225>Hello, <00:00:03.900>Danielle.

2
00:00:03.975 --> 00:00:06.135
<00:00:03.975>Hello, <00:00:04.208>everyone. <00:00:04.441>Who <00:00:04.675>is, <00:00:04.908>uh, <00:00:05.141>watching <00:00:05.375>us?

3
00:00:06.475 --> 00:00:08.095
<00:00:06.475>Um, <00:00:06.824>yeah, <00:00:07.175>my <00:00:07.524>great <00:00:07.875>pleasure

4
00:00:08.115 --> 00:00:11.495
<00:00:08.115>to <00:00:08.348>present <00:00:08.581>at <00:00:08.815>the <00:00:09.048>machine <00:00:09.281>learning <00:00:09.515>day.

5
00:00:12.075 --> 00:00:13.895
<00:00:12.075>And <00:00:12.774>let's <00:00:13.475>start

6
00:00:14.675 --> 00:00:19.535
<00:00:14.675>and <00:00:14.850>let's <00:00:15.025>talk <00:00:15.200>today <00:00:15.375>about <00:00:15.550>how <00:00:15.725>we <00:00:15.900>can <00:00:16.075>operationalize

7
00:00:20.195 --> 00:00:23.375
<00:00:20.195>our <00:00:20.475>and <00:00:20.755>AI <00:00:21.035>infused, <00:00:21.315>um, <00:00:21.595>solutions

8
00:00:23.675 --> 00:00:27.975
<00:00:23.675>or <00:00:23.908>applications <00:00:24.141>that <00:00:24.375>use <00:00:24.608>large <00:00:24.841>language <00:00:25.075>models.

9
00:00:30.375 --> 00:00:31.495
<00:00:30.375>I <00:00:30.711>am <00:00:31.047>Maxim <00:00:31.383>Nikko.

10
00:00:31.635 --> 00:00:36.375
<00:00:31.635>I'm <00:00:31.790>based <00:00:31.946>in <00:00:32.101>Oslo, <00:00:32.257>Norway, <00:00:32.412>where <00:00:32.568>I, <00:00:32.723>uh, <00:00:32.879>help <00:00:33.035>developers

11
00:00:36.395 --> 00:00:37.455
<00:00:36.395>to <00:00:36.713>succeed <00:00:37.031>with, <00:00:37.349>uh,

12
00:00:37.815 --> 00:00:40.815
<00:00:37.815>Microsoft's <00:00:38.095>cloud <00:00:38.375>developer <00:00:38.655>tools <00:00:38.934>and <00:00:39.214>ai.

13
00:00:41.775 --> 00:00:46.415
<00:00:41.775>I <00:00:41.930>personally <00:00:42.086>build <00:00:42.241>for <00:00:42.397>web <00:00:42.552>platform <00:00:42.708>since, <00:00:42.863>uh, <00:00:43.019>late <00:00:43.175>nineties

14
00:00:46.435 --> 00:00:47.455
<00:00:46.435>of <00:00:46.741>the <00:00:47.047>last <00:00:47.353>century,

15
00:00:47.755 --> 00:00:50.895
<00:00:47.755>and <00:00:47.930>I'm <00:00:48.105>huge, <00:00:48.280>huge <00:00:48.455>fan <00:00:48.630>of <00:00:48.805>the <00:00:48.980>developer <00:00:49.155>communities,

16
00:00:50.895 --> 00:00:52.335
<00:00:50.895>of <00:00:51.327>the <00:00:51.759>technical <00:00:52.191>communities.

17
00:00:52.815 --> 00:00:55.535
<00:00:52.815>I <00:00:52.970>organize <00:00:53.126>few <00:00:53.281>meetups <00:00:53.437>in, <00:00:53.592>uh, <00:00:53.748>Oslo <00:00:53.903>where <00:00:54.059>I <00:00:54.214>live

18
00:00:55.595 --> 00:00:57.735
<00:00:55.595>and <00:00:55.875>founded <00:00:56.155>a <00:00:56.435>couple <00:00:56.714>of <00:00:56.995>conferences.

19
00:00:58.285 --> 00:01:03.095
<00:00:58.285>Yeah, <00:00:58.459>so <00:00:58.635>I'm <00:00:58.809>always, <00:00:58.985>always, <00:00:59.160>uh, <00:00:59.334>feeling <00:00:59.510>myself <00:00:59.684>part

20
00:01:03.095 --> 00:01:04.255
<00:01:03.095>of <00:01:03.443>the <00:01:03.791>technical <00:01:04.138>community

21
00:01:04.315 --> 00:01:08.015
<00:01:04.315>and <00:01:04.470>doing <00:01:04.626>my <00:01:04.781>best <00:01:04.937>to <00:01:05.092>contribute <00:01:05.248>to <00:01:05.403>this <00:01:05.559>community <00:01:05.715>globally.

22
00:01:08.955 --> 00:01:13.295
<00:01:08.955>My <00:01:09.110>favorite, <00:01:09.266>uh, <00:01:09.421>topics <00:01:09.577>to <00:01:09.732>present <00:01:09.888>about <00:01:10.043>is <00:01:10.199>all <00:01:10.355>kinds

23
00:01:13.295 --> 00:01:15.295
<00:01:13.295>of <00:01:13.645>web <00:01:13.995>development, <00:01:14.345>cloud <00:01:14.695>development,

24
00:01:15.675 --> 00:01:18.455
<00:01:15.675>and <00:01:15.850>of <00:01:16.024>course, <00:01:16.200>last <00:01:16.375>couple <00:01:16.550>of <00:01:16.725>years, <00:01:16.899>uh, <00:01:17.075>everything

25
00:01:18.455 --> 00:01:19.895
<00:01:18.455>around <00:01:19.103>generative <00:01:19.750>ai

26
00:01:19.915 --> 00:01:23.095
<00:01:19.914>and <00:01:20.148>my <00:01:20.381>personal <00:01:20.615>passion <00:01:20.848>is <00:01:21.081>prompt <00:01:21.315>engineering.

27
00:01:24.435 --> 00:01:28.215
<00:01:24.435>But <00:01:24.635>let's, <00:01:24.835>uh, <00:01:25.035>go <00:01:25.235>back <00:01:25.435>to <00:01:25.635>LLM <00:01:25.835>ops

28
00:01:28.995 --> 00:01:33.775
<00:01:28.995>and <00:01:29.195>like, <00:01:29.395>uh, <00:01:29.595>pretty <00:01:29.795>much <00:01:29.995>always, <00:01:30.195>um, <00:01:30.395>discussions,

29
00:01:34.035 --> 00:01:38.335
<00:01:34.035>uh, <00:01:34.268>start <00:01:34.501>from <00:01:34.735>some <00:01:34.968>business <00:01:35.201>motivations, <00:01:35.435>right?

30
00:01:38.875 --> 00:01:42.295
<00:01:38.875>Why <00:01:39.075>is <00:01:39.275>that <00:01:39.475>ever <00:01:39.675>important <00:01:39.875>for <00:01:40.075>the <00:01:40.275>companies

31
00:01:42.435 --> 00:01:45.175
<00:01:42.435>to <00:01:42.785>build <00:01:43.135>AI <00:01:43.485>infused <00:01:43.835>solutions?

32
00:01:46.235 --> 00:01:49.895
<00:01:46.235>Why <00:01:46.362>you <00:01:46.489>clearly <00:01:46.616>see <00:01:46.744>on <00:01:46.871>the <00:01:46.998>screen <00:01:47.125>now, <00:01:47.253>first <00:01:47.380>of <00:01:47.507>all, <00:01:47.635>uh,

33
00:01:50.235 --> 00:01:54.095
<00:01:50.235>return <00:01:50.468>on <00:01:50.701>investment <00:01:50.935>is, <00:01:51.168>uh, <00:01:51.401>pretty <00:01:51.635>good.

34
00:01:54.395 --> 00:01:56.215
<00:01:54.395>I'd <00:01:54.675>say <00:01:54.955>you <00:01:55.235>get, <00:01:55.515>uh, <00:01:55.795>three

35
00:01:56.215 --> 00:02:00.935
<00:01:56.215>and <00:01:56.390>$5 <00:01:56.565>back <00:01:56.740>on <00:01:56.915>every <00:01:57.090>$1 <00:01:57.265>invested <00:01:57.440>in <00:01:57.615>ai.

36
00:02:00.995 --> 00:02:03.615
<00:02:00.995>And <00:02:01.135>I <00:02:01.275>mean, <00:02:01.415>this <00:02:01.555>is, <00:02:01.695>these <00:02:01.835>are <00:02:01.975>not <00:02:02.115>numbers <00:02:02.255>from <00:02:02.395>me.

37
00:02:03.615 --> 00:02:07.215
<00:02:03.615>This <00:02:03.848>is <00:02:04.081>a <00:02:04.315>result <00:02:04.548>of, <00:02:04.781>uh, <00:02:05.015>research

38
00:02:07.355 --> 00:02:08.975
<00:02:07.355>by <00:02:07.705>a <00:02:08.055>company <00:02:08.405>called <00:02:08.755>IDC.

39
00:02:09.435 --> 00:02:12.975
<00:02:09.435>And, <00:02:09.715>uh, <00:02:09.995>it <00:02:10.275>happens <00:02:10.555>quite <00:02:10.835>fast.

40
00:02:13.335 --> 00:02:17.975
<00:02:13.335>I <00:02:13.490>mean, <00:02:13.646>you <00:02:13.801>see <00:02:13.957>first <00:02:14.112>returns <00:02:14.268>on <00:02:14.423>your <00:02:14.579>investments, <00:02:14.735>uh,

41
00:02:18.065 --> 00:02:21.335
<00:02:18.065>after, <00:02:18.298>uh, <00:02:18.531>in <00:02:18.765>on <00:02:18.998>average <00:02:19.231>14 <00:02:19.465>months.

42
00:02:21.335 --> 00:02:24.415
<00:02:21.335>That <00:02:21.510>is <00:02:21.685>pretty <00:02:21.860>good <00:02:22.035>for <00:02:22.210>that <00:02:22.385>kind <00:02:22.560>of <00:02:22.735>investment.

43
00:02:25.315 --> 00:02:29.695
<00:02:25.315>Uh, <00:02:25.454>so, <00:02:25.595>and <00:02:25.734>the <00:02:25.875>question <00:02:26.015>then, <00:02:26.155>why <00:02:26.295>is <00:02:26.435>not <00:02:26.575>every <00:02:26.715>company,

44
00:02:29.915 --> 00:02:32.135
<00:02:29.915>why <00:02:30.265>is <00:02:30.614>not <00:02:30.965>every <00:02:31.315>organization

45
00:02:32.715 --> 00:02:37.335
<00:02:32.715>on <00:02:32.855>the <00:02:32.995>planet <00:02:33.135>working <00:02:33.275>hard <00:02:33.415>now <00:02:33.555>on <00:02:33.695>infusing <00:02:33.835>AI <00:02:33.975>in <00:02:34.115>their

46
00:02:37.335 --> 00:02:40.855
<00:02:37.335>solutions, <00:02:37.535>or <00:02:37.735>maybe <00:02:37.935>more <00:02:38.135>precisely <00:02:38.335>generative <00:02:38.535>AI <00:02:38.735>into

47
00:02:40.855 --> 00:02:42.375
<00:02:40.855>their <00:02:42.223>solutions?

48
00:02:42.565 --> 00:02:47.455
<00:02:42.565>Well, <00:02:42.704>there <00:02:42.845>are <00:02:42.984>some <00:02:43.125>things <00:02:43.265>that, <00:02:43.405>uh, <00:02:43.545>if <00:02:43.685>do <00:02:43.825>not <00:02:43.965>block,

49
00:02:47.515 --> 00:02:51.735
<00:02:47.515>but <00:02:47.690>at <00:02:47.864>least, <00:02:48.040>uh, <00:02:48.214>delay <00:02:48.390>adoption <00:02:48.565>of <00:02:48.739>f <00:02:48.915>ai,

50
00:02:52.195 --> 00:02:55.815
<00:02:52.195>and <00:02:52.394>it <00:02:52.595>all <00:02:52.795>starts <00:02:52.995>straight <00:02:53.195>from <00:02:53.394>getting <00:02:53.595>started.

51
00:02:56.235 --> 00:03:00.685
<00:02:56.235>The <00:02:56.362>pace <00:02:56.489>of <00:02:56.616>innovation <00:02:56.744>in <00:02:56.871>that <00:02:56.998>field <00:02:57.125>is, <00:02:57.253>uh, <00:02:57.380>so <00:02:57.507>high <00:02:57.635>that,

52
00:03:01.385 --> 00:03:05.165
<00:03:01.385>you <00:03:01.560>know, <00:03:01.734>sometimes <00:03:01.910>it's, <00:03:02.084>uh, <00:03:02.260>literally <00:03:02.435>hard <00:03:02.609>to <00:03:02.785>identify

53
00:03:05.735 --> 00:03:07.285
<00:03:05.735>where <00:03:06.432>to <00:03:07.130>start.

54
00:03:07.395 --> 00:03:09.005
<00:03:07.395>What <00:03:07.745>is <00:03:08.095>the <00:03:08.445>best <00:03:08.795>framework?

55
00:03:09.035 --> 00:03:11.525
<00:03:09.035>What <00:03:09.315>is <00:03:09.595>the <00:03:09.875>currently <00:03:10.155>best <00:03:10.435>model?

56
00:03:11.625 --> 00:03:12.885
<00:03:11.625>And <00:03:12.003>even <00:03:12.381>like, <00:03:12.759>like

57
00:03:12.885 --> 00:03:16.285
<00:03:12.885>after <00:03:13.084>you <00:03:13.285>made <00:03:13.484>your <00:03:13.685>technical <00:03:13.885>choice <00:03:14.084>next <00:03:14.285>day,

58
00:03:16.755 --> 00:03:19.045
<00:03:16.755>this <00:03:17.105>selection, <00:03:17.454>this, <00:03:17.805>uh, <00:03:18.155>model,

59
00:03:19.155 --> 00:03:23.725
<00:03:19.155>this <00:03:19.310>framework <00:03:19.466>might <00:03:19.621>become <00:03:19.777>next <00:03:19.932>best, <00:03:20.088>uh, <00:03:20.243>again, <00:03:20.399>thanks <00:03:20.555>to

60
00:03:23.745 --> 00:03:26.485
<00:03:23.745>or <00:03:23.920>thanks <00:03:24.095>to <00:03:24.270>speed <00:03:24.445>of <00:03:24.620>innovation <00:03:24.795>in <00:03:24.970>that <00:03:25.145>field,

61
00:03:26.825 --> 00:03:31.645
<00:03:26.825>but, <00:03:26.964>okay, <00:03:27.105>um, <00:03:27.244>you <00:03:27.385>stick <00:03:27.524>to <00:03:27.665>some, <00:03:27.804>uh, <00:03:27.945>large <00:03:28.084>language <00:03:28.225>model,

62
00:03:31.675 --> 00:03:34.525
<00:03:31.675>some <00:03:31.830>provider <00:03:31.986>of, <00:03:32.141>uh, <00:03:32.297>of <00:03:32.452>this <00:03:32.608>model, <00:03:32.763>maybe <00:03:32.919>some <00:03:33.075>framework,

63
00:03:34.555 --> 00:03:38.405
<00:03:34.555>some <00:03:34.905>technical <00:03:35.255>implementation <00:03:35.605>development, <00:03:35.955>um,

64
00:03:39.825 --> 00:03:41.805
<00:03:39.825>to <00:03:40.174>really <00:03:40.524>develop, <00:03:40.875>uh, <00:03:41.225>something

65
00:03:41.805 --> 00:03:43.525
<00:03:41.805>that <00:03:42.038>is <00:03:42.271>not <00:03:42.505>just <00:03:42.738>a <00:03:42.971>hello <00:03:43.205>world.

66
00:03:43.675 --> 00:03:46.725
<00:03:43.675>Yeah, <00:03:43.875>you <00:03:44.075>need <00:03:44.275>some <00:03:44.475>expertise <00:03:44.675>with <00:03:44.875>building <00:03:45.075>this.

67
00:03:46.785 --> 00:03:50.485
<00:03:46.785>And <00:03:46.940>again, <00:03:47.096>we <00:03:47.251>are <00:03:47.407>talking <00:03:47.562>here <00:03:47.718>about <00:03:47.873>some <00:03:48.029>cutting <00:03:48.185>edge

68
00:03:50.485 --> 00:03:53.525
<00:03:50.485>technologies, <00:03:50.835>cutting <00:03:51.185>edge, <00:03:51.535>uh, <00:03:51.885>approaches,

69
00:03:54.085 --> 00:03:55.525
<00:03:54.085>practices, <00:03:55.381>frameworks.

70
00:03:55.715 --> 00:03:59.885
<00:03:55.715>Yeah. <00:03:55.870>And <00:03:56.026>far <00:03:56.181>not <00:03:56.337>every <00:03:56.492>company <00:03:56.648>has <00:03:56.803>this <00:03:56.959>expertise <00:03:57.115>inhouse.

71
00:04:00.105 --> 00:04:04.365
<00:04:00.105>And, <00:04:00.338>uh, <00:04:00.571>those <00:04:00.804>need <00:04:01.038>for, <00:04:01.271>uh, <00:04:01.505>easy

72
00:04:04.505 --> 00:04:08.005
<00:04:04.505>to <00:04:04.704>start <00:04:04.905>tools <00:04:05.105>is, <00:04:05.305>uh, <00:04:05.505>tremendous <00:04:05.704>these <00:04:05.905>days.

73
00:04:08.825 --> 00:04:11.765
<00:04:08.825>Uh, <00:04:09.058>next <00:04:09.291>point, <00:04:09.524>uh, <00:04:09.758>your <00:04:09.991>own <00:04:10.225>data

74
00:04:12.025 --> 00:04:16.765
<00:04:12.025>or <00:04:12.165>your <00:04:12.305>company <00:04:12.445>data, <00:04:12.585>99% <00:04:12.725>of <00:04:12.865>the <00:04:13.005>cases, <00:04:13.145>you <00:04:13.285>will <00:04:13.425>realize

75
00:04:16.835 --> 00:04:19.085
<00:04:16.834>that <00:04:17.068>you <00:04:17.301>need <00:04:17.534>to <00:04:17.768>involve <00:04:18.001>your, <00:04:18.234>uh,

76
00:04:19.085 --> 00:04:23.765
<00:04:19.084>company's <00:04:19.240>data <00:04:19.396>in <00:04:19.551>the <00:04:19.707>overall <00:04:19.862>loop <00:04:20.018>straight <00:04:20.173>from <00:04:20.329>day <00:04:20.484>one.

77
00:04:24.225 --> 00:04:28.365
<00:04:24.225>And, <00:04:24.365>uh, <00:04:24.505>in <00:04:24.645>many <00:04:24.785>cases, <00:04:24.925>uh, <00:04:25.065>this <00:04:25.205>is <00:04:25.345>not <00:04:25.485>that <00:04:25.625>trivial,

78
00:04:28.625 --> 00:04:32.645
<00:04:28.625>I'd <00:04:28.800>say, <00:04:28.975>uh, <00:04:29.150>looking <00:04:29.325>at, <00:04:29.500>uh, <00:04:29.675>different <00:04:29.850>formats <00:04:30.025>of

79
00:04:33.285 --> 00:04:37.325
<00:04:33.284>existing <00:04:33.440>data, <00:04:33.596>different, <00:04:33.751>uh, <00:04:33.907>ways <00:04:34.062>of, <00:04:34.218>um, <00:04:34.373>how <00:04:34.529>you <00:04:34.684>store,

80
00:04:37.625 --> 00:04:39.045
<00:04:37.625>uh, <00:04:38.264>this <00:04:38.903>data.

81
00:04:39.385 --> 00:04:41.165
<00:04:39.385>Uh, <00:04:39.664>I <00:04:39.945>mean, <00:04:40.224>not <00:04:40.505>to <00:04:40.784>completely

82
00:04:41.755 --> 00:04:44.125
<00:04:41.755>rebuild <00:04:42.034>from <00:04:42.315>scratch <00:04:42.594>all <00:04:42.875>your <00:04:43.155>solutions

83
00:04:44.155 --> 00:04:45.525
<00:04:44.155>just <00:04:44.463>for <00:04:44.771>using <00:04:45.079>the <00:04:45.388>data.

84
00:04:45.585 --> 00:04:50.245
<00:04:45.585>So <00:04:45.760>also <00:04:45.935>some <00:04:46.109>tools <00:04:46.284>needed <00:04:46.460>to <00:04:46.635>streamline <00:04:46.810>this <00:04:46.984>experience.

85
00:04:50.915 --> 00:04:53.005
<00:04:50.915>Next <00:04:51.265>point <00:04:51.615>is, <00:04:51.965>um, <00:04:52.315>evaluation.

86
00:04:53.105 --> 00:04:55.405
<00:04:53.105>And <00:04:53.455>back <00:04:53.805>to <00:04:54.155>my <00:04:54.505>statement,

87
00:04:55.435 --> 00:04:59.725
<00:04:55.435>that <00:04:55.635>your <00:04:55.835>today's <00:04:56.035>best <00:04:56.235>LLM <00:04:56.435>might <00:04:56.635>become <00:04:56.835>next

88
00:05:00.035 --> 00:05:01.205
<00:05:00.035>best <00:05:01.087>tomorrow.

89
00:05:01.785 --> 00:05:04.645
<00:05:01.785>Uh, <00:05:02.065>and, <00:05:02.345>uh, <00:05:02.625>also <00:05:02.905>next <00:05:03.185>generation

90
00:05:04.665 --> 00:05:07.885
<00:05:04.665>of <00:05:04.898>LLMs <00:05:05.131>might <00:05:05.365>be <00:05:05.598>just <00:05:05.831>cheaper, <00:05:06.065>right?

91
00:05:07.885 --> 00:05:10.885
<00:05:07.885>And <00:05:08.025>this <00:05:08.164>is <00:05:08.305>a <00:05:08.445>general <00:05:08.585>trend <00:05:08.724>when <00:05:08.865>token <00:05:09.005>price <00:05:09.145>is <00:05:09.284>getting

92
00:05:10.885 --> 00:05:12.045
<00:05:10.885>cheaper, <00:05:11.929>um,

93
00:05:12.225 --> 00:05:15.405
<00:05:12.225>and <00:05:12.425>sometimes <00:05:12.625>it's <00:05:12.825>just <00:05:13.025>multiple <00:05:13.225>orders <00:05:13.425>cheaper, <00:05:13.625>right?

94
00:05:15.905 --> 00:05:19.905
<00:05:15.905>Um, <00:05:16.044>so, <00:05:16.184>and <00:05:16.325>at <00:05:16.465>the <00:05:16.604>same <00:05:16.744>time, <00:05:16.885>you <00:05:17.025>cannot <00:05:17.164>just, <00:05:17.304>uh,

95
00:05:19.905 --> 00:05:20.945
<00:05:19.905>immediately <00:05:20.841>switch

96
00:05:20.945 --> 00:05:24.385
<00:05:20.945>because <00:05:21.145>you <00:05:21.344>are <00:05:21.545>not <00:05:21.745>sure <00:05:21.945>real <00:05:22.145>results <00:05:22.344>remain

97
00:05:24.485 --> 00:05:25.505
<00:05:24.485>the <00:05:24.944>same, <00:05:25.403>right?

98
00:05:25.805 --> 00:05:30.585
<00:05:25.805>Uh, <00:05:25.932>so <00:05:26.059>you <00:05:26.186>need <00:05:26.314>some <00:05:26.441>ways <00:05:26.568>to, <00:05:26.695>um, <00:05:26.823>evaluate <00:05:26.950>all <00:05:27.077>these, <00:05:27.205>uh,

99
00:05:30.585 --> 00:05:33.545
<00:05:30.585>moving <00:05:30.864>parts, <00:05:31.145>what <00:05:31.424>happens <00:05:31.705>if <00:05:31.984>AB

100
00:05:33.675 --> 00:05:35.105
<00:05:33.675>tests, <00:05:33.996>et <00:05:34.318>cetera, <00:05:34.640>et <00:05:34.962>cetera.

101
00:05:35.105 --> 00:05:39.305
<00:05:35.105>And <00:05:35.245>definitely <00:05:35.385>you <00:05:35.525>don't <00:05:35.665>want <00:05:35.805>to, <00:05:35.945>um, <00:05:36.085>run <00:05:36.225>this <00:05:36.365>process <00:05:36.505>side

102
00:05:39.325 --> 00:05:42.305
<00:05:39.325>by <00:05:39.525>side <00:05:39.724>manually <00:05:39.925>compare <00:05:40.125>output <00:05:40.325>from <00:05:40.525>this <00:05:40.724>LLM,

103
00:05:42.305 --> 00:05:45.465
<00:05:42.305>this <00:05:42.538>LLM <00:05:42.771>also, <00:05:43.005>sample <00:05:43.238>automation <00:05:43.471>is <00:05:43.705>highly,

104
00:05:45.465 --> 00:05:46.745
<00:05:45.465>highly <00:05:46.617>appreciated.

105
00:05:47.205 --> 00:05:51.305
<00:05:47.205>Uh, <00:05:47.405>and <00:05:47.604>last <00:05:47.805>but <00:05:48.005>not <00:05:48.205>least, <00:05:48.405>operationalizing <00:05:48.604>everything.

106
00:05:51.445 --> 00:05:56.145
<00:05:51.445>Um, <00:05:51.620>again, <00:05:51.795>we <00:05:51.969>are <00:05:52.145>talking <00:05:52.320>about <00:05:52.495>automating, <00:05:52.670>uh, <00:05:52.844>everything,

107
00:05:56.165 --> 00:05:57.365
<00:05:56.165>what's <00:05:56.705>ever <00:05:57.245>possible

108
00:05:57.465 --> 00:06:01.765
<00:05:57.465>to <00:05:57.698>automate <00:05:57.931>without <00:05:58.165>any <00:05:58.398>compromises <00:05:58.631>on <00:05:58.865>privacy,

109
00:06:02.685 --> 00:06:05.965
<00:06:02.685>security, <00:06:02.918>and, <00:06:03.151>uh, <00:06:03.385>thinking <00:06:03.618>about <00:06:03.851>ethical <00:06:04.085>parts

110
00:06:05.985 --> 00:06:08.165
<00:06:05.985>of <00:06:06.335>the <00:06:06.685>story, <00:06:07.035>responsible <00:06:07.385>ai.

111
00:06:08.425 --> 00:06:11.885
<00:06:08.425>So <00:06:08.552>yeah, <00:06:08.679>you <00:06:08.806>see <00:06:08.934>that <00:06:09.061>I, <00:06:09.188>I <00:06:09.315>hope <00:06:09.443>that <00:06:09.570>I'm, <00:06:09.697>um, <00:06:09.825>demonstrated,

112
00:06:12.105 --> 00:06:16.325
<00:06:12.105>um, <00:06:12.245>pretty <00:06:12.385>clear <00:06:12.525>that <00:06:12.665>there <00:06:12.805>are <00:06:12.945>some <00:06:13.085>obstacles <00:06:13.225>on <00:06:13.365>your <00:06:13.505>way

113
00:06:16.325 --> 00:06:18.845
<00:06:16.325>to <00:06:16.791>adopt <00:06:17.258>generative <00:06:17.724>ai.

114
00:06:19.955 --> 00:06:24.365
<00:06:19.955>Luckily, <00:06:20.188>with <00:06:20.421>the <00:06:20.655>introduction <00:06:20.888>of <00:06:21.121>LLM <00:06:21.354>ops,

115
00:06:24.745 --> 00:06:28.565
<00:06:24.745>uh, <00:06:24.900>it's <00:06:25.056>becoming, <00:06:25.211>if <00:06:25.367>not, <00:06:25.522>uh, <00:06:25.678>like <00:06:25.833>100%, <00:06:25.989>uh, <00:06:26.145>simple

116
00:06:28.665 --> 00:06:31.765
<00:06:28.665>and <00:06:28.792>tril, <00:06:28.919>but <00:06:29.046>at <00:06:29.174>least <00:06:29.301>there <00:06:29.428>is, <00:06:29.555>uh, <00:06:29.683>some <00:06:29.810>vision <00:06:29.937>on <00:06:30.065>how

117
00:06:31.825 --> 00:06:33.965
<00:06:31.825>to <00:06:32.291>go <00:06:32.758>that <00:06:33.224>direction.

118
00:06:34.425 --> 00:06:39.285
<00:06:34.425>And, <00:06:34.541>um, <00:06:34.658>I <00:06:34.775>mean, <00:06:34.891>uh, <00:06:35.008>LL <00:06:35.125>Mops <00:06:35.241>as <00:06:35.358>name <00:06:35.475>says <00:06:35.591>this <00:06:35.708>is, <00:06:35.825>um,

119
00:06:39.705 --> 00:06:42.565
<00:06:39.705>um, <00:06:39.905>say, <00:06:40.104>uh, <00:06:40.305>the <00:06:40.505>same, <00:06:40.705>the <00:06:40.905>same <00:06:41.104>idea,

120
00:06:42.635 --> 00:06:46.405
<00:06:42.635>same <00:06:42.868>concept <00:06:43.101>like <00:06:43.335>DevOps, <00:06:43.568>but <00:06:43.801>specialized, <00:06:44.034>right?

121
00:06:46.765 --> 00:06:48.325
<00:06:46.765>Specifically <00:06:47.231>for <00:06:47.698>the <00:06:48.164>applications

122
00:06:48.345 --> 00:06:51.005
<00:06:48.345>or <00:06:48.545>parts <00:06:48.745>of <00:06:48.945>the <00:06:49.145>applications <00:06:49.345>that <00:06:49.545>are <00:06:49.745>working

123
00:06:51.035 --> 00:06:52.845
<00:06:51.034>with <00:06:51.501>large <00:06:51.968>language <00:06:52.434>models.

124
00:06:53.185 --> 00:06:57.085
<00:06:53.185>And <00:06:53.340>if <00:06:53.496>DevOps <00:06:53.651>in <00:06:53.807>its, <00:06:53.962>uh, <00:06:54.118>informal <00:06:54.273>definition <00:06:54.429>is <00:06:54.585>a,

125
00:06:57.525 --> 00:07:00.485
<00:06:57.525>a <00:06:57.804>confluence <00:06:58.085>of, <00:06:58.364>uh, <00:06:58.645>people, <00:06:58.924>processes

126
00:07:00.505 --> 00:07:03.005
<00:07:00.505>and <00:07:00.705>products, <00:07:00.905>then <00:07:01.105>LL <00:07:01.305>mops <00:07:01.505>is <00:07:01.705>the <00:07:01.905>same.

127
00:07:03.155 --> 00:07:06.725
<00:07:03.155>It's, <00:07:03.505>uh, <00:07:03.854>uh, <00:07:04.205>people, <00:07:04.554>processes

128
00:07:06.825 --> 00:07:09.245
<00:07:06.825>and <00:07:07.291>platform, <00:07:07.758>uh, <00:07:08.224>mixed

129
00:07:09.345 --> 00:07:13.805
<00:07:09.345>and <00:07:09.545>work <00:07:09.745>together <00:07:09.945>to <00:07:10.145>automate <00:07:10.345>all, <00:07:10.545>uh, <00:07:10.745>sides

130
00:07:13.825 --> 00:07:16.125
<00:07:13.825>of <00:07:14.175>your <00:07:14.525>LLM <00:07:14.875>infused <00:07:15.224>application.

131
00:07:16.705 --> 00:07:19.405
<00:07:16.705>Why? <00:07:16.880>Well, <00:07:17.055>the <00:07:17.229>final <00:07:17.405>goal <00:07:17.580>is, <00:07:17.755>uh, <00:07:17.930>the <00:07:18.104>same

132
00:07:19.505 --> 00:07:22.485
<00:07:19.505>for <00:07:19.705>pretty <00:07:19.905>much <00:07:20.105>everything <00:07:20.305>that <00:07:20.505>ends <00:07:20.705>with <00:07:20.905>ops

133
00:07:22.705 --> 00:07:27.005
<00:07:22.705>to <00:07:22.880>provide <00:07:23.055>continuous <00:07:23.229>value <00:07:23.405>to <00:07:23.580>our <00:07:23.755>users, <00:07:23.930>to <00:07:24.104>our

134
00:07:27.645 --> 00:07:29.085
<00:07:27.645>customers, <00:07:28.293>as <00:07:28.941>simple

135
00:07:29.465 --> 00:07:33.805
<00:07:29.465>and <00:07:29.640>as <00:07:29.815>complex <00:07:29.989>as <00:07:30.164>that, <00:07:30.340>uh, <00:07:30.515>there <00:07:30.690>are <00:07:30.864>clear

136
00:07:34.405 --> 00:07:38.205
<00:07:34.405>benefits <00:07:34.638>from, <00:07:34.871>uh, <00:07:35.104>lending <00:07:35.338>LLM <00:07:35.571>ops <00:07:35.804>concept

137
00:07:38.545 --> 00:07:42.805
<00:07:38.545>to <00:07:38.685>your <00:07:38.825>organization <00:07:38.965>for <00:07:39.105>your <00:07:39.245>project, <00:07:39.385>even <00:07:39.525>if <00:07:39.665>this <00:07:39.805>is, <00:07:39.945>uh,

138
00:07:42.955 --> 00:07:46.365
<00:07:42.955>just <00:07:43.130>your <00:07:43.305>small <00:07:43.479>hobby <00:07:43.655>project, <00:07:43.830>uh, <00:07:44.005>still, <00:07:44.180>I <00:07:44.354>mean,

139
00:07:46.465 --> 00:07:49.725
<00:07:46.465>you <00:07:46.665>will <00:07:46.865>clearly <00:07:47.065>see, <00:07:47.265>um, <00:07:47.465>this, <00:07:47.665>um, <00:07:47.865>advantage.

140
00:07:50.575 --> 00:07:53.365
<00:07:50.575>First <00:07:50.808>of <00:07:51.041>all, <00:07:51.275>it's <00:07:51.508>all <00:07:51.741>about <00:07:51.974>automation.

141
00:07:53.785 --> 00:07:58.165
<00:07:53.784>And <00:07:53.924>if, <00:07:54.064>um, <00:07:54.205>the <00:07:54.344>way <00:07:54.484>we, <00:07:54.624>uh, <00:07:54.765>for <00:07:54.905>example, <00:07:55.044>push <00:07:55.184>code

142
00:07:58.185 --> 00:08:00.365
<00:07:58.185>to <00:07:58.385>the <00:07:58.585>report, <00:07:58.785>deploy <00:07:58.985>the <00:07:59.185>code, <00:07:59.385>I <00:07:59.585>mean,

143
00:08:00.415 --> 00:08:03.885
<00:08:00.415>these <00:08:00.570>questions <00:08:00.726>are <00:08:00.881>answered <00:08:01.037>by <00:08:01.192>let's <00:08:01.348>say, <00:08:01.503>classic, <00:08:01.659>uh, <00:08:01.815>uh,

144
00:08:03.885 --> 00:08:05.005
<00:08:03.885>traditional <00:08:04.893>DevOps.

145
00:08:05.235 --> 00:08:08.685
<00:08:05.235>Then, <00:08:05.515>um, <00:08:05.795>automation <00:08:06.075>related <00:08:06.355>to <00:08:06.635>evaluation

146
00:08:08.905 --> 00:08:13.685
<00:08:08.905>and <00:08:09.104>testing <00:08:09.304>of, <00:08:09.505>um, <00:08:09.705>um, <00:08:09.905>these <00:08:10.104>probabilistic <00:08:10.304>engines.

147
00:08:14.075 --> 00:08:16.645
<00:08:14.075>This <00:08:14.308>is <00:08:14.541>where <00:08:14.775>LLM <00:08:15.008>ops <00:08:15.241>gives <00:08:15.474>answers

148
00:08:16.905 --> 00:08:20.405
<00:08:16.905>and, <00:08:17.080>uh, <00:08:17.255>also <00:08:17.429>points <00:08:17.604>to, <00:08:17.780>uh, <00:08:17.955>particular <00:08:18.130>tools, <00:08:18.304>right?

149
00:08:20.405 --> 00:08:23.165
<00:08:20.405>So <00:08:20.560>this <00:08:20.716>is <00:08:20.871>where <00:08:21.027>we <00:08:21.182>want <00:08:21.338>to <00:08:21.493>focus <00:08:21.649>our, <00:08:21.804>um,

150
00:08:24.055 --> 00:08:25.325
<00:08:24.055>automation <00:08:25.198>efforts.

151
00:08:25.995 --> 00:08:27.285
<00:08:25.995>Next, <00:08:26.575>uh, <00:08:27.156>collaboration,

152
00:08:27.425 --> 00:08:31.165
<00:08:27.425>and <00:08:27.580>here <00:08:27.736>we <00:08:27.891>focus <00:08:28.047>on, <00:08:28.202>uh, <00:08:28.358>sharing <00:08:28.513>what <00:08:28.669>we <00:08:28.825>have,

153
00:08:31.165 --> 00:08:32.165
<00:08:31.165>sharing <00:08:32.064>assets

154
00:08:32.305 --> 00:08:35.605
<00:08:32.304>and <00:08:32.538>resources, <00:08:32.771>connections <00:08:33.005>between <00:08:33.238>multiple <00:08:33.471>parts <00:08:33.704>of,

155
00:08:35.665 --> 00:08:37.085
<00:08:35.664>um, <00:08:36.304>our <00:08:36.943>solution.

156
00:08:37.825 --> 00:08:40.525
<00:08:37.825>Uh, <00:08:38.291>reproducibility <00:08:38.758>is, <00:08:39.225>uh,

157
00:08:41.365 --> 00:08:43.005
<00:08:41.365>absolutely <00:08:42.065>non-trivial <00:08:42.765>things.

158
00:08:43.225 --> 00:08:45.645
<00:08:43.225>If <00:08:43.458>we <00:08:43.691>talk <00:08:43.925>about, <00:08:44.158>um, <00:08:44.391>again, <00:08:44.625>probabilistic,

159
00:08:45.985 --> 00:08:49.525
<00:08:45.985>non-deterministic <00:08:46.335>holistic, <00:08:46.685>um, <00:08:47.035>applications, <00:08:47.385>uh,

160
00:08:49.525 --> 00:08:52.085
<00:08:49.525>or <00:08:49.665>parts <00:08:49.805>of <00:08:49.944>applications <00:08:50.084>where, <00:08:50.225>where <00:08:50.365>we, <00:08:50.505>when <00:08:50.645>we <00:08:50.785>talk <00:08:50.925>about

161
00:08:52.905 --> 00:08:55.285
<00:08:52.905>LMS <00:08:53.138>and <00:08:53.371>generative <00:08:53.605>ai, <00:08:53.838>I <00:08:54.071>mean, <00:08:54.305>uh,

162
00:08:55.345 --> 00:08:59.205
<00:08:55.345>we <00:08:55.472>definitely <00:08:55.599>need <00:08:55.726>some <00:08:55.854>focus <00:08:55.981>here <00:08:56.108>as <00:08:56.235>well <00:08:56.363>just <00:08:56.490>to <00:08:56.617>make <00:08:56.745>sure

163
00:08:59.205 --> 00:09:03.805
<00:08:59.205>that, <00:08:59.380>uh, <00:08:59.555>yeah, <00:08:59.730>uh, <00:08:59.905>all <00:09:00.080>our <00:09:00.255>components <00:09:00.430>are <00:09:00.605>reproducible

164
00:09:04.525 --> 00:09:07.725
<00:09:04.525>properly, <00:09:04.725>versioned, <00:09:04.925>and <00:09:05.125>easy <00:09:05.324>to <00:09:05.525>maintain <00:09:05.725>after <00:09:05.925>all.

165
00:09:08.185 --> 00:09:12.285
<00:09:08.185>Uh, <00:09:08.340>and <00:09:08.496>it <00:09:08.651>all <00:09:08.807>gives <00:09:08.962>us, <00:09:09.118>first <00:09:09.273>of <00:09:09.429>all, <00:09:09.584>velocity

166
00:09:12.945 --> 00:09:15.565
<00:09:12.945>and <00:09:13.411>second <00:09:13.878>security, <00:09:14.345>right?

167
00:09:15.585 --> 00:09:17.605
<00:09:15.585>So <00:09:15.818>we <00:09:16.051>definitely <00:09:16.285>don't <00:09:16.518>want <00:09:16.751>to, <00:09:16.985>uh,

168
00:09:17.735 --> 00:09:19.485
<00:09:17.735>compromise <00:09:18.085>on <00:09:18.435>that <00:09:18.785>as <00:09:19.135>well.

169
00:09:21.235 --> 00:09:23.765
<00:09:21.235>This <00:09:21.515>is <00:09:21.795>machine <00:09:22.075>learning <00:09:22.355>day, <00:09:22.635>right?

170
00:09:23.825 --> 00:09:27.205
<00:09:23.825>So <00:09:24.105>I <00:09:24.385>assume <00:09:24.665>that, <00:09:24.945>uh, <00:09:25.225>some

171
00:09:27.205 --> 00:09:29.725
<00:09:27.205>of <00:09:27.438>you <00:09:27.671>might <00:09:27.905>be <00:09:28.138>familiar <00:09:28.371>with, <00:09:28.605>uh,

172
00:09:29.875 --> 00:09:33.365
<00:09:29.875>machine <00:09:30.155>learning <00:09:30.435>operations <00:09:30.715>or <00:09:30.995>ML <00:09:31.275>ops.

173
00:09:33.545 --> 00:09:36.165
<00:09:33.545>Um, <00:09:33.745>and <00:09:33.944>you <00:09:34.145>might <00:09:34.344>also <00:09:34.545>have <00:09:34.745>a <00:09:34.944>question,

174
00:09:36.385 --> 00:09:38.525
<00:09:36.385>how <00:09:36.665>are <00:09:36.944>these <00:09:37.225>things <00:09:37.505>are <00:09:37.785>different

175
00:09:38.525 --> 00:09:42.005
<00:09:38.525>because <00:09:38.805>they <00:09:39.084>both <00:09:39.365>work <00:09:39.645>with, <00:09:39.925>um,

176
00:09:42.075 --> 00:09:43.845
<00:09:42.075>probabilistic <00:09:43.475>applications.

177
00:09:44.145 --> 00:09:45.165
<00:09:44.145>You <00:09:44.451>are <00:09:44.757>absolutely <00:09:45.063>right.

178
00:09:45.195 --> 00:09:47.085
<00:09:45.195>They <00:09:45.475>have <00:09:45.755>lots <00:09:46.035>of <00:09:46.315>intersection <00:09:46.595>points,

179
00:09:47.225 --> 00:09:50.005
<00:09:47.225>but <00:09:47.458>still <00:09:47.691>they <00:09:47.925>have <00:09:48.158>lots <00:09:48.391>of <00:09:48.625>differences.

180
00:09:50.225 --> 00:09:54.805
<00:09:50.225>So <00:09:50.352>let <00:09:50.479>me <00:09:50.606>dedicate <00:09:50.734>a <00:09:50.861>few <00:09:50.988>moments <00:09:51.115>to <00:09:51.243>explain, <00:09:51.370>uh, <00:09:51.497>that, <00:09:51.625>uh,

181
00:09:55.195 --> 00:09:59.165
<00:09:55.195>part, <00:09:55.335>first <00:09:55.475>of <00:09:55.615>all, <00:09:55.755>yeah, <00:09:55.895>uh, <00:09:56.035>if <00:09:56.175>you <00:09:56.315>talk <00:09:56.455>about <00:09:56.595>audience

182
00:09:59.385 --> 00:10:04.285
<00:09:59.385>who <00:09:59.560>is <00:09:59.735>main, <00:09:59.910>uh, <00:10:00.085>fault <00:10:00.260>responsible <00:10:00.435>for <00:10:00.610>these <00:10:00.785>ops,

183
00:10:04.385 --> 00:10:07.725
<00:10:04.385>and <00:10:04.540>maybe <00:10:04.696>at <00:10:04.851>the <00:10:05.007>same <00:10:05.162>time, <00:10:05.318>main, <00:10:05.473>main <00:10:05.629>bene <00:10:05.785>beneficiaries

184
00:10:07.865 --> 00:10:11.605
<00:10:07.865>of, <00:10:08.020>uh, <00:10:08.176>of <00:10:08.331>this, <00:10:08.487>obviously <00:10:08.642>this, <00:10:08.798>this <00:10:08.953>is <00:10:09.109>all <00:10:09.265>relevant

185
00:10:11.605 --> 00:10:15.005
<00:10:11.605>to <00:10:11.838>machine <00:10:12.071>learning <00:10:12.305>engineers <00:10:12.538>for <00:10:12.771>both <00:10:13.005>cases.

186
00:10:15.625 --> 00:10:19.765
<00:10:15.625>Um, <00:10:15.800>but <00:10:15.975>if <00:10:16.150>we <00:10:16.325>look <00:10:16.500>further, <00:10:16.675>uh, <00:10:16.850>it's <00:10:17.025>like

187
00:10:20.285 --> 00:10:23.605
<00:10:20.285>slightly <00:10:20.485>different <00:10:20.685>sides <00:10:20.885>of, <00:10:21.084>uh, <00:10:21.285>this, <00:10:21.485>uh, <00:10:21.685>spectrum.

188
00:10:23.945 --> 00:10:28.245
<00:10:23.945>So <00:10:24.100>if <00:10:24.256>traditional <00:10:24.411>MLM, <00:10:24.567>um, <00:10:24.722>ML <00:10:24.878>ops, <00:10:25.033>sorry, <00:10:25.189>uh, <00:10:25.345>uh,

189
00:10:28.375 --> 00:10:31.565
<00:10:28.375>focus <00:10:28.575>on <00:10:28.775>data <00:10:28.975>science <00:10:29.175>part <00:10:29.375>of <00:10:29.575>the <00:10:29.775>story,

190
00:10:31.835 --> 00:10:36.605
<00:10:31.835>then <00:10:32.010>LLM <00:10:32.185>ops <00:10:32.360>is <00:10:32.535>targeted <00:10:32.710>for <00:10:32.885>application <00:10:33.060>developers, <00:10:33.235>right?

191
00:10:36.665 --> 00:10:40.125
<00:10:36.665>So, <00:10:36.865>um, <00:10:37.064>you <00:10:37.265>clearly <00:10:37.464>see <00:10:37.665>a <00:10:37.865>difference <00:10:38.064>here.

192
00:10:40.755 --> 00:10:43.805
<00:10:40.755>Also, <00:10:40.930>if <00:10:41.105>you <00:10:41.280>talk <00:10:41.455>about, <00:10:41.630>um, <00:10:41.805>assets <00:10:41.980>about <00:10:42.155>resources,

193
00:10:43.945 --> 00:10:45.325
<00:10:43.945>we <00:10:44.566>operate <00:10:45.187>here

194
00:10:45.865 --> 00:10:50.405
<00:10:45.865>and <00:10:46.040>there, <00:10:46.215>ML <00:10:46.390>ops, <00:10:46.565>yeah, <00:10:46.740>it's <00:10:46.915>all <00:10:47.090>about <00:10:47.265>models,

195
00:10:50.865 --> 00:10:52.805
<00:10:50.865>uh, <00:10:51.331>and, <00:10:51.798>uh, <00:10:52.265>data

196
00:10:53.065 --> 00:10:56.725
<00:10:53.065>and <00:10:53.345>environments <00:10:53.625>while <00:10:53.905>slightly <00:10:54.185>different, <00:10:54.465>uh,

197
00:10:56.975 --> 00:10:59.685
<00:10:56.975>let's <00:10:57.208>say <00:10:57.441>entities <00:10:57.675>for <00:10:57.908>LLM <00:10:58.141>ops <00:10:58.375>here,

198
00:10:59.745 --> 00:11:03.925
<00:10:59.745>we <00:10:59.920>talk <00:11:00.095>about <00:11:00.270>large <00:11:00.445>language <00:11:00.620>models <00:11:00.795>themselves, <00:11:00.970>uh, <00:11:01.145>agents,

199
00:11:04.595 --> 00:11:07.325
<00:11:04.595>plugins, <00:11:04.945>uh, <00:11:05.295>prompts, <00:11:05.645>chains, <00:11:05.995>APIs,

200
00:11:07.345 --> 00:11:11.325
<00:11:07.345>and <00:11:07.520>let's <00:11:07.695>say <00:11:07.870>we <00:11:08.045>also <00:11:08.220>talk <00:11:08.395>about, <00:11:08.570>uh, <00:11:08.745>vectorization,

201
00:11:11.585 --> 00:11:14.845
<00:11:11.585>we <00:11:11.760>talk <00:11:11.935>about <00:11:12.110>chunking, <00:11:12.285>we <00:11:12.460>talk <00:11:12.635>about <00:11:12.810>prompt <00:11:12.985>engineering.

202
00:11:15.065 --> 00:11:19.365
<00:11:15.065>So <00:11:15.192>let's <00:11:15.319>say <00:11:15.446>we <00:11:15.574>can, <00:11:15.701>uh, <00:11:15.828>say <00:11:15.955>maybe <00:11:16.083>it's <00:11:16.210>higher <00:11:16.337>level, <00:11:16.465>uh,

203
00:11:19.845 --> 00:11:21.725
<00:11:19.845>entities <00:11:20.195>compared <00:11:20.545>to <00:11:20.895>ML <00:11:21.245>ops.

204
00:11:22.385 --> 00:11:26.485
<00:11:22.385>Uh, <00:11:22.585>also <00:11:22.785>very <00:11:22.985>different <00:11:23.185>metrics <00:11:23.385>if <00:11:23.585>in <00:11:23.785>mops,

205
00:11:26.585 --> 00:11:31.045
<00:11:26.585>we <00:11:26.725>mainly <00:11:26.865>focus <00:11:27.005>on, <00:11:27.145>uh, <00:11:27.285>accuracy <00:11:27.425>of <00:11:27.565>our <00:11:27.705>models <00:11:27.845>of, <00:11:27.985>uh,

206
00:11:31.075 --> 00:11:32.325
<00:11:31.075>fine <00:11:31.356>tuning <00:11:31.637>of <00:11:31.918>this <00:11:32.200>models.

207
00:11:32.635 --> 00:11:37.405
<00:11:32.635>Then <00:11:32.810>lots <00:11:32.985>of, <00:11:33.160>um, <00:11:33.335>uh, <00:11:33.510>more <00:11:33.685>precise, <00:11:33.860>uh, <00:11:34.035>metrics

208
00:11:37.585 --> 00:11:41.845
<00:11:37.585>of, <00:11:37.785>um, <00:11:37.985>evolution <00:11:38.185>for <00:11:38.385>LLM <00:11:38.585>ops, <00:11:38.785>like, <00:11:38.985>uh,

209
00:11:42.595 --> 00:11:47.485
<00:11:42.595>like <00:11:42.770>bias, <00:11:42.945>like <00:11:43.120>groundness, <00:11:43.295>like, <00:11:43.470>uh, <00:11:43.645>cost <00:11:43.820>per <00:11:43.995>token,

210
00:11:47.945 --> 00:11:49.005
<00:11:47.945>et <00:11:48.263>cetera, <00:11:48.581>et <00:11:48.899>cetera.

211
00:11:49.505 --> 00:11:52.965
<00:11:49.505>And, <00:11:49.660>uh, <00:11:49.816>last <00:11:49.971>but <00:11:50.127>not <00:11:50.282>least, <00:11:50.438>if <00:11:50.593>we <00:11:50.749>talk <00:11:50.905>about

212
00:11:53.545 --> 00:11:57.365
<00:11:53.545>mainly <00:11:53.719>building <00:11:53.895>models <00:11:54.069>from <00:11:54.245>scratch, <00:11:54.420>from, <00:11:54.594>uh, <00:11:54.770>for, <00:11:54.944>uh,

213
00:11:57.675 --> 00:11:59.605
<00:11:57.675>mops <00:11:57.908>like <00:11:58.141>building <00:11:58.375>or <00:11:58.608>maybe <00:11:58.841>fine <00:11:59.074>tuning.

214
00:12:00.155 --> 00:12:04.125
<00:12:00.155>Then <00:12:00.295>in <00:12:00.435>LL <00:12:00.574>mops, <00:12:00.714>uh, <00:12:00.855>at <00:12:00.995>least <00:12:01.135>what <00:12:01.275>I <00:12:01.415>see <00:12:01.555>now,

215
00:12:04.315 --> 00:12:08.885
<00:12:04.315>it's <00:12:04.470>mainly <00:12:04.626>using <00:12:04.781>of, <00:12:04.937>um, <00:12:05.092>some <00:12:05.248>pre-built <00:12:05.403>ones, <00:12:05.559>of <00:12:05.715>course,

216
00:12:08.945 --> 00:12:11.725
<00:12:08.945>uh, <00:12:09.120>yeah, <00:12:09.295>if <00:12:09.470>needed, <00:12:09.645>we <00:12:09.820>can <00:12:09.995>also <00:12:10.170>fine <00:12:10.345>tune.

217
00:12:12.145 --> 00:12:15.565
<00:12:12.145>And <00:12:12.285>after <00:12:12.425>all, <00:12:12.564>there <00:12:12.704>are <00:12:12.845>multiple <00:12:12.985>options <00:12:13.125>for <00:12:13.265>you <00:12:13.405>to, <00:12:13.545>uh,

218
00:12:15.825 --> 00:12:17.765
<00:12:15.825>use, <00:12:16.105>uh, <00:12:16.385>ready <00:12:16.665>to <00:12:16.945>go <00:12:17.225>models.

219
00:12:17.905 --> 00:12:21.965
<00:12:17.905>You <00:12:18.045>can <00:12:18.185>either, <00:12:18.324>um, <00:12:18.464>for <00:12:18.605>example, <00:12:18.745>use <00:12:18.885>this, <00:12:19.025>uh, <00:12:19.165>exposed <00:12:19.305>APIs

220
00:12:21.965 --> 00:12:24.005
<00:12:21.965>by <00:12:22.198>this <00:12:22.431>or <00:12:22.665>that <00:12:22.898>vendor <00:12:23.131>of <00:12:23.365>LLM,

221
00:12:24.105 --> 00:12:26.885
<00:12:24.105>or <00:12:24.260>you <00:12:24.416>can <00:12:24.571>spin <00:12:24.727>up <00:12:24.882>this <00:12:25.038>model <00:12:25.193>using, <00:12:25.349>uh, <00:12:25.505>compute,

222
00:12:26.985 --> 00:12:28.285
<00:12:26.985>or <00:12:27.277>you <00:12:27.569>can <00:12:27.862>use, <00:12:28.155>uh,

223
00:12:28.285 --> 00:12:30.205
<00:12:28.285>something <00:12:28.485>in <00:12:28.685>the <00:12:28.885>middle <00:12:29.084>like <00:12:29.285>model <00:12:29.485>SS <00:12:29.685>service.

224
00:12:30.615 --> 00:12:34.125
<00:12:30.615>Still, <00:12:30.815>we <00:12:31.015>mainly <00:12:31.215>talk <00:12:31.415>about <00:12:31.615>something <00:12:31.815>that <00:12:32.015>exists

225
00:12:34.265 --> 00:12:36.085
<00:12:34.265>and <00:12:34.498>yeah, <00:12:34.731>something <00:12:34.965>that <00:12:35.198>is <00:12:35.431>still <00:12:35.665>fine

226
00:12:36.085 --> 00:12:37.125
<00:12:36.085>tuneable <00:12:36.319>at <00:12:36.553>the <00:12:36.787>same <00:12:37.021>time.

227
00:12:39.275 --> 00:12:43.975
<00:12:39.275>Um, <00:12:39.382>and <00:12:39.490>if, <00:12:39.598>uh, <00:12:39.705>now <00:12:39.813>I <00:12:39.921>think <00:12:40.028>now <00:12:40.136>we <00:12:40.244>are <00:12:40.351>ready <00:12:40.459>to <00:12:40.567>go <00:12:40.675>through

228
00:12:44.725 --> 00:12:49.655
<00:12:44.725>some <00:12:44.925>cycles <00:12:45.125>that <00:12:45.325>construct <00:12:45.525>LLM <00:12:45.725>cycle, <00:12:45.925>uh, <00:12:46.125>LLM,

229
00:12:49.655 --> 00:12:51.495
<00:12:49.655>life <00:12:49.935>cycle <00:12:50.214>in <00:12:50.495>the <00:12:50.775>real <00:12:51.055>world.

230
00:12:51.555 --> 00:12:55.575
<00:12:51.555>Um, <00:12:51.755>again, <00:12:51.954>I'm <00:12:52.155>here <00:12:52.354>talking <00:12:52.555>about, <00:12:52.755>uh, <00:12:52.954>something

231
00:12:55.575 --> 00:12:59.535
<00:12:55.575>that <00:12:55.730>is <00:12:55.886>more <00:12:56.041>complex <00:12:56.197>than <00:12:56.352>just <00:12:56.508>sending <00:12:56.663>your, <00:12:56.819>uh, <00:12:56.975>first

232
00:12:59.635 --> 00:13:02.295
<00:12:59.635>and <00:12:59.835>only <00:13:00.035>ap, <00:13:00.235>uh, <00:13:00.435>API <00:13:00.635>request <00:13:00.835>to <00:13:01.035>this

233
00:13:02.295 --> 00:13:04.815
<00:13:02.295>or <00:13:02.528>that <00:13:02.761>LLM <00:13:02.995>provider <00:13:03.228>getting <00:13:03.461>completion <00:13:03.694>back

234
00:13:04.815 --> 00:13:06.135
<00:13:04.815>and <00:13:05.112>saying, <00:13:05.409>yeah, <00:13:05.706>that <00:13:06.003>works.

235
00:13:06.675 --> 00:13:09.415
<00:13:06.675>No, <00:13:06.849>uh, <00:13:07.025>if <00:13:07.199>you <00:13:07.375>talk <00:13:07.550>about <00:13:07.724>real <00:13:07.900>world <00:13:08.074>applications,

236
00:13:09.415 --> 00:13:13.855
<00:13:09.415>applications <00:13:09.570>that <00:13:09.726>must <00:13:09.881>scale, <00:13:10.037>that <00:13:10.192>must, <00:13:10.348>uh, <00:13:10.503>keep <00:13:10.659>all, <00:13:10.814>um,

237
00:13:13.995 --> 00:13:16.375
<00:13:13.995>on <00:13:14.275>privacy <00:13:14.555>security <00:13:14.835>topics <00:13:15.115>in <00:13:15.395>mind.

238
00:13:16.375 --> 00:13:18.695
<00:13:16.375>Yeah, <00:13:16.575>it's <00:13:16.775>a <00:13:16.975>bit <00:13:17.175>more <00:13:17.375>complex, <00:13:17.575>how <00:13:17.775>complex.

239
00:13:18.835 --> 00:13:20.015
<00:13:18.835>You'll <00:13:19.100>see <00:13:19.366>in <00:13:19.631>a <00:13:19.896>second.

240
00:13:20.715 --> 00:13:23.895
<00:13:20.715>It <00:13:20.915>all <00:13:21.115>starts <00:13:21.315>with, <00:13:21.515>uh, <00:13:21.715>business <00:13:21.915>need, <00:13:22.115>right?

241
00:13:24.195 --> 00:13:27.815
<00:13:24.195>And <00:13:24.395>once <00:13:24.595>we <00:13:24.795>got, <00:13:24.995>I, <00:13:25.195>uh, <00:13:25.395>like <00:13:25.595>request

242
00:13:27.915 --> 00:13:31.015
<00:13:27.915>or <00:13:28.194>idea <00:13:28.474>about <00:13:28.755>our <00:13:29.035>next <00:13:29.314>application

243
00:13:31.355 --> 00:13:34.575
<00:13:31.355>or <00:13:31.588>feature <00:13:31.821>of <00:13:32.055>application <00:13:32.288>related <00:13:32.521>to <00:13:32.755>ai,

244
00:13:34.755 --> 00:13:38.415
<00:13:34.755>we <00:13:35.035>immediately <00:13:35.314>start <00:13:35.595>ideation <00:13:35.875>and <00:13:36.155>exploration.

245
00:13:39.035 --> 00:13:42.815
<00:13:39.035>And <00:13:39.209>here, <00:13:39.385>yeah, <00:13:39.560>experimentation <00:13:39.735>is <00:13:39.910>a, <00:13:40.084>like, <00:13:40.260>big, <00:13:40.435>big,

246
00:13:42.835 --> 00:13:46.015
<00:13:42.835>big <00:13:43.010>part <00:13:43.185>of <00:13:43.360>all <00:13:43.535>the <00:13:43.710>story, <00:13:43.885>this <00:13:44.060>experimentation, <00:13:44.235>uh,

247
00:13:46.285 --> 00:13:47.535
<00:13:46.285>loop <00:13:46.847>or <00:13:47.410>cycle.

248
00:13:47.965 --> 00:13:50.815
<00:13:47.965>Here, <00:13:48.198>we <00:13:48.431>play <00:13:48.665>with <00:13:48.898>different <00:13:49.131>LMS <00:13:49.365>here.

249
00:13:50.835 --> 00:13:55.295
<00:13:50.835>We, <00:13:50.990>uh, <00:13:51.146>try <00:13:51.301>to, <00:13:51.457>uh, <00:13:51.612>identify <00:13:51.768>our <00:13:51.923>best <00:13:52.079>prompt <00:13:52.235>here.

250
00:13:55.295 --> 00:13:58.975
<00:13:55.295>We <00:13:55.574>validate <00:13:55.854>different, <00:13:56.135>uh, <00:13:56.415>hypothesis, <00:13:56.694>um,

251
00:13:59.075 --> 00:14:01.615
<00:13:59.075>and <00:13:59.275>yeah, <00:13:59.475>we <00:13:59.675>can <00:13:59.875>call <00:14:00.075>this <00:14:00.275>also <00:14:00.475>prototyping.

252
00:14:02.275 --> 00:14:06.815
<00:14:02.275>If <00:14:02.449>we <00:14:02.625>are <00:14:02.800>happy <00:14:02.975>with <00:14:03.150>what <00:14:03.324>we <00:14:03.500>get, <00:14:03.675>uh,

253
00:14:06.815 --> 00:14:08.815
<00:14:06.815>from <00:14:07.095>this <00:14:07.375>particular <00:14:07.655>LLM <00:14:07.935>with <00:14:08.215>this,

254
00:14:08.815 --> 00:14:12.055
<00:14:08.815>this <00:14:09.015>particular <00:14:09.215>prompt <00:14:09.415>we <00:14:09.615>can <00:14:09.815>think <00:14:10.015>about <00:14:10.215>start

255
00:14:12.655 --> 00:14:13.815
<00:14:12.655>building <00:14:13.177>something, <00:14:13.699>right?

256
00:14:14.115 --> 00:14:16.815
<00:14:14.115>So <00:14:14.395>we, <00:14:14.675>um, <00:14:14.955>on <00:14:15.235>that <00:14:15.515>level,

257
00:14:16.955 --> 00:14:19.375
<00:14:16.955>we <00:14:17.155>are <00:14:17.355>a <00:14:17.555>bit <00:14:17.755>more <00:14:17.955>serious <00:14:18.155>about <00:14:18.355>prompt.

258
00:14:19.555 --> 00:14:21.495
<00:14:19.555>So <00:14:19.788>this <00:14:20.021>is <00:14:20.255>not <00:14:20.488>just <00:14:20.721>the <00:14:20.954>experimentation.

259
00:14:21.515 --> 00:14:24.415
<00:14:21.515>So <00:14:21.715>here <00:14:21.915>we <00:14:22.115>start <00:14:22.314>thinking <00:14:22.515>about <00:14:22.715>prompt <00:14:22.915>engineering,

260
00:14:24.715 --> 00:14:27.615
<00:14:24.715>all <00:14:24.948>these <00:14:25.181>techniques, <00:14:25.415>uh, <00:14:25.648>maybe <00:14:25.881>some <00:14:26.115>kind

261
00:14:27.615 --> 00:14:29.735
<00:14:27.615>of <00:14:27.965>placeholders <00:14:28.315>in <00:14:28.665>our <00:14:29.015>prompts

262
00:14:29.735 --> 00:14:33.935
<00:14:29.735>where <00:14:29.910>we <00:14:30.085>feel <00:14:30.260>in <00:14:30.435>our <00:14:30.610>information <00:14:30.785>using <00:14:30.960>rag <00:14:31.135>retrieval,

263
00:14:33.935 --> 00:14:34.935
<00:14:33.935>augmented <00:14:34.834>generation.

264
00:14:35.355 --> 00:14:38.495
<00:14:35.355>Uh, <00:14:35.588>here <00:14:35.821>we <00:14:36.055>start <00:14:36.288>talking <00:14:36.521>about, <00:14:36.755>uh,

265
00:14:38.605 --> 00:14:40.015
<00:14:38.605>some <00:14:39.239>exception <00:14:39.874>handling.

266
00:14:40.285 --> 00:14:42.095
<00:14:40.285>What, <00:14:40.635>what <00:14:40.985>happens <00:14:41.334>if, <00:14:41.685>right?

267
00:14:42.195 --> 00:14:46.455
<00:14:42.195>Uh, <00:14:42.322>what <00:14:42.449>if <00:14:42.576>we <00:14:42.704>go <00:14:42.831>not, <00:14:42.958>uh, <00:14:43.085>not <00:14:43.213>success, <00:14:43.340>uh, <00:14:43.467>path <00:14:43.595>of,

268
00:14:46.515 --> 00:14:47.655
<00:14:46.515>uh, <00:14:46.857>of <00:14:47.199>this <00:14:47.540>cycle.

269
00:14:48.195 --> 00:14:52.365
<00:14:48.195>And <00:14:48.370>yeah, <00:14:48.545>if <00:14:48.720>needed, <00:14:48.895>we <00:14:49.070>can <00:14:49.245>always <00:14:49.420>go <00:14:49.595>back

270
00:14:52.425 --> 00:14:56.565
<00:14:52.425>to <00:14:52.580>ideation <00:14:52.736>to <00:14:52.891>re <00:14:53.047>rethink <00:14:53.202>parts <00:14:53.358>of, <00:14:53.513>uh, <00:14:53.669>our <00:14:53.824>application.

271
00:14:57.025 --> 00:14:59.045
<00:14:57.025>But <00:14:57.375>if <00:14:57.725>everything <00:14:58.074>looks <00:14:58.425>good

272
00:14:59.225 --> 00:15:02.245
<00:14:59.225>and <00:14:59.458>we <00:14:59.691>build <00:14:59.925>what <00:15:00.158>we <00:15:00.391>call <00:15:00.625>application,

273
00:15:02.305 --> 00:15:05.725
<00:15:02.305>or <00:15:02.444>at <00:15:02.584>least <00:15:02.724>part <00:15:02.864>of <00:15:03.005>the <00:15:03.145>application, <00:15:03.285>we <00:15:03.425>can <00:15:03.564>move <00:15:03.704>further

274
00:15:05.945 --> 00:15:09.485
<00:15:05.945>and <00:15:06.178>prepare <00:15:06.411>our <00:15:06.645>application <00:15:06.878>for <00:15:07.111>the <00:15:07.345>deployment.

275
00:15:10.105 --> 00:15:12.605
<00:15:10.105>And, <00:15:10.280>uh, <00:15:10.455>we <00:15:10.630>are <00:15:10.805>not <00:15:10.980>talking <00:15:11.155>about <00:15:11.330>just, <00:15:11.505>uh,

276
00:15:12.605 --> 00:15:16.325
<00:15:12.605>pushing <00:15:12.780>some <00:15:12.955>files <00:15:13.130>somewhere <00:15:13.305>on, <00:15:13.480>uh, <00:15:13.655>web <00:15:13.830>server, <00:15:14.005>right?

277
00:15:16.425 --> 00:15:19.045
<00:15:16.425>Of <00:15:16.704>course, <00:15:16.984>it's <00:15:17.265>much <00:15:17.545>more <00:15:17.824>sophisticated

278
00:15:19.185 --> 00:15:22.285
<00:15:19.185>and, <00:15:19.418>uh, <00:15:19.651>contains <00:15:19.885>many <00:15:20.118>more <00:15:20.351>components, <00:15:20.584>uh,

279
00:15:22.505 --> 00:15:23.725
<00:15:22.505>and <00:15:22.779>things <00:15:23.054>to <00:15:23.328>care <00:15:23.603>about.

280
00:15:23.945 --> 00:15:26.925
<00:15:23.945>So <00:15:24.145>starting <00:15:24.345>from, <00:15:24.545>uh, <00:15:24.745>looking <00:15:24.945>at, <00:15:25.145>uh, <00:15:25.345>cost

281
00:15:27.185 --> 00:15:28.725
<00:15:27.185>and, <00:15:27.531>um, <00:15:27.877>yeah, <00:15:28.224>in, <00:15:28.571>uh,

282
00:15:28.725 --> 00:15:32.085
<00:15:28.725>in <00:15:28.880>many <00:15:29.036>cases <00:15:29.191>we <00:15:29.347>talk <00:15:29.502>about <00:15:29.658>some, <00:15:29.813>some <00:15:29.969>payments, <00:15:30.125>right?

283
00:15:32.085 --> 00:15:34.485
<00:15:32.085>Either <00:15:32.435>for <00:15:32.785>consumption <00:15:33.135>of <00:15:33.485>APIs

284
00:15:34.505 --> 00:15:37.005
<00:15:34.505>or <00:15:34.785>consumption <00:15:35.064>of, <00:15:35.345>uh, <00:15:35.625>uh, <00:15:35.905>compute.

285
00:15:37.025 --> 00:15:39.005
<00:15:37.025>If <00:15:37.225>you <00:15:37.425>talk <00:15:37.625>about <00:15:37.824>our <00:15:38.025>own <00:15:38.225>virtual <00:15:38.425>machine

286
00:15:39.065 --> 00:15:42.365
<00:15:39.065>or <00:15:39.205>consumption, <00:15:39.345>we <00:15:39.485>are <00:15:39.625>mo <00:15:39.765>uh, <00:15:39.905>model <00:15:40.045>as <00:15:40.185>a <00:15:40.325>service, <00:15:40.465>um,

287
00:15:42.985 --> 00:15:44.165
<00:15:42.985>way <00:15:43.339>of, <00:15:43.693>uh, <00:15:44.047>pricing.

288
00:15:44.305 --> 00:15:47.645
<00:15:44.305>So <00:15:44.421>yeah, <00:15:44.538>this <00:15:44.655>is <00:15:44.771>where <00:15:44.888>we <00:15:45.005>want <00:15:45.121>to <00:15:45.238>keep <00:15:45.354>special <00:15:45.471>eye <00:15:45.588>on, <00:15:45.704>on,

289
00:15:47.745 --> 00:15:52.125
<00:15:47.745>um, <00:15:47.900>after <00:15:48.056>all, <00:15:48.211>um, <00:15:48.367>some, <00:15:48.522>some <00:15:48.678>economics <00:15:48.833>of <00:15:48.989>our <00:15:49.145>application.

290
00:15:52.705 --> 00:15:57.485
<00:15:52.705>Um, <00:15:52.880>and <00:15:53.055>the <00:15:53.230>same <00:15:53.405>for, <00:15:53.580>um, <00:15:53.755>for <00:15:53.930>example, <00:15:54.105>uh,

291
00:15:57.485 --> 00:15:59.725
<00:15:57.485>throughput <00:15:57.835>and, <00:15:58.185>uh, <00:15:58.535>quota <00:15:58.885>management.

292
00:15:59.985 --> 00:16:03.845
<00:15:59.985>Not <00:16:00.185>all <00:16:00.385>LLM <00:16:00.585>providers, <00:16:00.785>um, <00:16:00.985>are <00:16:01.185>ready <00:16:01.385>for,

293
00:16:04.015 --> 00:16:06.125
<00:16:04.015>let's <00:16:04.365>say <00:16:04.715>infinite, <00:16:05.064>uh, <00:16:05.415>number

294
00:16:06.225 --> 00:16:08.085
<00:16:06.225>of <00:16:06.575>requests <00:16:06.925>per <00:16:07.275>second, <00:16:07.625>right?

295
00:16:08.145 --> 00:16:11.285
<00:16:08.145>So <00:16:08.285>many <00:16:08.425>of <00:16:08.564>them <00:16:08.704>have, <00:16:08.845>uh, <00:16:08.985>some <00:16:09.125>kind <00:16:09.265>of <00:16:09.405>limitations <00:16:09.545>here,

296
00:16:11.465 --> 00:16:13.845
<00:16:11.465>and <00:16:11.698>it's <00:16:11.931>important <00:16:12.165>to <00:16:12.398>follow <00:16:12.631>these <00:16:12.865>limitations.

297
00:16:13.845 --> 00:16:17.045
<00:16:13.845>Otherwise, <00:16:14.000>we'll <00:16:14.156>just <00:16:14.311>get, <00:16:14.467>uh, <00:16:14.622>some <00:16:14.778>kind <00:16:14.933>of, <00:16:15.089>uh, <00:16:15.245>Danielle

298
00:16:17.045 --> 00:16:20.845
<00:16:17.045>of <00:16:17.200>services, <00:16:17.356>um, <00:16:17.511>every, <00:16:17.667>uh, <00:16:17.822>every <00:16:17.978>next <00:16:18.133>prompt <00:16:18.289>we <00:16:18.444>send.

299
00:16:20.905 --> 00:16:25.245
<00:16:20.905>And <00:16:21.045>definitely <00:16:21.185>we <00:16:21.324>want, <00:16:21.464>uh, <00:16:21.605>to <00:16:21.745>have <00:16:21.885>automated <00:16:22.025>way <00:16:22.165>to <00:16:22.305>ma

300
00:16:25.265 --> 00:16:27.085
<00:16:25.265>to <00:16:25.615>stay <00:16:25.965>within <00:16:26.314>these <00:16:26.665>limits.

301
00:16:28.025 --> 00:16:32.365
<00:16:28.025>Uh, <00:16:28.180>and, <00:16:28.336>um, <00:16:28.491>yeah, <00:16:28.647>we <00:16:28.802>can <00:16:28.958>call <00:16:29.113>this <00:16:29.269>part <00:16:29.425>operationalization.

302
00:16:33.185 --> 00:16:36.725
<00:16:33.185>Uh, <00:16:33.464>so <00:16:33.744>these <00:16:34.025>are <00:16:34.305>three <00:16:34.584>large,

303
00:16:37.105 --> 00:16:39.005
<00:16:37.105>we <00:16:37.385>can <00:16:37.665>call <00:16:37.945>them <00:16:38.225>internal <00:16:38.505>loops.

304
00:16:39.145 --> 00:16:43.165
<00:16:39.145>And <00:16:39.272>after <00:16:39.399>all, <00:16:39.526>there <00:16:39.654>is, <00:16:39.781>uh, <00:16:39.908>overall <00:16:40.035>one <00:16:40.163>that <00:16:40.290>is, <00:16:40.417>uh, <00:16:40.545>about

305
00:16:43.725 --> 00:16:47.605
<00:16:43.725>managing <00:16:43.900>of, <00:16:44.075>um, <00:16:44.250>everything <00:16:44.425>that <00:16:44.600>is <00:16:44.775>focusing <00:16:44.950>on <00:16:45.125>governance,

306
00:16:48.405 --> 00:16:50.725
<00:16:48.405>security, <00:16:49.105>compliance, <00:16:49.805>um,

307
00:16:50.985 --> 00:16:54.365
<00:16:50.985>and <00:16:51.160>data <00:16:51.335>framework <00:16:51.510>that, <00:16:51.685>uh, <00:16:51.860>balances <00:16:52.035>speed <00:16:52.210>in, <00:16:52.385>uh,

308
00:16:54.365 --> 00:16:58.165
<00:16:54.365>deliverables <00:16:54.645>with, <00:16:54.925>uh, <00:16:55.205>strict <00:16:55.485>following <00:16:55.765>current

309
00:16:59.125 --> 00:17:01.005
<00:16:59.125>policies, <00:16:59.825>standards, <00:17:00.525>limitations,

310
00:17:01.215 --> 00:17:04.085
<00:17:01.215>especially <00:17:01.415>if <00:17:01.615>you <00:17:01.815>talk <00:17:02.015>about <00:17:02.215>some, <00:17:02.415>uh, <00:17:02.615>regulated

311
00:17:04.185 --> 00:17:06.525
<00:17:04.185>or <00:17:04.534>highly <00:17:04.885>regulated <00:17:05.234>industries, <00:17:05.585>right?

312
00:17:06.705 --> 00:17:10.165
<00:17:06.704>Uh, <00:17:06.860>so <00:17:07.016>this <00:17:07.171>is <00:17:07.327>super, <00:17:07.482>super <00:17:07.638>important <00:17:07.793>component <00:17:07.949>of, <00:17:08.105>um,

313
00:17:10.275 --> 00:17:12.245
<00:17:10.275>overall <00:17:11.675>lifecycle.

314
00:17:13.065 --> 00:17:17.845
<00:17:13.065>Um, <00:17:13.181>and <00:17:13.298>if <00:17:13.415>we <00:17:13.531>reflect <00:17:13.648>on <00:17:13.765>this, <00:17:13.881>uh, <00:17:13.998>circles <00:17:14.115>a <00:17:14.231>bit <00:17:14.348>for, <00:17:14.465>uh,

315
00:17:17.985 --> 00:17:22.365
<00:17:17.984>uh, <00:17:18.140>a <00:17:18.296>bit, <00:17:18.451>um, <00:17:18.607>easier <00:17:18.762>way <00:17:18.918>to <00:17:19.073>consume <00:17:19.229>this <00:17:19.385>information,

316
00:17:22.685 --> 00:17:23.925
<00:17:22.685>I <00:17:22.908>can <00:17:23.131>come <00:17:23.354>up <00:17:23.577>with, <00:17:23.800>uh,

317
00:17:24.375 --> 00:17:28.445
<00:17:24.375>these <00:17:24.550>three <00:17:24.724>pillars <00:17:24.900>based <00:17:25.075>on <00:17:25.250>these <00:17:25.425>three, <00:17:25.599>um, <00:17:25.775>circles.

318
00:17:28.755 --> 00:17:31.005
<00:17:28.755>It's, <00:17:29.221>uh, <00:17:29.688>ideation, <00:17:30.155>exploring,

319
00:17:31.025 --> 00:17:33.165
<00:17:31.025>and <00:17:31.225>yeah, <00:17:31.425>I'm <00:17:31.625>not <00:17:31.825>going <00:17:32.025>to, <00:17:32.225>uh, <00:17:32.425>go

320
00:17:33.165 --> 00:17:35.045
<00:17:33.165>through <00:17:33.398>every <00:17:33.631>single <00:17:33.865>component <00:17:34.098>because <00:17:34.331>they <00:17:34.565>more

321
00:17:35.045 --> 00:17:37.165
<00:17:35.045>or <00:17:35.220>less <00:17:35.395>repeat <00:17:35.570>what <00:17:35.745>you've <00:17:35.920>seen <00:17:36.095>on <00:17:36.270>previous <00:17:36.445>slide.

322
00:17:37.185 --> 00:17:40.645
<00:17:37.185>But <00:17:37.360>again, <00:17:37.534>this <00:17:37.710>is <00:17:37.885>easier <00:17:38.060>to <00:17:38.235>consume, <00:17:38.409>uh, <00:17:38.585>way

323
00:17:40.665 --> 00:17:42.125
<00:17:40.665>of <00:17:41.322>presenting <00:17:41.979>information.

324
00:17:42.705 --> 00:17:44.605
<00:17:42.705>Um, <00:17:42.938>maybe <00:17:43.171>not <00:17:43.405>that <00:17:43.638>visual <00:17:43.871>though, <00:17:44.105>right?

325
00:17:44.745 --> 00:17:47.085
<00:17:44.745>So <00:17:44.978>it <00:17:45.211>doesn't, <00:17:45.445>uh, <00:17:45.678>illustrate <00:17:45.911>this, <00:17:46.145>uh,

326
00:17:47.925 --> 00:17:50.725
<00:17:47.925>multiple <00:17:48.274>interconnection, <00:17:48.625>uh, <00:17:48.975>interconnected <00:17:49.325>circles.

327
00:17:51.025 --> 00:17:54.805
<00:17:51.025>Uh, <00:17:51.152>but <00:17:51.279>just <00:17:51.406>keep <00:17:51.534>this, <00:17:51.661>uh, <00:17:51.788>slide <00:17:51.915>in <00:17:52.043>mind <00:17:52.170>as <00:17:52.297>a <00:17:52.425>kind

328
00:17:54.805 --> 00:17:57.605
<00:17:54.805>of <00:17:55.005>cheat <00:17:55.205>sheet <00:17:55.405>for <00:17:55.605>what <00:17:55.805>to <00:17:56.005>do, <00:17:56.205>what

329
00:17:57.605 --> 00:18:01.725
<00:17:57.605>to <00:17:57.780>put <00:17:57.955>special <00:17:58.130>attention <00:17:58.305>on, <00:17:58.480>on <00:17:58.655>every <00:17:58.830>single <00:17:59.005>step

330
00:18:01.825 --> 00:18:04.485
<00:18:01.825>of <00:18:02.105>your <00:18:02.385>LL <00:18:02.665>M'S <00:18:02.945>maturity <00:18:03.225>journey.

331
00:18:06.035 --> 00:18:08.895
<00:18:06.035>And <00:18:06.315>now <00:18:06.595>I'm <00:18:06.875>ready <00:18:07.155>to <00:18:07.435>introduce

332
00:18:09.485 --> 00:18:13.775
<00:18:09.485>what <00:18:09.718>we <00:18:09.951>call <00:18:10.185>LLM <00:18:10.418>ops <00:18:10.651>maturity <00:18:10.885>model.

333
00:18:14.115 --> 00:18:18.735
<00:18:14.115>So <00:18:14.315>depending <00:18:14.515>on <00:18:14.715>which <00:18:14.915>components <00:18:15.115>of <00:18:15.315>these <00:18:15.515>cycles,

334
00:18:18.845 --> 00:18:23.015
<00:18:18.845>circles <00:18:19.020>you <00:18:19.195>have <00:18:19.370>in <00:18:19.545>place <00:18:19.720>for <00:18:19.895>your <00:18:20.070>current <00:18:20.245>application

335
00:18:23.035 --> 00:18:27.615
<00:18:23.035>and <00:18:23.175>what <00:18:23.315>you <00:18:23.455>plan, <00:18:23.595>yeah, <00:18:23.735>you <00:18:23.875>can <00:18:24.015>estimate <00:18:24.155>where <00:18:24.295>are <00:18:24.435>you,

336
00:18:27.615 --> 00:18:29.415
<00:18:27.615>like <00:18:27.848>your <00:18:28.081>project <00:18:28.315>or <00:18:28.548>maybe <00:18:28.781>your <00:18:29.015>company

337
00:18:29.955 --> 00:18:32.535
<00:18:29.955>in <00:18:30.304>this <00:18:30.655>maturity <00:18:31.004>model <00:18:31.355>stages.

338
00:18:33.035 --> 00:18:36.495
<00:18:33.035>And <00:18:33.175>it <00:18:33.315>all <00:18:33.455>starts <00:18:33.595>with, <00:18:33.735>uh, <00:18:33.875>level, <00:18:34.015>um, <00:18:34.155>it's <00:18:34.295>not <00:18:34.435>zero,

339
00:18:36.555 --> 00:18:39.055
<00:18:36.555>but <00:18:36.905>level <00:18:37.255>one <00:18:37.605>initial <00:18:37.955>maybe

340
00:18:39.105 --> 00:18:42.735
<00:18:39.105>after <00:18:39.280>you <00:18:39.455>sent <00:18:39.630>your <00:18:39.805>first <00:18:39.980>API <00:18:40.155>calls <00:18:40.330>to <00:18:40.505>this

341
00:18:42.795 --> 00:18:44.215
<00:18:42.795>or <00:18:43.221>that <00:18:43.647>LLM <00:18:44.072>providers

342
00:18:44.235 --> 00:18:46.255
<00:18:44.235>or <00:18:44.435>maybe <00:18:44.635>just, <00:18:44.834>uh, <00:18:45.034>spun <00:18:45.235>up, <00:18:45.435>um, <00:18:45.635>your,

343
00:18:46.325 --> 00:18:48.095
<00:18:46.325>your <00:18:46.605>model <00:18:46.885>on <00:18:47.165>your <00:18:47.445>virtual <00:18:47.725>machine.

344
00:18:48.325 --> 00:18:51.615
<00:18:48.325>This <00:18:48.500>is <00:18:48.675>like <00:18:48.850>very <00:18:49.025>foundation <00:18:49.200>of, <00:18:49.375>uh, <00:18:49.550>your <00:18:49.725>very,

345
00:18:51.645 --> 00:18:53.295
<00:18:51.645>very <00:18:51.995>start <00:18:52.345>of <00:18:52.695>your <00:18:53.045>journey.

346
00:18:53.475 --> 00:18:56.415
<00:18:53.475>You <00:18:53.649>send <00:18:53.824>some, <00:18:54.000>some, <00:18:54.175>uh, <00:18:54.350>prompts, <00:18:54.524>got <00:18:54.699>some <00:18:54.875>completions,

347
00:18:56.785 --> 00:18:58.855
<00:18:56.785>maybe, <00:18:57.065>uh, <00:18:57.345>you <00:18:57.625>kind <00:18:57.905>of <00:18:58.185>manually

348
00:18:58.855 --> 00:19:02.405
<00:18:58.855>and, <00:18:59.055>uh, <00:18:59.255>visual, <00:18:59.455>let's <00:18:59.655>say, <00:18:59.855>let's <00:19:00.055>say <00:19:00.255>evaluate

349
00:19:02.405 --> 00:19:03.925
<00:19:02.405>and, <00:19:02.860>uh, <00:19:03.317>monitor <00:19:03.773>things.

350
00:19:04.035 --> 00:19:06.165
<00:19:04.035>It's <00:19:04.385>endlessly <00:19:04.735>far <00:19:05.085>from <00:19:05.435>automation.

351
00:19:06.915 --> 00:19:09.765
<00:19:06.915>Next, <00:19:07.264>you, <00:19:07.615>uh, <00:19:07.965>like <00:19:08.315>on

352
00:19:09.815 --> 00:19:14.165
<00:19:09.815>after <00:19:09.970>stage <00:19:10.126>one, <00:19:10.281>you <00:19:10.437>clearly <00:19:10.592>see <00:19:10.748>need <00:19:10.903>for, <00:19:11.059>uh, <00:19:11.215>automation

353
00:19:14.265 --> 00:19:17.285
<00:19:14.265>for, <00:19:14.545>again, <00:19:14.825>operation <00:19:15.105>operationalization <00:19:15.385>of, <00:19:15.665>uh,

354
00:19:17.385 --> 00:19:18.845
<00:19:17.385>all <00:19:17.713>these, <00:19:18.042>uh, <00:19:18.370>manual <00:19:18.699>things.

355
00:19:19.105 --> 00:19:23.885
<00:19:19.105>So <00:19:19.280>you <00:19:19.455>might <00:19:19.630>start <00:19:19.805>defining <00:19:19.980>your <00:19:20.155>strategy, <00:19:20.330>your, <00:19:20.505>um,

356
00:19:23.955 --> 00:19:26.405
<00:19:23.955>your <00:19:24.304>LLM <00:19:24.655>ops, <00:19:25.004>um, <00:19:25.355>approach.

357
00:19:26.745 --> 00:19:30.605
<00:19:26.745>And <00:19:26.945>here <00:19:27.145>we <00:19:27.344>talk <00:19:27.544>about <00:19:27.745>systematization, <00:19:27.945>systematization <00:19:28.145>of,

358
00:19:30.705 --> 00:19:34.845
<00:19:30.705>um, <00:19:31.054>development, <00:19:31.405>uh, <00:19:31.754>more <00:19:32.105>prominent

359
00:19:34.865 --> 00:19:36.285
<00:19:34.865>and <00:19:35.184>more, <00:19:35.504>let's <00:19:35.823>say <00:19:36.143>thoughtful

360
00:19:36.285 --> 00:19:38.765
<00:19:36.285>and <00:19:36.635>structured <00:19:36.985>work <00:19:37.335>with <00:19:37.685>prompts.

361
00:19:39.135 --> 00:19:41.285
<00:19:39.135>Maybe <00:19:39.415>at <00:19:39.695>the <00:19:39.975>same, <00:19:40.254>uh, <00:19:40.535>stage,

362
00:19:41.585 --> 00:19:46.245
<00:19:41.585>you <00:19:41.740>start <00:19:41.896>involving <00:19:42.051>your <00:19:42.207>own <00:19:42.362>data, <00:19:42.518>like <00:19:42.673>build <00:19:42.829>scaffolds <00:19:42.985>of,

363
00:19:46.305 --> 00:19:48.525
<00:19:46.305>uh, <00:19:46.771>retrieval, <00:19:47.238>augmented <00:19:47.705>generation,

364
00:19:48.825 --> 00:19:51.765
<00:19:48.825>and <00:19:49.000>also <00:19:49.175>you <00:19:49.350>start <00:19:49.525>thinking <00:19:49.700>about <00:19:49.875>how <00:19:50.050>to <00:19:50.225>structure

365
00:19:51.985 --> 00:19:54.005
<00:19:51.985>and <00:19:52.685>automate <00:19:53.385>deployment.

366
00:19:54.375 --> 00:19:57.805
<00:19:54.375>After <00:19:54.550>you <00:19:54.725>done <00:19:54.900>with <00:19:55.075>this <00:19:55.250>task, <00:19:55.425>you <00:19:55.600>can <00:19:55.775>say

367
00:19:57.805 --> 00:20:01.685
<00:19:57.805>that <00:19:57.980>you <00:19:58.155>are <00:19:58.330>on <00:19:58.505>managed <00:19:58.680>on <00:19:58.855>stage <00:19:59.030>number <00:19:59.205>three

368
00:20:01.745 --> 00:20:03.245
<00:20:01.745>of <00:20:02.195>this <00:20:02.645>maturity <00:20:03.094>model.

369
00:20:03.755 --> 00:20:07.405
<00:20:03.755>Here <00:20:03.988>you <00:20:04.221>have <00:20:04.455>quite <00:20:04.688>advanced <00:20:04.921>LLM <00:20:05.155>workflows

370
00:20:07.625 --> 00:20:09.845
<00:20:07.625>and, <00:20:08.091>uh, <00:20:08.558>automated <00:20:09.025>monitoring.

371
00:20:09.965 --> 00:20:14.485
<00:20:09.965>I <00:20:10.105>mean, <00:20:10.245>you <00:20:10.385>don't <00:20:10.524>wait <00:20:10.665>for, <00:20:10.804>uh, <00:20:10.945>something <00:20:11.084>to, <00:20:11.225>to <00:20:11.365>break.

372
00:20:14.545 --> 00:20:16.685
<00:20:14.545>You <00:20:14.778>can, <00:20:15.011>uh, <00:20:15.245>you <00:20:15.478>can <00:20:15.711>predict <00:20:15.945>this

373
00:20:16.705 --> 00:20:18.645
<00:20:16.705>and <00:20:16.938>you <00:20:17.171>can <00:20:17.405>mitigate <00:20:17.638>this <00:20:17.871>in <00:20:18.105>advance.

374
00:20:18.655 --> 00:20:20.245
<00:20:18.655>Again, <00:20:19.004>looking <00:20:19.355>at <00:20:19.705>the <00:20:20.055>monitoring

375
00:20:20.465 --> 00:20:23.085
<00:20:20.465>and, <00:20:20.698>uh, <00:20:20.931>you <00:20:21.165>have, <00:20:21.398>uh, <00:20:21.631>respective <00:20:21.865>tools.

376
00:20:23.915 --> 00:20:25.965
<00:20:23.915>Your <00:20:24.264>prompt <00:20:24.615>management <00:20:24.965>is <00:20:25.315>comprehensive.

377
00:20:26.145 --> 00:20:28.965
<00:20:26.145>So <00:20:26.345>you <00:20:26.545>talk <00:20:26.745>about, <00:20:26.945>uh, <00:20:27.145>not <00:20:27.345>only <00:20:27.545>evaluation,

378
00:20:29.105 --> 00:20:32.205
<00:20:29.105>but <00:20:29.385>real <00:20:29.665>time <00:20:29.945>deployment, <00:20:30.225>uh, <00:20:30.505>versioning,

379
00:20:32.645 --> 00:20:35.165
<00:20:32.645>collaborative <00:20:32.878>work, <00:20:33.111>uh, <00:20:33.345>on <00:20:33.578>your <00:20:33.811>prompts, <00:20:34.045>uh,

380
00:20:35.225 --> 00:20:37.365
<00:20:35.225>having <00:20:35.504>like <00:20:35.784>templates <00:20:36.064>in <00:20:36.344>your <00:20:36.625>prompt.

381
00:20:37.585 --> 00:20:41.805
<00:20:37.585>Um, <00:20:37.740>yeah, <00:20:37.896>so <00:20:38.051>you, <00:20:38.207>you <00:20:38.362>consider <00:20:38.518>prompt <00:20:38.673>engineering <00:20:38.829>as <00:20:38.985>a,

382
00:20:42.425 --> 00:20:44.125
<00:20:42.425>if <00:20:42.891>not <00:20:43.358>separate <00:20:43.825>discipline,

383
00:20:44.345 --> 00:20:48.605
<00:20:44.345>but, <00:20:44.520>uh, <00:20:44.695>prominent <00:20:44.870>part <00:20:45.045>of <00:20:45.220>your, <00:20:45.395>uh, <00:20:45.570>developer <00:20:45.745>work.

384
00:20:49.025 --> 00:20:53.085
<00:20:49.025>And <00:20:49.225>also <00:20:49.425>you <00:20:49.625>set <00:20:49.825>up <00:20:50.025>advanced <00:20:50.225>monitoring <00:20:50.425>alerts

385
00:20:53.185 --> 00:20:55.645
<00:20:53.185>and, <00:20:53.360>uh, <00:20:53.534>all <00:20:53.710>about, <00:20:53.885>uh, <00:20:54.060>all <00:20:54.235>kinds <00:20:54.409>of, <00:20:54.585>uh,

386
00:20:56.195 --> 00:20:58.245
<00:20:56.195>performance <00:20:56.895>cost, <00:20:57.595>everything.

387
00:20:58.245 --> 00:20:59.565
<00:20:58.245>So <00:20:58.482>we <00:20:58.720>have <00:20:58.957>full <00:20:59.195>control <00:20:59.433>there.

388
00:21:00.185 --> 00:21:04.605
<00:21:00.185>And, <00:21:00.340>uh, <00:21:00.496>last <00:21:00.651>stage <00:21:00.807>here, <00:21:00.962>what <00:21:01.118>we <00:21:01.273>can <00:21:01.429>call <00:21:01.585>optimized.

389
00:21:04.785 --> 00:21:09.645
<00:21:04.785>So <00:21:05.018>you <00:21:05.251>achieved <00:21:05.485>operational <00:21:05.718>excellence, <00:21:05.951>uh, <00:21:06.185>congrats.

390
00:21:09.945 --> 00:21:12.725
<00:21:09.945>And, <00:21:10.225>uh, <00:21:10.504>you <00:21:10.784>continuously <00:21:11.064>improved <00:21:11.345>this

391
00:21:12.725 --> 00:21:14.365
<00:21:12.725>because <00:21:13.004>this <00:21:13.284>is <00:21:13.564>a <00:21:13.844>cycle, <00:21:14.125>right?

392
00:21:14.425 --> 00:21:18.525
<00:21:14.425>So <00:21:14.580>this <00:21:14.736>is <00:21:14.891>not <00:21:15.047>like <00:21:15.202>one, <00:21:15.358>uh, <00:21:15.513>one <00:21:15.669>time <00:21:15.825>operation

393
00:21:18.525 --> 00:21:23.005
<00:21:18.525>because <00:21:18.725>your <00:21:18.925>application <00:21:19.125>evolves, <00:21:19.325>uh, <00:21:19.525>LMS <00:21:19.725>evolve, <00:21:19.925>uh,

394
00:21:23.785 --> 00:21:25.925
<00:21:23.785>all <00:21:24.135>field <00:21:24.485>is <00:21:24.835>evolving, <00:21:25.185>right?

395
00:21:25.985 --> 00:21:30.165
<00:21:25.985>And <00:21:26.125>you <00:21:26.264>need <00:21:26.405>to <00:21:26.544>follow <00:21:26.685>this, <00:21:26.824>um, <00:21:26.965>uh, <00:21:27.104>this, <00:21:27.245>um, <00:21:27.385>like

396
00:21:30.845 --> 00:21:33.045
<00:21:30.845>progress <00:21:31.045>in <00:21:31.245>your <00:21:31.445>application <00:21:31.645>just <00:21:31.845>to <00:21:32.045>make <00:21:32.245>sure

397
00:21:33.045 --> 00:21:34.725
<00:21:33.045>that <00:21:33.325>your <00:21:33.605>application <00:21:33.885>is <00:21:34.165>getting <00:21:34.445>better.

398
00:21:35.265 --> 00:21:38.205
<00:21:35.265>Uh, <00:21:35.498>it <00:21:35.731>is, <00:21:35.965>um, <00:21:36.198>it's <00:21:36.431>using <00:21:36.665>latest

399
00:21:38.305 --> 00:21:41.445
<00:21:38.305>and <00:21:38.505>greatest <00:21:38.705>models, <00:21:38.905>features <00:21:39.105>of <00:21:39.305>this <00:21:39.505>models, <00:21:39.705>uh,

400
00:21:41.585 --> 00:21:45.845
<00:21:41.585>to <00:21:41.760>provide <00:21:41.935>continuous <00:21:42.110>value <00:21:42.285>for <00:21:42.460>your <00:21:42.635>customers <00:21:42.810>and <00:21:42.985>users.

401
00:21:46.225 --> 00:21:49.645
<00:21:46.225>And <00:21:46.380>here <00:21:46.536>we <00:21:46.691>can <00:21:46.847>talk <00:21:47.002>about <00:21:47.158>full <00:21:47.313>automation <00:21:47.469>of, <00:21:47.625>um,

402
00:21:49.785 --> 00:21:52.525
<00:21:49.785>all <00:21:49.960>the <00:21:50.135>process, <00:21:50.310>I <00:21:50.485>mean, <00:21:50.660>everything, <00:21:50.835>what's <00:21:51.010>ever <00:21:51.185>possible

403
00:21:52.585 --> 00:21:56.805
<00:21:52.585>to <00:21:52.785>automate, <00:21:52.985>where <00:21:53.185>are <00:21:53.385>you <00:21:53.585>on, <00:21:53.785>um, <00:21:53.985>this,

404
00:21:56.985 --> 00:21:58.605
<00:21:56.985>um, <00:21:58.385>stages?

405
00:21:58.985 --> 00:22:03.565
<00:21:58.985>And <00:21:59.159>I <00:21:59.334>can <00:21:59.510>give <00:21:59.685>you <00:21:59.860>very <00:22:00.034>simple <00:22:00.209>way <00:22:00.385>to

406
00:22:04.545 --> 00:22:07.005
<00:22:04.545>assess <00:22:05.011>your <00:22:05.478>current <00:22:05.945>position.

407
00:22:07.105 --> 00:22:10.045
<00:22:07.105>Are <00:22:07.280>you <00:22:07.455>on, <00:22:07.630>uh, <00:22:07.805>zero <00:22:07.980>one <00:22:08.155>or <00:22:08.330>zero <00:22:08.505>four?

408
00:22:10.225 --> 00:22:15.085
<00:22:10.225>You <00:22:10.341>can <00:22:10.458>do <00:22:10.574>it <00:22:10.691>in <00:22:10.808>just <00:22:10.925>five <00:22:11.041>minutes <00:22:11.158>in <00:22:11.274>a <00:22:11.391>fully <00:22:11.508>automated, <00:22:11.625>um,

409
00:22:15.235 --> 00:22:18.365
<00:22:15.235>like, <00:22:15.435>um, <00:22:15.635>assessment <00:22:15.834>process <00:22:16.034>kind <00:22:16.235>of <00:22:16.435>flow, <00:22:16.635>um,

410
00:22:18.465 --> 00:22:21.045
<00:22:18.465>and, <00:22:18.665>uh, <00:22:18.865>where <00:22:19.064>you <00:22:19.264>answer <00:22:19.465>a <00:22:19.665>few <00:22:19.865>questions

411
00:22:21.585 --> 00:22:24.445
<00:22:21.585>and <00:22:21.785>you <00:22:21.985>get <00:22:22.185>not <00:22:22.385>only <00:22:22.585>your <00:22:22.785>current <00:22:22.985>stage,

412
00:22:24.665 --> 00:22:28.685
<00:22:24.665>but <00:22:24.805>also <00:22:24.945>ways <00:22:25.085>for <00:22:25.225>you <00:22:25.365>to <00:22:25.504>move <00:22:25.645>to <00:22:25.784>the <00:22:25.925>next <00:22:26.065>step.

413
00:22:29.185 --> 00:22:30.885
<00:22:29.185>Uh, <00:22:29.651>and <00:22:30.118>stay <00:22:30.585>tuned.

414
00:22:31.025 --> 00:22:33.485
<00:22:31.025>At <00:22:31.165>the <00:22:31.305>very <00:22:31.445>end <00:22:31.585>of <00:22:31.725>my <00:22:31.865>session, <00:22:32.005>I <00:22:32.145>will <00:22:32.285>explain <00:22:32.425>you

415
00:22:33.505 --> 00:22:37.485
<00:22:33.505>how <00:22:33.645>you <00:22:33.785>can <00:22:33.925>get <00:22:34.065>this, <00:22:34.205>um, <00:22:34.345>assessment <00:22:34.485>very <00:22:34.625>fast <00:22:34.765>and <00:22:34.905>easy,

416
00:22:37.585 --> 00:22:40.685
<00:22:37.585>and <00:22:37.785>again, <00:22:37.985>in <00:22:38.185>a <00:22:38.385>fully <00:22:38.585>automated <00:22:38.785>online <00:22:38.985>way.

417
00:22:41.785 --> 00:22:45.565
<00:22:41.785>And <00:22:41.940>of <00:22:42.096>course, <00:22:42.251>uh, <00:22:42.407>my <00:22:42.562>session <00:22:42.718>will <00:22:42.873>be <00:22:43.029>incomplete <00:22:43.185>without

418
00:22:45.635 --> 00:22:50.245
<00:22:45.635>sharing <00:22:45.762>some <00:22:45.889>tools <00:22:46.016>that <00:22:46.144>can <00:22:46.271>help <00:22:46.398>you <00:22:46.525>with <00:22:46.653>LLM <00:22:46.780>ops <00:22:46.907>with, <00:22:47.035>uh,

419
00:22:50.245 --> 00:22:53.365
<00:22:50.245>moving <00:22:50.419>from <00:22:50.594>stage <00:22:50.770>to <00:22:50.945>stage <00:22:51.120>and <00:22:51.294>this <00:22:51.469>maturity <00:22:51.645>model.

420
00:22:53.745 --> 00:22:56.845
<00:22:53.745>And <00:22:53.945>yeah, <00:22:54.145>uh, <00:22:54.344>we <00:22:54.544>are <00:22:54.745>talking <00:22:54.945>here <00:22:55.145>about,

421
00:22:56.945 --> 00:22:58.645
<00:22:56.945>uh, <00:22:57.645>Microsoft's <00:22:58.345>offering.

422
00:22:58.865 --> 00:23:02.925
<00:22:58.865>And, <00:22:59.065>um, <00:22:59.265>this <00:22:59.465>one <00:22:59.665>is, <00:22:59.865>uh, <00:23:00.065>Azure <00:23:00.265>ai.

423
00:23:03.395 --> 00:23:07.885
<00:23:03.395>Briefly, <00:23:03.570>it <00:23:03.745>contains <00:23:03.920>all, <00:23:04.095>or <00:23:04.270>like, <00:23:04.445>not, <00:23:04.620>not <00:23:04.795>all,

424
00:23:07.905 --> 00:23:11.845
<00:23:07.905>but <00:23:08.080>mainstream <00:23:08.254>foundation <00:23:08.430>models <00:23:08.605>that <00:23:08.780>you <00:23:08.955>can <00:23:09.129>easy <00:23:09.305>find

425
00:23:12.345 --> 00:23:15.645
<00:23:12.345>and, <00:23:12.578>uh, <00:23:12.811>evaluate <00:23:13.045>and <00:23:13.278>test <00:23:13.511>and <00:23:13.745>compare.

426
00:23:15.705 --> 00:23:19.205
<00:23:15.705>But, <00:23:15.860>uh, <00:23:16.016>a <00:23:16.171>bit, <00:23:16.327>uh, <00:23:16.482>later <00:23:16.638>on <00:23:16.793>that <00:23:16.949>with, <00:23:17.105>uh,

427
00:23:19.375 --> 00:23:23.725
<00:23:19.375>Azure <00:23:19.515>AI <00:23:19.655>from <00:23:19.795>Microsoft, <00:23:19.935>uh, <00:23:20.075>our, <00:23:20.215>our <00:23:20.355>cloud <00:23:20.495>offering <00:23:20.635>for <00:23:20.775>ai,

428
00:23:23.985 --> 00:23:28.565
<00:23:23.985>you <00:23:24.140>can <00:23:24.296>scale <00:23:24.451>your <00:23:24.607>LLM <00:23:24.762>practices <00:23:24.918>with, <00:23:25.073>uh, <00:23:25.229>precision <00:23:25.385>just

429
00:23:28.565 --> 00:23:30.005
<00:23:28.565>to <00:23:28.824>make <00:23:29.083>sure <00:23:29.342>that <00:23:29.601>your, <00:23:29.861>uh,

430
00:23:30.405 --> 00:23:33.405
<00:23:30.405>workflows <00:23:30.754>are <00:23:31.105>automated <00:23:31.455>streamlined, <00:23:31.805>um,

431
00:23:33.825 --> 00:23:36.605
<00:23:33.825>and <00:23:34.058>you <00:23:34.291>can <00:23:34.525>collaborate <00:23:34.758>with <00:23:34.991>your <00:23:35.225>team.

432
00:23:36.625 --> 00:23:39.805
<00:23:36.625>You <00:23:36.780>remember <00:23:36.936>that <00:23:37.091>collaboration <00:23:37.247>is <00:23:37.402>one <00:23:37.558>of, <00:23:37.713>uh, <00:23:37.869>LLM <00:23:38.025>ops

433
00:23:39.825 --> 00:23:43.505
<00:23:39.825>and <00:23:40.058>pretty <00:23:40.291>much <00:23:40.525>everything <00:23:40.758>ops <00:23:40.991>pillars, <00:23:41.225>right?

434
00:23:43.565 --> 00:23:47.525
<00:23:43.565>So <00:23:43.720>you <00:23:43.876>have, <00:23:44.031>uh, <00:23:44.187>full, <00:23:44.342>full, <00:23:44.498>full <00:23:44.653>tool <00:23:44.809>set <00:23:44.965>here.

435
00:23:48.225 --> 00:23:53.045
<00:23:48.225>And, <00:23:48.425>uh, <00:23:48.625>of <00:23:48.824>course, <00:23:49.024>uh, <00:23:49.225>governance, <00:23:49.425>responsible <00:23:49.625>ai,

436
00:23:53.355 --> 00:23:57.765
<00:23:53.355>ethical, <00:23:53.555>um, <00:23:53.755>perspective <00:23:53.955>on <00:23:54.155>your <00:23:54.355>work <00:23:54.555>with, <00:23:54.755>um,

437
00:23:58.185 --> 00:23:59.605
<00:23:58.185>LMS <00:23:58.610>is <00:23:59.037>also <00:23:59.463>included.

438
00:23:59.905 --> 00:24:03.045
<00:23:59.905>So <00:24:00.138>what <00:24:00.371>is <00:24:00.605>Azure <00:24:00.838>ai <00:24:01.071>after <00:24:01.305>all?

439
00:24:03.045 --> 00:24:05.325
<00:24:03.045>First <00:24:03.245>of <00:24:03.445>all, <00:24:03.645>um, <00:24:03.845>you <00:24:04.045>can <00:24:04.245>easily <00:24:04.445>go

440
00:24:05.345 --> 00:24:07.605
<00:24:05.345>and <00:24:05.811>try <00:24:06.278>this <00:24:06.745>ai.azure.com.

441
00:24:07.665 --> 00:24:09.565
<00:24:07.665>You <00:24:07.945>just <00:24:08.225>need <00:24:08.504>Azure <00:24:08.784>Cloud <00:24:09.065>subscription.

442
00:24:09.565 --> 00:24:11.325
<00:24:09.565>But, <00:24:09.720>uh, <00:24:09.876>if <00:24:10.031>you <00:24:10.187>don't <00:24:10.342>have <00:24:10.498>one, <00:24:10.653>you <00:24:10.809>can <00:24:10.965>go

443
00:24:11.325 --> 00:24:12.685
<00:24:11.325>and <00:24:11.937>register <00:24:12.549>trial.

444
00:24:12.825 --> 00:24:14.165
<00:24:12.825>Uh, <00:24:13.126>you'll <00:24:13.428>get <00:24:13.729>some <00:24:14.031>credits,

445
00:24:14.225 --> 00:24:18.325
<00:24:14.225>so <00:24:14.380>you <00:24:14.536>can <00:24:14.691>start <00:24:14.847>exploring <00:24:15.002>this, <00:24:15.158>uh, <00:24:15.313>tool <00:24:15.469>right <00:24:15.625>here,

446
00:24:18.325 --> 00:24:21.165
<00:24:18.325>right <00:24:18.465>now, <00:24:18.605>but <00:24:18.745>mean <00:24:18.885>not, <00:24:19.025>not <00:24:19.165>now, <00:24:19.305>wait <00:24:19.445>until, <00:24:19.585>uh, <00:24:19.725>end

447
00:24:21.165 --> 00:24:23.925
<00:24:21.165>of <00:24:21.365>the <00:24:21.565>event <00:24:21.764>and <00:24:21.965>then <00:24:22.165>go <00:24:22.365>and <00:24:22.565>explore.

448
00:24:24.425 --> 00:24:26.965
<00:24:24.425>And, <00:24:24.705>um, <00:24:24.985>main <00:24:25.264>component <00:24:25.544>of, <00:24:25.825>um,

449
00:24:27.345 --> 00:24:30.325
<00:24:27.345>all <00:24:27.520>like <00:24:27.695>overall <00:24:27.870>Azure <00:24:28.045>AI <00:24:28.220>stack <00:24:28.395>is <00:24:28.570>what's <00:24:28.745>called

450
00:24:30.575 --> 00:24:32.165
<00:24:30.575>Azure <00:24:31.275>AI <00:24:31.975>Foundry.

451
00:24:32.345 --> 00:24:36.005
<00:24:32.345>And <00:24:32.500>if <00:24:32.656>you <00:24:32.811>never <00:24:32.967>heard <00:24:33.122>this <00:24:33.278>name, <00:24:33.433>I'm <00:24:33.589>not <00:24:33.745>surprised

452
00:24:36.005 --> 00:24:40.085
<00:24:36.005>because <00:24:36.160>this <00:24:36.316>is, <00:24:36.471>uh, <00:24:36.627>recent <00:24:36.782>rebranding <00:24:36.938>from <00:24:37.093>Azure <00:24:37.249>AI <00:24:37.405>Studio.

453
00:24:40.185 --> 00:24:44.365
<00:24:40.185>So <00:24:40.360>that <00:24:40.534>that <00:24:40.710>rebranding <00:24:40.885>happened, <00:24:41.060>uh, <00:24:41.235>just, <00:24:41.409>just <00:24:41.585>recently

454
00:24:44.365 --> 00:24:46.325
<00:24:44.365>and <00:24:44.645>was <00:24:44.925>announced <00:24:45.205>at <00:24:45.485>Microsoft <00:24:45.765>Ignite.

455
00:24:46.545 --> 00:24:50.765
<00:24:46.545>So <00:24:46.661>if <00:24:46.778>you <00:24:46.895>know <00:24:47.011>what <00:24:47.128>Azure <00:24:47.245>AI <00:24:47.361>Studio <00:24:47.478>is, <00:24:47.595>that <00:24:47.711>means <00:24:47.828>you <00:24:47.945>know

456
00:24:50.765 --> 00:24:54.005
<00:24:50.765>what <00:24:50.940>Azure <00:24:51.115>AI <00:24:51.290>found <00:24:51.465>because <00:24:51.640>this <00:24:51.815>rebranding <00:24:51.990>happened, <00:24:52.165>uh,

457
00:24:54.005 --> 00:24:58.325
<00:24:54.005>because <00:24:54.145>we <00:24:54.285>want <00:24:54.425>to <00:24:54.565>demonstrate <00:24:54.705>that <00:24:54.845>it's, <00:24:54.985>um, <00:24:55.125>it, <00:24:55.265>I <00:24:55.405>mean,

458
00:24:58.325 --> 00:25:02.325
<00:24:58.325>it, <00:24:58.465>it <00:24:58.605>covers <00:24:58.745>more <00:24:58.885>and <00:24:59.025>more <00:24:59.165>parts <00:24:59.305>of <00:24:59.445>your <00:24:59.585>AI <00:24:59.725>journey.

459
00:25:02.625 --> 00:25:05.925
<00:25:02.625>So, <00:25:02.780>uh, <00:25:02.936>Azure, <00:25:03.091>AI <00:25:03.247>Foundry, <00:25:03.402>it's <00:25:03.558>all <00:25:03.713>about <00:25:03.869>model <00:25:04.025>catalog.

460
00:25:06.515 --> 00:25:10.285
<00:25:06.515>It's, <00:25:06.670>uh, <00:25:06.826>end-to-end <00:25:06.981>AI <00:25:07.137>tool <00:25:07.292>chain <00:25:07.448>for <00:25:07.603>you <00:25:07.759>to, <00:25:07.915>again,

461
00:25:10.685 --> 00:25:13.045
<00:25:10.685>automate, <00:25:10.918>to <00:25:11.151>streamline <00:25:11.385>all <00:25:11.618>your <00:25:11.851>operations <00:25:12.085>and,

462
00:25:13.045 --> 00:25:14.205
<00:25:13.045>and <00:25:13.393>the <00:25:13.741>development <00:25:14.089>itself.

463
00:25:14.785 --> 00:25:19.045
<00:25:14.785>Uh, <00:25:14.985>it <00:25:15.185>has <00:25:15.385>responsible <00:25:15.585>AI <00:25:15.785>practices <00:25:15.985>as <00:25:16.185>foundation,

464
00:25:19.585 --> 00:25:22.165
<00:25:19.585>and <00:25:19.760>yeah, <00:25:19.935>as, <00:25:20.110>uh, <00:25:20.285>pretty <00:25:20.460>much <00:25:20.635>everything <00:25:20.810>in <00:25:20.985>Microsoft.

465
00:25:22.355 --> 00:25:27.165
<00:25:22.355>It's, <00:25:22.530>um, <00:25:22.705>enterprise <00:25:22.880>ready, <00:25:23.055>uh, <00:25:23.230>production <00:25:23.405>at <00:25:23.580>scale <00:25:23.755>ready.

466
00:25:28.225 --> 00:25:32.845
<00:25:28.225>Uh, <00:25:28.399>it <00:25:28.574>has <00:25:28.750>full <00:25:28.925>catalog <00:25:29.100>of <00:25:29.274>cutting <00:25:29.449>edge <00:25:29.625>models

467
00:25:32.995 --> 00:25:37.885
<00:25:32.995>with, <00:25:33.135>um, <00:25:33.274>all, <00:25:33.415>um, <00:25:33.554>ways <00:25:33.695>that <00:25:33.834>you <00:25:33.975>might, <00:25:34.114>uh, <00:25:34.254>ever <00:25:34.395>think

468
00:25:37.885 --> 00:25:39.765
<00:25:37.885>to <00:25:38.118>about <00:25:38.351>how <00:25:38.585>to <00:25:38.818>consume <00:25:39.051>these <00:25:39.285>models.

469
00:25:39.785 --> 00:25:41.885
<00:25:39.785>Either <00:25:40.251>just <00:25:40.718>exposed <00:25:41.185>APIs

470
00:25:41.985 --> 00:25:44.165
<00:25:41.985>or, <00:25:42.218>uh, <00:25:42.451>spinning <00:25:42.685>up <00:25:42.918>your <00:25:43.151>virtual <00:25:43.385>machine

471
00:25:44.225 --> 00:25:45.365
<00:25:44.225>or <00:25:44.481>model <00:25:44.738>as <00:25:44.994>a <00:25:45.251>service.

472
00:25:45.705 --> 00:25:48.925
<00:25:45.705>You <00:25:45.879>choose <00:25:46.054>what <00:25:46.230>works <00:25:46.405>better <00:25:46.580>for <00:25:46.754>your <00:25:46.929>particular <00:25:47.105>project.

473
00:25:49.545 --> 00:25:53.085
<00:25:49.545>It <00:25:49.685>has <00:25:49.825>set <00:25:49.965>of, <00:25:50.105>uh, <00:25:50.245>what <00:25:50.385>we <00:25:50.525>call <00:25:50.665>Azure <00:25:50.805>AI <00:25:50.945>services.

474
00:25:53.095 --> 00:25:56.965
<00:25:53.095>These <00:25:53.235>are <00:25:53.375>just, <00:25:53.515>um, <00:25:53.655>uh, <00:25:53.795>some <00:25:53.935>parts <00:25:54.075>of, <00:25:54.215>uh, <00:25:54.355>ai, <00:25:54.495>uh,

475
00:25:56.965 --> 00:25:59.605
<00:25:56.965>capabilities <00:25:57.431>exposed <00:25:57.898>VR, <00:25:58.365>APIs.

476
00:25:59.705 --> 00:26:03.765
<00:25:59.705>Uh, <00:25:59.832>I <00:25:59.959>mean, <00:26:00.086>it's, <00:26:00.214>uh, <00:26:00.341>you <00:26:00.468>don't <00:26:00.595>need <00:26:00.723>to <00:26:00.850>have <00:26:00.977>data <00:26:01.105>science,

477
00:26:03.995 --> 00:26:05.725
<00:26:03.995>data <00:26:04.695>engineering, <00:26:05.395>um,

478
00:26:05.955 --> 00:26:08.085
<00:26:05.955>even <00:26:06.304>machine <00:26:06.655>learning <00:26:07.004>engineering <00:26:07.355>in-house

479
00:26:08.305 --> 00:26:11.645
<00:26:08.305>to <00:26:08.538>start <00:26:08.771>building <00:26:09.005>your <00:26:09.238>AI <00:26:09.471>capable <00:26:09.705>application.

480
00:26:11.745 --> 00:26:14.965
<00:26:11.745>So <00:26:11.900>I, <00:26:12.056>if <00:26:12.211>you <00:26:12.367>talk <00:26:12.522>about, <00:26:12.678>let's <00:26:12.833>say, <00:26:12.989>traditional, <00:26:13.145>um,

481
00:26:15.265 --> 00:26:18.085
<00:26:15.265>AI <00:26:15.440>applications <00:26:15.615>like <00:26:15.790>text <00:26:15.965>to <00:26:16.140>speech, <00:26:16.315>speech <00:26:16.490>to <00:26:16.665>text,

482
00:26:18.445 --> 00:26:22.645
<00:26:18.445>computer <00:26:18.600>vision, <00:26:18.756>we <00:26:18.911>have <00:26:19.067>these <00:26:19.222>APIs <00:26:19.378>in <00:26:19.533>production <00:26:19.689>for <00:26:19.845>years,

483
00:26:22.945 --> 00:26:24.525
<00:26:22.945>and <00:26:23.225>they <00:26:23.504>are <00:26:23.784>very, <00:26:24.064>very <00:26:24.345>capable.

484
00:26:24.755 --> 00:26:27.845
<00:26:24.755>They <00:26:24.930>are <00:26:25.105>very, <00:26:25.280>um, <00:26:25.455>like, <00:26:25.630>uh, <00:26:25.805>comprehensive <00:26:25.980>in <00:26:26.155>number

485
00:26:27.865 --> 00:26:29.045
<00:26:27.865>of <00:26:28.219>features <00:26:28.573>they <00:26:28.927>offer,

486
00:26:29.105 --> 00:26:31.605
<00:26:29.105>and <00:26:29.338>still, <00:26:29.571>they <00:26:29.805>are <00:26:30.038>under <00:26:30.271>constant <00:26:30.505>development

487
00:26:31.625 --> 00:26:34.045
<00:26:31.625>to <00:26:31.858>provide <00:26:32.091>even <00:26:32.325>better <00:26:32.558>set <00:26:32.791>of, <00:26:33.025>um,

488
00:26:34.485 --> 00:26:35.805
<00:26:34.485>features <00:26:34.880>faster <00:26:35.277>and <00:26:35.673>cheaper.

489
00:26:36.425 --> 00:26:40.085
<00:26:36.425>Uh, <00:26:36.625>and <00:26:36.825>if <00:26:37.024>needed, <00:26:37.225>if <00:26:37.425>you <00:26:37.625>wish <00:26:37.825>to

490
00:26:40.895 --> 00:26:43.525
<00:26:40.895>build <00:26:41.095>your <00:26:41.295>own <00:26:41.495>models <00:26:41.695>or <00:26:41.895>fine <00:26:42.095>tune <00:26:42.295>models

491
00:26:43.785 --> 00:26:45.685
<00:26:43.785>and <00:26:44.251>orchestrate <00:26:44.718>this <00:26:45.185>flow.

492
00:26:45.775 --> 00:26:48.605
<00:26:45.775>Again, <00:26:46.055>end-to-end, <00:26:46.335>it <00:26:46.615>also <00:26:46.895>contains <00:26:47.175>tools

493
00:26:48.825 --> 00:26:53.645
<00:26:48.825>and, <00:26:49.058>um, <00:26:49.291>uh, <00:26:49.525>features <00:26:49.758>for <00:26:49.991>machine <00:26:50.225>learning.

494
00:26:54.145 --> 00:26:55.325
<00:26:54.145>And <00:26:54.499>under <00:26:54.853>the <00:26:55.207>hood,

495
00:26:55.425 --> 00:26:59.005
<00:26:55.425>it <00:26:55.625>all <00:26:55.825>based <00:26:56.024>on <00:26:56.225>cutting <00:26:56.425>edge <00:26:56.625>AI <00:26:56.825>infrastructure,

496
00:26:59.185 --> 00:27:03.685
<00:26:59.185>or <00:26:59.312>we <00:26:59.439>can <00:26:59.566>say <00:26:59.694>it, <00:26:59.821>state <00:26:59.948>of <00:27:00.075>art <00:27:00.203>AI <00:27:00.330>infrastructure, <00:27:00.457>uh, <00:27:00.585>uh,

497
00:27:03.785 --> 00:27:07.005
<00:27:03.785>on <00:27:03.985>Microsoft <00:27:04.185>data <00:27:04.385>centers, <00:27:04.585>Azure <00:27:04.785>data <00:27:04.985>centers, <00:27:05.185>uh,

498
00:27:07.075 --> 00:27:08.085
<00:27:07.075>with <00:27:07.529>all <00:27:07.984>whistle

499
00:27:08.225 --> 00:27:12.085
<00:27:08.225>and <00:27:08.380>bells <00:27:08.536>ever, <00:27:08.691>uh, <00:27:08.847>possible <00:27:09.002>for <00:27:09.158>this <00:27:09.313>kind <00:27:09.469>of <00:27:09.625>compute.

500
00:27:12.625 --> 00:27:16.525
<00:27:12.625>Um, <00:27:12.765>now <00:27:12.905>end <00:27:13.045>of <00:27:13.185>this <00:27:13.325>session, <00:27:13.465>uh, <00:27:13.605>uh, <00:27:13.745>to <00:27:13.885>the <00:27:14.025>end

501
00:27:16.525 --> 00:27:20.405
<00:27:16.525>of <00:27:16.680>the <00:27:16.836>session, <00:27:16.991>let's <00:27:17.147>quickly <00:27:17.302>go <00:27:17.458>through <00:27:17.613>some <00:27:17.769>components <00:27:17.925>of,

502
00:27:20.505 --> 00:27:24.655
<00:27:20.505>uh, <00:27:20.738>this, <00:27:20.971>uh, <00:27:21.205>super, <00:27:21.438>super <00:27:21.671>massive, <00:27:21.905>um,

503
00:27:24.995 --> 00:27:26.375
<00:27:24.995>studio <00:27:25.616>of <00:27:26.237>foundry.

504
00:27:26.375 --> 00:27:29.855
<00:27:26.375>Yeah, <00:27:26.550>maybe <00:27:26.725>foundry <00:27:26.900>is <00:27:27.075>even <00:27:27.250>better <00:27:27.425>term <00:27:27.600>now, <00:27:27.775>right?

505
00:27:29.995 --> 00:27:34.255
<00:27:29.995>Uh, <00:27:30.150>to <00:27:30.306>understand <00:27:30.461>where, <00:27:30.617>uh, <00:27:30.772>exactly <00:27:30.928>it <00:27:31.083>contributes <00:27:31.239>to <00:27:31.395>this

506
00:27:34.315 --> 00:27:38.255
<00:27:34.315>or <00:27:34.515>that <00:27:34.715>part <00:27:34.915>of, <00:27:35.115>uh, <00:27:35.315>this, <00:27:35.515>uh, <00:27:35.715>circles

507
00:27:38.255 --> 00:27:40.015
<00:27:38.255>or <00:27:38.721>cycles <00:27:39.188>I <00:27:39.655>mentioned,

508
00:27:40.395 --> 00:27:42.495
<00:27:40.395>and <00:27:40.570>let's <00:27:40.745>start <00:27:40.920>from <00:27:41.095>the <00:27:41.270>first <00:27:41.445>one <00:27:41.620>of <00:27:41.795>course,

509
00:27:42.655 --> 00:27:44.175
<00:27:42.655>ideation, <00:27:44.023>exploring.

510
00:27:44.595 --> 00:27:48.415
<00:27:44.595>And <00:27:44.735>as <00:27:44.875>I <00:27:45.015>mentioned, <00:27:45.155>in <00:27:45.295>many <00:27:45.435>cases, <00:27:45.575>it <00:27:45.715>starts <00:27:45.855>with, <00:27:45.995>uh,

511
00:27:48.715 --> 00:27:51.935
<00:27:48.715>you <00:27:48.995>choosing <00:27:49.274>right <00:27:49.554>model, <00:27:49.834>right <00:27:50.115>model,

512
00:27:52.235 --> 00:27:55.735
<00:27:52.235>and <00:27:52.468>right <00:27:52.701>consumption <00:27:52.935>model <00:27:53.168>for <00:27:53.401>this <00:27:53.635>model.

513
00:27:56.245 --> 00:27:57.815
<00:27:56.245>Here, <00:27:56.594>you <00:27:56.945>are <00:27:57.294>fully <00:27:57.645>covered.

514
00:27:57.995 --> 00:28:02.535
<00:27:57.995>Uh, <00:27:58.195>the <00:27:58.395>catalog <00:27:58.594>today <00:27:58.794>contains <00:27:58.995>over <00:27:59.195>one <00:27:59.395>1000

515
00:28:02.635 --> 00:28:05.255
<00:28:02.635>to <00:28:03.335>800 <00:28:04.035>models.

516
00:28:05.675 --> 00:28:07.575
<00:28:05.675>Um, <00:28:06.375>all <00:28:07.075>like,

517
00:28:07.745 --> 00:28:10.855
<00:28:07.745>let's <00:28:08.024>say <00:28:08.304>mainstream <00:28:08.584>foundational <00:28:08.864>l <00:28:09.145>lms

518
00:28:10.915 --> 00:28:14.095
<00:28:10.915>and <00:28:11.070>new <00:28:11.226>generation <00:28:11.381>of, <00:28:11.537>uh, <00:28:11.692>what <00:28:11.848>we <00:28:12.003>call <00:28:12.159>now <00:28:12.315>small

519
00:28:14.735 --> 00:28:17.255
<00:28:14.735>language <00:28:14.909>models, <00:28:15.084>or <00:28:15.260>I <00:28:15.435>can <00:28:15.610>call <00:28:15.784>them <00:28:15.959>personally, <00:28:16.135>small,

520
00:28:17.385 --> 00:28:21.855
<00:28:17.385>large <00:28:17.560>language <00:28:17.735>models, <00:28:17.910>uh, <00:28:18.085>from, <00:28:18.260>uh, <00:28:18.435>multiple <00:28:18.610>providers, <00:28:18.785>um,

521
00:28:22.125 --> 00:28:25.575
<00:28:22.125>like <00:28:22.265>the <00:28:22.405>ones <00:28:22.545>from, <00:28:22.685>uh, <00:28:22.825>OpenAI <00:28:22.965>that <00:28:23.105>are <00:28:23.245>part <00:28:23.385>of, <00:28:23.525>uh,

522
00:28:25.585 --> 00:28:29.135
<00:28:25.585>Azure <00:28:25.818>OpenAI <00:28:26.051>service, <00:28:26.285>including <00:28:26.518>cutting <00:28:26.751>edge <00:28:26.985>ones

523
00:28:29.235 --> 00:28:30.255
<00:28:29.235>for, <00:28:29.694>for <00:28:30.153>today.

524
00:28:30.475 --> 00:28:34.135
<00:28:30.475>Uh, <00:28:30.615>and <00:28:30.754>today, <00:28:30.895>the, <00:28:31.034>the <00:28:31.175>most <00:28:31.314>sophisticated <00:28:31.455>one <00:28:31.594>are <00:28:31.735>four <00:28:31.875>zero

525
00:28:34.555 --> 00:28:39.375
<00:28:34.555>or, <00:28:34.682>and <00:28:34.809>oh <00:28:34.936>one, <00:28:35.064>maybe <00:28:35.191>if <00:28:35.318>you <00:28:35.445>watch <00:28:35.573>this <00:28:35.700>session <00:28:35.827>in <00:28:35.955>recording

526
00:28:39.385 --> 00:28:42.875
<00:28:39.385>after, <00:28:39.585>after <00:28:39.785>one <00:28:39.985>year <00:28:40.185>after <00:28:40.385>it's <00:28:40.585>been <00:28:40.785>recorded

527
00:28:42.895 --> 00:28:44.995
<00:28:42.895>and <00:28:43.175>demonstrated, <00:28:43.455>you, <00:28:43.735>you <00:28:44.014>can <00:28:44.295>smile.

528
00:28:45.215 --> 00:28:47.715
<00:28:45.215>So <00:28:45.415>you, <00:28:45.615>you <00:28:45.814>call <00:28:46.014>this <00:28:46.215>model <00:28:46.415>cutting <00:28:46.615>edge.

529
00:28:47.815 --> 00:28:50.515
<00:28:47.815>Now <00:28:47.970>they <00:28:48.126>are <00:28:48.281>legacy. <00:28:48.437>Yeah, <00:28:48.592>and <00:28:48.748>this <00:28:48.903>is <00:28:49.059>true, <00:28:49.215>folks.

530
00:28:50.695 --> 00:28:53.755
<00:28:50.695>Uh, <00:28:50.928>we <00:28:51.161>call <00:28:51.395>the <00:28:51.628>this <00:28:51.861>like <00:28:52.095>GPT-4

531
00:28:53.975 --> 00:28:56.915
<00:28:53.975>and, <00:28:54.130>uh, <00:28:54.286>cutting <00:28:54.441>edge <00:28:54.597>now, <00:28:54.752>now <00:28:54.908>it's <00:28:55.063>in, <00:28:55.219>uh, <00:28:55.375>in,

532
00:28:56.945 --> 00:28:59.635
<00:28:56.945>it's <00:28:57.100>in <00:28:57.256>legacy <00:28:57.411>part <00:28:57.567>of, <00:28:57.722>uh, <00:28:57.878>this <00:28:58.033>model <00:28:58.189>stack, <00:28:58.345>right?

533
00:28:59.745 --> 00:29:00.835
<00:28:59.745>Because <00:29:00.726>again,

534
00:29:00.835 --> 00:29:03.435
<00:29:00.835>innovation <00:29:01.035>base <00:29:01.235>is <00:29:01.435>just <00:29:01.635>incredible <00:29:01.835>in <00:29:02.035>that <00:29:02.235>field.

535
00:29:03.655 --> 00:29:07.075
<00:29:03.655>So <00:29:03.830>everything <00:29:04.004>from <00:29:04.180>open <00:29:04.355>ai, <00:29:04.530>uh, <00:29:04.705>open <00:29:04.879>source <00:29:05.055>models,

536
00:29:07.105 --> 00:29:10.315
<00:29:07.105>from <00:29:07.338>meta, <00:29:07.571>from <00:29:07.805>hugging <00:29:08.038>face, <00:29:08.271>uh, <00:29:08.505>cohere,

537
00:29:10.705 --> 00:29:12.875
<00:29:10.705>mistral, <00:29:11.171>you <00:29:11.638>choose, <00:29:12.105>right?

538
00:29:13.375 --> 00:29:17.395
<00:29:13.375>And <00:29:13.530>the, <00:29:13.686>I <00:29:13.841>mean, <00:29:13.997>you <00:29:14.152>have <00:29:14.308>luxury <00:29:14.463>problem <00:29:14.619>here, <00:29:14.775>right?

539
00:29:17.655 --> 00:29:21.995
<00:29:17.655>How <00:29:17.830>to <00:29:18.004>choose <00:29:18.180>model <00:29:18.355>from <00:29:18.530>this <00:29:18.705>almost <00:29:18.879>2000 <00:29:19.055>ones.

540
00:29:22.185 --> 00:29:24.275
<00:29:22.185>What <00:29:22.465>works <00:29:22.745>specifically <00:29:23.024>for <00:29:23.304>your <00:29:23.585>scenario?

541
00:29:24.695 --> 00:29:27.235
<00:29:24.695>We <00:29:24.850>have <00:29:25.006>you <00:29:25.161>covered, <00:29:25.317>uh, <00:29:25.472>because, <00:29:25.628>um, <00:29:25.783>if <00:29:25.939>you <00:29:26.095>go

542
00:29:27.235 --> 00:29:29.635
<00:29:27.235>and <00:29:27.435>check <00:29:27.635>the <00:29:27.834>interface <00:29:28.034>of <00:29:28.235>this <00:29:28.435>model <00:29:28.635>catalog,

543
00:29:29.825 --> 00:29:31.075
<00:29:29.825>it's, <00:29:30.106>uh, <00:29:30.387>it's <00:29:30.668>so <00:29:30.950>cool.

544
00:29:31.095 --> 00:29:32.555
<00:29:31.095>So <00:29:31.357>you <00:29:31.620>can <00:29:31.883>choose <00:29:32.146>your <00:29:32.409>industry,

545
00:29:32.555 --> 00:29:33.715
<00:29:32.555>you <00:29:32.816>can <00:29:33.077>choose <00:29:33.338>your <00:29:33.599>scenario,

546
00:29:34.015 --> 00:29:36.795
<00:29:34.015>you <00:29:34.190>can <00:29:34.365>choose <00:29:34.540>your <00:29:34.715>desired <00:29:34.890>model <00:29:35.065>to <00:29:35.240>how, <00:29:35.415>how

547
00:29:36.795 --> 00:29:39.435
<00:29:36.795>to <00:29:36.950>consume <00:29:37.106>this <00:29:37.261>model, <00:29:37.417>how <00:29:37.572>to <00:29:37.728>pay <00:29:37.883>for <00:29:38.039>these <00:29:38.195>services.

548
00:29:39.615 --> 00:29:43.845
<00:29:39.615>So, <00:29:39.755>uh, <00:29:39.895>choosing <00:29:40.035>part <00:29:40.175>is, <00:29:40.315>uh, <00:29:40.455>well <00:29:40.595>covered <00:29:40.735>in <00:29:40.875>model <00:29:41.015>catalog,

549
00:29:44.305 --> 00:29:47.645
<00:29:44.305>and <00:29:44.480>you <00:29:44.655>immediately <00:29:44.830>can <00:29:45.005>compare <00:29:45.180>some <00:29:45.355>models <00:29:45.530>with, <00:29:45.705>uh,

550
00:29:48.475 --> 00:29:51.645
<00:29:48.475>each <00:29:48.630>other, <00:29:48.786>uh, <00:29:48.941>how <00:29:49.097>they <00:29:49.252>operate <00:29:49.408>for <00:29:49.563>your <00:29:49.719>particular <00:29:49.875>task.

551
00:29:51.865 --> 00:29:54.005
<00:29:51.865>You <00:29:52.145>can <00:29:52.425>immediately <00:29:52.705>test <00:29:52.985>the <00:29:53.265>model.

552
00:29:54.005 --> 00:29:57.205
<00:29:54.005>There <00:29:54.145>is <00:29:54.285>kind <00:29:54.425>of <00:29:54.565>sandbox <00:29:54.705>where <00:29:54.845>you <00:29:54.985>can <00:29:55.125>start <00:29:55.265>sending <00:29:55.405>prompts

553
00:29:57.225 --> 00:30:01.605
<00:29:57.225>and, <00:29:57.365>uh, <00:29:57.504>check, <00:29:57.645>uh, <00:29:57.784>what <00:29:57.925>kind <00:29:58.064>of <00:29:58.205>completions <00:29:58.344>they <00:29:58.485>give <00:29:58.625>you.

554
00:30:02.145 --> 00:30:04.805
<00:30:02.145>And, <00:30:02.320>uh, <00:30:02.495>really <00:30:02.670>cool <00:30:02.845>that <00:30:03.020>you <00:30:03.195>can <00:30:03.370>even, <00:30:03.545>uh,

555
00:30:05.035 --> 00:30:06.445
<00:30:05.035>benchmark <00:30:05.352>some <00:30:05.669>of <00:30:05.986>the <00:30:06.303>models.

556
00:30:06.645 --> 00:30:10.445
<00:30:06.645>I <00:30:06.800>mean, <00:30:06.956>something <00:30:07.111>more, <00:30:07.267>uh, <00:30:07.422>more <00:30:07.578>structured <00:30:07.733>than, <00:30:07.889>than <00:30:08.045>just,

557
00:30:10.465 --> 00:30:12.365
<00:30:10.465>uh, <00:30:10.814>just <00:30:11.165>testing, <00:30:11.514>just <00:30:11.865>comparison.

558
00:30:12.505 --> 00:30:15.725
<00:30:12.505>So <00:30:12.660>there <00:30:12.816>is <00:30:12.971>set <00:30:13.127>of, <00:30:13.282>uh, <00:30:13.438>metrics, <00:30:13.593>for <00:30:13.749>example, <00:30:13.905>uh,

559
00:30:16.005 --> 00:30:19.285
<00:30:16.005>covering <00:30:16.238>AI <00:30:16.471>quality <00:30:16.705>like <00:30:16.938>accuracy, <00:30:17.171>groundedness, <00:30:17.405>relevance,

560
00:30:19.285 --> 00:30:20.645
<00:30:19.285>conference <00:30:19.897>fluency, <00:30:20.509>uh,

561
00:30:20.665 --> 00:30:23.565
<00:30:20.665>but <00:30:20.840>not <00:30:21.014>only, <00:30:21.190>so <00:30:21.365>based, <00:30:21.540>uh, <00:30:21.715>on, <00:30:21.889>on <00:30:22.065>top

562
00:30:23.565 --> 00:30:25.085
<00:30:23.565>of <00:30:23.907>this <00:30:24.249>AI <00:30:24.591>quality <00:30:24.933>metrics,

563
00:30:25.185 --> 00:30:28.765
<00:30:25.185>you <00:30:25.385>can <00:30:25.585>also <00:30:25.784>benchmark <00:30:25.985>models <00:30:26.185>on <00:30:26.385>cost <00:30:26.585>latency,

564
00:30:28.765 --> 00:30:30.965
<00:30:28.765>super <00:30:29.045>important <00:30:29.325>thing <00:30:29.605>and, <00:30:29.885>uh, <00:30:30.165>throughput.

565
00:30:30.965 --> 00:30:34.325
<00:30:30.965>And <00:30:31.139>it's <00:30:31.314>all <00:30:31.490>in <00:30:31.665>very, <00:30:31.840>um, <00:30:32.014>uh, <00:30:32.189>developer <00:30:32.365>friendly

566
00:30:34.345 --> 00:30:37.045
<00:30:34.345>or <00:30:34.625>user <00:30:34.905>friendly, <00:30:35.185>uh, <00:30:35.465>visualized <00:30:35.745>way.

567
00:30:37.145 --> 00:30:38.925
<00:30:37.145>So <00:30:37.425>I <00:30:37.705>really <00:30:37.985>love <00:30:38.264>how <00:30:38.545>we

568
00:30:39.675 --> 00:30:42.285
<00:30:39.675>have <00:30:39.908>benchmarking <00:30:40.141>in <00:30:40.375>place <00:30:40.608>in <00:30:40.841>Azure <00:30:41.075>ai.

569
00:30:42.985 --> 00:30:46.045
<00:30:42.985>So <00:30:43.185>you <00:30:43.385>are <00:30:43.584>fully <00:30:43.784>covered <00:30:43.985>for <00:30:44.185>this <00:30:44.385>ideation

570
00:30:46.105 --> 00:30:47.605
<00:30:46.105>and <00:30:46.780>experimentation <00:30:47.455>stage.

571
00:30:48.195 --> 00:30:52.125
<00:30:48.195>What <00:30:48.311>if <00:30:48.428>we <00:30:48.544>go <00:30:48.661>next? <00:30:48.778>What <00:30:48.895>if <00:30:49.011>we <00:30:49.128>are <00:30:49.245>ready <00:30:49.361>to <00:30:49.478>build <00:30:49.595>something?

572
00:30:52.465 --> 00:30:56.845
<00:30:52.465>And, <00:30:52.605>uh, <00:30:52.745>as <00:30:52.885>I <00:30:53.024>already <00:30:53.165>mentioned, <00:30:53.304>in <00:30:53.445>many, <00:30:53.584>many <00:30:53.725>cases, <00:30:53.865>uh,

573
00:30:57.145 --> 00:31:00.125
<00:30:57.145>I'd <00:30:57.495>say <00:30:57.845>99.9% <00:30:58.195>of, <00:30:58.545>uh,

574
00:31:00.425 --> 00:31:04.245
<00:31:00.425>all <00:31:00.658>enterprise <00:31:00.891>AI <00:31:01.125>infused <00:31:01.358>applications, <00:31:01.591>you <00:31:01.825>need

575
00:31:04.265 --> 00:31:06.965
<00:31:04.265>to <00:31:04.498>think <00:31:04.731>about <00:31:04.965>retrieval <00:31:05.198>augmented <00:31:05.431>generation <00:31:05.665>from

576
00:31:07.065 --> 00:31:08.085
<00:31:07.065>the <00:31:07.524>day <00:31:07.983>one.

577
00:31:08.385 --> 00:31:10.805
<00:31:08.385>Of <00:31:08.540>course, <00:31:08.696>uh, <00:31:08.851>we <00:31:09.007>don't <00:31:09.162>have <00:31:09.318>time <00:31:09.473>to <00:31:09.629>dive <00:31:09.785>deeper

578
00:31:10.985 --> 00:31:14.845
<00:31:10.985>or, <00:31:11.159>uh, <00:31:11.334>uh, <00:31:11.510>if, <00:31:11.685>um, <00:31:11.860>if <00:31:12.034>I <00:31:12.209>was <00:31:12.385>LLM,

579
00:31:14.965 --> 00:31:18.205
<00:31:14.965>I <00:31:15.139>would <00:31:15.314>say <00:31:15.490>delve <00:31:15.665>deeper <00:31:15.840>into <00:31:16.014>what <00:31:16.189>is <00:31:16.365>rack.

580
00:31:18.265 --> 00:31:20.405
<00:31:18.265>So <00:31:18.420>I <00:31:18.576>assume <00:31:18.731>that <00:31:18.887>you <00:31:19.042>have <00:31:19.198>at <00:31:19.353>least <00:31:19.509>foundational <00:31:19.665>knowledge

581
00:31:20.515 --> 00:31:22.885
<00:31:20.515>what <00:31:20.690>I <00:31:20.865>wanted <00:31:21.040>to <00:31:21.215>say <00:31:21.390>here <00:31:21.565>that, <00:31:21.740>uh, <00:31:21.915>yeah,

582
00:31:22.905 --> 00:31:24.525
<00:31:22.905>you <00:31:23.138>are <00:31:23.371>fully <00:31:23.605>covered <00:31:23.838>here <00:31:24.071>as <00:31:24.305>well.

583
00:31:24.745 --> 00:31:27.045
<00:31:24.745>Uh, <00:31:25.094>so <00:31:25.445>as, <00:31:25.794>um, <00:31:26.145>sophisticated

584
00:31:27.765 --> 00:31:32.685
<00:31:27.765>re <00:31:27.881>we <00:31:27.998>have <00:31:28.115>Azure <00:31:28.231>AI <00:31:28.348>search, <00:31:28.465>um, <00:31:28.581>as <00:31:28.698>a <00:31:28.815>model <00:31:28.931>you <00:31:29.048>can <00:31:29.165>use,

585
00:31:32.685 --> 00:31:34.365
<00:31:32.685>for <00:31:32.965>example, <00:31:33.245>Azure <00:31:33.524>Open <00:31:33.804>AI <00:31:34.085>service

586
00:31:34.545 --> 00:31:35.845
<00:31:34.545>or <00:31:34.935>any <00:31:35.325>other <00:31:35.715>models

587
00:31:35.845 --> 00:31:38.605
<00:31:35.845>that <00:31:36.020>I <00:31:36.195>demonstrated <00:31:36.370>recently <00:31:36.545>on <00:31:36.720>this <00:31:36.895>model <00:31:37.070>catalog <00:31:37.245>side.

588
00:31:39.025 --> 00:31:43.485
<00:31:39.025>And <00:31:39.180>yeah, <00:31:39.336>you <00:31:39.491>have <00:31:39.647>all <00:31:39.802>tools <00:31:39.958>for, <00:31:40.113>uh, <00:31:40.269>for, <00:31:40.425>uh,

589
00:31:43.885 --> 00:31:47.485
<00:31:43.885>covering <00:31:44.060>this <00:31:44.235>right <00:31:44.410>part <00:31:44.585>of <00:31:44.760>this <00:31:44.935>diagram, <00:31:45.110>everything <00:31:45.285>related

590
00:31:47.505 --> 00:31:52.365
<00:31:47.505>to <00:31:47.705>chunking, <00:31:47.905>vectorization, <00:31:48.105>indexing, <00:31:48.305>ranking, <00:31:48.505>so <00:31:48.705>it's <00:31:48.905>all,

591
00:31:52.545 --> 00:31:55.605
<00:31:52.545>uh, <00:31:52.745>covered <00:31:52.945>very <00:31:53.145>well <00:31:53.345>by <00:31:53.545>Azure <00:31:53.745>AI <00:31:53.945>search.

592
00:31:56.065 --> 00:31:58.845
<00:31:56.065>But <00:31:56.220>if <00:31:56.376>we <00:31:56.531>look <00:31:56.687>at, <00:31:56.842>uh, <00:31:56.998>if <00:31:57.153>you <00:31:57.309>like, <00:31:57.465>um,

593
00:31:59.105 --> 00:32:02.405
<00:31:59.105>if <00:31:59.260>you <00:31:59.416>remember <00:31:59.571>previous <00:31:59.727>slide, <00:31:59.882>the, <00:32:00.038>the <00:32:00.193>left <00:32:00.349>part, <00:32:00.505>all,

594
00:32:02.425 --> 00:32:06.125
<00:32:02.425>you <00:32:02.625>know, <00:32:02.825>orchestration, <00:32:03.024>how <00:32:03.225>we <00:32:03.425>actually <00:32:03.625>orchestrate <00:32:03.825>this,

595
00:32:06.225 --> 00:32:10.925
<00:32:06.225>uh, <00:32:06.380>rag <00:32:06.536>flow, <00:32:06.691>uh, <00:32:06.847>other <00:32:07.002>tools <00:32:07.158>for <00:32:07.313>us <00:32:07.469>to <00:32:07.625>help

596
00:32:11.025 --> 00:32:13.285
<00:32:11.025>to <00:32:11.375>automate, <00:32:11.725>uh, <00:32:12.075>these <00:32:12.425>components.

597
00:32:13.825 --> 00:32:18.325
<00:32:13.825>Yes, <00:32:13.980>luckily <00:32:14.136>we <00:32:14.291>have, <00:32:14.447>um, <00:32:14.602>a <00:32:14.758>framework <00:32:14.913>called <00:32:15.069>Prompt <00:32:15.225>Flow

598
00:32:18.545 --> 00:32:23.485
<00:32:18.545>for, <00:32:18.745>um, <00:32:18.945>yeah, <00:32:19.145>literally <00:32:19.345>improving <00:32:19.545>our <00:32:19.745>LLM <00:32:19.945>operations.

599
00:32:24.025 --> 00:32:27.525
<00:32:24.025>And <00:32:24.258>this, <00:32:24.491>uh, <00:32:24.725>framework <00:32:24.958>is <00:32:25.191>open <00:32:25.425>source.

600
00:32:27.685 --> 00:32:31.805
<00:32:27.685>I <00:32:27.825>mean, <00:32:27.965>you <00:32:28.105>can <00:32:28.245>run <00:32:28.385>this, <00:32:28.524>uh, <00:32:28.665>in <00:32:28.804>full <00:32:28.945>disconnection <00:32:29.085>from,

601
00:32:31.865 --> 00:32:34.045
<00:32:31.865>uh, <00:32:32.098>Azure <00:32:32.331>AI <00:32:32.565>from <00:32:32.798>these <00:32:33.031>cloud <00:32:33.265>services.

602
00:32:34.265 --> 00:32:37.485
<00:32:34.265>You <00:32:34.420>can, <00:32:34.576>uh, <00:32:34.731>spin <00:32:34.887>this <00:32:35.042>up <00:32:35.198>locally <00:32:35.353>on <00:32:35.509>your <00:32:35.665>machine.

603
00:32:37.865 --> 00:32:41.725
<00:32:37.865>Uh, <00:32:38.005>it <00:32:38.145>has <00:32:38.285>a <00:32:38.425>really <00:32:38.565>nice <00:32:38.705>extension <00:32:38.845>for <00:32:38.985>Visual <00:32:39.125>Studio <00:32:39.265>code

604
00:32:41.725 --> 00:32:44.765
<00:32:41.725>that <00:32:41.865>allows <00:32:42.004>you <00:32:42.145>to <00:32:42.284>both <00:32:42.425>write <00:32:42.564>it <00:32:42.705>as <00:32:42.844>a <00:32:42.985>code <00:32:43.125>first.

605
00:32:44.785 --> 00:32:47.845
<00:32:44.785>And <00:32:44.925>this <00:32:45.065>is <00:32:45.205>code <00:32:45.345>first <00:32:45.485>approach <00:32:45.625>is <00:32:45.765>super <00:32:45.905>important <00:32:46.045>if <00:32:46.185>you

606
00:32:47.845 --> 00:32:50.365
<00:32:47.845>ever <00:32:48.125>talk <00:32:48.405>about <00:32:48.685>operationalizing <00:32:48.965>something, <00:32:49.245>right?

607
00:32:50.365 --> 00:32:54.565
<00:32:50.365>If <00:32:50.520>you <00:32:50.676>talk <00:32:50.831>about, <00:32:50.987>uh, <00:32:51.142>like <00:32:51.298>storing <00:32:51.453>these <00:32:51.609>workflows, <00:32:51.765>um,

608
00:32:55.165 --> 00:32:58.445
<00:32:55.165>reproducing <00:32:55.365>these <00:32:55.565>workflows, <00:32:55.764>of <00:32:55.965>course, <00:32:56.165>um, <00:32:56.365>it's, <00:32:56.565>uh,

609
00:32:58.445 --> 00:33:00.205
<00:32:58.445>like <00:32:58.725>UI <00:32:59.004>is <00:32:59.284>not <00:32:59.564>enough, <00:32:59.845>right?

610
00:33:00.425 --> 00:33:02.925
<00:33:00.425>Uh, <00:33:00.625>code <00:33:00.825>first <00:33:01.024>is, <00:33:01.225>uh, <00:33:01.425>absolutely <00:33:01.625>must <00:33:01.825>have.

611
00:33:03.185 --> 00:33:06.365
<00:33:03.185>At <00:33:03.325>the <00:33:03.465>same <00:33:03.605>time, <00:33:03.745>it <00:33:03.885>has <00:33:04.024>very <00:33:04.165>nice <00:33:04.304>UI <00:33:04.445>as <00:33:04.585>well.

612
00:33:06.465 --> 00:33:10.285
<00:33:06.465>So <00:33:06.581>if <00:33:06.698>you <00:33:06.814>prefer <00:33:06.931>kind <00:33:07.048>of <00:33:07.165>this, <00:33:07.281>um, <00:33:07.398>low <00:33:07.514>code, <00:33:07.631>no <00:33:07.748>code <00:33:07.865>way

613
00:33:10.285 --> 00:33:13.605
<00:33:10.285>of <00:33:10.425>building <00:33:10.565>your <00:33:10.705>flows, <00:33:10.845>you <00:33:10.985>are <00:33:11.125>fully <00:33:11.265>covered <00:33:11.405>here <00:33:11.545>as <00:33:11.685>well.

614
00:33:13.825 --> 00:33:16.565
<00:33:13.825>But <00:33:13.980>in <00:33:14.136>the <00:33:14.291>big <00:33:14.447>picture, <00:33:14.602>prompt <00:33:14.758>flow <00:33:14.913>gives <00:33:15.069>you <00:33:15.225>opportunity

615
00:33:16.625 --> 00:33:20.605
<00:33:16.625>to <00:33:16.765>create <00:33:16.905>and <00:33:17.045>develop <00:33:17.185>flow <00:33:17.325>again <00:33:17.465>in <00:33:17.605>the <00:33:17.745>way <00:33:17.885>you <00:33:18.025>prefer.

616
00:33:21.065 --> 00:33:25.125
<00:33:21.065>It <00:33:21.220>gives <00:33:21.376>you <00:33:21.531>tools <00:33:21.687>to <00:33:21.842>evaluate <00:33:21.998>for <00:33:22.153>quality <00:33:22.309>and <00:33:22.465>performance.

617
00:33:25.545 --> 00:33:30.445
<00:33:25.545>And <00:33:25.685>yeah, <00:33:25.825>uh, <00:33:25.965>you <00:33:26.105>have, <00:33:26.245>um, <00:33:26.385>all <00:33:26.525>needed, <00:33:26.665>uh, <00:33:26.805>runtime, <00:33:26.945>uh,

618
00:33:30.595 --> 00:33:33.365
<00:33:30.595>tool <00:33:30.945>chain <00:33:31.295>for <00:33:31.645>streamline <00:33:31.995>development.

619
00:33:33.825 --> 00:33:37.165
<00:33:33.825>Um, <00:33:34.025>this <00:33:34.225>is <00:33:34.425>how <00:33:34.625>that <00:33:34.825>looks <00:33:35.025>on, <00:33:35.225>uh,

620
00:33:37.535 --> 00:33:41.525
<00:33:37.535>Azure <00:33:37.690>AI <00:33:37.846>in, <00:33:38.001>um, <00:33:38.157>in, <00:33:38.312>uh, <00:33:38.468>it's <00:33:38.623>a <00:33:38.779>cloud, <00:33:38.935>uh,

621
00:33:41.865 --> 00:33:43.845
<00:33:41.865>hosted <00:33:42.098>version, <00:33:42.331>but <00:33:42.565>again, <00:33:42.798>you <00:33:43.031>can, <00:33:43.265>uh,

622
00:33:44.285 --> 00:33:48.125
<00:33:44.285>reproduce <00:33:44.425>very <00:33:44.565>similar <00:33:44.705>UI <00:33:44.845>straight <00:33:44.985>in <00:33:45.125>your <00:33:45.265>VS <00:33:45.405>code <00:33:45.545>if <00:33:45.685>you

623
00:33:48.125 --> 00:33:50.605
<00:33:48.125>don't <00:33:48.252>want <00:33:48.379>to <00:33:48.506>run <00:33:48.634>a <00:33:48.761>code, <00:33:48.888>uh, <00:33:49.015>prompt <00:33:49.143>flow <00:33:49.270>as <00:33:49.397>a <00:33:49.525>part

624
00:33:50.605 --> 00:33:51.765
<00:33:50.605>of <00:33:51.127>Azure <00:33:51.649>ai.

625
00:33:52.065 --> 00:33:55.445
<00:33:52.065>And <00:33:52.192>yeah, <00:33:52.319>I, <00:33:52.446>I, <00:33:52.574>I <00:33:52.701>just <00:33:52.828>have <00:33:52.955>a <00:33:53.083>couple <00:33:53.210>of <00:33:53.337>slides, <00:33:53.465>uh,

626
00:33:55.445 --> 00:34:00.405
<00:33:55.445>to <00:33:55.585>highlight <00:33:55.725>just <00:33:55.865>few <00:33:56.004>of <00:33:56.145>the <00:33:56.284>features, <00:33:56.425>um, <00:33:56.564>from <00:33:56.705>prompt <00:33:56.845>flow.

627
00:34:00.705 --> 00:34:03.925
<00:34:00.705>And, <00:34:00.821>uh, <00:34:00.938>here <00:34:01.054>you <00:34:01.171>can <00:34:01.288>see <00:34:01.405>that <00:34:01.521>you <00:34:01.638>can <00:34:01.754>create <00:34:01.871>your <00:34:01.988>11 <00:34:02.105>flows,

628
00:34:04.065 --> 00:34:05.845
<00:34:04.065>um, <00:34:04.345>basically <00:34:04.625>as <00:34:04.905>a <00:34:05.185>flow, <00:34:05.465>right?

629
00:34:05.945 --> 00:34:10.125
<00:34:05.945>In <00:34:06.100>the <00:34:06.256>technical <00:34:06.411>terms. <00:34:06.567>This <00:34:06.722>is, <00:34:06.878>um, <00:34:07.033>graph <00:34:07.189>like, <00:34:07.345>uh,

630
00:34:10.765 --> 00:34:15.125
<00:34:10.764>directed, <00:34:10.920>uh, <00:34:11.076>a <00:34:11.231>cyclic, <00:34:11.387>uh, <00:34:11.542>graph <00:34:11.698>where, <00:34:11.853>where <00:34:12.009>each <00:34:12.165>node

631
00:34:15.885 --> 00:34:19.925
<00:34:15.885>represents <00:34:16.085>either <00:34:16.285>call <00:34:16.485>to <00:34:16.685>LLM <00:34:16.885>or, <00:34:17.085>uh, <00:34:17.285>prompt

632
00:34:20.465 --> 00:34:23.805
<00:34:20.465>or, <00:34:20.620>uh, <00:34:20.776>some <00:34:20.931>simple <00:34:21.087>snippet <00:34:21.242>of <00:34:21.398>code <00:34:21.553>if <00:34:21.709>you <00:34:21.865>need

633
00:34:23.805 --> 00:34:25.925
<00:34:23.804>to <00:34:24.038>do <00:34:24.271>something <00:34:24.504>with, <00:34:24.738>uh, <00:34:24.971>completion, <00:34:25.205>some,

634
00:34:25.925 --> 00:34:27.605
<00:34:25.925>some <00:34:26.205>simple <00:34:26.485>string <00:34:26.765>operations, <00:34:27.045>for <00:34:27.325>example.

635
00:34:27.865 --> 00:34:30.725
<00:34:27.864>And <00:34:28.040>then, <00:34:28.214>yeah, <00:34:28.389>you <00:34:28.564>can <00:34:28.739>literally <00:34:28.915>combine <00:34:29.089>this, <00:34:29.264>uh,

636
00:34:30.975 --> 00:34:34.805
<00:34:30.975>nodes <00:34:31.150>into <00:34:31.324>graph <00:34:31.500>or <00:34:31.674>flow <00:34:31.850>in <00:34:32.025>this, <00:34:32.199>uh, <00:34:32.375>terminology.

637
00:34:35.425 --> 00:34:37.965
<00:34:35.425>Uh, <00:34:35.625>it <00:34:35.825>also <00:34:36.025>gives <00:34:36.225>you <00:34:36.425>super <00:34:36.625>handy <00:34:36.825>way

638
00:34:37.965 --> 00:34:39.445
<00:34:37.965>to <00:34:38.409>manage <00:34:38.853>your <00:34:39.297>connections.

639
00:34:39.525 --> 00:34:43.085
<00:34:39.525>I <00:34:39.641>mean, <00:34:39.758>you <00:34:39.875>don't <00:34:39.991>need <00:34:40.108>to <00:34:40.225>think, <00:34:40.341>okay, <00:34:40.458>where <00:34:40.575>do <00:34:40.691>I <00:34:40.808>store, <00:34:40.925>uh,

640
00:34:43.555 --> 00:34:44.965
<00:34:43.554>credentials <00:34:44.824>secrets?

641
00:34:45.065 --> 00:34:46.845
<00:34:45.065>How <00:34:45.298>do <00:34:45.531>I <00:34:45.764>change <00:34:45.998>them <00:34:46.231>if <00:34:46.465>needed?

642
00:34:47.145 --> 00:34:49.485
<00:34:47.145>Um, <00:34:47.344>again, <00:34:47.545>you <00:34:47.745>have <00:34:47.945>either <00:34:48.145>code <00:34:48.344>first <00:34:48.545>approach

643
00:34:49.665 --> 00:34:51.485
<00:34:49.665>or <00:34:49.945>this <00:34:50.225>super <00:34:50.505>simple <00:34:50.784>visual <00:34:51.065>one

644
00:34:51.535 --> 00:34:53.405
<00:34:51.534>where <00:34:51.768>you <00:34:52.001>just <00:34:52.234>literally <00:34:52.468>pick <00:34:52.701>from <00:34:52.935>a

645
00:34:53.405 --> 00:34:55.005
<00:34:53.405>available <00:34:53.871>set <00:34:54.338>of <00:34:54.805>connections.

646
00:34:55.545 --> 00:34:58.365
<00:34:55.545>Uh, <00:34:55.745>and, <00:34:55.945>uh, <00:34:56.145>last, <00:34:56.345>uh, <00:34:56.545>feature <00:34:56.745>I <00:34:56.945>want

647
00:34:58.365 --> 00:35:02.925
<00:34:58.365>to <00:34:58.520>highlight <00:34:58.676>from <00:34:58.831>pro <00:34:58.987>Flow <00:34:59.142>is, <00:34:59.298>uh, <00:34:59.453>very, <00:34:59.609>uh, <00:34:59.765>handy

648
00:35:03.145 --> 00:35:05.325
<00:35:03.145>and <00:35:03.378>again, <00:35:03.611>very <00:35:03.845>visual <00:35:04.078>way <00:35:04.311>for <00:35:04.545>you

649
00:35:05.345 --> 00:35:08.125
<00:35:05.345>to <00:35:05.625>keep <00:35:05.904>multiple <00:35:06.185>variants <00:35:06.464>of <00:35:06.745>prompts.

650
00:35:08.545 --> 00:35:11.845
<00:35:08.545>Why, <00:35:08.825>uh, <00:35:09.105>well, <00:35:09.385>uh, <00:35:09.665>for <00:35:09.945>evaluation,

651
00:35:11.845 --> 00:35:14.125
<00:35:11.845>which <00:35:12.194>prompts <00:35:12.544>works <00:35:12.895>better, <00:35:13.245>right?

652
00:35:14.145 --> 00:35:17.285
<00:35:14.145>So, <00:35:14.261>and <00:35:14.378>you <00:35:14.495>can <00:35:14.611>keep <00:35:14.728>something <00:35:14.845>as <00:35:14.961>a <00:35:15.078>kind <00:35:15.195>of, <00:35:15.311>uh, <00:35:15.428>backup <00:35:15.545>to,

653
00:35:17.305 --> 00:35:19.845
<00:35:17.305>to <00:35:17.480>try <00:35:17.654>this <00:35:17.830>for <00:35:18.004>with, <00:35:18.180>for <00:35:18.355>example, <00:35:18.529>next <00:35:18.705>generation

654
00:35:19.865 --> 00:35:20.965
<00:35:19.865>of, <00:35:20.194>of <00:35:20.525>the <00:35:20.855>models.

655
00:35:21.185 --> 00:35:26.045
<00:35:21.185>So <00:35:21.325>yeah, <00:35:21.465>for <00:35:21.605>every <00:35:21.745>node <00:35:21.884>you <00:35:22.025>can <00:35:22.165>have <00:35:22.305>multiple, <00:35:22.445>um, <00:35:22.585>variance

656
00:35:26.265 --> 00:35:29.085
<00:35:26.265>of, <00:35:26.420>uh, <00:35:26.576>prompt <00:35:26.731>you <00:35:26.887>can <00:35:27.042>you <00:35:27.198>want <00:35:27.353>to <00:35:27.509>use <00:35:27.665>here.

657
00:35:29.425 --> 00:35:33.285
<00:35:29.425>Um, <00:35:29.580>and <00:35:29.736>yeah, <00:35:29.891>you <00:35:30.047>can <00:35:30.202>switch <00:35:30.358>just <00:35:30.513>immediately <00:35:30.669>between <00:35:30.825>them

658
00:35:33.385 --> 00:35:35.085
<00:35:33.385>and <00:35:33.735>also <00:35:34.085>in <00:35:34.435>automated <00:35:34.785>way.

659
00:35:35.625 --> 00:35:38.125
<00:35:35.625>Uh, <00:35:35.825>also, <00:35:36.025>if <00:35:36.225>we <00:35:36.425>talk <00:35:36.625>about <00:35:36.825>fine <00:35:37.025>tuning,

660
00:35:38.125 --> 00:35:41.645
<00:35:38.125>switching <00:35:38.280>gears <00:35:38.436>a <00:35:38.591>bit, <00:35:38.747>if, <00:35:38.902>uh, <00:35:39.058>rag <00:35:39.213>is <00:35:39.369>not <00:35:39.525>enough

661
00:35:41.745 --> 00:35:43.405
<00:35:41.745>for <00:35:42.025>your <00:35:42.305>scenario, <00:35:42.585>that <00:35:42.865>might <00:35:43.145>happen,

662
00:35:43.915 --> 00:35:46.245
<00:35:43.915>even <00:35:44.148>though <00:35:44.381>fine <00:35:44.615>tuning <00:35:44.848>is, <00:35:45.081>um, <00:35:45.315>maybe

663
00:35:46.995 --> 00:35:49.405
<00:35:46.995>much <00:35:47.345>more <00:35:47.694>niche <00:35:48.045>approach <00:35:48.395>to

664
00:35:49.965 --> 00:35:51.525
<00:35:49.965>building <00:35:50.245>your <00:35:50.525>AI <00:35:50.805>in <00:35:51.085>field <00:35:51.365>application.

665
00:35:51.665 --> 00:35:55.005
<00:35:51.665>It <00:35:51.820>still <00:35:51.976>exists <00:35:52.131>and <00:35:52.287>still <00:35:52.442>many, <00:35:52.598>many <00:35:52.753>customers <00:35:52.909>use <00:35:53.065>this.

666
00:35:55.465 --> 00:35:56.485
<00:35:55.465>Um, <00:35:55.924>and <00:35:56.383>yeah,

667
00:35:56.485 --> 00:36:01.125
<00:35:56.485>after <00:35:56.660>all, <00:35:56.835>this <00:35:57.010>is, <00:35:57.185>um, <00:35:57.360>about <00:35:57.535>injecting <00:35:57.710>your <00:35:57.885>data,

668
00:36:01.195 --> 00:36:03.605
<00:36:01.195>your <00:36:01.350>company <00:36:01.506>data, <00:36:01.661>not <00:36:01.817>as <00:36:01.972>a <00:36:02.128>part <00:36:02.283>of <00:36:02.439>the <00:36:02.595>prompt,

669
00:36:03.785 --> 00:36:06.525
<00:36:03.785>but, <00:36:03.912>uh, <00:36:04.039>just, <00:36:04.166>uh, <00:36:04.294>let's <00:36:04.421>say <00:36:04.548>as <00:36:04.675>a <00:36:04.803>part <00:36:04.930>of <00:36:05.057>the <00:36:05.185>model

670
00:36:06.535 --> 00:36:09.805
<00:36:06.535>where <00:36:06.734>you <00:36:06.935>update, <00:36:07.134>uh, <00:36:07.335>rates <00:36:07.535>and, <00:36:07.734>um, <00:36:07.935>biases.

671
00:36:10.225 --> 00:36:12.605
<00:36:10.225>Do, <00:36:10.458>uh, <00:36:10.691>have <00:36:10.924>some <00:36:11.158>tools <00:36:11.391>in, <00:36:11.625>um,

672
00:36:13.815 --> 00:36:15.565
<00:36:13.815>Azure <00:36:14.515>AI <00:36:15.215>Foundry.

673
00:36:15.825 --> 00:36:18.245
<00:36:15.825>Yes, <00:36:16.058>you <00:36:16.291>are. <00:36:16.524>And, <00:36:16.758>uh, <00:36:16.991>oh, <00:36:17.225>sorry,

674
00:36:18.265 --> 00:36:19.325
<00:36:18.265>let <00:36:18.424>me <00:36:18.582>go <00:36:18.741>back <00:36:18.901>for <00:36:19.060>a <00:36:19.219>second.

675
00:36:19.325 --> 00:36:23.205
<00:36:19.325>This, <00:36:19.500>there <00:36:19.674>is <00:36:19.850>a <00:36:20.024>short <00:36:20.200>video <00:36:20.375>that, <00:36:20.549>uh, <00:36:20.725>demonstrates

676
00:36:24.065 --> 00:36:27.085
<00:36:24.065>how <00:36:24.265>you <00:36:24.465>can, <00:36:24.665>again, <00:36:24.865>first <00:36:25.065>of <00:36:25.265>all, <00:36:25.465>visualize

677
00:36:27.145 --> 00:36:31.165
<00:36:27.145>and <00:36:27.320>then <00:36:27.495>automate <00:36:27.670>this, <00:36:27.845>uh, <00:36:28.020>in <00:36:28.195>big <00:36:28.370>picture, <00:36:28.545>not,

678
00:36:31.305 --> 00:36:34.845
<00:36:31.305>not <00:36:31.460>very <00:36:31.616>trivial <00:36:31.771>process <00:36:31.927>of <00:36:32.082>fine <00:36:32.238>tuning <00:36:32.393>of <00:36:32.549>the <00:36:32.705>model.

679
00:36:34.995 --> 00:36:36.445
<00:36:34.995>Here, <00:36:35.256>you <00:36:35.517>can <00:36:35.778>achieve <00:36:36.039>this, <00:36:36.300>uh,

680
00:36:36.665 --> 00:36:38.685
<00:36:36.665>in <00:36:36.898>a <00:36:37.131>just <00:36:37.365>a <00:36:37.598>couple <00:36:37.831>of <00:36:38.065>colleagues.

681
00:36:38.905 --> 00:36:41.885
<00:36:38.905>Uh, <00:36:39.021>and <00:36:39.138>yeah, <00:36:39.255>then <00:36:39.371>you <00:36:39.488>of <00:36:39.605>course, <00:36:39.721>you <00:36:39.838>need <00:36:39.955>to <00:36:40.071>wait <00:36:40.188>some <00:36:40.305>time

682
00:36:41.885 --> 00:36:42.965
<00:36:41.885>because, <00:36:42.128>uh, <00:36:42.371>in <00:36:42.614>many <00:36:42.857>cases,

683
00:36:43.075 --> 00:36:45.205
<00:36:43.075>fine <00:36:43.355>tuning <00:36:43.634>is <00:36:43.915>not <00:36:44.194>that <00:36:44.475>immediate.

684
00:36:45.305 --> 00:36:48.565
<00:36:45.305>But <00:36:45.504>again, <00:36:45.705>it's <00:36:45.904>all <00:36:46.105>about <00:36:46.305>flows <00:36:46.504>and <00:36:46.705>pipelines.

685
00:36:48.625 --> 00:36:52.445
<00:36:48.625>You <00:36:48.780>are <00:36:48.936>fully <00:36:49.091>covered <00:36:49.247>using, <00:36:49.402>uh, <00:36:49.558>Azure <00:36:49.713>AI <00:36:49.869>found, <00:36:50.025>and

686
00:36:52.445 --> 00:36:57.245
<00:36:52.445>after <00:36:52.620>all, <00:36:52.795>when <00:36:52.970>time <00:36:53.145>comes <00:36:53.320>to <00:36:53.495>really <00:36:53.670>operationalize <00:36:53.845>things,

687
00:36:57.385 --> 00:36:59.845
<00:36:57.385>uh, <00:36:57.665>to <00:36:57.945>deploy <00:36:58.225>and, <00:36:58.505>uh, <00:36:58.785>monitor

688
00:37:00.345 --> 00:37:02.885
<00:37:00.345>and <00:37:00.578>make <00:37:00.811>sure <00:37:01.044>that <00:37:01.278>it <00:37:01.511>all <00:37:01.745>safe

689
00:37:03.105 --> 00:37:06.965
<00:37:03.105>and <00:37:03.305>secure, <00:37:03.505>yeah, <00:37:03.705>uh, <00:37:03.905>you <00:37:04.105>can <00:37:04.305>just <00:37:04.505>go

690
00:37:07.185 --> 00:37:10.245
<00:37:07.185>and <00:37:07.535>deploy <00:37:07.884>this <00:37:08.235>LLM <00:37:08.585>flow

691
00:37:10.275 --> 00:37:12.525
<00:37:10.275>that <00:37:10.555>you <00:37:10.835>created <00:37:11.115>using <00:37:11.395>prompt <00:37:11.675>flow.

692
00:37:12.745 --> 00:37:14.845
<00:37:12.745>And <00:37:12.900>maybe <00:37:13.056>this <00:37:13.211>is, <00:37:13.367>uh, <00:37:13.522>one <00:37:13.678>of <00:37:13.833>the <00:37:13.989>most, <00:37:14.145>uh,

693
00:37:14.915 --> 00:37:16.685
<00:37:14.915>cost <00:37:15.265>efficient <00:37:15.615>options <00:37:15.965>for <00:37:16.315>you.

694
00:37:16.705 --> 00:37:19.205
<00:37:16.705>So <00:37:16.880>you <00:37:17.055>don't <00:37:17.230>have <00:37:17.404>to <00:37:17.580>care <00:37:17.755>about, <00:37:17.930>uh, <00:37:18.105>infrastructure.

695
00:37:19.305 --> 00:37:21.885
<00:37:19.305>You <00:37:19.444>don't <00:37:19.585>have <00:37:19.725>to <00:37:19.865>care <00:37:20.004>about, <00:37:20.145>um, <00:37:20.285>even <00:37:20.424>like, <00:37:20.565>um, <00:37:20.705>uh,

696
00:37:22.245 --> 00:37:24.925
<00:37:22.245>platform <00:37:22.444>since <00:37:22.645>you <00:37:22.845>just, <00:37:23.045>uh, <00:37:23.245>operate <00:37:23.444>this <00:37:23.645>flow

697
00:37:25.345 --> 00:37:27.725
<00:37:25.345>and, <00:37:25.694>uh, <00:37:26.044>it <00:37:26.395>can, <00:37:26.745>uh,

698
00:37:28.035 --> 00:37:31.925
<00:37:28.035>autoscale <00:37:28.234>you <00:37:28.435>have <00:37:28.634>full <00:37:28.835>control <00:37:29.035>over <00:37:29.234>costs, <00:37:29.435>uh,

699
00:37:32.145 --> 00:37:33.285
<00:37:32.145>of <00:37:32.658>this <00:37:33.171>endpoint.

700
00:37:33.385 --> 00:37:37.445
<00:37:33.385>And <00:37:33.540>yeah, <00:37:33.696>it <00:37:33.851>gives <00:37:34.007>you <00:37:34.162>way <00:37:34.318>to <00:37:34.473>streamline <00:37:34.629>your <00:37:34.785>development

701
00:37:37.545 --> 00:37:39.245
<00:37:37.545>and <00:37:38.245>enhance <00:37:38.945>operations.

702
00:37:39.665 --> 00:37:43.405
<00:37:39.665>And, <00:37:39.840>um, <00:37:40.015>what's <00:37:40.190>really <00:37:40.365>cool <00:37:40.540>at <00:37:40.715>it's <00:37:40.890>your <00:37:41.065>choice,

703
00:37:43.585 --> 00:37:48.165
<00:37:43.585>how <00:37:43.740>you <00:37:43.896>exactly <00:37:44.051>build <00:37:44.207>your <00:37:44.362>flow <00:37:44.518>in, <00:37:44.673>uh, <00:37:44.829>prompt <00:37:44.985>flow.

704
00:37:48.385 --> 00:37:52.805
<00:37:48.385>You <00:37:48.525>can <00:37:48.665>either, <00:37:48.805>either <00:37:48.945>have <00:37:49.085>it, <00:37:49.225>uh, <00:37:49.365>fully <00:37:49.505>in <00:37:49.645>the <00:37:49.785>cloud,

705
00:37:52.935 --> 00:37:55.125
<00:37:52.935>cloud <00:37:53.168>first <00:37:53.401>and <00:37:53.634>cloud <00:37:53.868>only, <00:37:54.101>I'd <00:37:54.335>say,

706
00:37:55.185 --> 00:37:58.565
<00:37:55.185>or <00:37:55.340>you <00:37:55.496>can <00:37:55.651>start <00:37:55.807>developing <00:37:55.962>this <00:37:56.118>in <00:37:56.273>your <00:37:56.429>local <00:37:56.585>machine

707
00:37:58.625 --> 00:37:59.965
<00:37:58.625>and <00:37:59.027>start <00:37:59.429>evaluating <00:37:59.831>this

708
00:37:59.965 --> 00:38:01.445
<00:37:59.965>and <00:38:00.187>testing <00:38:00.409>this <00:38:00.631>on <00:38:00.853>your <00:38:01.075>local <00:38:01.297>machine.

709
00:38:01.785 --> 00:38:06.165
<00:38:01.785>And <00:38:01.924>then <00:38:02.065>you <00:38:02.205>have <00:38:02.345>all <00:38:02.484>needed <00:38:02.625>tools <00:38:02.765>to, <00:38:02.904>uh, <00:38:03.045>transit, <00:38:03.185>uh,

710
00:38:06.655 --> 00:38:08.805
<00:38:06.655>local <00:38:07.121>cloud, <00:38:07.588>cloud <00:38:08.055>local.

711
00:38:09.225 --> 00:38:11.165
<00:38:09.225>And <00:38:09.505>yet <00:38:09.785>it's, <00:38:10.065>uh, <00:38:10.345>all <00:38:10.625>automated.

712
00:38:11.265 --> 00:38:14.405
<00:38:11.265>And <00:38:11.464>it <00:38:11.665>also, <00:38:11.865>uh, <00:38:12.065>has <00:38:12.265>connections <00:38:12.464>with, <00:38:12.665>uh,

713
00:38:14.405 --> 00:38:17.925
<00:38:14.405>the <00:38:14.580>most <00:38:14.755>popular <00:38:14.930>frameworks, <00:38:15.105>uh, <00:38:15.280>from, <00:38:15.455>uh, <00:38:15.630>from, <00:38:15.805>uh,

714
00:38:17.925 --> 00:38:20.765
<00:38:17.925>generative <00:38:18.125>ai <00:38:18.325>from <00:38:18.525>LM <00:38:18.725>Field, <00:38:18.925>like <00:38:19.125>link <00:38:19.325>chain,

715
00:38:21.015 --> 00:38:22.605
<00:38:21.015>multi <00:38:21.481>kernel <00:38:21.948>auto <00:38:22.415>gen.

716
00:38:22.985 --> 00:38:25.645
<00:38:22.985>And <00:38:23.185>of <00:38:23.385>course, <00:38:23.585>since <00:38:23.785>it <00:38:23.985>code <00:38:24.185>first <00:38:24.385>approach,

717
00:38:25.945 --> 00:38:28.805
<00:38:25.945>as <00:38:26.120>I <00:38:26.295>already <00:38:26.470>mentioned, <00:38:26.645>it's <00:38:26.820>100% <00:38:26.995>friendly <00:38:27.170>for, <00:38:27.345>uh,

718
00:38:28.985 --> 00:38:31.845
<00:38:28.985>all <00:38:29.160>kinds <00:38:29.335>of, <00:38:29.510>um, <00:38:29.685>automation, <00:38:29.860>all <00:38:30.035>kinds <00:38:30.210>of, <00:38:30.385>uh,

719
00:38:31.845 --> 00:38:33.645
<00:38:31.845>development <00:38:32.125>scripts, <00:38:32.404>et <00:38:32.685>cetera, <00:38:32.964>et <00:38:33.245>cetera.

720
00:38:34.025 --> 00:38:37.045
<00:38:34.025>Um, <00:38:34.225>yeah, <00:38:34.425>so <00:38:34.625>you <00:38:34.825>have <00:38:35.025>full <00:38:35.225>control <00:38:35.425>here.

721
00:38:37.145 --> 00:38:41.605
<00:38:37.145>And, <00:38:37.285>um, <00:38:37.425>like <00:38:37.565>no <00:38:37.705>pressure <00:38:37.845>cloud <00:38:37.985>only, <00:38:38.125>uh, <00:38:38.265>local <00:38:38.405>plus <00:38:38.545>cloud,

722
00:38:41.825 --> 00:38:43.845
<00:38:41.825>you <00:38:42.058>decide <00:38:42.291>for <00:38:42.524>specifically <00:38:42.758>for <00:38:42.991>your <00:38:43.225>project.

723
00:38:44.585 --> 00:38:48.885
<00:38:44.585>If <00:38:44.712>we <00:38:44.839>talk <00:38:44.966>about <00:38:45.094>content <00:38:45.221>safety, <00:38:45.348>if, <00:38:45.475>uh, <00:38:45.603>we <00:38:45.730>talk <00:38:45.857>about <00:38:45.985>how

724
00:38:48.885 --> 00:38:52.805
<00:38:48.885>to <00:38:49.085>make <00:38:49.285>sure <00:38:49.485>that, <00:38:49.685>uh, <00:38:49.885>completions <00:38:50.085>are, <00:38:50.285>uh,

725
00:38:53.465 --> 00:38:56.405
<00:38:53.465>giving <00:38:53.745>us, <00:38:54.025>uh, <00:38:54.305>let's <00:38:54.585>say <00:38:54.865>safe

726
00:38:56.705 --> 00:39:00.085
<00:38:56.705>and, <00:38:56.985>uh, <00:38:57.265>responsible <00:38:57.545>answers, <00:38:57.825>we <00:38:58.105>have

727
00:39:00.085 --> 00:39:02.005
<00:39:00.085>what <00:39:00.318>we <00:39:00.551>call <00:39:00.785>Azure <00:39:01.018>AI <00:39:01.251>content <00:39:01.485>safety.

728
00:39:02.155 --> 00:39:05.605
<00:39:02.155>This <00:39:02.435>is <00:39:02.715>set <00:39:02.995>of, <00:39:03.275>uh, <00:39:03.555>filters.

729
00:39:05.825 --> 00:39:09.445
<00:39:05.825>You <00:39:06.000>can <00:39:06.174>fine <00:39:06.350>tune <00:39:06.524>depending <00:39:06.700>on, <00:39:06.875>again, <00:39:07.049>your <00:39:07.225>project.

730
00:39:09.705 --> 00:39:11.765
<00:39:09.705>So <00:39:09.938>you <00:39:10.171>can <00:39:10.404>be <00:39:10.638>like <00:39:10.871>very <00:39:11.105>restrictive.

731
00:39:12.065 --> 00:39:14.005
<00:39:12.065>You <00:39:12.415>can <00:39:12.765>be <00:39:13.115>somehow <00:39:13.465>moderate.

732
00:39:14.505 --> 00:39:19.125
<00:39:14.505>You <00:39:14.680>decide <00:39:14.855>and <00:39:15.030>you <00:39:15.205>identify <00:39:15.380>this, <00:39:15.555>uh, <00:39:15.730>harm <00:39:15.905>filter

733
00:39:19.505 --> 00:39:23.405
<00:39:19.505>to, <00:39:19.680>uh, <00:39:19.855>monitor <00:39:20.030>inappropriate, <00:39:20.205>uh, <00:39:20.380>responses, <00:39:20.555>uh, <00:39:20.730>that, <00:39:20.905>uh,

734
00:39:23.695 --> 00:39:26.285
<00:39:23.695>might <00:39:23.975>not <00:39:24.255>exactly <00:39:24.535>like <00:39:24.815>follow <00:39:25.095>what,

735
00:39:26.305 --> 00:39:27.685
<00:39:26.305>what's <00:39:26.615>needed <00:39:26.926>for <00:39:27.236>your <00:39:27.547>project.

736
00:39:27.855 --> 00:39:31.645
<00:39:27.855>Again, <00:39:28.030>it's <00:39:28.205>a <00:39:28.380>very <00:39:28.555>simple <00:39:28.730>visual <00:39:28.905>way <00:39:29.080>for <00:39:29.255>you

737
00:39:31.645 --> 00:39:33.085
<00:39:31.645>to <00:39:32.077>set <00:39:32.509>things <00:39:32.941>up.

738
00:39:33.745 --> 00:39:37.165
<00:39:33.745>And, <00:39:33.900>uh, <00:39:34.056>last <00:39:34.211>but <00:39:34.367>not <00:39:34.522>least, <00:39:34.678>how <00:39:34.833>you <00:39:34.989>monitor <00:39:35.145>everything,

739
00:39:37.185 --> 00:39:41.365
<00:39:37.185>how <00:39:37.360>you <00:39:37.535>monitor, <00:39:37.710>uh, <00:39:37.884>your, <00:39:38.060>um, <00:39:38.235>your <00:39:38.410>deployed <00:39:38.585>application.

740
00:39:41.555 --> 00:39:43.605
<00:39:41.555>Yeah, <00:39:41.904>all <00:39:42.254>tools <00:39:42.605>are, <00:39:42.955>uh,

741
00:39:44.085 --> 00:39:46.045
<00:39:44.085>existing <00:39:44.318>in <00:39:44.551>Azure <00:39:44.785>AI <00:39:45.018>Foundry <00:39:45.251>for <00:39:45.485>you.

742
00:39:46.105 --> 00:39:49.765
<00:39:46.105>So <00:39:46.260>yeah, <00:39:46.416>you <00:39:46.571>have <00:39:46.727>full <00:39:46.882>control <00:39:47.038>over <00:39:47.193>its <00:39:47.349>performance, <00:39:47.505>like,

743
00:39:49.945 --> 00:39:51.765
<00:39:49.945>uh, <00:39:50.645>speed <00:39:51.345>throughput.

744
00:39:51.785 --> 00:39:53.605
<00:39:51.785>You <00:39:52.065>have <00:39:52.345>full <00:39:52.625>control <00:39:52.904>over <00:39:53.185>cost,

745
00:39:53.905 --> 00:39:57.645
<00:39:53.905>and <00:39:54.045>you <00:39:54.185>take, <00:39:54.325>uh, <00:39:54.465>you <00:39:54.605>can <00:39:54.745>take <00:39:54.885>informed <00:39:55.025>decision <00:39:55.165>on <00:39:55.305>what

746
00:39:57.645 --> 00:39:59.805
<00:39:57.645>to <00:39:57.845>do <00:39:58.045>next <00:39:58.245>just <00:39:58.445>based <00:39:58.645>on <00:39:58.845>these <00:39:59.045>monitors.

747
00:39:59.805 --> 00:40:01.525
<00:39:59.805>And <00:40:00.038>of <00:40:00.271>course, <00:40:00.504>you <00:40:00.738>can <00:40:00.971>automate <00:40:01.205>this

748
00:40:01.525 --> 00:40:02.925
<00:40:01.525>and, <00:40:01.735>uh, <00:40:01.945>build <00:40:02.155>kind <00:40:02.365>of <00:40:02.575>this, <00:40:02.785>uh,

749
00:40:03.205 --> 00:40:04.805
<00:40:03.205>feedback <00:40:03.555>loop <00:40:03.904>if, <00:40:04.255>if <00:40:04.605>needed.

750
00:40:05.945 --> 00:40:10.815
<00:40:05.945>Two, <00:40:06.120>sum <00:40:06.295>up <00:40:06.470>how <00:40:06.645>to <00:40:06.820>mature <00:40:06.995>your <00:40:07.170>LLM <00:40:07.345>ops

751
00:40:10.955 --> 00:40:12.055
<00:40:10.955>to <00:40:11.944>accelerate

752
00:40:12.115 --> 00:40:15.295
<00:40:12.115>or <00:40:12.314>start <00:40:12.515>your <00:40:12.714>adoption <00:40:12.915>of <00:40:13.115>generative <00:40:13.314>AI <00:40:13.515>features.

753
00:40:15.715 --> 00:40:18.375
<00:40:15.715>It <00:40:15.890>all <00:40:16.065>starts <00:40:16.240>with <00:40:16.415>assessment. <00:40:16.590>Where <00:40:16.765>are <00:40:16.940>you <00:40:17.115>now?

754
00:40:18.475 --> 00:40:20.735
<00:40:18.475>And <00:40:18.615>on <00:40:18.755>the <00:40:18.895>next <00:40:19.035>slide, <00:40:19.174>I'll <00:40:19.315>tell <00:40:19.455>you <00:40:19.595>how <00:40:19.735>to <00:40:19.875>start.

755
00:40:20.855 --> 00:40:24.855
<00:40:20.855>I, <00:40:21.010>I <00:40:21.166>promised, <00:40:21.321>uh, <00:40:21.477>then, <00:40:21.632>um, <00:40:21.788>look <00:40:21.943>at <00:40:22.099>this, <00:40:22.255>uh,

756
00:40:25.205 --> 00:40:27.015
<00:40:25.205>life <00:40:25.671>cycles <00:40:26.138>of <00:40:26.605>LLMs.

757
00:40:27.015 --> 00:40:29.575
<00:40:27.015>You <00:40:27.248>remember <00:40:27.481>these, <00:40:27.714>uh, <00:40:27.948>three <00:40:28.181>internal <00:40:28.415>ones

758
00:40:29.715 --> 00:40:33.575
<00:40:29.715>and, <00:40:29.855>uh, <00:40:29.995>one <00:40:30.135>external, <00:40:30.275>and <00:40:30.415>of <00:40:30.555>course, <00:40:30.695>pick <00:40:30.835>the <00:40:30.975>right <00:40:31.115>tools.

759
00:40:33.945 --> 00:40:36.695
<00:40:33.945>Azure <00:40:34.120>AI <00:40:34.295>Foundry <00:40:34.470>could <00:40:34.645>be <00:40:34.820>natural <00:40:34.995>solutions <00:40:35.170>for <00:40:35.345>you

760
00:40:36.715 --> 00:40:40.215
<00:40:36.715>to <00:40:36.915>start <00:40:37.115>your <00:40:37.315>LLM <00:40:37.515>journey, <00:40:37.715>LLM <00:40:37.915>ops <00:40:38.115>journey.

761
00:40:40.755 --> 00:40:42.175
<00:40:40.755>And <00:40:41.074>this <00:40:41.394>is <00:40:41.713>my <00:40:42.033>slide.

762
00:40:42.595 --> 00:40:45.575
<00:40:42.595>And, <00:40:42.750>uh, <00:40:42.906>it, <00:40:43.061>it <00:40:43.217>has <00:40:43.372>very <00:40:43.528>simple <00:40:43.683>call <00:40:43.839>to <00:40:43.995>action.

763
00:40:45.805 --> 00:40:48.615
<00:40:45.805>Connect <00:40:45.980>with <00:40:46.154>me <00:40:46.330>on <00:40:46.504>LinkedIn. <00:40:46.680>This <00:40:46.855>is <00:40:47.029>QR <00:40:47.205>code.

764
00:40:48.725 --> 00:40:49.735
<00:40:48.725>Just, <00:40:49.028>uh, <00:40:49.331>scan <00:40:49.634>it.

765
00:40:49.735 --> 00:40:51.775
<00:40:49.735>You'll <00:40:49.935>get <00:40:50.135>straight <00:40:50.335>to <00:40:50.535>my <00:40:50.735>profile <00:40:50.935>on <00:40:51.135>LinkedIn.

766
00:40:51.965 --> 00:40:53.135
<00:40:51.965>Send <00:40:52.491>connection <00:40:53.018>request.

767
00:40:53.205 --> 00:40:55.775
<00:40:53.205>It's <00:40:53.380>my <00:40:53.555>great <00:40:53.730>pleasure <00:40:53.904>to <00:40:54.080>accept <00:40:54.255>all <00:40:54.430>incoming <00:40:54.605>connections

768
00:40:55.775 --> 00:40:57.615
<00:40:55.775>from, <00:40:56.125>uh, <00:40:56.475>from <00:40:56.825>this <00:40:57.175>event.

769
00:40:57.715 --> 00:41:02.055
<00:40:57.715>And <00:40:57.870>ask <00:40:58.026>me <00:40:58.181>any <00:40:58.337>question <00:40:58.492>about, <00:40:58.648>uh, <00:40:58.803>LMS <00:40:58.959>generative <00:40:59.115>AI

770
00:41:02.755 --> 00:41:04.895
<00:41:02.755>web <00:41:03.221>development, <00:41:03.688>prompt <00:41:04.155>engineering.

771
00:41:05.215 --> 00:41:07.135
<00:41:05.215>I <00:41:05.390>appreciate <00:41:05.565>if <00:41:05.740>you <00:41:05.915>ask <00:41:06.090>me <00:41:06.265>about <00:41:06.440>prompt <00:41:06.615>engineering.

772
00:41:07.595 --> 00:41:10.935
<00:41:07.595>And, <00:41:07.750>uh, <00:41:07.906>in <00:41:08.061>return, <00:41:08.217>I <00:41:08.372>will <00:41:08.528>send <00:41:08.683>you <00:41:08.839>the <00:41:08.995>link

773
00:41:11.185 --> 00:41:15.775
<00:41:11.185>where <00:41:11.340>you <00:41:11.496>can <00:41:11.651>identify <00:41:11.807>your <00:41:11.962>current <00:41:12.118>stage <00:41:12.273>in <00:41:12.429>your <00:41:12.585>L

774
00:41:15.995 --> 00:41:17.775
<00:41:15.995>lms, <00:41:16.345>uh, <00:41:16.694>LLM <00:41:17.045>ops <00:41:17.395>journey.

775
00:41:17.795 --> 00:41:20.335
<00:41:17.795>So <00:41:17.995>this <00:41:18.195>is, <00:41:18.395>again, <00:41:18.595>five <00:41:18.795>minutes <00:41:18.995>long <00:41:19.195>assessment

776
00:41:20.425 --> 00:41:24.615
<00:41:20.425>where <00:41:20.580>you <00:41:20.736>answer <00:41:20.891>some <00:41:21.047>question, <00:41:21.202>you <00:41:21.358>get <00:41:21.513>your <00:41:21.669>current <00:41:21.825>status,

777
00:41:25.115 --> 00:41:27.295
<00:41:25.115>not <00:41:25.314>on, <00:41:25.515>and <00:41:25.714>not <00:41:25.915>only, <00:41:26.115>and <00:41:26.314>next, <00:41:26.515>uh,

778
00:41:27.295 --> 00:41:29.655
<00:41:27.295>and <00:41:27.528>recommendations <00:41:27.761>on <00:41:27.995>how <00:41:28.228>to <00:41:28.461>move <00:41:28.695>next.

779
00:41:30.795 --> 00:41:31.975
<00:41:30.795>That's <00:41:31.060>it <00:41:31.326>from <00:41:31.591>my <00:41:31.857>side.

780
00:41:32.155 --> 00:41:34.535
<00:41:32.155>Uh, <00:41:32.330>great <00:41:32.505>pleasure <00:41:32.680>to <00:41:32.855>present, <00:41:33.030>uh, <00:41:33.205>at <00:41:33.380>this <00:41:33.555>event.

781
00:41:34.555 --> 00:41:36.615
<00:41:34.555>And <00:41:34.730>let's <00:41:34.904>see <00:41:35.080>if <00:41:35.254>we <00:41:35.430>have, <00:41:35.605>uh, <00:41:35.779>any <00:41:35.955>questions.

782
00:41:36.835 --> 00:41:40.135
<00:41:36.835>And <00:41:36.975>always, <00:41:37.115>uh, <00:41:37.255>if, <00:41:37.395>if, <00:41:37.535>if <00:41:37.675>you <00:41:37.815>don't <00:41:37.955>have <00:41:38.095>questions <00:41:38.235>now,

783
00:41:40.625 --> 00:41:44.775
<00:41:40.625>maybe <00:41:40.780>you'll <00:41:40.936>have <00:41:41.091>them, <00:41:41.247>um, <00:41:41.402>tomorrow <00:41:41.558>ping <00:41:41.713>me <00:41:41.869>on <00:41:42.025>LinkedIn.

784
00:41:44.775 --> 00:41:45.055
<00:41:44.775>Thank <00:41:45.027>you.