WEBVTT

00:00:00.000 --> 00:00:01.870 align:start position:0%
<00:00:00.000>Thank <00:00:00.279>you <00:00:00.559>for <00:00:00.839>every <00:00:01.119>everybody <00:00:01.400>for

00:00:01.870 --> 00:00:01.880 align:start position:0%
<00:00:01.870>Thank <00:00:01.871>you <00:00:01.873>for <00:00:01.875>every <00:00:01.877>everybody <00:00:01.879>for

00:00:01.880 --> 00:00:03.190 align:start position:0%
<00:00:01.880>Thank <00:00:02.048>you <00:00:02.216>for <00:00:02.385>every <00:00:02.553>everybody <00:00:02.722>for <00:00:02.890>joining <00:00:03.059>us.

00:00:03.190 --> 00:00:03.200 align:start position:0%
<00:00:03.190>joining <00:00:03.199>us.

00:00:03.200 --> 00:00:04.870 align:start position:0%
<00:00:03.200>joining <00:00:03.900>us. <00:00:04.600>Which

00:00:04.870 --> 00:00:04.880 align:start position:0%
Which

00:00:04.880 --> 00:00:07.470 align:start position:0%
<00:00:04.880>Which <00:00:05.080>brings <00:00:05.280>me <00:00:05.479>to <00:00:05.680>I'm <00:00:05.880>Andrew, <00:00:06.080>the <00:00:06.279>moderator

00:00:07.470 --> 00:00:07.480 align:start position:0%
<00:00:07.470>brings <00:00:07.471>me <00:00:07.473>to <00:00:07.474>I'm <00:00:07.476>Andrew, <00:00:07.477>the <00:00:07.479>moderator

00:00:07.480 --> 00:00:08.990 align:start position:0%
<00:00:07.480>brings <00:00:07.631>me <00:00:07.782>to <00:00:07.933>I'm <00:00:08.084>Andrew, <00:00:08.235>the <00:00:08.386>moderator <00:00:08.537>for <00:00:08.688>this <00:00:08.839>afternoon,

00:00:08.990 --> 00:00:09.000 align:start position:0%
<00:00:08.990>for <00:00:08.994>this <00:00:08.999>afternoon,

00:00:09.000 --> 00:00:11.070 align:start position:0%
<00:00:09.000>for <00:00:09.200>this <00:00:09.400>afternoon, <00:00:09.600>introducing <00:00:09.800>our <00:00:10.000>next <00:00:10.200>speaker, <00:00:10.400>Victoria

00:00:11.070 --> 00:00:11.080 align:start position:0%
<00:00:11.070>introducing <00:00:11.072>our <00:00:11.074>next <00:00:11.076>speaker, <00:00:11.079>Victoria

00:00:11.080 --> 00:00:14.150 align:start position:0%
<00:00:11.080>introducing <00:00:11.196>our <00:00:11.313>next <00:00:11.430>speaker, <00:00:11.546>Victoria <00:00:11.663>Seaman. <00:00:11.780>So, <00:00:11.896>I <00:00:12.013>come <00:00:12.129>from <00:00:12.246>I <00:00:12.363>suppose <00:00:12.480>the

00:00:14.150 --> 00:00:14.160 align:start position:0%
<00:00:14.150>Seaman. <00:00:14.151>So, <00:00:14.152>I <00:00:14.153>come <00:00:14.155>from <00:00:14.156>I <00:00:14.157>suppose <00:00:14.159>the

00:00:14.160 --> 00:00:16.350 align:start position:0%
<00:00:14.160>Seaman. <00:00:14.260>So, <00:00:14.360>I <00:00:14.460>come <00:00:14.560>from <00:00:14.660>I <00:00:14.760>suppose <00:00:14.860>the <00:00:14.960>open <00:00:15.060>core <00:00:15.160>community. <00:00:15.260>I've <00:00:15.360>done <00:00:15.460>like <00:00:15.560>58

00:00:16.350 --> 00:00:16.360 align:start position:0%
<00:00:16.350>open <00:00:16.351>core <00:00:16.353>community. <00:00:16.354>I've <00:00:16.356>done <00:00:16.357>like <00:00:16.358>58

00:00:16.360 --> 00:00:18.190 align:start position:0%
<00:00:16.360>open <00:00:16.467>core <00:00:16.575>community. <00:00:16.683>I've <00:00:16.790>done <00:00:16.898>like <00:00:17.006>58 <00:00:17.113>commits <00:00:17.221>to <00:00:17.329>main <00:00:17.436>and <00:00:17.544>don't <00:00:17.652>hold <00:00:17.759>it

00:00:18.190 --> 00:00:18.200 align:start position:0%
<00:00:18.190>commits <00:00:18.191>to <00:00:18.193>main <00:00:18.194>and <00:00:18.196>don't <00:00:18.197>hold <00:00:18.198>it

00:00:18.200 --> 00:00:20.510 align:start position:0%
<00:00:18.200>commits <00:00:18.293>to <00:00:18.386>main <00:00:18.480>and <00:00:18.573>don't <00:00:18.666>hold <00:00:18.759>it <00:00:18.853>against <00:00:18.946>me, <00:00:19.040>but <00:00:19.133>I <00:00:19.226>took <00:00:19.320>a <00:00:19.413>brain <00:00:19.506>trust <00:00:19.599>of

00:00:20.510 --> 00:00:20.520 align:start position:0%
<00:00:20.510>against <00:00:20.511>me, <00:00:20.512>but <00:00:20.513>I <00:00:20.514>took <00:00:20.515>a <00:00:20.516>brain <00:00:20.517>trust <00:00:20.519>of

00:00:20.520 --> 00:00:22.870 align:start position:0%
<00:00:20.520>against <00:00:20.607>me, <00:00:20.695>but <00:00:20.782>I <00:00:20.870>took <00:00:20.957>a <00:00:21.044>brain <00:00:21.132>trust <00:00:21.220>of <00:00:21.307>the <00:00:21.395>best <00:00:21.482>minds <00:00:21.570>of <00:00:21.657>that <00:00:21.745>space <00:00:21.832>to <00:00:21.919>attempt

00:00:22.870 --> 00:00:22.880 align:start position:0%
<00:00:22.870>the <00:00:22.871>best <00:00:22.872>minds <00:00:22.873>of <00:00:22.875>that <00:00:22.876>space <00:00:22.877>to <00:00:22.878>attempt

00:00:22.880 --> 00:00:26.190 align:start position:0%
<00:00:22.880>the <00:00:22.967>best <00:00:23.055>minds <00:00:23.142>of <00:00:23.230>that <00:00:23.317>space <00:00:23.404>to <00:00:23.492>attempt <00:00:23.580>to <00:00:23.667>network <00:00:23.755>AI <00:00:23.842>and <00:00:23.930>I <00:00:24.017>did <00:00:24.105>that, <00:00:24.192>but <00:00:24.279>then

00:00:26.190 --> 00:00:26.200 align:start position:0%
<00:00:26.190>to <00:00:26.191>network <00:00:26.192>AI <00:00:26.193>and <00:00:26.194>I <00:00:26.195>did <00:00:26.196>that, <00:00:26.197>but <00:00:26.198>then

00:00:26.200 --> 00:00:28.350 align:start position:0%
<00:00:26.200>to <00:00:26.307>network <00:00:26.415>AI <00:00:26.523>and <00:00:26.630>I <00:00:26.738>did <00:00:26.846>that, <00:00:26.953>but <00:00:27.061>then <00:00:27.169>Databricks <00:00:27.276>open-sourced <00:00:27.384>it <00:00:27.492>and <00:00:27.599>Victoria

00:00:28.350 --> 00:00:28.360 align:start position:0%
<00:00:28.350>Databricks <00:00:28.352>open-sourced <00:00:28.354>it <00:00:28.356>and <00:00:28.359>Victoria

00:00:28.360 --> 00:00:29.750 align:start position:0%
<00:00:28.360>Databricks <00:00:28.456>open-sourced <00:00:28.552>it <00:00:28.648>and <00:00:28.744>Victoria <00:00:28.841>is <00:00:28.937>part <00:00:29.033>of <00:00:29.129>a <00:00:29.226>team <00:00:29.322>that's <00:00:29.418>sort <00:00:29.514>of <00:00:29.611>doing

00:00:29.750 --> 00:00:29.760 align:start position:0%
<00:00:29.750>is <00:00:29.751>part <00:00:29.752>of <00:00:29.753>a <00:00:29.754>team <00:00:29.755>that's <00:00:29.756>sort <00:00:29.757>of <00:00:29.759>doing

00:00:29.760 --> 00:00:32.429 align:start position:0%
<00:00:29.760>is <00:00:29.847>part <00:00:29.935>of <00:00:30.022>a <00:00:30.110>team <00:00:30.197>that's <00:00:30.285>sort <00:00:30.372>of <00:00:30.460>doing <00:00:30.547>some <00:00:30.635>amazing <00:00:30.722>work <00:00:30.810>and <00:00:30.897>so <00:00:30.985>I <00:00:31.072>classify <00:00:31.160>this

00:00:32.429 --> 00:00:32.439 align:start position:0%
<00:00:32.429>some <00:00:32.430>amazing <00:00:32.431>work <00:00:32.432>and <00:00:32.434>so <00:00:32.435>I <00:00:32.436>classify <00:00:32.438>this

00:00:32.439 --> 00:00:34.950 align:start position:0%
<00:00:32.439>some <00:00:32.526>amazing <00:00:32.613>work <00:00:32.701>and <00:00:32.789>so <00:00:32.876>I <00:00:32.964>classify <00:00:33.051>this <00:00:33.139>is <00:00:33.226>one <00:00:33.314>of <00:00:33.401>the <00:00:33.489>the <00:00:33.576>best <00:00:33.664>talks <00:00:33.751>of <00:00:33.839>this

00:00:34.950 --> 00:00:34.960 align:start position:0%
<00:00:34.950>is <00:00:34.951>one <00:00:34.952>of <00:00:34.953>the <00:00:34.954>the <00:00:34.955>best <00:00:34.956>talks <00:00:34.957>of <00:00:34.959>this

00:00:34.960 --> 00:00:37.590 align:start position:0%
<00:00:34.960>is <00:00:35.060>one <00:00:35.160>of <00:00:35.260>the <00:00:35.360>the <00:00:35.460>best <00:00:35.560>talks <00:00:35.660>of <00:00:35.760>this <00:00:35.860>entire <00:00:35.960>conference <00:00:36.060>because <00:00:36.160>of <00:00:36.260>what <00:00:36.360>she's

00:00:37.590 --> 00:00:37.600 align:start position:0%
<00:00:37.590>entire <00:00:37.591>conference <00:00:37.593>because <00:00:37.595>of <00:00:37.597>what <00:00:37.599>she's

00:00:37.600 --> 00:00:39.390 align:start position:0%
<00:00:37.600>entire <00:00:37.727>conference <00:00:37.854>because <00:00:37.981>of <00:00:38.109>what <00:00:38.236>she's <00:00:38.363>going <00:00:38.490>to <00:00:38.618>teach <00:00:38.745>you. <00:00:38.872>Particularly <00:00:39.000>cuz

00:00:39.390 --> 00:00:39.400 align:start position:0%
<00:00:39.390>going <00:00:39.391>to <00:00:39.393>teach <00:00:39.395>you. <00:00:39.397>Particularly <00:00:39.399>cuz

00:00:39.400 --> 00:00:40.950 align:start position:0%
<00:00:39.400>going <00:00:39.507>to <00:00:39.614>teach <00:00:39.721>you. <00:00:39.829>Particularly <00:00:39.936>cuz <00:00:40.043>she's <00:00:40.151>going <00:00:40.258>to <00:00:40.365>show <00:00:40.473>you <00:00:40.580>you <00:00:40.687>don't <00:00:40.795>need

00:00:40.950 --> 00:00:40.960 align:start position:0%
<00:00:40.950>she's <00:00:40.951>going <00:00:40.952>to <00:00:40.953>show <00:00:40.955>you <00:00:40.956>you <00:00:40.957>don't <00:00:40.959>need

00:00:40.960 --> 00:00:42.870 align:start position:0%
<00:00:40.960>she's <00:00:41.067>going <00:00:41.175>to <00:00:41.283>show <00:00:41.390>you <00:00:41.498>you <00:00:41.606>don't <00:00:41.713>need <00:00:41.821>the <00:00:41.929>biggest, <00:00:42.036>most <00:00:42.144>expensive <00:00:42.252>model <00:00:42.360>to

00:00:42.870 --> 00:00:42.880 align:start position:0%
<00:00:42.870>the <00:00:42.871>biggest, <00:00:42.873>most <00:00:42.875>expensive <00:00:42.877>model <00:00:42.879>to

00:00:42.880 --> 00:00:43.790 align:start position:0%
<00:00:42.880>the <00:00:43.016>biggest, <00:00:43.153>most <00:00:43.289>expensive <00:00:43.426>model <00:00:43.562>to <00:00:43.699>win,

00:00:43.790 --> 00:00:43.800 align:start position:0%
win,

00:00:43.800 --> 00:00:45.830 align:start position:0%
<00:00:43.800>win, <00:00:44.080>but <00:00:44.360>Victoria <00:00:44.640>Seaman's <00:00:44.919>a <00:00:45.199>principal

00:00:45.830 --> 00:00:45.840 align:start position:0%
<00:00:45.830>but <00:00:45.832>Victoria <00:00:45.834>Seaman's <00:00:45.836>a <00:00:45.839>principal

00:00:45.840 --> 00:00:47.190 align:start position:0%
<00:00:45.840>but <00:00:46.083>Victoria <00:00:46.326>Seaman's <00:00:46.569>a <00:00:46.812>principal <00:00:47.055>evangelist

00:00:47.190 --> 00:00:47.200 align:start position:0%
evangelist

00:00:47.200 --> 00:00:49.150 align:start position:0%
<00:00:47.200>evangelist <00:00:47.375>at <00:00:47.550>Databricks <00:00:47.725>and <00:00:47.900>one <00:00:48.075>of <00:00:48.250>her <00:00:48.425>first <00:00:48.600>moves

00:00:49.150 --> 00:00:49.160 align:start position:0%
<00:00:49.150>at <00:00:49.151>Databricks <00:00:49.152>and <00:00:49.153>one <00:00:49.155>of <00:00:49.156>her <00:00:49.157>first <00:00:49.159>moves

00:00:49.160 --> 00:00:51.430 align:start position:0%
<00:00:49.160>at <00:00:49.276>Databricks <00:00:49.393>and <00:00:49.510>one <00:00:49.626>of <00:00:49.743>her <00:00:49.860>first <00:00:49.976>moves <00:00:50.093>was <00:00:50.209>co-writing <00:00:50.326>a <00:00:50.443>briefing <00:00:50.559>telling

00:00:51.430 --> 00:00:51.440 align:start position:0%
<00:00:51.430>was <00:00:51.432>co-writing <00:00:51.434>a <00:00:51.436>briefing <00:00:51.439>telling

00:00:51.440 --> 00:00:53.710 align:start position:0%
<00:00:51.440>was <00:00:51.580>co-writing <00:00:51.720>a <00:00:51.860>briefing <00:00:52.000>telling <00:00:52.140>companies <00:00:52.280>to <00:00:52.419>stop <00:00:52.559>obsessing <00:00:52.699>over <00:00:52.839>token

00:00:53.710 --> 00:00:53.720 align:start position:0%
<00:00:53.710>companies <00:00:53.711>to <00:00:53.713>stop <00:00:53.715>obsessing <00:00:53.717>over <00:00:53.719>token

00:00:53.720 --> 00:00:56.870 align:start position:0%
<00:00:53.720>companies <00:00:53.847>to <00:00:53.974>stop <00:00:54.101>obsessing <00:00:54.229>over <00:00:54.356>token <00:00:54.483>counts <00:00:54.610>and <00:00:54.738>start <00:00:54.865>measuring <00:00:54.992>the <00:00:55.120>value

00:00:56.870 --> 00:00:56.880 align:start position:0%
<00:00:56.870>counts <00:00:56.871>and <00:00:56.873>start <00:00:56.875>measuring <00:00:56.877>the <00:00:56.879>value

00:00:56.880 --> 00:00:58.630 align:start position:0%
<00:00:56.880>counts <00:00:56.987>and <00:00:57.095>start <00:00:57.203>measuring <00:00:57.310>the <00:00:57.418>value <00:00:57.526>that <00:00:57.633>they <00:00:57.741>actually <00:00:57.849>get <00:00:57.956>out <00:00:58.064>of <00:00:58.172>AI, <00:00:58.280>which

00:00:58.630 --> 00:00:58.640 align:start position:0%
<00:00:58.630>that <00:00:58.631>they <00:00:58.632>actually <00:00:58.633>get <00:00:58.635>out <00:00:58.636>of <00:00:58.637>AI, <00:00:58.639>which

00:00:58.640 --> 00:01:00.150 align:start position:0%
<00:00:58.640>that <00:00:58.744>they <00:00:58.849>actually <00:00:58.953>get <00:00:59.058>out <00:00:59.162>of <00:00:59.267>AI, <00:00:59.371>which <00:00:59.476>is <00:00:59.580>an <00:00:59.685>interesting <00:00:59.789>concept. <00:00:59.894>We <00:00:59.998>don't

00:01:00.150 --> 00:01:00.160 align:start position:0%
<00:01:00.150>is <00:01:00.151>an <00:01:00.153>interesting <00:01:00.155>concept. <00:01:00.157>We <00:01:00.159>don't

00:01:00.160 --> 00:01:02.350 align:start position:0%
<00:01:00.160>is <00:01:00.276>an <00:01:00.393>interesting <00:01:00.510>concept. <00:01:00.626>We <00:01:00.743>don't <00:01:00.860>really <00:01:00.976>talk <00:01:01.093>about <00:01:01.209>that. <00:01:01.326>So, <00:01:01.443>today <00:01:01.559>she

00:01:02.350 --> 00:01:02.360 align:start position:0%
<00:01:02.350>really <00:01:02.351>talk <00:01:02.353>about <00:01:02.354>that. <00:01:02.356>So, <00:01:02.357>today <00:01:02.359>she

00:01:02.360 --> 00:01:04.110 align:start position:0%
<00:01:02.360>really <00:01:02.476>talk <00:01:02.593>about <00:01:02.710>that. <00:01:02.826>So, <00:01:02.943>today <00:01:03.060>she <00:01:03.176>pushes <00:01:03.293>this <00:01:03.410>this <00:01:03.526>further. <00:01:03.643>So, <00:01:03.760>a

00:01:04.110 --> 00:01:04.120 align:start position:0%
<00:01:04.110>pushes <00:01:04.111>this <00:01:04.113>this <00:01:04.115>further. <00:01:04.117>So, <00:01:04.119>a

00:01:04.120 --> 00:01:07.070 align:start position:0%
<00:01:04.120>pushes <00:01:04.260>this <00:01:04.400>this <00:01:04.540>further. <00:01:04.680>So, <00:01:04.820>a <00:01:04.960>fine-tuned <00:01:05.100>open-source <00:01:05.240>model <00:01:05.380>trained <00:01:05.520>on

00:01:07.070 --> 00:01:07.080 align:start position:0%
<00:01:07.070>fine-tuned <00:01:07.072>open-source <00:01:07.074>model <00:01:07.076>trained <00:01:07.079>on

00:01:07.080 --> 00:01:09.470 align:start position:0%
<00:01:07.080>fine-tuned <00:01:07.220>open-source <00:01:07.360>model <00:01:07.500>trained <00:01:07.640>on <00:01:07.780>your <00:01:07.920>own <00:01:08.060>data <00:01:08.200>beating <00:01:08.340>proprietary <00:01:08.480>one

00:01:09.470 --> 00:01:09.480 align:start position:0%
<00:01:09.470>your <00:01:09.471>own <00:01:09.473>data <00:01:09.475>beating <00:01:09.477>proprietary <00:01:09.479>one

00:01:09.480 --> 00:01:11.630 align:start position:0%
<00:01:09.480>your <00:01:09.596>own <00:01:09.713>data <00:01:09.830>beating <00:01:09.946>proprietary <00:01:10.063>one <00:01:10.180>both <00:01:10.296>in <00:01:10.413>cost <00:01:10.530>and <00:01:10.646>quality. <00:01:10.763>So, <00:01:10.880>from

00:01:11.630 --> 00:01:11.640 align:start position:0%
<00:01:11.630>both <00:01:11.631>in <00:01:11.633>cost <00:01:11.634>and <00:01:11.636>quality. <00:01:11.637>So, <00:01:11.639>from

00:01:11.640 --> 00:01:13.750 align:start position:0%
<00:01:11.640>both <00:01:11.756>in <00:01:11.873>cost <00:01:11.990>and <00:01:12.106>quality. <00:01:12.223>So, <00:01:12.340>from <00:01:12.456>Databricks, <00:01:12.573>the <00:01:12.690>stage <00:01:12.806>is <00:01:12.923>yours, <00:01:13.040>Victoria

00:01:13.750 --> 00:01:13.760 align:start position:0%
<00:01:13.750>Databricks, <00:01:13.751>the <00:01:13.753>stage <00:01:13.755>is <00:01:13.757>yours, <00:01:13.759>Victoria

00:01:13.760 --> 00:01:18.310 align:start position:0%
<00:01:13.760>Databricks, <00:01:13.993>the <00:01:14.226>stage <00:01:14.460>is <00:01:14.693>yours, <00:01:14.926>Victoria <00:01:15.160>Seaman.

00:01:18.320 --> 00:01:20.510 align:start position:0%
<00:01:18.320>&gt;&gt; <00:01:18.520>Well, <00:01:18.720>thank <00:01:18.919>you <00:01:19.119>so <00:01:19.320>much, <00:01:19.520>Andrew, <00:01:19.720>for

00:01:20.510 --> 00:01:20.520 align:start position:0%
<00:01:20.510>&gt;&gt; <00:01:20.511>Well, <00:01:20.512>thank <00:01:20.513>you <00:01:20.515>so <00:01:20.516>much, <00:01:20.517>Andrew, <00:01:20.518>for

00:01:20.520 --> 00:01:23.350 align:start position:0%
<00:01:20.520>&gt;&gt; <00:01:20.647>Well, <00:01:20.774>thank <00:01:20.901>you <00:01:21.029>so <00:01:21.156>much, <00:01:21.283>Andrew, <00:01:21.410>for <00:01:21.538>setting <00:01:21.665>up <00:01:21.792>high <00:01:21.920>expectations.

00:01:23.350 --> 00:01:23.360 align:start position:0%
<00:01:23.350>setting <00:01:23.353>up <00:01:23.356>high <00:01:23.359>expectations.

00:01:23.360 --> 00:01:25.710 align:start position:0%
<00:01:23.360>setting <00:01:23.487>up <00:01:23.614>high <00:01:23.741>expectations. <00:01:23.869>Now <00:01:23.996>I <00:01:24.123>have <00:01:24.250>to <00:01:24.378>fulfill <00:01:24.505>them. <00:01:24.632>So, <00:01:24.760>thank

00:01:25.710 --> 00:01:25.720 align:start position:0%
<00:01:25.710>Now <00:01:25.711>I <00:01:25.712>have <00:01:25.713>to <00:01:25.715>fulfill <00:01:25.716>them. <00:01:25.717>So, <00:01:25.719>thank

00:01:25.720 --> 00:01:27.350 align:start position:0%
<00:01:25.720>Now <00:01:25.820>I <00:01:25.920>have <00:01:26.020>to <00:01:26.120>fulfill <00:01:26.220>them. <00:01:26.320>So, <00:01:26.420>thank <00:01:26.520>you <00:01:26.620>so <00:01:26.720>much <00:01:26.820>for <00:01:26.920>joining <00:01:27.020>this <00:01:27.120>session.

00:01:27.350 --> 00:01:27.360 align:start position:0%
<00:01:27.350>you <00:01:27.351>so <00:01:27.353>much <00:01:27.354>for <00:01:27.356>joining <00:01:27.357>this <00:01:27.359>session.

00:01:27.360 --> 00:01:29.830 align:start position:0%
<00:01:27.360>you <00:01:27.460>so <00:01:27.560>much <00:01:27.660>for <00:01:27.760>joining <00:01:27.860>this <00:01:27.960>session. <00:01:28.060>So, <00:01:28.160>today <00:01:28.260>we <00:01:28.360>will <00:01:28.460>talk <00:01:28.560>about <00:01:28.660>really <00:01:28.760>a

00:01:29.830 --> 00:01:29.840 align:start position:0%
<00:01:29.830>So, <00:01:29.831>today <00:01:29.832>we <00:01:29.833>will <00:01:29.835>talk <00:01:29.836>about <00:01:29.837>really <00:01:29.839>a

00:01:29.840 --> 00:01:32.910 align:start position:0%
<00:01:29.840>So, <00:01:29.933>today <00:01:30.026>we <00:01:30.120>will <00:01:30.213>talk <00:01:30.306>about <00:01:30.400>really <00:01:30.493>a <00:01:30.586>shift <00:01:30.680>in <00:01:30.773>generative <00:01:30.866>AI. <00:01:30.960>So, <00:01:31.053>if <00:01:31.146>we <00:01:31.240>think

00:01:32.910 --> 00:01:32.920 align:start position:0%
<00:01:32.910>shift <00:01:32.911>in <00:01:32.912>generative <00:01:32.913>AI. <00:01:32.915>So, <00:01:32.916>if <00:01:32.917>we <00:01:32.919>think

00:01:32.920 --> 00:01:35.790 align:start position:0%
<00:01:32.920>shift <00:01:33.007>in <00:01:33.095>generative <00:01:33.182>AI. <00:01:33.270>So, <00:01:33.357>if <00:01:33.445>we <00:01:33.532>think <00:01:33.620>about <00:01:33.707>in <00:01:33.795>the <00:01:33.882>past <00:01:33.970>2 <00:01:34.057>years, <00:01:34.145>we <00:01:34.232>all <00:01:34.320>talk

00:01:35.790 --> 00:01:35.800 align:start position:0%
<00:01:35.789>about <00:01:35.791>in <00:01:35.792>the <00:01:35.793>past <00:01:35.794>2 <00:01:35.795>years, <00:01:35.796>we <00:01:35.797>all <00:01:35.798>talk

00:01:35.800 --> 00:01:39.670 align:start position:0%
<00:01:35.800>about <00:01:35.893>in <00:01:35.986>the <00:01:36.080>past <00:01:36.173>2 <00:01:36.266>years, <00:01:36.360>we <00:01:36.453>all <00:01:36.546>talk <00:01:36.640>about <00:01:36.733>what <00:01:36.826>workloads, <00:01:36.920>what <00:01:37.013>use <00:01:37.106>cases <00:01:37.200>we

00:01:39.670 --> 00:01:39.680 align:start position:0%
<00:01:39.670>about <00:01:39.671>what <00:01:39.673>workloads, <00:01:39.674>what <00:01:39.676>use <00:01:39.677>cases <00:01:39.679>we

00:01:39.680 --> 00:01:42.190 align:start position:0%
<00:01:39.680>about <00:01:39.787>what <00:01:39.895>workloads, <00:01:40.003>what <00:01:40.110>use <00:01:40.218>cases <00:01:40.326>we <00:01:40.433>need <00:01:40.541>to <00:01:40.649>identify <00:01:40.756>where <00:01:40.864>we <00:01:40.972>can <00:01:41.080>start

00:01:42.190 --> 00:01:42.200 align:start position:0%
<00:01:42.190>need <00:01:42.191>to <00:01:42.193>identify <00:01:42.194>where <00:01:42.196>we <00:01:42.197>can <00:01:42.199>start

00:01:42.200 --> 00:01:46.270 align:start position:0%
<00:01:42.200>need <00:01:42.316>to <00:01:42.433>identify <00:01:42.550>where <00:01:42.666>we <00:01:42.783>can <00:01:42.900>start <00:01:43.016>utilizing <00:01:43.133>LLM. <00:01:43.250>But <00:01:43.366>now <00:01:43.483>organizations <00:01:43.600>are

00:01:46.270 --> 00:01:46.280 align:start position:0%
<00:01:46.270>utilizing <00:01:46.271>LLM. <00:01:46.273>But <00:01:46.275>now <00:01:46.277>organizations <00:01:46.279>are

00:01:46.280 --> 00:01:48.710 align:start position:0%
<00:01:46.280>utilizing <00:01:46.420>LLM. <00:01:46.560>But <00:01:46.700>now <00:01:46.840>organizations <00:01:46.980>are <00:01:47.120>asking <00:01:47.260>different <00:01:47.400>questions. <00:01:47.540>You <00:01:47.680>hear

00:01:48.710 --> 00:01:48.720 align:start position:0%
<00:01:48.710>asking <00:01:48.712>different <00:01:48.714>questions. <00:01:48.716>You <00:01:48.719>hear

00:01:48.720 --> 00:01:51.670 align:start position:0%
<00:01:48.720>asking <00:01:48.860>different <00:01:49.000>questions. <00:01:49.140>You <00:01:49.280>hear <00:01:49.420>more <00:01:49.560>about <00:01:49.700>token <00:01:49.840>efficiency <00:01:49.980>because <00:01:50.120>as

00:01:51.670 --> 00:01:51.680 align:start position:0%
<00:01:51.670>more <00:01:51.671>about <00:01:51.673>token <00:01:51.675>efficiency <00:01:51.677>because <00:01:51.679>as

00:01:51.680 --> 00:01:55.030 align:start position:0%
<00:01:51.680>more <00:01:51.807>about <00:01:51.934>token <00:01:52.061>efficiency <00:01:52.189>because <00:01:52.316>as <00:01:52.443>production <00:01:52.570>volume <00:01:52.698>scale, <00:01:52.825>the <00:01:52.952>cost <00:01:53.080>are

00:01:55.030 --> 00:01:55.040 align:start position:0%
<00:01:55.030>production <00:01:55.031>volume <00:01:55.033>scale, <00:01:55.035>the <00:01:55.037>cost <00:01:55.038>are

00:01:55.040 --> 00:01:57.990 align:start position:0%
<00:01:55.039>production <00:01:55.147>volume <00:01:55.255>scale, <00:01:55.363>the <00:01:55.470>cost <00:01:55.578>are <00:01:55.686>rising. <00:01:55.793>So, <00:01:55.901>what <00:01:56.009>we <00:01:56.116>will <00:01:56.224>talk <00:01:56.332>today <00:01:56.440>is

00:01:57.990 --> 00:01:58.000 align:start position:0%
<00:01:57.990>rising. <00:01:57.991>So, <00:01:57.992>what <00:01:57.993>we <00:01:57.995>will <00:01:57.996>talk <00:01:57.997>today <00:01:57.999>is

00:01:58.000 --> 00:02:01.870 align:start position:0%
<00:01:58.000>rising. <00:01:58.093>So, <00:01:58.186>what <00:01:58.280>we <00:01:58.373>will <00:01:58.466>talk <00:01:58.560>today <00:01:58.653>is <00:01:58.746>about <00:01:58.840>how <00:01:58.933>you <00:01:59.026>can <00:01:59.120>optimize, <00:01:59.213>how <00:01:59.306>you <00:01:59.400>can

00:02:01.870 --> 00:02:01.880 align:start position:0%
<00:02:01.870>about <00:02:01.871>how <00:02:01.872>you <00:02:01.873>can <00:02:01.875>optimize, <00:02:01.876>how <00:02:01.877>you <00:02:01.878>can

00:02:01.880 --> 00:02:05.190 align:start position:0%
<00:02:01.880>about <00:02:01.987>how <00:02:02.095>you <00:02:02.203>can <00:02:02.310>optimize, <00:02:02.418>how <00:02:02.526>you <00:02:02.633>can <00:02:02.741>select <00:02:02.849>the <00:02:02.956>right <00:02:03.064>model, <00:02:03.172>then <00:02:03.280>evaluate

00:02:05.190 --> 00:02:05.200 align:start position:0%
<00:02:05.190>select <00:02:05.191>the <00:02:05.193>right <00:02:05.195>model, <00:02:05.197>then <00:02:05.199>evaluate

00:02:05.200 --> 00:02:07.670 align:start position:0%
<00:02:05.200>select <00:02:05.327>the <00:02:05.454>right <00:02:05.581>model, <00:02:05.709>then <00:02:05.836>evaluate <00:02:05.963>those <00:02:06.090>models, <00:02:06.218>and <00:02:06.345>really <00:02:06.472>optimize <00:02:06.600>them

00:02:07.670 --> 00:02:07.680 align:start position:0%
<00:02:07.670>those <00:02:07.671>models, <00:02:07.673>and <00:02:07.675>really <00:02:07.677>optimize <00:02:07.679>them

00:02:07.680 --> 00:02:09.830 align:start position:0%
<00:02:07.680>those <00:02:07.835>models, <00:02:07.991>and <00:02:08.146>really <00:02:08.302>optimize <00:02:08.457>them <00:02:08.613>for <00:02:08.768>your <00:02:08.924>use <00:02:09.080>case.

00:02:09.830 --> 00:02:09.840 align:start position:0%
<00:02:09.830>for <00:02:09.833>your <00:02:09.836>use <00:02:09.839>case.

00:02:09.840 --> 00:02:12.670 align:start position:0%
<00:02:09.840>for <00:02:10.015>your <00:02:10.190>use <00:02:10.365>case. <00:02:10.539>And <00:02:10.715>build <00:02:10.890>LLM <00:02:11.065>diversification <00:02:11.240>portfolio.

00:02:12.670 --> 00:02:12.680 align:start position:0%
<00:02:12.670>And <00:02:12.672>build <00:02:12.674>LLM <00:02:12.676>diversification <00:02:12.679>portfolio.

00:02:12.680 --> 00:02:14.870 align:start position:0%
<00:02:12.680>And <00:02:12.787>build <00:02:12.895>LLM <00:02:13.003>diversification <00:02:13.110>portfolio. <00:02:13.218>So, <00:02:13.326>if <00:02:13.433>we <00:02:13.541>look <00:02:13.649>at <00:02:13.756>right <00:02:13.864>now <00:02:13.972>what's <00:02:14.080>kind

00:02:14.870 --> 00:02:14.880 align:start position:0%
<00:02:14.870>So, <00:02:14.871>if <00:02:14.872>we <00:02:14.873>look <00:02:14.874>at <00:02:14.875>right <00:02:14.876>now <00:02:14.877>what's <00:02:14.879>kind

00:02:14.880 --> 00:02:16.350 align:start position:0%
<00:02:14.880>So, <00:02:14.974>if <00:02:15.069>we <00:02:15.163>look <00:02:15.257>at <00:02:15.352>right <00:02:15.447>now <00:02:15.541>what's <00:02:15.636>kind <00:02:15.730>of <00:02:15.825>like <00:02:15.919>happening <00:02:16.013>in <00:02:16.108>a <00:02:16.203>broader

00:02:16.350 --> 00:02:16.360 align:start position:0%
<00:02:16.350>of <00:02:16.351>like <00:02:16.353>happening <00:02:16.355>in <00:02:16.357>a <00:02:16.359>broader

00:02:16.360 --> 00:02:20.949 align:start position:0%
<00:02:16.360>of <00:02:16.476>like <00:02:16.593>happening <00:02:16.710>in <00:02:16.826>a <00:02:16.943>broader <00:02:17.060>ecosystem. <00:02:17.176>So, <00:02:17.293>this <00:02:17.410>chart <00:02:17.526>shows <00:02:17.643>the <00:02:17.760>LLM

00:02:20.949 --> 00:02:20.959 align:start position:0%
<00:02:20.949>ecosystem. <00:02:20.950>So, <00:02:20.952>this <00:02:20.953>chart <00:02:20.955>shows <00:02:20.956>the <00:02:20.958>LLM

00:02:20.959 --> 00:02:23.830 align:start position:0%
<00:02:20.959>ecosystem. <00:02:21.075>So, <00:02:21.192>this <00:02:21.309>chart <00:02:21.425>shows <00:02:21.542>the <00:02:21.659>LLM <00:02:21.775>by <00:02:21.892>different <00:02:22.009>model <00:02:22.125>providers, <00:02:22.242>and <00:02:22.359>each

00:02:23.830 --> 00:02:23.840 align:start position:0%
<00:02:23.829>by <00:02:23.831>different <00:02:23.833>model <00:02:23.835>providers, <00:02:23.837>and <00:02:23.839>each

00:02:23.840 --> 00:02:26.949 align:start position:0%
<00:02:23.840>by <00:02:23.940>different <00:02:24.040>model <00:02:24.140>providers, <00:02:24.240>and <00:02:24.340>each <00:02:24.440>of <00:02:24.540>this <00:02:24.640>point <00:02:24.740>is <00:02:24.840>model. <00:02:24.940>And <00:02:25.040>as <00:02:25.140>you <00:02:25.240>can

00:02:26.949 --> 00:02:26.959 align:start position:0%
<00:02:26.949>of <00:02:26.950>this <00:02:26.951>point <00:02:26.952>is <00:02:26.953>model. <00:02:26.954>And <00:02:26.955>as <00:02:26.956>you <00:02:26.958>can

00:02:26.959 --> 00:02:32.550 align:start position:0%
<00:02:26.959>of <00:02:27.046>this <00:02:27.134>point <00:02:27.221>is <00:02:27.309>model. <00:02:27.396>And <00:02:27.484>as <00:02:27.571>you <00:02:27.659>can <00:02:27.746>see <00:02:27.834>in <00:02:27.921>2022, <00:02:28.009>in <00:02:28.096>2023, <00:02:28.184>the <00:02:28.271>this <00:02:28.359>shift

00:02:32.550 --> 00:02:32.560 align:start position:0%
<00:02:32.550>see <00:02:32.551>in <00:02:32.552>2022, <00:02:32.553>in <00:02:32.555>2023, <00:02:32.556>the <00:02:32.557>this <00:02:32.559>shift

00:02:32.560 --> 00:02:34.070 align:start position:0%
<00:02:32.560>see <00:02:32.664>in <00:02:32.769>2022, <00:02:32.873>in <00:02:32.978>2023, <00:02:33.082>the <00:02:33.187>this <00:02:33.291>shift <00:02:33.396>between <00:02:33.500>when <00:02:33.605>the <00:02:33.709>new <00:02:33.814>model <00:02:33.918>was

00:02:34.070 --> 00:02:34.080 align:start position:0%
<00:02:34.070>between <00:02:34.071>when <00:02:34.073>the <00:02:34.075>new <00:02:34.077>model <00:02:34.078>was

00:02:34.080 --> 00:02:37.710 align:start position:0%
<00:02:34.079>between <00:02:34.196>when <00:02:34.313>the <00:02:34.429>new <00:02:34.546>model <00:02:34.663>was <00:02:34.779>introduced <00:02:34.896>was <00:02:35.013>about <00:02:35.130>12 <00:02:35.246>to <00:02:35.363>18 <00:02:35.480>months.

00:02:37.710 --> 00:02:37.720 align:start position:0%
<00:02:37.710>introduced <00:02:37.711>was <00:02:37.713>about <00:02:37.714>12 <00:02:37.716>to <00:02:37.717>18 <00:02:37.719>months.

00:02:37.720 --> 00:02:39.310 align:start position:0%
<00:02:37.720>introduced <00:02:37.895>was <00:02:38.070>about <00:02:38.245>12 <00:02:38.420>to <00:02:38.595>18 <00:02:38.770>months. <00:02:38.945>But <00:02:39.120>now

00:02:39.310 --> 00:02:39.320 align:start position:0%
<00:02:39.310>But <00:02:39.319>now

00:02:39.320 --> 00:02:42.270 align:start position:0%
<00:02:39.320>But <00:02:39.519>now <00:02:39.720>the <00:02:39.920>pace <00:02:40.120>of <00:02:40.320>innovation <00:02:40.519>is <00:02:40.720>accelerating.

00:02:42.270 --> 00:02:42.280 align:start position:0%
<00:02:42.270>the <00:02:42.271>pace <00:02:42.273>of <00:02:42.275>innovation <00:02:42.277>is <00:02:42.279>accelerating.

00:02:42.280 --> 00:02:45.590 align:start position:0%
<00:02:42.280>the <00:02:42.396>pace <00:02:42.513>of <00:02:42.630>innovation <00:02:42.746>is <00:02:42.863>accelerating. <00:02:42.980>So, <00:02:43.096>this <00:02:43.213>shelf <00:02:43.330>life <00:02:43.446>of <00:02:43.563>commercial <00:02:43.680>LLMs,

00:02:45.590 --> 00:02:45.600 align:start position:0%
<00:02:45.590>So, <00:02:45.591>this <00:02:45.593>shelf <00:02:45.594>life <00:02:45.596>of <00:02:45.597>commercial <00:02:45.599>LLMs,

00:02:45.600 --> 00:02:48.510 align:start position:0%
<00:02:45.600>So, <00:02:45.727>this <00:02:45.854>shelf <00:02:45.981>life <00:02:46.109>of <00:02:46.236>commercial <00:02:46.363>LLMs, <00:02:46.490>they're <00:02:46.618>now <00:02:46.745>under <00:02:46.872>three <00:02:47.000>months.

00:02:48.510 --> 00:02:48.520 align:start position:0%
<00:02:48.510>they're <00:02:48.512>now <00:02:48.514>under <00:02:48.516>three <00:02:48.519>months.

00:02:48.520 --> 00:02:52.670 align:start position:0%
<00:02:48.520>they're <00:02:48.660>now <00:02:48.800>under <00:02:48.940>three <00:02:49.080>months. <00:02:49.220>And <00:02:49.360>this <00:02:49.500>introduces <00:02:49.640>challenge <00:02:49.780>for <00:02:49.920>anyone

00:02:52.670 --> 00:02:52.680 align:start position:0%
<00:02:52.670>And <00:02:52.671>this <00:02:52.673>introduces <00:02:52.675>challenge <00:02:52.677>for <00:02:52.679>anyone

00:02:52.680 --> 00:02:55.270 align:start position:0%
<00:02:52.680>And <00:02:52.807>this <00:02:52.934>introduces <00:02:53.061>challenge <00:02:53.189>for <00:02:53.316>anyone <00:02:53.443>who's <00:02:53.570>building <00:02:53.698>with <00:02:53.825>AI <00:02:53.952>because <00:02:54.080>Samsung

00:02:55.270 --> 00:02:55.280 align:start position:0%
<00:02:55.270>who's <00:02:55.271>building <00:02:55.273>with <00:02:55.275>AI <00:02:55.277>because <00:02:55.279>Samsung

00:02:55.280 --> 00:02:58.510 align:start position:0%
<00:02:55.280>who's <00:02:55.387>building <00:02:55.495>with <00:02:55.603>AI <00:02:55.710>because <00:02:55.818>Samsung <00:02:55.926>that <00:02:56.033>was <00:02:56.141>at <00:02:56.249>the <00:02:56.356>top <00:02:56.464>three <00:02:56.572>months <00:02:56.680>ago

00:02:58.510 --> 00:02:58.520 align:start position:0%
<00:02:58.510>that <00:02:58.511>was <00:02:58.512>at <00:02:58.513>the <00:02:58.515>top <00:02:58.516>three <00:02:58.517>months <00:02:58.519>ago

00:02:58.520 --> 00:03:01.350 align:start position:0%
<00:02:58.520>that <00:02:58.636>was <00:02:58.753>at <00:02:58.870>the <00:02:58.986>top <00:02:59.103>three <00:02:59.220>months <00:02:59.336>ago <00:02:59.453>will <00:02:59.570>might <00:02:59.686>be <00:02:59.803>deprecated <00:02:59.920>tomorrow.

00:03:01.350 --> 00:03:01.360 align:start position:0%
<00:03:01.350>will <00:03:01.352>might <00:03:01.354>be <00:03:01.356>deprecated <00:03:01.359>tomorrow.

00:03:01.360 --> 00:03:03.790 align:start position:0%
<00:03:01.360>will <00:03:01.500>might <00:03:01.640>be <00:03:01.780>deprecated <00:03:01.920>tomorrow. <00:03:02.060>So, <00:03:02.200>what <00:03:02.340>companies <00:03:02.480>need <00:03:02.620>to <00:03:02.760>start

00:03:03.790 --> 00:03:03.800 align:start position:0%
<00:03:03.790>So, <00:03:03.791>what <00:03:03.793>companies <00:03:03.795>need <00:03:03.797>to <00:03:03.799>start

00:03:03.800 --> 00:03:07.430 align:start position:0%
<00:03:03.800>So, <00:03:03.916>what <00:03:04.033>companies <00:03:04.150>need <00:03:04.266>to <00:03:04.383>start <00:03:04.500>thinking <00:03:04.616>about <00:03:04.733>is <00:03:04.850>how <00:03:04.966>they <00:03:05.083>can <00:03:05.200>decouple

00:03:07.430 --> 00:03:07.440 align:start position:0%
<00:03:07.430>thinking <00:03:07.431>about <00:03:07.433>is <00:03:07.434>how <00:03:07.436>they <00:03:07.437>can <00:03:07.439>decouple

00:03:07.440 --> 00:03:10.430 align:start position:0%
<00:03:07.440>thinking <00:03:07.556>about <00:03:07.673>is <00:03:07.790>how <00:03:07.906>they <00:03:08.023>can <00:03:08.140>decouple <00:03:08.256>application <00:03:08.373>layer <00:03:08.490>from <00:03:08.606>the <00:03:08.723>model <00:03:08.840>serving

00:03:10.430 --> 00:03:10.440 align:start position:0%
<00:03:10.430>application <00:03:10.431>layer <00:03:10.433>from <00:03:10.435>the <00:03:10.437>model <00:03:10.439>serving

00:03:10.440 --> 00:03:13.110 align:start position:0%
<00:03:10.440>application <00:03:10.547>layer <00:03:10.655>from <00:03:10.763>the <00:03:10.870>model <00:03:10.978>serving <00:03:11.086>layer. <00:03:11.193>And <00:03:11.301>in <00:03:11.409>this <00:03:11.516>way <00:03:11.624>build <00:03:11.732>really <00:03:11.840>a

00:03:13.110 --> 00:03:13.120 align:start position:0%
<00:03:13.110>layer. <00:03:13.111>And <00:03:13.112>in <00:03:13.113>this <00:03:13.115>way <00:03:13.116>build <00:03:13.117>really <00:03:13.119>a

00:03:13.120 --> 00:03:17.630 align:start position:0%
<00:03:13.120>layer. <00:03:13.260>And <00:03:13.400>in <00:03:13.540>this <00:03:13.680>way <00:03:13.820>build <00:03:13.960>really <00:03:14.100>a <00:03:14.240>sustainable <00:03:14.380>business <00:03:14.520>solution.

00:03:17.640 --> 00:03:20.229 align:start position:0%
<00:03:17.640>One <00:03:17.873>of <00:03:18.106>the <00:03:18.339>interesting <00:03:18.573>use <00:03:18.806>cases <00:03:19.040>is

00:03:20.229 --> 00:03:20.239 align:start position:0%
<00:03:20.228>One <00:03:20.230>of <00:03:20.232>the <00:03:20.233>interesting <00:03:20.234>use <00:03:20.236>cases <00:03:20.238>is

00:03:20.239 --> 00:03:23.190 align:start position:0%
<00:03:20.239>One <00:03:20.339>of <00:03:20.439>the <00:03:20.539>interesting <00:03:20.639>use <00:03:20.739>cases <00:03:20.839>is <00:03:20.939>Cursor. <00:03:21.039>So, <00:03:21.139>I'm <00:03:21.239>sure <00:03:21.339>a <00:03:21.439>lot <00:03:21.539>of <00:03:21.639>you

00:03:23.190 --> 00:03:23.200 align:start position:0%
<00:03:23.190>Cursor. <00:03:23.191>So, <00:03:23.192>I'm <00:03:23.193>sure <00:03:23.195>a <00:03:23.196>lot <00:03:23.197>of <00:03:23.198>you

00:03:23.200 --> 00:03:26.190 align:start position:0%
<00:03:23.200>Cursor. <00:03:23.307>So, <00:03:23.415>I'm <00:03:23.523>sure <00:03:23.630>a <00:03:23.738>lot <00:03:23.846>of <00:03:23.953>you <00:03:24.061>utilize <00:03:24.169>Cursor. <00:03:24.276>So, <00:03:24.384>they <00:03:24.492>first <00:03:24.600>built

00:03:26.190 --> 00:03:26.200 align:start position:0%
<00:03:26.190>utilize <00:03:26.191>Cursor. <00:03:26.193>So, <00:03:26.195>they <00:03:26.197>first <00:03:26.198>built

00:03:26.200 --> 00:03:28.550 align:start position:0%
<00:03:26.200>utilize <00:03:26.339>Cursor. <00:03:26.480>So, <00:03:26.619>they <00:03:26.760>first <00:03:26.899>built <00:03:27.040>their <00:03:27.179>AI <00:03:27.320>coding <00:03:27.459>agents <00:03:27.600>utilizing

00:03:28.550 --> 00:03:28.560 align:start position:0%
<00:03:28.550>their <00:03:28.552>AI <00:03:28.554>coding <00:03:28.556>agents <00:03:28.559>utilizing

00:03:28.560 --> 00:03:32.310 align:start position:0%
<00:03:28.560>their <00:03:28.687>AI <00:03:28.814>coding <00:03:28.941>agents <00:03:29.069>utilizing <00:03:29.196>proprietary <00:03:29.323>APIs. <00:03:29.450>So, <00:03:29.578>Sun <00:03:29.705>add <00:03:29.832>open <00:03:29.960>AI.

00:03:32.310 --> 00:03:32.320 align:start position:0%
<00:03:32.310>proprietary <00:03:32.311>APIs. <00:03:32.313>So, <00:03:32.314>Sun <00:03:32.316>add <00:03:32.317>open <00:03:32.319>AI.

00:03:32.320 --> 00:03:34.070 align:start position:0%
<00:03:32.320>proprietary <00:03:32.427>APIs. <00:03:32.535>So, <00:03:32.643>Sun <00:03:32.750>add <00:03:32.858>open <00:03:32.966>AI. <00:03:33.073>But <00:03:33.181>if <00:03:33.289>you <00:03:33.396>think <00:03:33.504>about <00:03:33.612>this, <00:03:33.720>their

00:03:34.070 --> 00:03:34.080 align:start position:0%
<00:03:34.070>But <00:03:34.071>if <00:03:34.072>you <00:03:34.074>think <00:03:34.076>about <00:03:34.077>this, <00:03:34.078>their

00:03:34.080 --> 00:03:37.670 align:start position:0%
<00:03:34.079>But <00:03:34.196>if <00:03:34.313>you <00:03:34.429>think <00:03:34.546>about <00:03:34.663>this, <00:03:34.779>their <00:03:34.896>business <00:03:35.013>model <00:03:35.130>is <00:03:35.246>based <00:03:35.363>on <00:03:35.480>subscription.

00:03:37.670 --> 00:03:37.680 align:start position:0%
<00:03:37.670>business <00:03:37.671>model <00:03:37.673>is <00:03:37.675>based <00:03:37.677>on <00:03:37.679>subscription.

00:03:37.680 --> 00:03:39.430 align:start position:0%
<00:03:37.680>business <00:03:37.807>model <00:03:37.934>is <00:03:38.061>based <00:03:38.189>on <00:03:38.316>subscription. <00:03:38.443>And <00:03:38.570>at <00:03:38.698>some <00:03:38.825>point <00:03:38.952>it <00:03:39.080>became

00:03:39.430 --> 00:03:39.440 align:start position:0%
<00:03:39.430>And <00:03:39.431>at <00:03:39.433>some <00:03:39.435>point <00:03:39.437>it <00:03:39.439>became

00:03:39.440 --> 00:03:42.790 align:start position:0%
<00:03:39.440>And <00:03:39.567>at <00:03:39.694>some <00:03:39.821>point <00:03:39.949>it <00:03:40.076>became <00:03:40.203>unsustainable <00:03:40.330>because <00:03:40.458>the <00:03:40.585>cost <00:03:40.712>per <00:03:40.840>task

00:03:42.790 --> 00:03:42.800 align:start position:0%
<00:03:42.790>unsustainable <00:03:42.791>because <00:03:42.793>the <00:03:42.795>cost <00:03:42.797>per <00:03:42.799>task

00:03:42.800 --> 00:03:44.830 align:start position:0%
<00:03:42.800>unsustainable <00:03:42.907>because <00:03:43.015>the <00:03:43.123>cost <00:03:43.230>per <00:03:43.338>task <00:03:43.446>was <00:03:43.553>very <00:03:43.661>high. <00:03:43.769>So, <00:03:43.876>they <00:03:43.984>needed <00:03:44.092>to <00:03:44.200>do

00:03:44.830 --> 00:03:44.840 align:start position:0%
<00:03:44.829>was <00:03:44.831>very <00:03:44.832>high. <00:03:44.833>So, <00:03:44.835>they <00:03:44.836>needed <00:03:44.837>to <00:03:44.839>do

00:03:44.840 --> 00:03:46.509 align:start position:0%
<00:03:44.840>was <00:03:44.980>very <00:03:45.120>high. <00:03:45.260>So, <00:03:45.400>they <00:03:45.540>needed <00:03:45.680>to <00:03:45.820>do <00:03:45.960>something <00:03:46.100>about <00:03:46.240>this.

00:03:46.509 --> 00:03:46.519 align:start position:0%
<00:03:46.509>something <00:03:46.513>about <00:03:46.518>this.

00:03:46.519 --> 00:03:49.270 align:start position:0%
<00:03:46.519>something <00:03:46.674>about <00:03:46.830>this. <00:03:46.985>So, <00:03:47.141>what <00:03:47.296>they <00:03:47.452>did, <00:03:47.607>they <00:03:47.763>utilized <00:03:47.919>open

00:03:49.270 --> 00:03:49.280 align:start position:0%
<00:03:49.270>So, <00:03:49.271>what <00:03:49.273>they <00:03:49.274>did, <00:03:49.276>they <00:03:49.277>utilized <00:03:49.279>open

00:03:49.280 --> 00:03:51.150 align:start position:0%
<00:03:49.280>So, <00:03:49.435>what <00:03:49.591>they <00:03:49.746>did, <00:03:49.902>they <00:03:50.057>utilized <00:03:50.213>open <00:03:50.368>weight <00:03:50.524>model <00:03:50.680>Kimera.

00:03:51.150 --> 00:03:51.160 align:start position:0%
<00:03:51.150>weight <00:03:51.154>model <00:03:51.159>Kimera.

00:03:51.160 --> 00:03:53.950 align:start position:0%
<00:03:51.160>weight <00:03:51.359>model <00:03:51.560>Kimera. <00:03:51.760>They <00:03:51.960>analyzed <00:03:52.160>their <00:03:52.359>prompt <00:03:52.560>response

00:03:53.950 --> 00:03:53.960 align:start position:0%
<00:03:53.950>They <00:03:53.952>analyzed <00:03:53.954>their <00:03:53.956>prompt <00:03:53.959>response

00:03:53.960 --> 00:03:56.550 align:start position:0%
<00:03:53.960>They <00:03:54.115>analyzed <00:03:54.271>their <00:03:54.426>prompt <00:03:54.582>response <00:03:54.737>loops <00:03:54.893>and <00:03:55.048>they <00:03:55.204>fine-tuned <00:03:55.360>Kimia

00:03:56.550 --> 00:03:56.560 align:start position:0%
<00:03:56.550>loops <00:03:56.552>and <00:03:56.554>they <00:03:56.556>fine-tuned <00:03:56.559>Kimia

00:03:56.560 --> 00:04:00.470 align:start position:0%
<00:03:56.560>loops <00:03:56.700>and <00:03:56.840>they <00:03:56.980>fine-tuned <00:03:57.120>Kimia <00:03:57.260>specifically <00:03:57.400>for <00:03:57.540>coding <00:03:57.680>tasks. <00:03:57.820>And <00:03:57.960>while

00:04:00.470 --> 00:04:00.480 align:start position:0%
<00:04:00.470>specifically <00:04:00.471>for <00:04:00.473>coding <00:04:00.475>tasks. <00:04:00.477>And <00:04:00.478>while

00:04:00.480 --> 00:04:04.790 align:start position:0%
<00:04:00.480>specifically <00:04:00.607>for <00:04:00.734>coding <00:04:00.861>tasks. <00:04:00.989>And <00:04:01.116>while <00:04:01.243>maintaining <00:04:01.370>the <00:04:01.498>same <00:04:01.625>quality <00:04:01.752>F1 <00:04:01.880>score,

00:04:04.790 --> 00:04:04.800 align:start position:0%
<00:04:04.790>maintaining <00:04:04.791>the <00:04:04.793>same <00:04:04.795>quality <00:04:04.797>F1 <00:04:04.799>score,

00:04:04.800 --> 00:04:07.990 align:start position:0%
<00:04:04.800>maintaining <00:04:04.927>the <00:04:05.054>same <00:04:05.181>quality <00:04:05.309>F1 <00:04:05.436>score, <00:04:05.563>their <00:04:05.690>model <00:04:05.818>composer <00:04:05.945>2 <00:04:06.072>achieved <00:04:06.200>overall

00:04:07.990 --> 00:04:08.000 align:start position:0%
<00:04:07.990>their <00:04:07.991>model <00:04:07.993>composer <00:04:07.995>2 <00:04:07.997>achieved <00:04:07.999>overall

00:04:08.000 --> 00:04:11.830 align:start position:0%
<00:04:08.000>their <00:04:08.127>model <00:04:08.254>composer <00:04:08.381>2 <00:04:08.509>achieved <00:04:08.636>overall <00:04:08.763>86% <00:04:08.890>drop <00:04:09.018>in <00:04:09.145>the <00:04:09.272>token <00:04:09.400>usage.

00:04:11.830 --> 00:04:11.840 align:start position:0%
<00:04:11.830>86% <00:04:11.831>drop <00:04:11.833>in <00:04:11.835>the <00:04:11.837>token <00:04:11.839>usage.

00:04:11.840 --> 00:04:14.870 align:start position:0%
<00:04:11.840>86% <00:04:11.933>drop <00:04:12.026>in <00:04:12.120>the <00:04:12.213>token <00:04:12.306>usage. <00:04:12.400>So, <00:04:12.493>what <00:04:12.586>I <00:04:12.680>want <00:04:12.773>to <00:04:12.866>talk <00:04:12.960>today <00:04:13.053>is <00:04:13.146>how <00:04:13.240>you

00:04:14.870 --> 00:04:14.880 align:start position:0%
<00:04:14.870>So, <00:04:14.871>what <00:04:14.872>I <00:04:14.873>want <00:04:14.874>to <00:04:14.875>talk <00:04:14.876>today <00:04:14.877>is <00:04:14.878>how <00:04:14.879>you

00:04:14.880 --> 00:04:17.949 align:start position:0%
<00:04:14.880>So, <00:04:14.967>what <00:04:15.055>I <00:04:15.142>want <00:04:15.230>to <00:04:15.317>talk <00:04:15.405>today <00:04:15.492>is <00:04:15.579>how <00:04:15.667>you <00:04:15.755>can <00:04:15.842>identify <00:04:15.930>the <00:04:16.017>right <00:04:16.105>use <00:04:16.192>cases <00:04:16.279>where

00:04:17.949 --> 00:04:17.959 align:start position:0%
<00:04:17.949>can <00:04:17.950>identify <00:04:17.952>the <00:04:17.953>right <00:04:17.954>use <00:04:17.956>cases <00:04:17.958>where

00:04:17.959 --> 00:04:20.349 align:start position:0%
<00:04:17.959>can <00:04:18.099>identify <00:04:18.238>the <00:04:18.379>right <00:04:18.519>use <00:04:18.659>cases <00:04:18.798>where <00:04:18.939>you <00:04:19.079>can <00:04:19.219>achieve <00:04:19.358>similar

00:04:20.349 --> 00:04:20.359 align:start position:0%
<00:04:20.349>you <00:04:20.351>can <00:04:20.354>achieve <00:04:20.358>similar

00:04:20.359 --> 00:04:22.070 align:start position:0%
<00:04:20.358>you <00:04:20.709>can <00:04:21.058>achieve <00:04:21.409>similar <00:04:21.758>results.

00:04:22.070 --> 00:04:22.080 align:start position:0%
results.

00:04:22.080 --> 00:04:24.110 align:start position:0%
<00:04:22.079>results. <00:04:22.280>During <00:04:22.479>this <00:04:22.680>session, <00:04:22.880>I'm <00:04:23.080>going <00:04:23.280>to <00:04:23.479>show

00:04:24.110 --> 00:04:24.120 align:start position:0%
<00:04:24.110>During <00:04:24.111>this <00:04:24.113>session, <00:04:24.114>I'm <00:04:24.116>going <00:04:24.117>to <00:04:24.119>show

00:04:24.120 --> 00:04:26.990 align:start position:0%
<00:04:24.120>During <00:04:24.213>this <00:04:24.306>session, <00:04:24.400>I'm <00:04:24.493>going <00:04:24.586>to <00:04:24.680>show <00:04:24.773>you <00:04:24.866>a <00:04:24.960>few <00:04:25.053>demos <00:04:25.146>to <00:04:25.240>walk <00:04:25.333>you <00:04:25.426>through <00:04:25.520>how

00:04:26.990 --> 00:04:27.000 align:start position:0%
<00:04:26.990>you <00:04:26.991>a <00:04:26.992>few <00:04:26.993>demos <00:04:26.994>to <00:04:26.995>walk <00:04:26.996>you <00:04:26.997>through <00:04:26.999>how

00:04:27.000 --> 00:04:29.670 align:start position:0%
<00:04:27.000>you <00:04:27.087>a <00:04:27.175>few <00:04:27.262>demos <00:04:27.350>to <00:04:27.437>walk <00:04:27.525>you <00:04:27.612>through <00:04:27.700>how <00:04:27.787>you <00:04:27.875>can <00:04:27.962>build. <00:04:28.050>And <00:04:28.137>um <00:04:28.225>to <00:04:28.312>build <00:04:28.400>this

00:04:29.670 --> 00:04:29.680 align:start position:0%
<00:04:29.670>you <00:04:29.671>can <00:04:29.672>build. <00:04:29.673>And <00:04:29.675>um <00:04:29.676>to <00:04:29.677>build <00:04:29.679>this

00:04:29.680 --> 00:04:32.030 align:start position:0%
<00:04:29.680>you <00:04:29.773>can <00:04:29.866>build. <00:04:29.960>And <00:04:30.053>um <00:04:30.146>to <00:04:30.240>build <00:04:30.333>this <00:04:30.426>demos, <00:04:30.520>I <00:04:30.613>come <00:04:30.706>up <00:04:30.800>with <00:04:30.893>this <00:04:30.986>use <00:04:31.080>case

00:04:32.030 --> 00:04:32.040 align:start position:0%
<00:04:32.030>demos, <00:04:32.031>I <00:04:32.032>come <00:04:32.033>up <00:04:32.035>with <00:04:32.036>this <00:04:32.037>use <00:04:32.039>case

00:04:32.040 --> 00:04:34.550 align:start position:0%
<00:04:32.040>demos, <00:04:32.195>I <00:04:32.351>come <00:04:32.506>up <00:04:32.662>with <00:04:32.817>this <00:04:32.973>use <00:04:33.128>case <00:04:33.284>regarding <00:04:33.440>soccer.

00:04:34.550 --> 00:04:34.560 align:start position:0%
<00:04:34.550>regarding <00:04:34.559>soccer.

00:04:34.560 --> 00:04:36.670 align:start position:0%
<00:04:34.560>regarding <00:04:34.687>soccer. <00:04:34.814>Of <00:04:34.941>course, <00:04:35.069>I'm <00:04:35.196>sure <00:04:35.323>a <00:04:35.450>lot <00:04:35.578>of <00:04:35.705>you <00:04:35.832>are <00:04:35.960>now

00:04:36.670 --> 00:04:36.680 align:start position:0%
<00:04:36.670>Of <00:04:36.671>course, <00:04:36.672>I'm <00:04:36.673>sure <00:04:36.674>a <00:04:36.675>lot <00:04:36.676>of <00:04:36.677>you <00:04:36.678>are <00:04:36.679>now

00:04:36.680 --> 00:04:39.510 align:start position:0%
<00:04:36.680>Of <00:04:36.767>course, <00:04:36.855>I'm <00:04:36.942>sure <00:04:37.030>a <00:04:37.117>lot <00:04:37.205>of <00:04:37.292>you <00:04:37.380>are <00:04:37.467>now <00:04:37.555>following <00:04:37.642>the <00:04:37.730>games. <00:04:37.817>So, <00:04:37.905>now <00:04:37.992>imagine <00:04:38.080>we

00:04:39.510 --> 00:04:39.520 align:start position:0%
<00:04:39.510>following <00:04:39.511>the <00:04:39.513>games. <00:04:39.514>So, <00:04:39.515>now <00:04:39.517>imagine <00:04:39.519>we

00:04:39.520 --> 00:04:42.750 align:start position:0%
<00:04:39.520>following <00:04:39.627>the <00:04:39.735>games. <00:04:39.843>So, <00:04:39.950>now <00:04:40.058>imagine <00:04:40.166>we <00:04:40.273>are <00:04:40.381>company <00:04:40.489>that <00:04:40.596>has <00:04:40.704>a <00:04:40.812>platform <00:04:40.919>where

00:04:42.750 --> 00:04:42.760 align:start position:0%
<00:04:42.750>are <00:04:42.751>company <00:04:42.753>that <00:04:42.754>has <00:04:42.756>a <00:04:42.757>platform <00:04:42.759>where

00:04:42.760 --> 00:04:44.510 align:start position:0%
<00:04:42.760>are <00:04:42.887>company <00:04:43.014>that <00:04:43.141>has <00:04:43.269>a <00:04:43.396>platform <00:04:43.523>where <00:04:43.650>people <00:04:43.778>are <00:04:43.905>watching <00:04:44.032>soccer, <00:04:44.159>they're

00:04:44.510 --> 00:04:44.520 align:start position:0%
<00:04:44.510>people <00:04:44.512>are <00:04:44.514>watching <00:04:44.516>soccer, <00:04:44.519>they're

00:04:44.520 --> 00:04:46.230 align:start position:0%
<00:04:44.520>people <00:04:44.675>are <00:04:44.831>watching <00:04:44.986>soccer, <00:04:45.142>they're <00:04:45.297>sending <00:04:45.453>thousands <00:04:45.608>and <00:04:45.764>thousands <00:04:45.919>of

00:04:46.230 --> 00:04:46.240 align:start position:0%
<00:04:46.230>sending <00:04:46.232>thousands <00:04:46.234>and <00:04:46.236>thousands <00:04:46.239>of

00:04:46.240 --> 00:04:49.110 align:start position:0%
<00:04:46.240>sending <00:04:46.367>thousands <00:04:46.494>and <00:04:46.621>thousands <00:04:46.749>of <00:04:46.876>messages, <00:04:47.003>and <00:04:47.130>we <00:04:47.258>need <00:04:47.385>to <00:04:47.512>build <00:04:47.640>AI

00:04:49.110 --> 00:04:49.120 align:start position:0%
<00:04:49.110>messages, <00:04:49.111>and <00:04:49.113>we <00:04:49.114>need <00:04:49.116>to <00:04:49.117>build <00:04:49.119>AI

00:04:49.120 --> 00:04:50.590 align:start position:0%
<00:04:49.120>messages, <00:04:49.309>and <00:04:49.498>we <00:04:49.687>need <00:04:49.876>to <00:04:50.065>build <00:04:50.254>AI <00:04:50.443>moderation.

00:04:50.590 --> 00:04:50.600 align:start position:0%
moderation.

00:04:50.600 --> 00:04:53.310 align:start position:0%
<00:04:50.600>moderation. <00:04:50.833>And <00:04:51.066>AI <00:04:51.300>moderation <00:04:51.533>can <00:04:51.766>mean <00:04:52.000>different

00:04:53.310 --> 00:04:53.320 align:start position:0%
<00:04:53.310>And <00:04:53.311>AI <00:04:53.313>moderation <00:04:53.315>can <00:04:53.317>mean <00:04:53.319>different

00:04:53.320 --> 00:04:55.470 align:start position:0%
<00:04:53.320>And <00:04:53.447>AI <00:04:53.574>moderation <00:04:53.701>can <00:04:53.829>mean <00:04:53.956>different <00:04:54.083>tasks, <00:04:54.210>right? <00:04:54.338>So, <00:04:54.465>for <00:04:54.592>your <00:04:54.719>workloads,

00:04:55.470 --> 00:04:55.480 align:start position:0%
<00:04:55.470>tasks, <00:04:55.471>right? <00:04:55.473>So, <00:04:55.475>for <00:04:55.477>your <00:04:55.479>workloads,

00:04:55.480 --> 00:04:57.590 align:start position:0%
<00:04:55.480>tasks, <00:04:55.596>right? <00:04:55.713>So, <00:04:55.830>for <00:04:55.946>your <00:04:56.063>workloads, <00:04:56.180>you <00:04:56.296>also <00:04:56.413>will <00:04:56.530>have <00:04:56.646>different <00:04:56.763>tasks. <00:04:56.880>One

00:04:57.590 --> 00:04:57.600 align:start position:0%
<00:04:57.590>you <00:04:57.591>also <00:04:57.593>will <00:04:57.594>have <00:04:57.596>different <00:04:57.597>tasks. <00:04:57.599>One

00:04:57.600 --> 00:05:00.909 align:start position:0%
<00:04:57.600>you <00:04:57.707>also <00:04:57.815>will <00:04:57.923>have <00:04:58.030>different <00:04:58.138>tasks. <00:04:58.246>One <00:04:58.353>task <00:04:58.461>is <00:04:58.569>to <00:04:58.676>classify <00:04:58.784>those <00:04:58.892>messages. <00:04:59.000>Some

00:05:00.909 --> 00:05:00.919 align:start position:0%
<00:05:00.909>task <00:05:00.910>is <00:05:00.912>to <00:05:00.913>classify <00:05:00.914>those <00:05:00.916>messages. <00:05:00.918>Some

00:05:00.919 --> 00:05:03.350 align:start position:0%
<00:05:00.919>task <00:05:01.026>is <00:05:01.134>to <00:05:01.242>classify <00:05:01.349>those <00:05:01.457>messages. <00:05:01.565>Some <00:05:01.672>of <00:05:01.780>them <00:05:01.888>will <00:05:01.995>be <00:05:02.103>spam, <00:05:02.211>harassment. <00:05:02.318>We

00:05:03.350 --> 00:05:03.360 align:start position:0%
<00:05:03.350>of <00:05:03.351>them <00:05:03.353>will <00:05:03.354>be <00:05:03.356>spam, <00:05:03.357>harassment. <00:05:03.359>We

00:05:03.360 --> 00:05:06.150 align:start position:0%
<00:05:03.360>of <00:05:03.460>them <00:05:03.560>will <00:05:03.660>be <00:05:03.760>spam, <00:05:03.860>harassment. <00:05:03.960>We <00:05:04.060>right <00:05:04.160>away <00:05:04.260>want <00:05:04.360>to <00:05:04.460>auto <00:05:04.560>ban <00:05:04.660>them. <00:05:04.760>But,

00:05:06.150 --> 00:05:06.160 align:start position:0%
<00:05:06.150>right <00:05:06.151>away <00:05:06.152>want <00:05:06.153>to <00:05:06.155>auto <00:05:06.156>ban <00:05:06.157>them. <00:05:06.159>But,

00:05:06.160 --> 00:05:08.430 align:start position:0%
<00:05:06.160>right <00:05:06.253>away <00:05:06.346>want <00:05:06.440>to <00:05:06.533>auto <00:05:06.626>ban <00:05:06.720>them. <00:05:06.813>But, <00:05:06.906>you <00:05:07.000>know, <00:05:07.093>some <00:05:07.186>messages <00:05:07.280>might <00:05:07.373>not <00:05:07.466>be <00:05:07.560>as

00:05:08.430 --> 00:05:08.440 align:start position:0%
<00:05:08.430>you <00:05:08.431>know, <00:05:08.432>some <00:05:08.433>messages <00:05:08.435>might <00:05:08.436>not <00:05:08.437>be <00:05:08.439>as

00:05:08.440 --> 00:05:11.430 align:start position:0%
<00:05:08.440>you <00:05:08.533>know, <00:05:08.626>some <00:05:08.719>messages <00:05:08.813>might <00:05:08.906>not <00:05:09.000>be <00:05:09.093>as <00:05:09.186>easy. <00:05:09.280>It <00:05:09.373>might <00:05:09.466>be <00:05:09.560>a <00:05:09.653>joke, <00:05:09.746>might <00:05:09.840>be

00:05:11.430 --> 00:05:11.440 align:start position:0%
<00:05:11.430>easy. <00:05:11.431>It <00:05:11.432>might <00:05:11.433>be <00:05:11.435>a <00:05:11.436>joke, <00:05:11.437>might <00:05:11.439>be

00:05:11.440 --> 00:05:14.470 align:start position:0%
<00:05:11.440>easy. <00:05:11.540>It <00:05:11.640>might <00:05:11.740>be <00:05:11.840>a <00:05:11.940>joke, <00:05:12.040>might <00:05:12.140>be <00:05:12.240>sarcasm, <00:05:12.340>or <00:05:12.440>might <00:05:12.540>be <00:05:12.640>a <00:05:12.740>threat <00:05:12.840>disguised

00:05:14.470 --> 00:05:14.480 align:start position:0%
<00:05:14.470>sarcasm, <00:05:14.471>or <00:05:14.473>might <00:05:14.474>be <00:05:14.476>a <00:05:14.477>threat <00:05:14.479>disguised

00:05:14.480 --> 00:05:17.590 align:start position:0%
<00:05:14.480>sarcasm, <00:05:14.573>or <00:05:14.666>might <00:05:14.760>be <00:05:14.853>a <00:05:14.946>threat <00:05:15.040>disguised <00:05:15.133>as <00:05:15.226>a <00:05:15.320>joke. <00:05:15.413>And <00:05:15.506>for <00:05:15.600>those <00:05:15.693>tasks, <00:05:15.786>we <00:05:15.880>need

00:05:17.590 --> 00:05:17.600 align:start position:0%
<00:05:17.590>as <00:05:17.591>a <00:05:17.592>joke. <00:05:17.593>And <00:05:17.594>for <00:05:17.595>those <00:05:17.596>tasks, <00:05:17.597>we <00:05:17.599>need

00:05:17.600 --> 00:05:21.230 align:start position:0%
<00:05:17.600>as <00:05:17.687>a <00:05:17.775>joke. <00:05:17.862>And <00:05:17.950>for <00:05:18.037>those <00:05:18.125>tasks, <00:05:18.212>we <00:05:18.300>need <00:05:18.387>to <00:05:18.475>provide <00:05:18.562>enough <00:05:18.650>context <00:05:18.737>for <00:05:18.825>a <00:05:18.912>human <00:05:19.000>to

00:05:21.230 --> 00:05:21.240 align:start position:0%
<00:05:21.230>to <00:05:21.231>provide <00:05:21.232>enough <00:05:21.233>context <00:05:21.235>for <00:05:21.236>a <00:05:21.237>human <00:05:21.239>to

00:05:21.240 --> 00:05:23.990 align:start position:0%
<00:05:21.240>to <00:05:21.347>provide <00:05:21.455>enough <00:05:21.563>context <00:05:21.670>for <00:05:21.778>a <00:05:21.886>human <00:05:21.993>to <00:05:22.101>review. <00:05:22.209>So, <00:05:22.316>we <00:05:22.424>have <00:05:22.532>two <00:05:22.640>tasks

00:05:23.990 --> 00:05:24.000 align:start position:0%
<00:05:23.990>review. <00:05:23.991>So, <00:05:23.993>we <00:05:23.995>have <00:05:23.997>two <00:05:23.999>tasks

00:05:24.000 --> 00:05:26.550 align:start position:0%
<00:05:24.000>review. <00:05:24.107>So, <00:05:24.215>we <00:05:24.323>have <00:05:24.430>two <00:05:24.538>tasks <00:05:24.646>that <00:05:24.753>we <00:05:24.861>will <00:05:24.969>be <00:05:25.076>trying <00:05:25.184>to <00:05:25.292>identify <00:05:25.400>the

00:05:26.550 --> 00:05:26.560 align:start position:0%
<00:05:26.550>that <00:05:26.551>we <00:05:26.552>will <00:05:26.553>be <00:05:26.555>trying <00:05:26.556>to <00:05:26.557>identify <00:05:26.559>the

00:05:26.560 --> 00:05:28.590 align:start position:0%
<00:05:26.560>that <00:05:26.653>we <00:05:26.746>will <00:05:26.840>be <00:05:26.933>trying <00:05:27.026>to <00:05:27.120>identify <00:05:27.213>the <00:05:27.306>right <00:05:27.400>model. <00:05:27.493>So, <00:05:27.586>now <00:05:27.680>you <00:05:27.773>can <00:05:27.866>all <00:05:27.960>think

00:05:28.590 --> 00:05:28.600 align:start position:0%
<00:05:28.590>right <00:05:28.591>model. <00:05:28.592>So, <00:05:28.593>now <00:05:28.595>you <00:05:28.596>can <00:05:28.597>all <00:05:28.599>think

00:05:28.600 --> 00:05:31.190 align:start position:0%
<00:05:28.600>right <00:05:28.693>model. <00:05:28.786>So, <00:05:28.880>now <00:05:28.973>you <00:05:29.066>can <00:05:29.160>all <00:05:29.253>think <00:05:29.346>about <00:05:29.440>which <00:05:29.533>model <00:05:29.626>is <00:05:29.720>going <00:05:29.813>to <00:05:29.906>win <00:05:30.000>for

00:05:31.190 --> 00:05:31.200 align:start position:0%
<00:05:31.190>about <00:05:31.191>which <00:05:31.192>model <00:05:31.193>is <00:05:31.195>going <00:05:31.196>to <00:05:31.197>win <00:05:31.199>for

00:05:31.200 --> 00:05:33.590 align:start position:0%
<00:05:31.200>about <00:05:31.293>which <00:05:31.386>model <00:05:31.479>is <00:05:31.573>going <00:05:31.666>to <00:05:31.760>win <00:05:31.853>for <00:05:31.946>which <00:05:32.039>task, <00:05:32.133>and <00:05:32.226>you <00:05:32.320>will <00:05:32.413>see <00:05:32.506>the <00:05:32.599>results

00:05:33.590 --> 00:05:33.600 align:start position:0%
<00:05:33.590>which <00:05:33.591>task, <00:05:33.592>and <00:05:33.593>you <00:05:33.595>will <00:05:33.596>see <00:05:33.597>the <00:05:33.599>results

00:05:33.600 --> 00:05:35.990 align:start position:0%
<00:05:33.600>which <00:05:33.682>task, <00:05:33.764>and <00:05:33.847>you <00:05:33.929>will <00:05:34.011>see <00:05:34.094>the <00:05:34.176>results <00:05:34.258>at <00:05:34.341>the <00:05:34.423>end. <00:05:34.505>So, <00:05:34.588>the <00:05:34.670>way <00:05:34.752>that <00:05:34.835>we <00:05:34.917>will <00:05:35.000>do

00:05:35.990 --> 00:05:36.000 align:start position:0%
<00:05:35.990>at <00:05:35.991>the <00:05:35.992>end. <00:05:35.993>So, <00:05:35.994>the <00:05:35.995>way <00:05:35.996>that <00:05:35.997>we <00:05:35.998>will <00:05:35.999>do

00:05:36.000 --> 00:05:38.150 align:start position:0%
<00:05:36.000>at <00:05:36.082>the <00:05:36.164>end. <00:05:36.247>So, <00:05:36.329>the <00:05:36.411>way <00:05:36.494>that <00:05:36.576>we <00:05:36.658>will <00:05:36.741>do <00:05:36.823>it, <00:05:36.905>we <00:05:36.988>will <00:05:37.070>do <00:05:37.152>it <00:05:37.235>in <00:05:37.317>a <00:05:37.400>step-by-step

00:05:38.150 --> 00:05:38.160 align:start position:0%
<00:05:38.150>it, <00:05:38.151>we <00:05:38.152>will <00:05:38.153>do <00:05:38.155>it <00:05:38.156>in <00:05:38.157>a <00:05:38.159>step-by-step

00:05:38.160 --> 00:05:40.510 align:start position:0%
<00:05:38.159>it, <00:05:38.260>we <00:05:38.359>will <00:05:38.460>do <00:05:38.559>it <00:05:38.659>in <00:05:38.760>a <00:05:38.859>step-by-step <00:05:38.960>approach. <00:05:39.059>So, <00:05:39.159>first <00:05:39.260>we <00:05:39.359>will <00:05:39.460>just <00:05:39.559>discuss

00:05:40.510 --> 00:05:40.520 align:start position:0%
<00:05:40.510>approach. <00:05:40.511>So, <00:05:40.513>first <00:05:40.514>we <00:05:40.515>will <00:05:40.517>just <00:05:40.519>discuss

00:05:40.520 --> 00:05:42.430 align:start position:0%
<00:05:40.520>approach. <00:05:40.647>So, <00:05:40.774>first <00:05:40.901>we <00:05:41.029>will <00:05:41.156>just <00:05:41.283>discuss <00:05:41.410>about <00:05:41.538>different <00:05:41.665>models <00:05:41.792>that <00:05:41.919>are

00:05:42.430 --> 00:05:42.440 align:start position:0%
<00:05:42.430>about <00:05:42.432>different <00:05:42.434>models <00:05:42.436>that <00:05:42.439>are

00:05:42.440 --> 00:05:45.270 align:start position:0%
<00:05:42.440>about <00:05:42.595>different <00:05:42.751>models <00:05:42.906>that <00:05:43.062>are <00:05:43.217>available, <00:05:43.373>what <00:05:43.528>are <00:05:43.684>their <00:05:43.840>trade-offs.

00:05:45.270 --> 00:05:45.280 align:start position:0%
<00:05:45.270>available, <00:05:45.272>what <00:05:45.274>are <00:05:45.276>their <00:05:45.279>trade-offs.

00:05:45.280 --> 00:05:47.830 align:start position:0%
<00:05:45.280>available, <00:05:45.396>what <00:05:45.513>are <00:05:45.630>their <00:05:45.746>trade-offs. <00:05:45.863>And <00:05:45.979>then <00:05:46.096>talk <00:05:46.213>about <00:05:46.330>step <00:05:46.446>one, <00:05:46.563>how <00:05:46.679>to

00:05:47.830 --> 00:05:47.840 align:start position:0%
<00:05:47.830>And <00:05:47.831>then <00:05:47.832>talk <00:05:47.833>about <00:05:47.835>step <00:05:47.836>one, <00:05:47.837>how <00:05:47.839>to

00:05:47.840 --> 00:05:50.950 align:start position:0%
<00:05:47.840>And <00:05:47.940>then <00:05:48.040>talk <00:05:48.140>about <00:05:48.240>step <00:05:48.340>one, <00:05:48.440>how <00:05:48.540>to <00:05:48.640>evaluate <00:05:48.740>them. <00:05:48.840>Step <00:05:48.940>two, <00:05:49.040>how <00:05:49.140>to <00:05:49.240>deploy

00:05:50.950 --> 00:05:50.960 align:start position:0%
<00:05:50.950>evaluate <00:05:50.951>them. <00:05:50.953>Step <00:05:50.954>two, <00:05:50.955>how <00:05:50.957>to <00:05:50.959>deploy

00:05:50.960 --> 00:05:54.190 align:start position:0%
<00:05:50.960>evaluate <00:05:51.067>them. <00:05:51.175>Step <00:05:51.283>two, <00:05:51.390>how <00:05:51.498>to <00:05:51.606>deploy <00:05:51.713>these <00:05:51.821>models <00:05:51.929>and <00:05:52.036>utilize <00:05:52.144>live <00:05:52.252>traces <00:05:52.359>to

00:05:54.190 --> 00:05:54.200 align:start position:0%
<00:05:54.190>these <00:05:54.191>models <00:05:54.193>and <00:05:54.194>utilize <00:05:54.195>live <00:05:54.197>traces <00:05:54.199>to

00:05:54.200 --> 00:05:55.910 align:start position:0%
<00:05:54.200>these <00:05:54.400>models <00:05:54.599>and <00:05:54.800>utilize <00:05:55.000>live <00:05:55.200>traces <00:05:55.400>to <00:05:55.599>continuously

00:05:55.910 --> 00:05:55.920 align:start position:0%
continuously

00:05:55.920 --> 00:05:58.270 align:start position:0%
<00:05:55.920>continuously <00:05:56.386>improve <00:05:56.853>our <00:05:57.320>results.

00:05:58.270 --> 00:05:58.280 align:start position:0%
<00:05:58.270>improve <00:05:58.274>our <00:05:58.279>results.

00:05:58.280 --> 00:06:00.350 align:start position:0%
<00:05:58.280>improve <00:05:58.435>our <00:05:58.591>results. <00:05:58.746>And <00:05:58.902>then <00:05:59.057>step <00:05:59.213>three, <00:05:59.368>we'll <00:05:59.524>talk <00:05:59.679>about

00:06:00.350 --> 00:06:00.360 align:start position:0%
<00:06:00.350>And <00:06:00.351>then <00:06:00.353>step <00:06:00.354>three, <00:06:00.356>we'll <00:06:00.357>talk <00:06:00.359>about

00:06:00.360 --> 00:06:02.630 align:start position:0%
<00:06:00.360>And <00:06:00.476>then <00:06:00.593>step <00:06:00.710>three, <00:06:00.826>we'll <00:06:00.943>talk <00:06:01.060>about <00:06:01.176>when <00:06:01.293>you <00:06:01.410>actually <00:06:01.526>need <00:06:01.643>to <00:06:01.760>fine-tune

00:06:02.630 --> 00:06:02.640 align:start position:0%
<00:06:02.630>when <00:06:02.631>you <00:06:02.633>actually <00:06:02.635>need <00:06:02.637>to <00:06:02.639>fine-tune

00:06:02.640 --> 00:06:05.150 align:start position:0%
<00:06:02.640>when <00:06:02.780>you <00:06:02.919>actually <00:06:03.060>need <00:06:03.200>to <00:06:03.340>fine-tune <00:06:03.479>because <00:06:03.620>fine-tuning <00:06:03.760>shouldn't <00:06:03.900>be <00:06:04.039>your

00:06:05.150 --> 00:06:05.160 align:start position:0%
<00:06:05.150>because <00:06:05.152>fine-tuning <00:06:05.154>shouldn't <00:06:05.156>be <00:06:05.159>your

00:06:05.160 --> 00:06:07.150 align:start position:0%
<00:06:05.160>because <00:06:05.300>fine-tuning <00:06:05.440>shouldn't <00:06:05.580>be <00:06:05.720>your <00:06:05.860>default <00:06:06.000>choice. <00:06:06.140>So, <00:06:06.280>what <00:06:06.420>are <00:06:06.560>those

00:06:07.150 --> 00:06:07.160 align:start position:0%
<00:06:07.150>default <00:06:07.151>choice. <00:06:07.153>So, <00:06:07.155>what <00:06:07.157>are <00:06:07.159>those

00:06:07.160 --> 00:06:09.270 align:start position:0%
<00:06:07.160>default <00:06:07.287>choice. <00:06:07.414>So, <00:06:07.541>what <00:06:07.669>are <00:06:07.796>those <00:06:07.923>requirements <00:06:08.050>for <00:06:08.178>a <00:06:08.305>fine-tuning <00:06:08.432>and <00:06:08.560>how

00:06:09.270 --> 00:06:09.280 align:start position:0%
<00:06:09.270>requirements <00:06:09.271>for <00:06:09.273>a <00:06:09.275>fine-tuning <00:06:09.277>and <00:06:09.279>how

00:06:09.280 --> 00:06:10.750 align:start position:0%
<00:06:09.280>requirements <00:06:09.426>for <00:06:09.573>a <00:06:09.721>fine-tuning <00:06:09.868>and <00:06:10.015>how <00:06:10.162>you <00:06:10.308>can <00:06:10.456>do <00:06:10.603>it?

00:06:10.750 --> 00:06:10.760 align:start position:0%
<00:06:10.750>you <00:06:10.753>can <00:06:10.756>do <00:06:10.759>it?

00:06:10.760 --> 00:06:13.470 align:start position:0%
<00:06:10.760>you <00:06:10.915>can <00:06:11.071>do <00:06:11.226>it? <00:06:11.382>Uh <00:06:11.537>quick <00:06:11.693>question <00:06:11.848>before <00:06:12.004>I <00:06:12.159>begin,

00:06:13.470 --> 00:06:13.480 align:start position:0%
<00:06:13.470>Uh <00:06:13.471>quick <00:06:13.473>question <00:06:13.475>before <00:06:13.477>I <00:06:13.479>begin,

00:06:13.480 --> 00:06:16.070 align:start position:0%
<00:06:13.480>Uh <00:06:13.596>quick <00:06:13.713>question <00:06:13.830>before <00:06:13.946>I <00:06:14.063>begin, <00:06:14.180>how <00:06:14.296>many <00:06:14.413>of <00:06:14.530>you <00:06:14.646>tried <00:06:14.763>Databricks? <00:06:14.880>This

00:06:16.070 --> 00:06:16.080 align:start position:0%
<00:06:16.070>how <00:06:16.071>many <00:06:16.073>of <00:06:16.074>you <00:06:16.075>tried <00:06:16.077>Databricks? <00:06:16.079>This

00:06:16.080 --> 00:06:17.990 align:start position:0%
<00:06:16.080>how <00:06:16.180>many <00:06:16.280>of <00:06:16.380>you <00:06:16.479>tried <00:06:16.580>Databricks? <00:06:16.680>This <00:06:16.780>will <00:06:16.880>just <00:06:16.979>help <00:06:17.080>me <00:06:17.180>to <00:06:17.280>understand <00:06:17.380>how <00:06:17.479>much

00:06:17.990 --> 00:06:18.000 align:start position:0%
<00:06:17.990>will <00:06:17.991>just <00:06:17.992>help <00:06:17.993>me <00:06:17.995>to <00:06:17.996>understand <00:06:17.997>how <00:06:17.999>much

00:06:18.000 --> 00:06:20.150 align:start position:0%
<00:06:18.000>will <00:06:18.093>just <00:06:18.186>help <00:06:18.280>me <00:06:18.373>to <00:06:18.466>understand <00:06:18.560>how <00:06:18.653>much <00:06:18.746>to <00:06:18.840>explain. <00:06:18.933>Can <00:06:19.026>you <00:06:19.120>raise <00:06:19.213>your <00:06:19.306>hand <00:06:19.400>if

00:06:20.150 --> 00:06:20.160 align:start position:0%
<00:06:20.150>to <00:06:20.151>explain. <00:06:20.152>Can <00:06:20.153>you <00:06:20.155>raise <00:06:20.156>your <00:06:20.157>hand <00:06:20.159>if

00:06:20.160 --> 00:06:22.630 align:start position:0%
<00:06:20.160>to <00:06:20.300>explain. <00:06:20.440>Can <00:06:20.580>you <00:06:20.720>raise <00:06:20.860>your <00:06:21.000>hand <00:06:21.140>if <00:06:21.280>you <00:06:21.420>tried <00:06:21.560>Databricks?

00:06:22.630 --> 00:06:22.640 align:start position:0%
<00:06:22.630>you <00:06:22.634>tried <00:06:22.639>Databricks?

00:06:22.640 --> 00:06:26.909 align:start position:0%
<00:06:22.640>you <00:06:22.780>tried <00:06:22.919>Databricks? <00:06:23.060>Okay, <00:06:23.200>maybe <00:06:23.340>30%. <00:06:23.479>Good. <00:06:23.620>So, <00:06:23.760>you <00:06:23.900>all <00:06:24.039>Most

00:06:26.909 --> 00:06:26.919 align:start position:0%
<00:06:26.909>Okay, <00:06:26.910>maybe <00:06:26.911>30%. <00:06:26.912>Good. <00:06:26.914>So, <00:06:26.915>you <00:06:26.916>all <00:06:26.918>Most

00:06:26.919 --> 00:06:28.150 align:start position:0%
<00:06:26.919>Okay, <00:06:26.998>maybe <00:06:27.077>30%. <00:06:27.156>Good. <00:06:27.235>So, <00:06:27.314>you <00:06:27.393>all <00:06:27.472>Most <00:06:27.552>of <00:06:27.631>you <00:06:27.710>going <00:06:27.789>to <00:06:27.868>learn <00:06:27.947>something <00:06:28.026>new

00:06:28.150 --> 00:06:28.160 align:start position:0%
<00:06:28.150>of <00:06:28.151>you <00:06:28.153>going <00:06:28.154>to <00:06:28.156>learn <00:06:28.157>something <00:06:28.159>new

00:06:28.160 --> 00:06:29.430 align:start position:0%
<00:06:28.160>of <00:06:28.323>you <00:06:28.486>going <00:06:28.649>to <00:06:28.813>learn <00:06:28.976>something <00:06:29.139>new <00:06:29.303>today.

00:06:29.430 --> 00:06:29.440 align:start position:0%
today.

00:06:29.440 --> 00:06:31.110 align:start position:0%
<00:06:29.440>today. <00:06:30.140>Um <00:06:30.840>so,

00:06:31.110 --> 00:06:31.120 align:start position:0%
<00:06:31.110>Um <00:06:31.119>so,

00:06:31.120 --> 00:06:33.870 align:start position:0%
<00:06:31.120>Um <00:06:31.320>so, <00:06:31.520>first, <00:06:31.720>let's <00:06:31.920>talk <00:06:32.120>about <00:06:32.320>what <00:06:32.520>enterprises

00:06:33.870 --> 00:06:33.880 align:start position:0%
<00:06:33.870>first, <00:06:33.871>let's <00:06:33.873>talk <00:06:33.875>about <00:06:33.877>what <00:06:33.879>enterprises

00:06:33.880 --> 00:06:36.750 align:start position:0%
<00:06:33.880>first, <00:06:34.007>let's <00:06:34.134>talk <00:06:34.261>about <00:06:34.389>what <00:06:34.516>enterprises <00:06:34.643>are <00:06:34.770>already <00:06:34.898>doing <00:06:35.025>to <00:06:35.152>win <00:06:35.280>now.

00:06:36.750 --> 00:06:36.760 align:start position:0%
<00:06:36.750>are <00:06:36.751>already <00:06:36.753>doing <00:06:36.755>to <00:06:36.757>win <00:06:36.759>now.

00:06:36.760 --> 00:06:40.510 align:start position:0%
<00:06:36.760>are <00:06:36.876>already <00:06:36.993>doing <00:06:37.110>to <00:06:37.226>win <00:06:37.343>now. <00:06:37.460>If <00:06:37.576>you <00:06:37.693>look <00:06:37.810>at <00:06:37.926>Corsa, <00:06:38.043>Perplexity, <00:06:38.159>Glean,

00:06:40.510 --> 00:06:40.520 align:start position:0%
<00:06:40.510>If <00:06:40.511>you <00:06:40.513>look <00:06:40.514>at <00:06:40.515>Corsa, <00:06:40.517>Perplexity, <00:06:40.519>Glean,

00:06:40.520 --> 00:06:42.470 align:start position:0%
<00:06:40.520>If <00:06:40.636>you <00:06:40.753>look <00:06:40.870>at <00:06:40.986>Corsa, <00:06:41.103>Perplexity, <00:06:41.219>Glean, <00:06:41.336>most <00:06:41.453>of <00:06:41.570>these <00:06:41.686>companies, <00:06:41.803>they <00:06:41.919>already

00:06:42.470 --> 00:06:42.480 align:start position:0%
<00:06:42.470>most <00:06:42.471>of <00:06:42.473>these <00:06:42.475>companies, <00:06:42.477>they <00:06:42.479>already

00:06:42.480 --> 00:06:44.950 align:start position:0%
<00:06:42.480>most <00:06:42.607>of <00:06:42.734>these <00:06:42.861>companies, <00:06:42.989>they <00:06:43.116>already <00:06:43.243>utilizing <00:06:43.370>open <00:06:43.498>weight <00:06:43.625>models <00:06:43.752>in <00:06:43.880>their

00:06:44.950 --> 00:06:44.960 align:start position:0%
<00:06:44.950>utilizing <00:06:44.951>open <00:06:44.953>weight <00:06:44.955>models <00:06:44.957>in <00:06:44.959>their

00:06:44.960 --> 00:06:46.430 align:start position:0%
<00:06:44.960>utilizing <00:06:45.180>open <00:06:45.401>weight <00:06:45.621>models <00:06:45.842>in <00:06:46.062>their <00:06:46.283>production.

00:06:46.430 --> 00:06:46.440 align:start position:0%
production.

00:06:46.440 --> 00:06:50.230 align:start position:0%
<00:06:46.440>production. <00:06:46.615>And <00:06:46.790>what <00:06:46.965>this <00:06:47.140>chart <00:06:47.315>shows <00:06:47.490>is <00:06:47.665>how <00:06:47.840>quickly

00:06:50.230 --> 00:06:50.240 align:start position:0%
<00:06:50.230>And <00:06:50.231>what <00:06:50.232>this <00:06:50.233>chart <00:06:50.235>shows <00:06:50.236>is <00:06:50.237>how <00:06:50.239>quickly

00:06:50.240 --> 00:06:52.830 align:start position:0%
<00:06:50.240>And <00:06:50.347>what <00:06:50.455>this <00:06:50.563>chart <00:06:50.670>shows <00:06:50.778>is <00:06:50.886>how <00:06:50.993>quickly <00:06:51.101>those <00:06:51.209>open <00:06:51.316>weight <00:06:51.424>models <00:06:51.532>catching <00:06:51.640>up

00:06:52.830 --> 00:06:52.840 align:start position:0%
<00:06:52.830>those <00:06:52.831>open <00:06:52.833>weight <00:06:52.835>models <00:06:52.837>catching <00:06:52.839>up

00:06:52.840 --> 00:06:55.750 align:start position:0%
<00:06:52.840>those <00:06:52.967>open <00:06:53.094>weight <00:06:53.221>models <00:06:53.349>catching <00:06:53.476>up <00:06:53.603>with <00:06:53.730>proprietary. <00:06:53.858>So, <00:06:53.985>right <00:06:54.112>now, <00:06:54.240>they're

00:06:55.750 --> 00:06:55.760 align:start position:0%
<00:06:55.750>with <00:06:55.751>proprietary. <00:06:55.753>So, <00:06:55.755>right <00:06:55.757>now, <00:06:55.759>they're

00:06:55.760 --> 00:06:58.510 align:start position:0%
<00:06:55.760>with <00:06:55.876>proprietary. <00:06:55.993>So, <00:06:56.110>right <00:06:56.226>now, <00:06:56.343>they're <00:06:56.460>about <00:06:56.576>3 <00:06:56.693>and <00:06:56.810>1/2 <00:06:56.926>months <00:06:57.043>apart. <00:06:57.159>So,

00:06:58.510 --> 00:06:58.520 align:start position:0%
<00:06:58.510>about <00:06:58.511>3 <00:06:58.513>and <00:06:58.514>1/2 <00:06:58.515>months <00:06:58.517>apart. <00:06:58.519>So,

00:06:58.520 --> 00:07:00.750 align:start position:0%
<00:06:58.520>about <00:06:58.627>3 <00:06:58.735>and <00:06:58.843>1/2 <00:06:58.950>months <00:06:59.058>apart. <00:06:59.166>So, <00:06:59.273>basically, <00:06:59.381>the <00:06:59.489>new <00:06:59.596>model <00:06:59.704>drops, <00:06:59.812>it <00:06:59.919>has

00:07:00.750 --> 00:07:00.760 align:start position:0%
<00:07:00.750>basically, <00:07:00.751>the <00:07:00.753>new <00:07:00.754>model <00:07:00.756>drops, <00:07:00.757>it <00:07:00.759>has

00:07:00.760 --> 00:07:03.870 align:start position:0%
<00:07:00.760>basically, <00:07:00.867>the <00:07:00.975>new <00:07:01.083>model <00:07:01.190>drops, <00:07:01.298>it <00:07:01.406>has <00:07:01.513>this <00:07:01.621>intelligence <00:07:01.729>score <00:07:01.836>on <00:07:01.944>the <00:07:02.052>Y <00:07:02.159>axis,

00:07:03.870 --> 00:07:03.880 align:start position:0%
<00:07:03.870>this <00:07:03.871>intelligence <00:07:03.873>score <00:07:03.874>on <00:07:03.876>the <00:07:03.877>Y <00:07:03.879>axis,

00:07:03.880 --> 00:07:06.030 align:start position:0%
<00:07:03.880>this <00:07:03.980>intelligence <00:07:04.080>score <00:07:04.180>on <00:07:04.280>the <00:07:04.380>Y <00:07:04.480>axis, <00:07:04.580>and <00:07:04.680>3 <00:07:04.780>and <00:07:04.880>1/2 <00:07:04.980>months <00:07:05.080>later, <00:07:05.180>you <00:07:05.280>already

00:07:06.030 --> 00:07:06.040 align:start position:0%
<00:07:06.030>and <00:07:06.031>3 <00:07:06.032>and <00:07:06.033>1/2 <00:07:06.035>months <00:07:06.036>later, <00:07:06.037>you <00:07:06.039>already

00:07:06.040 --> 00:07:08.070 align:start position:0%
<00:07:06.040>and <00:07:06.147>3 <00:07:06.255>and <00:07:06.363>1/2 <00:07:06.470>months <00:07:06.578>later, <00:07:06.686>you <00:07:06.793>already <00:07:06.901>have <00:07:07.009>open <00:07:07.116>weight <00:07:07.224>model <00:07:07.332>that <00:07:07.440>achieves

00:07:08.070 --> 00:07:08.080 align:start position:0%
<00:07:08.070>have <00:07:08.071>open <00:07:08.073>weight <00:07:08.075>model <00:07:08.077>that <00:07:08.079>achieves

00:07:08.080 --> 00:07:10.310 align:start position:0%
<00:07:08.080>have <00:07:08.280>open <00:07:08.479>weight <00:07:08.680>model <00:07:08.880>that <00:07:09.080>achieves <00:07:09.280>similar <00:07:09.479>quality.

00:07:10.310 --> 00:07:10.320 align:start position:0%
<00:07:10.310>similar <00:07:10.319>quality.

00:07:10.320 --> 00:07:14.390 align:start position:0%
<00:07:10.320>similar <00:07:10.475>quality. <00:07:10.631>What <00:07:10.786>we <00:07:10.942>also <00:07:11.097>seen <00:07:11.253>that <00:07:11.408>38% <00:07:11.564>of <00:07:11.719>overall

00:07:14.390 --> 00:07:14.400 align:start position:0%
<00:07:14.390>What <00:07:14.391>we <00:07:14.392>also <00:07:14.393>seen <00:07:14.395>that <00:07:14.396>38% <00:07:14.397>of <00:07:14.399>overall

00:07:14.400 --> 00:07:16.990 align:start position:0%
<00:07:14.400>What <00:07:14.507>we <00:07:14.615>also <00:07:14.723>seen <00:07:14.830>that <00:07:14.938>38% <00:07:15.046>of <00:07:15.153>overall <00:07:15.261>traffic <00:07:15.369>in <00:07:15.476>token <00:07:15.584>volume <00:07:15.692>is <00:07:15.799>already

00:07:16.990 --> 00:07:17.000 align:start position:0%
<00:07:16.990>traffic <00:07:16.991>in <00:07:16.993>token <00:07:16.995>volume <00:07:16.997>is <00:07:16.999>already

00:07:17.000 --> 00:07:19.590 align:start position:0%
<00:07:17.000>traffic <00:07:17.127>in <00:07:17.254>token <00:07:17.381>volume <00:07:17.509>is <00:07:17.636>already <00:07:17.763>actually <00:07:17.890>coming <00:07:18.018>from <00:07:18.145>open <00:07:18.272>weight <00:07:18.400>models.

00:07:19.590 --> 00:07:19.600 align:start position:0%
<00:07:19.590>actually <00:07:19.591>coming <00:07:19.593>from <00:07:19.595>open <00:07:19.597>weight <00:07:19.599>models.

00:07:19.600 --> 00:07:22.430 align:start position:0%
<00:07:19.600>actually <00:07:19.755>coming <00:07:19.911>from <00:07:20.066>open <00:07:20.222>weight <00:07:20.377>models. <00:07:20.533>So, <00:07:20.688>companies <00:07:20.844>increasingly <00:07:21.000>utilizing

00:07:22.430 --> 00:07:22.440 align:start position:0%
<00:07:22.430>So, <00:07:22.433>companies <00:07:22.436>increasingly <00:07:22.439>utilizing

00:07:22.440 --> 00:07:23.670 align:start position:0%
<00:07:22.440>So, <00:07:22.661>companies <00:07:22.882>increasingly <00:07:23.104>utilizing <00:07:23.325>open <00:07:23.547>weight

00:07:23.670 --> 00:07:23.680 align:start position:0%
<00:07:23.670>open <00:07:23.679>weight

00:07:23.680 --> 00:07:24.790 align:start position:0%
<00:07:23.680>open <00:07:24.179>weight <00:07:24.679>models.

00:07:24.790 --> 00:07:24.800 align:start position:0%
models.

00:07:24.800 --> 00:07:27.110 align:start position:0%
<00:07:24.800>models. <00:07:24.975>So, <00:07:25.150>what <00:07:25.325>are <00:07:25.500>the <00:07:25.675>tradeoffs? <00:07:25.850>Let's <00:07:26.025>say <00:07:26.200>if

00:07:27.110 --> 00:07:27.120 align:start position:0%
<00:07:27.110>So, <00:07:27.111>what <00:07:27.112>are <00:07:27.113>the <00:07:27.115>tradeoffs? <00:07:27.116>Let's <00:07:27.117>say <00:07:27.119>if

00:07:27.120 --> 00:07:30.150 align:start position:0%
<00:07:27.120>So, <00:07:27.220>what <00:07:27.320>are <00:07:27.420>the <00:07:27.520>tradeoffs? <00:07:27.620>Let's <00:07:27.720>say <00:07:27.820>if <00:07:27.920>you <00:07:28.020>decide <00:07:28.120>to <00:07:28.220>go <00:07:28.320>with <00:07:28.420>proprietary, <00:07:28.520>open

00:07:30.150 --> 00:07:30.160 align:start position:0%
<00:07:30.150>you <00:07:30.151>decide <00:07:30.153>to <00:07:30.154>go <00:07:30.156>with <00:07:30.157>proprietary, <00:07:30.159>open

00:07:30.160 --> 00:07:32.750 align:start position:0%
<00:07:30.160>you <00:07:30.315>decide <00:07:30.471>to <00:07:30.626>go <00:07:30.782>with <00:07:30.937>proprietary, <00:07:31.093>open <00:07:31.248>weight, <00:07:31.404>or <00:07:31.560>fine-tuned.

00:07:32.750 --> 00:07:32.760 align:start position:0%
<00:07:32.750>weight, <00:07:32.754>or <00:07:32.759>fine-tuned.

00:07:32.760 --> 00:07:34.030 align:start position:0%
<00:07:32.760>weight, <00:07:33.140>or <00:07:33.522>fine-tuned. <00:07:33.902>Well,

00:07:34.030 --> 00:07:34.040 align:start position:0%
Well,

00:07:34.040 --> 00:07:37.110 align:start position:0%
<00:07:34.040>Well, <00:07:34.240>depending <00:07:34.440>on <00:07:34.640>each <00:07:34.840>of <00:07:35.040>these <00:07:35.240>choices, <00:07:35.440>you

00:07:37.110 --> 00:07:37.120 align:start position:0%
<00:07:37.110>depending <00:07:37.111>on <00:07:37.113>each <00:07:37.114>of <00:07:37.116>these <00:07:37.117>choices, <00:07:37.119>you

00:07:37.120 --> 00:07:39.990 align:start position:0%
<00:07:37.120>depending <00:07:37.220>on <00:07:37.320>each <00:07:37.420>of <00:07:37.520>these <00:07:37.620>choices, <00:07:37.720>you <00:07:37.820>are <00:07:37.920>going <00:07:38.020>to <00:07:38.120>give <00:07:38.220>up <00:07:38.320>some <00:07:38.420>control, <00:07:38.520>but

00:07:39.990 --> 00:07:40.000 align:start position:0%
<00:07:39.990>are <00:07:39.991>going <00:07:39.992>to <00:07:39.993>give <00:07:39.995>up <00:07:39.996>some <00:07:39.997>control, <00:07:39.999>but

00:07:40.000 --> 00:07:43.230 align:start position:0%
<00:07:40.000>are <00:07:40.100>going <00:07:40.200>to <00:07:40.300>give <00:07:40.400>up <00:07:40.500>some <00:07:40.600>control, <00:07:40.700>but <00:07:40.800>you <00:07:40.900>also <00:07:41.000>need <00:07:41.100>to <00:07:41.200>take <00:07:41.300>on <00:07:41.400>responsibility.

00:07:43.230 --> 00:07:43.240 align:start position:0%
<00:07:43.230>you <00:07:43.231>also <00:07:43.233>need <00:07:43.234>to <00:07:43.236>take <00:07:43.237>on <00:07:43.239>responsibility.

00:07:43.240 --> 00:07:45.070 align:start position:0%
<00:07:43.240>you <00:07:43.340>also <00:07:43.440>need <00:07:43.540>to <00:07:43.640>take <00:07:43.740>on <00:07:43.840>responsibility. <00:07:43.940>So, <00:07:44.040>let's <00:07:44.140>say <00:07:44.240>if <00:07:44.340>you <00:07:44.440>are <00:07:44.540>decide <00:07:44.640>to

00:07:45.070 --> 00:07:45.080 align:start position:0%
<00:07:45.070>So, <00:07:45.071>let's <00:07:45.072>say <00:07:45.073>if <00:07:45.075>you <00:07:45.076>are <00:07:45.077>decide <00:07:45.079>to

00:07:45.080 --> 00:07:48.230 align:start position:0%
<00:07:45.080>So, <00:07:45.180>let's <00:07:45.280>say <00:07:45.380>if <00:07:45.479>you <00:07:45.580>are <00:07:45.680>decide <00:07:45.780>to <00:07:45.880>utilize <00:07:45.979>proprietary <00:07:46.080>and <00:07:46.180>you <00:07:46.280>can <00:07:46.380>use <00:07:46.479>it

00:07:48.230 --> 00:07:48.240 align:start position:0%
<00:07:48.230>utilize <00:07:48.231>proprietary <00:07:48.233>and <00:07:48.234>you <00:07:48.236>can <00:07:48.237>use <00:07:48.239>it

00:07:48.240 --> 00:07:50.110 align:start position:0%
<00:07:48.240>utilize <00:07:48.367>proprietary <00:07:48.494>and <00:07:48.621>you <00:07:48.749>can <00:07:48.876>use <00:07:49.003>it <00:07:49.130>on <00:07:49.258>Databricks. <00:07:49.385>Actually, <00:07:49.512>Databricks <00:07:49.640>is

00:07:50.110 --> 00:07:50.120 align:start position:0%
<00:07:50.110>on <00:07:50.112>Databricks. <00:07:50.114>Actually, <00:07:50.116>Databricks <00:07:50.119>is

00:07:50.120 --> 00:07:52.630 align:start position:0%
<00:07:50.120>on <00:07:50.247>Databricks. <00:07:50.374>Actually, <00:07:50.501>Databricks <00:07:50.629>is <00:07:50.756>an <00:07:50.883>only <00:07:51.010>platform <00:07:51.138>that <00:07:51.265>allows <00:07:51.392>you <00:07:51.520>to

00:07:52.630 --> 00:07:52.640 align:start position:0%
<00:07:52.630>an <00:07:52.631>only <00:07:52.633>platform <00:07:52.634>that <00:07:52.635>allows <00:07:52.637>you <00:07:52.639>to

00:07:52.640 --> 00:07:55.590 align:start position:0%
<00:07:52.640>an <00:07:52.756>only <00:07:52.873>platform <00:07:52.990>that <00:07:53.106>allows <00:07:53.223>you <00:07:53.340>to <00:07:53.456>utilize <00:07:53.573>any <00:07:53.690>model <00:07:53.806>provider. <00:07:53.923>Meaning, <00:07:54.039>you

00:07:55.590 --> 00:07:55.600 align:start position:0%
<00:07:55.590>utilize <00:07:55.591>any <00:07:55.593>model <00:07:55.595>provider. <00:07:55.597>Meaning, <00:07:55.599>you

00:07:55.600 --> 00:07:58.150 align:start position:0%
<00:07:55.600>utilize <00:07:55.707>any <00:07:55.815>model <00:07:55.923>provider. <00:07:56.030>Meaning, <00:07:56.138>you <00:07:56.246>can <00:07:56.353>go <00:07:56.461>to <00:07:56.569>Gemini, <00:07:56.676>you <00:07:56.784>can <00:07:56.892>use <00:07:57.000>OpenAI,

00:07:58.150 --> 00:07:58.160 align:start position:0%
<00:07:58.150>can <00:07:58.151>go <00:07:58.152>to <00:07:58.153>Gemini, <00:07:58.155>you <00:07:58.156>can <00:07:58.157>use <00:07:58.159>OpenAI,

00:07:58.160 --> 00:08:00.470 align:start position:0%
<00:07:58.159>can <00:07:58.253>go <00:07:58.346>to <00:07:58.439>Gemini, <00:07:58.533>you <00:07:58.626>can <00:07:58.719>use <00:07:58.813>OpenAI, <00:07:58.906>you <00:07:58.999>can <00:07:59.093>use <00:07:59.186>Anthropic. <00:07:59.280>So, <00:07:59.373>you <00:07:59.466>you <00:07:59.559>set

00:08:00.470 --> 00:08:00.480 align:start position:0%
<00:08:00.470>you <00:08:00.471>can <00:08:00.472>use <00:08:00.473>Anthropic. <00:08:00.475>So, <00:08:00.476>you <00:08:00.477>you <00:08:00.479>set

00:08:00.480 --> 00:08:02.590 align:start position:0%
<00:08:00.480>you <00:08:00.580>can <00:08:00.680>use <00:08:00.780>Anthropic. <00:08:00.880>So, <00:08:00.980>you <00:08:01.080>you <00:08:01.180>set <00:08:01.280>up <00:08:01.380>your <00:08:01.480>Unity <00:08:01.580>Catalog <00:08:01.680>Gateway <00:08:01.780>and <00:08:01.880>now

00:08:02.590 --> 00:08:02.600 align:start position:0%
<00:08:02.590>up <00:08:02.591>your <00:08:02.592>Unity <00:08:02.594>Catalog <00:08:02.596>Gateway <00:08:02.597>and <00:08:02.599>now

00:08:02.600 --> 00:08:05.590 align:start position:0%
<00:08:02.600>up <00:08:02.700>your <00:08:02.800>Unity <00:08:02.900>Catalog <00:08:03.000>Gateway <00:08:03.100>and <00:08:03.200>now <00:08:03.300>you <00:08:03.400>can <00:08:03.500>use <00:08:03.600>any <00:08:03.700>model <00:08:03.800>from <00:08:03.900>any <00:08:04.000>provider

00:08:05.590 --> 00:08:05.600 align:start position:0%
<00:08:05.590>you <00:08:05.591>can <00:08:05.592>use <00:08:05.593>any <00:08:05.595>model <00:08:05.596>from <00:08:05.597>any <00:08:05.599>provider

00:08:05.600 --> 00:08:07.670 align:start position:0%
<00:08:05.600>you <00:08:05.727>can <00:08:05.854>use <00:08:05.981>any <00:08:06.109>model <00:08:06.236>from <00:08:06.363>any <00:08:06.490>provider <00:08:06.618>utilizing <00:08:06.745>just <00:08:06.872>a <00:08:07.000>one

00:08:07.670 --> 00:08:07.680 align:start position:0%
<00:08:07.670>utilizing <00:08:07.673>just <00:08:07.676>a <00:08:07.679>one

00:08:07.680 --> 00:08:09.830 align:start position:0%
<00:08:07.680>utilizing <00:08:08.030>just <00:08:08.380>a <00:08:08.730>one <00:08:09.080>endpoint.

00:08:09.830 --> 00:08:09.840 align:start position:0%
endpoint.

00:08:09.840 --> 00:08:12.670 align:start position:0%
<00:08:09.840>endpoint. <00:08:10.073>With <00:08:10.306>proprietary <00:08:10.539>models, <00:08:10.773>you <00:08:11.006>pay <00:08:11.239>per

00:08:12.670 --> 00:08:12.680 align:start position:0%
<00:08:12.670>With <00:08:12.671>proprietary <00:08:12.673>models, <00:08:12.675>you <00:08:12.677>pay <00:08:12.679>per

00:08:12.680 --> 00:08:15.150 align:start position:0%
<00:08:12.680>With <00:08:12.796>proprietary <00:08:12.913>models, <00:08:13.030>you <00:08:13.146>pay <00:08:13.263>per <00:08:13.380>token. <00:08:13.496>All <00:08:13.613>right? <00:08:13.730>So, <00:08:13.846>you <00:08:13.963>are <00:08:14.080>utilizing

00:08:15.150 --> 00:08:15.160 align:start position:0%
<00:08:15.150>token. <00:08:15.151>All <00:08:15.153>right? <00:08:15.154>So, <00:08:15.156>you <00:08:15.157>are <00:08:15.159>utilizing

00:08:15.160 --> 00:08:17.830 align:start position:0%
<00:08:15.160>token. <00:08:15.267>All <00:08:15.375>right? <00:08:15.483>So, <00:08:15.590>you <00:08:15.698>are <00:08:15.806>utilizing <00:08:15.913>the <00:08:16.021>external <00:08:16.129>models. <00:08:16.236>That's <00:08:16.344>how <00:08:16.452>the <00:08:16.560>more

00:08:17.830 --> 00:08:17.840 align:start position:0%
<00:08:17.830>the <00:08:17.831>external <00:08:17.832>models. <00:08:17.834>That's <00:08:17.835>how <00:08:17.837>the <00:08:17.839>more

00:08:17.840 --> 00:08:20.750 align:start position:0%
<00:08:17.840>the <00:08:17.956>external <00:08:18.073>models. <00:08:18.190>That's <00:08:18.306>how <00:08:18.423>the <00:08:18.539>more <00:08:18.656>you <00:08:18.773>utilize, <00:08:18.890>the <00:08:19.006>more <00:08:19.123>you <00:08:19.239>pay.

00:08:20.750 --> 00:08:20.760 align:start position:0%
<00:08:20.750>you <00:08:20.751>utilize, <00:08:20.753>the <00:08:20.755>more <00:08:20.757>you <00:08:20.759>pay.

00:08:20.760 --> 00:08:22.510 align:start position:0%
<00:08:20.760>you <00:08:20.876>utilize, <00:08:20.993>the <00:08:21.110>more <00:08:21.226>you <00:08:21.343>pay. <00:08:21.460>With <00:08:21.576>open <00:08:21.693>weight <00:08:21.810>models, <00:08:21.926>now <00:08:22.043>you <00:08:22.159>have

00:08:22.510 --> 00:08:22.520 align:start position:0%
<00:08:22.510>With <00:08:22.511>open <00:08:22.513>weight <00:08:22.514>models, <00:08:22.515>now <00:08:22.517>you <00:08:22.519>have

00:08:22.520 --> 00:08:24.670 align:start position:0%
<00:08:22.520>With <00:08:22.627>open <00:08:22.735>weight <00:08:22.843>models, <00:08:22.950>now <00:08:23.058>you <00:08:23.166>have <00:08:23.273>two <00:08:23.381>choices. <00:08:23.489>First, <00:08:23.596>of <00:08:23.704>course, <00:08:23.812>you <00:08:23.919>can

00:08:24.670 --> 00:08:24.680 align:start position:0%
<00:08:24.670>two <00:08:24.671>choices. <00:08:24.673>First, <00:08:24.674>of <00:08:24.676>course, <00:08:24.677>you <00:08:24.679>can

00:08:24.680 --> 00:08:27.510 align:start position:0%
<00:08:24.680>two <00:08:24.780>choices. <00:08:24.880>First, <00:08:24.980>of <00:08:25.080>course, <00:08:25.180>you <00:08:25.280>can <00:08:25.380>pay <00:08:25.480>per <00:08:25.580>token, <00:08:25.680>but <00:08:25.780>your <00:08:25.880>second <00:08:25.980>choice <00:08:26.080>is

00:08:27.510 --> 00:08:27.520 align:start position:0%
<00:08:27.510>pay <00:08:27.511>per <00:08:27.512>token, <00:08:27.513>but <00:08:27.515>your <00:08:27.516>second <00:08:27.517>choice <00:08:27.519>is

00:08:27.520 --> 00:08:29.630 align:start position:0%
<00:08:27.520>pay <00:08:27.647>per <00:08:27.774>token, <00:08:27.901>but <00:08:28.029>your <00:08:28.156>second <00:08:28.283>choice <00:08:28.410>is <00:08:28.538>you <00:08:28.665>can <00:08:28.792>self-host <00:08:28.919>it.

00:08:29.630 --> 00:08:29.640 align:start position:0%
<00:08:29.630>you <00:08:29.633>can <00:08:29.635>self-host <00:08:29.639>it.

00:08:29.640 --> 00:08:31.750 align:start position:0%
<00:08:29.640>you <00:08:29.756>can <00:08:29.873>self-host <00:08:29.990>it. <00:08:30.106>And <00:08:30.223>now <00:08:30.340>you <00:08:30.456>will <00:08:30.573>be <00:08:30.690>using <00:08:30.806>it <00:08:30.923>based <00:08:31.039>on

00:08:31.750 --> 00:08:31.760 align:start position:0%
<00:08:31.750>And <00:08:31.751>now <00:08:31.752>you <00:08:31.753>will <00:08:31.754>be <00:08:31.755>using <00:08:31.756>it <00:08:31.757>based <00:08:31.759>on

00:08:31.760 --> 00:08:34.270 align:start position:0%
<00:08:31.760>And <00:08:31.860>now <00:08:31.960>you <00:08:32.059>will <00:08:32.159>be <00:08:32.260>using <00:08:32.360>it <00:08:32.460>based <00:08:32.559>on <00:08:32.659>compute. <00:08:32.760>You <00:08:32.860>can <00:08:32.960>also <00:08:33.059>utilize <00:08:33.159>serverless

00:08:34.270 --> 00:08:34.280 align:start position:0%
<00:08:34.270>compute. <00:08:34.271>You <00:08:34.273>can <00:08:34.275>also <00:08:34.277>utilize <00:08:34.279>serverless

00:08:34.280 --> 00:08:36.430 align:start position:0%
<00:08:34.280>compute. <00:08:34.387>You <00:08:34.495>can <00:08:34.603>also <00:08:34.710>utilize <00:08:34.818>serverless <00:08:34.926>computes, <00:08:35.033>or <00:08:35.141>if <00:08:35.249>you <00:08:35.356>don't <00:08:35.464>use <00:08:35.572>it, <00:08:35.679>you

00:08:36.430 --> 00:08:36.440 align:start position:0%
<00:08:36.429>computes, <00:08:36.431>or <00:08:36.432>if <00:08:36.433>you <00:08:36.435>don't <00:08:36.436>use <00:08:36.437>it, <00:08:36.439>you

00:08:36.440 --> 00:08:38.469 align:start position:0%
<00:08:36.440>computes, <00:08:36.567>or <00:08:36.694>if <00:08:36.821>you <00:08:36.949>don't <00:08:37.076>use <00:08:37.203>it, <00:08:37.330>you <00:08:37.458>can <00:08:37.585>shut <00:08:37.712>it <00:08:37.840>down.

00:08:38.469 --> 00:08:38.479 align:start position:0%
<00:08:38.469>can <00:08:38.472>shut <00:08:38.475>it <00:08:38.478>down.

00:08:38.479 --> 00:08:41.350 align:start position:0%
<00:08:38.479>can <00:08:38.619>shut <00:08:38.759>it <00:08:38.899>down. <00:08:39.039>Or <00:08:39.179>it <00:08:39.319>will <00:08:39.459>scale <00:08:39.599>basically <00:08:39.739>to <00:08:39.879>zero.

00:08:41.350 --> 00:08:41.360 align:start position:0%
<00:08:41.350>Or <00:08:41.351>it <00:08:41.353>will <00:08:41.354>scale <00:08:41.356>basically <00:08:41.357>to <00:08:41.359>zero.

00:08:41.360 --> 00:08:44.510 align:start position:0%
<00:08:41.360>Or <00:08:41.467>it <00:08:41.575>will <00:08:41.683>scale <00:08:41.790>basically <00:08:41.898>to <00:08:42.006>zero. <00:08:42.113>And <00:08:42.221>then, <00:08:42.329>the <00:08:42.436>last <00:08:42.544>step <00:08:42.652>is <00:08:42.760>fine-tune.

00:08:44.510 --> 00:08:44.520 align:start position:0%
<00:08:44.510>And <00:08:44.511>then, <00:08:44.513>the <00:08:44.514>last <00:08:44.516>step <00:08:44.517>is <00:08:44.519>fine-tune.

00:08:44.520 --> 00:08:47.510 align:start position:0%
<00:08:44.520>And <00:08:44.627>then, <00:08:44.735>the <00:08:44.843>last <00:08:44.950>step <00:08:45.058>is <00:08:45.166>fine-tune. <00:08:45.273>What <00:08:45.381>you <00:08:45.489>do <00:08:45.596>with <00:08:45.704>the <00:08:45.812>fine-tuned <00:08:45.920>models,

00:08:47.510 --> 00:08:47.520 align:start position:0%
<00:08:47.510>What <00:08:47.511>you <00:08:47.513>do <00:08:47.514>with <00:08:47.516>the <00:08:47.517>fine-tuned <00:08:47.519>models,

00:08:47.520 --> 00:08:50.550 align:start position:0%
<00:08:47.520>What <00:08:47.636>you <00:08:47.753>do <00:08:47.870>with <00:08:47.986>the <00:08:48.103>fine-tuned <00:08:48.220>models, <00:08:48.336>you <00:08:48.453>truly <00:08:48.569>create <00:08:48.686>your <00:08:48.803>own <00:08:48.920>intellectual

00:08:50.550 --> 00:08:50.560 align:start position:0%
<00:08:50.550>you <00:08:50.551>truly <00:08:50.553>create <00:08:50.555>your <00:08:50.557>own <00:08:50.559>intellectual

00:08:50.560 --> 00:08:53.829 align:start position:0%
<00:08:50.560>you <00:08:50.687>truly <00:08:50.814>create <00:08:50.941>your <00:08:51.069>own <00:08:51.196>intellectual <00:08:51.323>property. <00:08:51.450>Because <00:08:51.578>now <00:08:51.705>all <00:08:51.832>the <00:08:51.959>traces,

00:08:53.829 --> 00:08:53.839 align:start position:0%
<00:08:53.829>property. <00:08:53.830>Because <00:08:53.832>now <00:08:53.834>all <00:08:53.836>the <00:08:53.838>traces,

00:08:53.839 --> 00:08:56.910 align:start position:0%
<00:08:53.839>property. <00:08:53.946>Because <00:08:54.054>now <00:08:54.162>all <00:08:54.269>the <00:08:54.377>traces, <00:08:54.485>all <00:08:54.592>the <00:08:54.700>prompts, <00:08:54.808>all <00:08:54.915>of <00:08:55.023>those <00:08:55.131>label <00:08:55.238>sets

00:08:56.910 --> 00:08:56.920 align:start position:0%
<00:08:56.910>all <00:08:56.911>the <00:08:56.912>prompts, <00:08:56.913>all <00:08:56.915>of <00:08:56.916>those <00:08:56.917>label <00:08:56.919>sets

00:08:56.920 --> 00:08:59.030 align:start position:0%
<00:08:56.920>all <00:08:57.013>the <00:08:57.106>prompts, <00:08:57.199>all <00:08:57.293>of <00:08:57.386>those <00:08:57.479>label <00:08:57.573>sets <00:08:57.666>that <00:08:57.760>you <00:08:57.853>you <00:08:57.946>you <00:08:58.040>used <00:08:58.133>to <00:08:58.226>train <00:08:58.319>the

00:08:59.030 --> 00:08:59.040 align:start position:0%
<00:08:59.030>that <00:08:59.031>you <00:08:59.032>you <00:08:59.033>you <00:08:59.035>used <00:08:59.036>to <00:08:59.037>train <00:08:59.039>the

00:08:59.040 --> 00:09:01.070 align:start position:0%
<00:08:59.040>that <00:08:59.147>you <00:08:59.255>you <00:08:59.363>you <00:08:59.470>used <00:08:59.578>to <00:08:59.686>train <00:08:59.793>the <00:08:59.901>model, <00:09:00.009>right? <00:09:00.116>To <00:09:00.224>fine-tune <00:09:00.332>the <00:09:00.439>model,

00:09:01.070 --> 00:09:01.080 align:start position:0%
<00:09:01.070>model, <00:09:01.071>right? <00:09:01.073>To <00:09:01.075>fine-tune <00:09:01.077>the <00:09:01.079>model,

00:09:01.080 --> 00:09:03.150 align:start position:0%
<00:09:01.080>model, <00:09:01.235>right? <00:09:01.391>To <00:09:01.546>fine-tune <00:09:01.702>the <00:09:01.857>model, <00:09:02.013>it's <00:09:02.168>becoming <00:09:02.324>your <00:09:02.480>own.

00:09:03.150 --> 00:09:03.160 align:start position:0%
<00:09:03.150>it's <00:09:03.153>becoming <00:09:03.156>your <00:09:03.159>own.

00:09:03.160 --> 00:09:04.590 align:start position:0%
<00:09:03.160>it's <00:09:03.343>becoming <00:09:03.527>your <00:09:03.711>own. <00:09:03.895>So, <00:09:04.079>you <00:09:04.263>are <00:09:04.447>not

00:09:04.590 --> 00:09:04.600 align:start position:0%
<00:09:04.590>So, <00:09:04.593>you <00:09:04.596>are <00:09:04.599>not

00:09:04.600 --> 00:09:07.470 align:start position:0%
<00:09:04.600>So, <00:09:04.755>you <00:09:04.911>are <00:09:05.066>not <00:09:05.222>sending <00:09:05.377>somewhere <00:09:05.533>those <00:09:05.688>prompts <00:09:05.844>and <00:09:06.000>then

00:09:07.470 --> 00:09:07.480 align:start position:0%
<00:09:07.470>sending <00:09:07.471>somewhere <00:09:07.473>those <00:09:07.475>prompts <00:09:07.477>and <00:09:07.479>then

00:09:07.480 --> 00:09:08.910 align:start position:0%
<00:09:07.480>sending <00:09:07.587>somewhere <00:09:07.694>those <00:09:07.801>prompts <00:09:07.909>and <00:09:08.016>then <00:09:08.123>you <00:09:08.230>don't <00:09:08.338>know <00:09:08.445>whether <00:09:08.552>you <00:09:08.659>can <00:09:08.766>actually

00:09:08.910 --> 00:09:08.920 align:start position:0%
<00:09:08.910>you <00:09:08.911>don't <00:09:08.913>know <00:09:08.914>whether <00:09:08.915>you <00:09:08.917>can <00:09:08.919>actually

00:09:08.920 --> 00:09:11.030 align:start position:0%
<00:09:08.920>you <00:09:09.060>don't <00:09:09.199>know <00:09:09.339>whether <00:09:09.479>you <00:09:09.620>can <00:09:09.760>actually <00:09:09.900>use <00:09:10.040>those <00:09:10.180>traces <00:09:10.319>or

00:09:11.030 --> 00:09:11.040 align:start position:0%
<00:09:11.030>use <00:09:11.033>those <00:09:11.036>traces <00:09:11.039>or

00:09:11.040 --> 00:09:12.630 align:start position:0%
<00:09:11.040>use <00:09:11.273>those <00:09:11.506>traces <00:09:11.740>or <00:09:11.973>later. <00:09:12.206>So, <00:09:12.439>that's

00:09:12.630 --> 00:09:12.640 align:start position:0%
<00:09:12.630>later. <00:09:12.634>So, <00:09:12.639>that's

00:09:12.640 --> 00:09:13.829 align:start position:0%
<00:09:12.640>later. <00:09:12.773>So, <00:09:12.907>that's <00:09:13.041>really <00:09:13.175>something <00:09:13.308>that <00:09:13.442>you <00:09:13.576>need <00:09:13.710>to

00:09:13.829 --> 00:09:13.839 align:start position:0%
<00:09:13.829>really <00:09:13.830>something <00:09:13.832>that <00:09:13.834>you <00:09:13.836>need <00:09:13.838>to

00:09:13.839 --> 00:09:17.070 align:start position:0%
<00:09:13.839>really <00:09:13.955>something <00:09:14.072>that <00:09:14.189>you <00:09:14.305>need <00:09:14.422>to <00:09:14.539>consider <00:09:14.655>in <00:09:14.772>terms <00:09:14.889>of <00:09:15.005>how <00:09:15.122>much <00:09:15.239>ownership

00:09:17.070 --> 00:09:17.080 align:start position:0%
<00:09:17.070>consider <00:09:17.071>in <00:09:17.073>terms <00:09:17.074>of <00:09:17.076>how <00:09:17.077>much <00:09:17.079>ownership

00:09:17.080 --> 00:09:19.390 align:start position:0%
<00:09:17.080>consider <00:09:17.180>in <00:09:17.280>terms <00:09:17.380>of <00:09:17.480>how <00:09:17.580>much <00:09:17.680>ownership <00:09:17.780>you <00:09:17.880>want <00:09:17.980>to <00:09:18.080>have <00:09:18.180>because <00:09:18.280>the <00:09:18.380>more <00:09:18.480>you

00:09:19.390 --> 00:09:19.400 align:start position:0%
<00:09:19.390>you <00:09:19.391>want <00:09:19.392>to <00:09:19.393>have <00:09:19.395>because <00:09:19.396>the <00:09:19.397>more <00:09:19.399>you

00:09:19.400 --> 00:09:22.750 align:start position:0%
<00:09:19.400>you <00:09:19.500>want <00:09:19.600>to <00:09:19.699>have <00:09:19.800>because <00:09:19.900>the <00:09:20.000>more <00:09:20.100>you <00:09:20.199>move <00:09:20.300>to <00:09:20.400>the <00:09:20.500>right, <00:09:20.600>the <00:09:20.699>more <00:09:20.800>ownership

00:09:22.750 --> 00:09:22.760 align:start position:0%
<00:09:22.750>move <00:09:22.751>to <00:09:22.753>the <00:09:22.754>right, <00:09:22.756>the <00:09:22.757>more <00:09:22.759>ownership

00:09:22.760 --> 00:09:24.190 align:start position:0%
<00:09:22.760>move <00:09:22.859>to <00:09:22.958>the <00:09:23.057>right, <00:09:23.156>the <00:09:23.255>more <00:09:23.354>ownership <00:09:23.453>you <00:09:23.552>will <00:09:23.651>have. <00:09:23.750>Well, <00:09:23.849>for <00:09:23.948>you <00:09:24.047>it's

00:09:24.190 --> 00:09:24.200 align:start position:0%
<00:09:24.190>you <00:09:24.191>will <00:09:24.193>have. <00:09:24.194>Well, <00:09:24.196>for <00:09:24.197>you <00:09:24.199>it's

00:09:24.200 --> 00:09:26.110 align:start position:0%
<00:09:24.200>you <00:09:24.327>will <00:09:24.454>have. <00:09:24.581>Well, <00:09:24.709>for <00:09:24.836>you <00:09:24.963>it's <00:09:25.090>probably <00:09:25.218>more <00:09:25.345>to <00:09:25.472>the <00:09:25.600>left.

00:09:26.110 --> 00:09:26.120 align:start position:0%
<00:09:26.110>probably <00:09:26.112>more <00:09:26.114>to <00:09:26.116>the <00:09:26.119>left.

00:09:26.120 --> 00:09:27.310 align:start position:0%
<00:09:26.120>probably <00:09:26.334>more <00:09:26.548>to <00:09:26.762>the <00:09:26.976>left. <00:09:27.190>Um

00:09:27.310 --> 00:09:27.320 align:start position:0%
Um

00:09:27.320 --> 00:09:28.910 align:start position:0%
<00:09:27.320>Um <00:09:28.020>So, <00:09:28.720>then

00:09:28.910 --> 00:09:28.920 align:start position:0%
<00:09:28.910>So, <00:09:28.919>then

00:09:28.920 --> 00:09:31.590 align:start position:0%
<00:09:28.920>So, <00:09:29.120>then <00:09:29.319>another <00:09:29.520>thing <00:09:29.719>is <00:09:29.920>in <00:09:30.120>terms <00:09:30.319>of

00:09:31.590 --> 00:09:31.600 align:start position:0%
<00:09:31.590>another <00:09:31.591>thing <00:09:31.593>is <00:09:31.595>in <00:09:31.597>terms <00:09:31.599>of

00:09:31.600 --> 00:09:33.950 align:start position:0%
<00:09:31.600>another <00:09:31.775>thing <00:09:31.950>is <00:09:32.125>in <00:09:32.300>terms <00:09:32.475>of <00:09:32.650>of <00:09:32.825>course <00:09:33.000>the

00:09:33.950 --> 00:09:33.960 align:start position:0%
<00:09:33.950>of <00:09:33.954>course <00:09:33.959>the

00:09:33.960 --> 00:09:36.870 align:start position:0%
<00:09:33.960>of <00:09:34.100>course <00:09:34.240>the <00:09:34.380>how <00:09:34.520>large <00:09:34.660>is <00:09:34.800>the <00:09:34.940>model, <00:09:35.080>the <00:09:35.220>larger <00:09:35.360>the

00:09:36.870 --> 00:09:36.880 align:start position:0%
<00:09:36.870>how <00:09:36.871>large <00:09:36.872>is <00:09:36.873>the <00:09:36.875>model, <00:09:36.876>the <00:09:36.877>larger <00:09:36.879>the

00:09:36.880 --> 00:09:38.990 align:start position:0%
<00:09:36.880>how <00:09:37.020>large <00:09:37.160>is <00:09:37.300>the <00:09:37.439>model, <00:09:37.580>the <00:09:37.720>larger <00:09:37.860>the <00:09:38.000>model, <00:09:38.140>the <00:09:38.280>more

00:09:38.990 --> 00:09:39.000 align:start position:0%
<00:09:38.990>model, <00:09:38.994>the <00:09:38.999>more

00:09:39.000 --> 00:09:41.350 align:start position:0%
<00:09:39.000>model, <00:09:39.140>the <00:09:39.280>more <00:09:39.420>tasks <00:09:39.560>you <00:09:39.700>can <00:09:39.840>do. <00:09:39.980>What <00:09:40.120>we're <00:09:40.260>seeing <00:09:40.400>from

00:09:41.350 --> 00:09:41.360 align:start position:0%
<00:09:41.350>tasks <00:09:41.351>you <00:09:41.352>can <00:09:41.353>do. <00:09:41.355>What <00:09:41.356>we're <00:09:41.357>seeing <00:09:41.359>from

00:09:41.360 --> 00:09:43.470 align:start position:0%
<00:09:41.360>tasks <00:09:41.476>you <00:09:41.593>can <00:09:41.710>do. <00:09:41.826>What <00:09:41.943>we're <00:09:42.060>seeing <00:09:42.176>from <00:09:42.293>customers <00:09:42.410>that <00:09:42.526>they're <00:09:42.643>utilizing <00:09:42.760>those

00:09:43.470 --> 00:09:43.480 align:start position:0%
<00:09:43.470>customers <00:09:43.472>that <00:09:43.474>they're <00:09:43.476>utilizing <00:09:43.479>those

00:09:43.480 --> 00:09:46.070 align:start position:0%
<00:09:43.480>customers <00:09:43.607>that <00:09:43.734>they're <00:09:43.861>utilizing <00:09:43.989>those <00:09:44.116>large <00:09:44.243>models <00:09:44.370>as <00:09:44.498>Opus <00:09:44.625>for <00:09:44.752>something <00:09:44.880>very

00:09:46.070 --> 00:09:46.080 align:start position:0%
<00:09:46.070>large <00:09:46.071>models <00:09:46.073>as <00:09:46.074>Opus <00:09:46.076>for <00:09:46.077>something <00:09:46.079>very

00:09:46.080 --> 00:09:47.590 align:start position:0%
<00:09:46.080>large <00:09:46.274>models <00:09:46.468>as <00:09:46.662>Opus <00:09:46.856>for <00:09:47.050>something <00:09:47.244>very <00:09:47.439>complex

00:09:47.590 --> 00:09:47.600 align:start position:0%
complex

00:09:47.600 --> 00:09:49.830 align:start position:0%
<00:09:47.600>complex <00:09:47.800>tasks <00:09:48.000>where <00:09:48.200>they <00:09:48.400>don't <00:09:48.600>really <00:09:48.800>know <00:09:49.000>the

00:09:49.830 --> 00:09:49.840 align:start position:0%
<00:09:49.830>tasks <00:09:49.831>where <00:09:49.833>they <00:09:49.834>don't <00:09:49.836>really <00:09:49.837>know <00:09:49.839>the

00:09:49.840 --> 00:09:53.070 align:start position:0%
<00:09:49.840>tasks <00:09:49.947>where <00:09:50.055>they <00:09:50.163>don't <00:09:50.270>really <00:09:50.378>know <00:09:50.486>the <00:09:50.593>exact <00:09:50.701>uh <00:09:50.809>questions <00:09:50.916>that <00:09:51.024>will <00:09:51.132>be <00:09:51.240>asked.

00:09:53.070 --> 00:09:53.080 align:start position:0%
<00:09:53.070>exact <00:09:53.071>uh <00:09:53.073>questions <00:09:53.074>that <00:09:53.076>will <00:09:53.077>be <00:09:53.079>asked.

00:09:53.080 --> 00:09:55.310 align:start position:0%
<00:09:53.080>exact <00:09:53.173>uh <00:09:53.266>questions <00:09:53.360>that <00:09:53.453>will <00:09:53.546>be <00:09:53.640>asked. <00:09:53.733>And <00:09:53.826>then <00:09:53.920>where <00:09:54.013>we <00:09:54.106>are <00:09:54.200>seeing <00:09:54.293>more <00:09:54.386>of <00:09:54.480>a

00:09:55.310 --> 00:09:55.320 align:start position:0%
<00:09:55.310>And <00:09:55.311>then <00:09:55.312>where <00:09:55.313>we <00:09:55.314>are <00:09:55.315>seeing <00:09:55.316>more <00:09:55.317>of <00:09:55.319>a

00:09:55.320 --> 00:09:57.430 align:start position:0%
<00:09:55.320>And <00:09:55.420>then <00:09:55.520>where <00:09:55.620>we <00:09:55.720>are <00:09:55.820>seeing <00:09:55.920>more <00:09:56.020>of <00:09:56.120>a <00:09:56.220>fine-tuned <00:09:56.320>models <00:09:56.420>are <00:09:56.520>that <00:09:56.620>are <00:09:56.720>being

00:09:57.430 --> 00:09:57.440 align:start position:0%
<00:09:57.430>fine-tuned <00:09:57.431>models <00:09:57.433>are <00:09:57.435>that <00:09:57.437>are <00:09:57.439>being

00:09:57.440 --> 00:10:01.110 align:start position:0%
<00:09:57.440>fine-tuned <00:09:57.547>models <00:09:57.655>are <00:09:57.763>that <00:09:57.870>are <00:09:57.978>being <00:09:58.086>used <00:09:58.193>is <00:09:58.301>when <00:09:58.409>we <00:09:58.516>are <00:09:58.624>truly <00:09:58.732>defined <00:09:58.840>the

00:10:01.110 --> 00:10:01.120 align:start position:0%
<00:10:01.110>used <00:10:01.111>is <00:10:01.112>when <00:10:01.113>we <00:10:01.115>are <00:10:01.116>truly <00:10:01.117>defined <00:10:01.119>the

00:10:01.120 --> 00:10:04.150 align:start position:0%
<00:10:01.120>used <00:10:01.213>is <00:10:01.306>when <00:10:01.400>we <00:10:01.493>are <00:10:01.586>truly <00:10:01.680>defined <00:10:01.773>the <00:10:01.866>exact <00:10:01.960>kind <00:10:02.053>of <00:10:02.146>a <00:10:02.240>narrow <00:10:02.333>problem <00:10:02.426>and <00:10:02.520>then

00:10:04.150 --> 00:10:04.160 align:start position:0%
<00:10:04.150>exact <00:10:04.151>kind <00:10:04.152>of <00:10:04.153>a <00:10:04.155>narrow <00:10:04.156>problem <00:10:04.157>and <00:10:04.159>then

00:10:04.160 --> 00:10:07.310 align:start position:0%
<00:10:04.160>exact <00:10:04.260>kind <00:10:04.360>of <00:10:04.459>a <00:10:04.560>narrow <00:10:04.660>problem <00:10:04.760>and <00:10:04.860>then <00:10:04.959>we <00:10:05.060>fine-tune <00:10:05.160>the <00:10:05.260>small <00:10:05.360>model <00:10:05.459>on <00:10:05.560>this

00:10:07.310 --> 00:10:07.320 align:start position:0%
<00:10:07.310>we <00:10:07.311>fine-tune <00:10:07.313>the <00:10:07.314>small <00:10:07.316>model <00:10:07.317>on <00:10:07.319>this

00:10:07.320 --> 00:10:09.750 align:start position:0%
<00:10:07.320>we <00:10:07.427>fine-tune <00:10:07.535>the <00:10:07.643>small <00:10:07.750>model <00:10:07.858>on <00:10:07.966>this <00:10:08.073>problem <00:10:08.181>and <00:10:08.289>we <00:10:08.396>can <00:10:08.504>achieve <00:10:08.612>similar <00:10:08.720>score

00:10:09.750 --> 00:10:09.760 align:start position:0%
<00:10:09.750>problem <00:10:09.751>and <00:10:09.753>we <00:10:09.754>can <00:10:09.756>achieve <00:10:09.757>similar <00:10:09.759>score

00:10:09.760 --> 00:10:12.270 align:start position:0%
<00:10:09.760>problem <00:10:09.915>and <00:10:10.071>we <00:10:10.226>can <00:10:10.382>achieve <00:10:10.537>similar <00:10:10.693>score <00:10:10.848>to <00:10:11.004>proprietary <00:10:11.160>API.

00:10:12.270 --> 00:10:12.280 align:start position:0%
<00:10:12.270>to <00:10:12.274>proprietary <00:10:12.279>API.

00:10:12.280 --> 00:10:14.150 align:start position:0%
<00:10:12.280>to <00:10:12.420>proprietary <00:10:12.560>API. <00:10:12.699>Okay, <00:10:12.839>so <00:10:12.980>how <00:10:13.120>do <00:10:13.260>we <00:10:13.400>get <00:10:13.540>started? <00:10:13.680>Well,

00:10:14.150 --> 00:10:14.160 align:start position:0%
<00:10:14.150>Okay, <00:10:14.151>so <00:10:14.152>how <00:10:14.153>do <00:10:14.155>we <00:10:14.156>get <00:10:14.157>started? <00:10:14.159>Well,

00:10:14.160 --> 00:10:15.790 align:start position:0%
<00:10:14.160>Okay, <00:10:14.247>so <00:10:14.334>how <00:10:14.422>do <00:10:14.510>we <00:10:14.597>get <00:10:14.685>started? <00:10:14.772>Well, <00:10:14.860>the <00:10:14.947>first <00:10:15.035>thing <00:10:15.122>that <00:10:15.209>you <00:10:15.297>need <00:10:15.385>to <00:10:15.472>do, <00:10:15.560>you

00:10:15.790 --> 00:10:15.800 align:start position:0%
<00:10:15.790>the <00:10:15.791>first <00:10:15.792>thing <00:10:15.793>that <00:10:15.794>you <00:10:15.795>need <00:10:15.796>to <00:10:15.797>do, <00:10:15.799>you

00:10:15.800 --> 00:10:18.790 align:start position:0%
<00:10:15.800>the <00:10:15.893>first <00:10:15.986>thing <00:10:16.079>that <00:10:16.173>you <00:10:16.266>need <00:10:16.359>to <00:10:16.453>do, <00:10:16.546>you <00:10:16.640>need <00:10:16.733>to <00:10:16.826>build <00:10:16.920>your <00:10:17.013>evaluation <00:10:17.106>set. <00:10:17.199>You

00:10:18.790 --> 00:10:18.800 align:start position:0%
<00:10:18.790>need <00:10:18.791>to <00:10:18.793>build <00:10:18.794>your <00:10:18.795>evaluation <00:10:18.797>set. <00:10:18.799>You

00:10:18.800 --> 00:10:22.190 align:start position:0%
<00:10:18.800>need <00:10:18.900>to <00:10:19.000>build <00:10:19.099>your <00:10:19.199>evaluation <00:10:19.300>set. <00:10:19.400>You <00:10:19.500>need <00:10:19.599>to <00:10:19.699>define <00:10:19.800>what <00:10:19.900>good <00:10:20.000>looks <00:10:20.099>like. <00:10:20.199>And

00:10:22.190 --> 00:10:22.200 align:start position:0%
<00:10:22.190>need <00:10:22.191>to <00:10:22.192>define <00:10:22.193>what <00:10:22.195>good <00:10:22.196>looks <00:10:22.197>like. <00:10:22.199>And

00:10:22.200 --> 00:10:24.830 align:start position:0%
<00:10:22.200>need <00:10:22.293>to <00:10:22.386>define <00:10:22.480>what <00:10:22.573>good <00:10:22.666>looks <00:10:22.760>like. <00:10:22.853>And <00:10:22.946>you <00:10:23.040>can <00:10:23.133>do <00:10:23.226>this <00:10:23.320>by <00:10:23.413>utilizing <00:10:23.506>MLflow <00:10:23.600>3.

00:10:24.830 --> 00:10:24.840 align:start position:0%
<00:10:24.830>you <00:10:24.831>can <00:10:24.832>do <00:10:24.833>this <00:10:24.835>by <00:10:24.836>utilizing <00:10:24.837>MLflow <00:10:24.839>3.

00:10:24.840 --> 00:10:27.830 align:start position:0%
<00:10:24.840>you <00:10:24.956>can <00:10:25.073>do <00:10:25.190>this <00:10:25.306>by <00:10:25.423>utilizing <00:10:25.540>MLflow <00:10:25.656>3. <00:10:25.773>MLflow <00:10:25.890>is <00:10:26.006>open-source <00:10:26.123>platform. <00:10:26.240>It

00:10:27.830 --> 00:10:27.840 align:start position:0%
<00:10:27.830>MLflow <00:10:27.832>is <00:10:27.834>open-source <00:10:27.836>platform. <00:10:27.839>It

00:10:27.840 --> 00:10:30.630 align:start position:0%
<00:10:27.840>MLflow <00:10:27.995>is <00:10:28.151>open-source <00:10:28.306>platform. <00:10:28.462>It <00:10:28.617>started <00:10:28.773>originally <00:10:28.928>for <00:10:29.084>ML <00:10:29.240>Ops

00:10:30.630 --> 00:10:30.640 align:start position:0%
<00:10:30.630>started <00:10:30.632>originally <00:10:30.634>for <00:10:30.636>ML <00:10:30.639>Ops

00:10:30.640 --> 00:10:33.590 align:start position:0%
<00:10:30.640>started <00:10:30.747>originally <00:10:30.855>for <00:10:30.963>ML <00:10:31.070>Ops <00:10:31.178>um <00:10:31.286>and <00:10:31.393>then <00:10:31.501>with <00:10:31.609>MLflow <00:10:31.716>3, <00:10:31.824>it <00:10:31.932>was <00:10:32.040>really

00:10:33.590 --> 00:10:33.600 align:start position:0%
<00:10:33.590>um <00:10:33.591>and <00:10:33.592>then <00:10:33.593>with <00:10:33.594>MLflow <00:10:33.595>3, <00:10:33.596>it <00:10:33.597>was <00:10:33.599>really

00:10:33.600 --> 00:10:37.630 align:start position:0%
<00:10:33.600>um <00:10:33.707>and <00:10:33.815>then <00:10:33.923>with <00:10:34.030>MLflow <00:10:34.138>3, <00:10:34.246>it <00:10:34.353>was <00:10:34.461>really <00:10:34.569>defined <00:10:34.676>for <00:10:34.784>agentic <00:10:34.892>era. <00:10:35.000>So,

00:10:37.630 --> 00:10:37.640 align:start position:0%
<00:10:37.630>defined <00:10:37.632>for <00:10:37.634>agentic <00:10:37.636>era. <00:10:37.639>So,

00:10:37.640 --> 00:10:39.230 align:start position:0%
<00:10:37.640>defined <00:10:37.795>for <00:10:37.951>agentic <00:10:38.106>era. <00:10:38.262>So, <00:10:38.417>MLflow <00:10:38.573>allows <00:10:38.728>you <00:10:38.884>to <00:10:39.040>run

00:10:39.230 --> 00:10:39.240 align:start position:0%
<00:10:39.230>MLflow <00:10:39.232>allows <00:10:39.234>you <00:10:39.236>to <00:10:39.239>run

00:10:39.240 --> 00:10:41.870 align:start position:0%
<00:10:39.240>MLflow <00:10:39.380>allows <00:10:39.520>you <00:10:39.660>to <00:10:39.800>run <00:10:39.940>experimentations. <00:10:40.080>It <00:10:40.220>logs <00:10:40.360>all <00:10:40.500>of <00:10:40.640>the

00:10:41.870 --> 00:10:41.880 align:start position:0%
<00:10:41.870>experimentations. <00:10:41.871>It <00:10:41.873>logs <00:10:41.875>all <00:10:41.877>of <00:10:41.879>the

00:10:41.880 --> 00:10:44.510 align:start position:0%
<00:10:41.880>experimentations. <00:10:41.996>It <00:10:42.113>logs <00:10:42.230>all <00:10:42.346>of <00:10:42.463>the <00:10:42.580>traces. <00:10:42.696>You <00:10:42.813>can <00:10:42.930>see <00:10:43.046>what <00:10:43.163>agent <00:10:43.280>was

00:10:44.510 --> 00:10:44.520 align:start position:0%
<00:10:44.510>traces. <00:10:44.511>You <00:10:44.513>can <00:10:44.514>see <00:10:44.516>what <00:10:44.517>agent <00:10:44.519>was

00:10:44.520 --> 00:10:46.470 align:start position:0%
<00:10:44.520>traces. <00:10:44.647>You <00:10:44.774>can <00:10:44.901>see <00:10:45.029>what <00:10:45.156>agent <00:10:45.283>was <00:10:45.410>thinking, <00:10:45.538>why <00:10:45.665>it <00:10:45.792>made <00:10:45.920>particular

00:10:46.470 --> 00:10:46.480 align:start position:0%
<00:10:46.470>thinking, <00:10:46.472>why <00:10:46.474>it <00:10:46.476>made <00:10:46.479>particular

00:10:46.480 --> 00:10:48.950 align:start position:0%
<00:10:46.480>thinking, <00:10:46.635>why <00:10:46.791>it <00:10:46.946>made <00:10:47.102>particular <00:10:47.257>decision. <00:10:47.413>You <00:10:47.568>can <00:10:47.724>compare <00:10:47.880>results

00:10:48.950 --> 00:10:48.960 align:start position:0%
<00:10:48.950>decision. <00:10:48.952>You <00:10:48.954>can <00:10:48.956>compare <00:10:48.959>results

00:10:48.960 --> 00:10:51.110 align:start position:0%
<00:10:48.960>decision. <00:10:49.100>You <00:10:49.240>can <00:10:49.380>compare <00:10:49.520>results <00:10:49.660>between <00:10:49.800>different <00:10:49.940>models. <00:10:50.080>So, <00:10:50.220>I'll <00:10:50.360>show

00:10:51.110 --> 00:10:51.120 align:start position:0%
<00:10:51.110>between <00:10:51.111>different <00:10:51.113>models. <00:10:51.115>So, <00:10:51.117>I'll <00:10:51.119>show

00:10:51.120 --> 00:10:53.550 align:start position:0%
<00:10:51.120>between <00:10:51.236>different <00:10:51.353>models. <00:10:51.470>So, <00:10:51.586>I'll <00:10:51.703>show <00:10:51.820>you <00:10:51.936>later <00:10:52.053>dashboard. <00:10:52.170>So, <00:10:52.286>how <00:10:52.403>do <00:10:52.520>you

00:10:53.550 --> 00:10:53.560 align:start position:0%
<00:10:53.550>you <00:10:53.551>later <00:10:53.553>dashboard. <00:10:53.554>So, <00:10:53.555>how <00:10:53.557>do <00:10:53.559>you

00:10:53.560 --> 00:10:56.430 align:start position:0%
<00:10:53.560>you <00:10:53.676>later <00:10:53.793>dashboard. <00:10:53.910>So, <00:10:54.026>how <00:10:54.143>do <00:10:54.260>you <00:10:54.376>define <00:10:54.493>an <00:10:54.609>MLflow <00:10:54.726>evaluation? <00:10:54.843>There <00:10:54.959>are

00:10:56.430 --> 00:10:56.440 align:start position:0%
<00:10:56.430>define <00:10:56.431>an <00:10:56.433>MLflow <00:10:56.435>evaluation? <00:10:56.437>There <00:10:56.439>are

00:10:56.440 --> 00:10:58.510 align:start position:0%
<00:10:56.440>define <00:10:56.556>an <00:10:56.673>MLflow <00:10:56.790>evaluation? <00:10:56.906>There <00:10:57.023>are <00:10:57.140>four <00:10:57.256>programmatic <00:10:57.373>steps <00:10:57.490>that <00:10:57.606>you <00:10:57.723>need <00:10:57.840>to

00:10:58.510 --> 00:10:58.520 align:start position:0%
<00:10:58.510>four <00:10:58.511>programmatic <00:10:58.513>steps <00:10:58.514>that <00:10:58.516>you <00:10:58.517>need <00:10:58.519>to

00:10:58.520 --> 00:11:00.910 align:start position:0%
<00:10:58.520>four <00:10:58.620>programmatic <00:10:58.720>steps <00:10:58.819>that <00:10:58.920>you <00:10:59.020>need <00:10:59.120>to <00:10:59.220>do. <00:10:59.319>So, <00:10:59.420>first, <00:10:59.520>you <00:10:59.620>need <00:10:59.720>to <00:10:59.819>create <00:10:59.920>a

00:11:00.910 --> 00:11:00.920 align:start position:0%
<00:11:00.910>do. <00:11:00.911>So, <00:11:00.912>first, <00:11:00.913>you <00:11:00.915>need <00:11:00.916>to <00:11:00.917>create <00:11:00.919>a

00:11:00.920 --> 00:11:03.790 align:start position:0%
<00:11:00.920>do. <00:11:01.013>So, <00:11:01.106>first, <00:11:01.199>you <00:11:01.293>need <00:11:01.386>to <00:11:01.479>create <00:11:01.573>a <00:11:01.666>quality <00:11:01.760>set. <00:11:01.853>So, <00:11:01.946>let's <00:11:02.040>say <00:11:02.133>in <00:11:02.226>our <00:11:02.319>use

00:11:03.790 --> 00:11:03.800 align:start position:0%
<00:11:03.790>quality <00:11:03.791>set. <00:11:03.792>So, <00:11:03.793>let's <00:11:03.795>say <00:11:03.796>in <00:11:03.797>our <00:11:03.799>use

00:11:03.800 --> 00:11:06.270 align:start position:0%
<00:11:03.800>quality <00:11:03.900>set. <00:11:04.000>So, <00:11:04.099>let's <00:11:04.199>say <00:11:04.300>in <00:11:04.400>our <00:11:04.500>use <00:11:04.599>case <00:11:04.699>when <00:11:04.800>we <00:11:04.900>want <00:11:05.000>to <00:11:05.099>classify <00:11:05.199>different

00:11:06.270 --> 00:11:06.280 align:start position:0%
<00:11:06.270>case <00:11:06.271>when <00:11:06.273>we <00:11:06.274>want <00:11:06.276>to <00:11:06.277>classify <00:11:06.279>different

00:11:06.280 --> 00:11:08.910 align:start position:0%
<00:11:06.280>case <00:11:06.396>when <00:11:06.513>we <00:11:06.630>want <00:11:06.746>to <00:11:06.863>classify <00:11:06.980>different <00:11:07.096>images, <00:11:07.213>oh <00:11:07.329>sorry, <00:11:07.446>different <00:11:07.563>messages, <00:11:07.680>we

00:11:08.910 --> 00:11:08.920 align:start position:0%
<00:11:08.910>images, <00:11:08.911>oh <00:11:08.913>sorry, <00:11:08.915>different <00:11:08.917>messages, <00:11:08.919>we

00:11:08.920 --> 00:11:12.110 align:start position:0%
<00:11:08.920>images, <00:11:09.036>oh <00:11:09.153>sorry, <00:11:09.270>different <00:11:09.386>messages, <00:11:09.503>we <00:11:09.620>have <00:11:09.736>eight <00:11:09.853>categories. <00:11:09.969>So, <00:11:10.086>it <00:11:10.203>means <00:11:10.319>that

00:11:12.110 --> 00:11:12.120 align:start position:0%
<00:11:12.110>have <00:11:12.111>eight <00:11:12.113>categories. <00:11:12.114>So, <00:11:12.116>it <00:11:12.117>means <00:11:12.119>that

00:11:12.120 --> 00:11:13.390 align:start position:0%
<00:11:12.120>have <00:11:12.207>eight <00:11:12.295>categories. <00:11:12.383>So, <00:11:12.471>it <00:11:12.559>means <00:11:12.647>that <00:11:12.735>when <00:11:12.823>we <00:11:12.911>have <00:11:12.999>to <00:11:13.087>make <00:11:13.175>a <00:11:13.263>really

00:11:13.390 --> 00:11:13.400 align:start position:0%
<00:11:13.390>when <00:11:13.391>we <00:11:13.393>have <00:11:13.394>to <00:11:13.396>make <00:11:13.397>a <00:11:13.399>really

00:11:13.400 --> 00:11:15.430 align:start position:0%
<00:11:13.400>when <00:11:13.516>we <00:11:13.633>have <00:11:13.750>to <00:11:13.866>make <00:11:13.983>a <00:11:14.100>really <00:11:14.216>representative <00:11:14.333>set <00:11:14.449>and <00:11:14.566>we <00:11:14.683>have <00:11:14.800>to

00:11:15.430 --> 00:11:15.440 align:start position:0%
<00:11:15.430>representative <00:11:15.431>set <00:11:15.433>and <00:11:15.435>we <00:11:15.437>have <00:11:15.439>to

00:11:15.440 --> 00:11:17.430 align:start position:0%
<00:11:15.440>representative <00:11:15.556>set <00:11:15.673>and <00:11:15.790>we <00:11:15.906>have <00:11:16.023>to <00:11:16.140>stretch <00:11:16.256>the <00:11:16.373>model. <00:11:16.490>We <00:11:16.606>have <00:11:16.723>to <00:11:16.840>think

00:11:17.430 --> 00:11:17.440 align:start position:0%
<00:11:17.430>stretch <00:11:17.431>the <00:11:17.433>model. <00:11:17.434>We <00:11:17.436>have <00:11:17.437>to <00:11:17.439>think

00:11:17.440 --> 00:11:19.310 align:start position:0%
<00:11:17.440>stretch <00:11:17.547>the <00:11:17.655>model. <00:11:17.763>We <00:11:17.870>have <00:11:17.978>to <00:11:18.086>think <00:11:18.193>about <00:11:18.301>those <00:11:18.409>edge <00:11:18.516>cases, <00:11:18.624>not <00:11:18.732>just <00:11:18.840>a

00:11:19.310 --> 00:11:19.320 align:start position:0%
<00:11:19.310>about <00:11:19.311>those <00:11:19.313>edge <00:11:19.314>cases, <00:11:19.316>not <00:11:19.317>just <00:11:19.319>a

00:11:19.320 --> 00:11:22.510 align:start position:0%
<00:11:19.320>about <00:11:19.436>those <00:11:19.553>edge <00:11:19.670>cases, <00:11:19.786>not <00:11:19.903>just <00:11:20.020>a <00:11:20.136>simple <00:11:20.253>set <00:11:20.370>that <00:11:20.486>is <00:11:20.603>very <00:11:20.720>obvious.

00:11:22.510 --> 00:11:22.520 align:start position:0%
<00:11:22.510>simple <00:11:22.511>set <00:11:22.513>that <00:11:22.515>is <00:11:22.517>very <00:11:22.519>obvious.

00:11:22.520 --> 00:11:25.310 align:start position:0%
<00:11:22.520>simple <00:11:22.647>set <00:11:22.774>that <00:11:22.901>is <00:11:23.029>very <00:11:23.156>obvious. <00:11:23.283>Once <00:11:23.410>you <00:11:23.538>define <00:11:23.665>your <00:11:23.792>evaluation <00:11:23.920>set,

00:11:25.310 --> 00:11:25.320 align:start position:0%
<00:11:25.310>Once <00:11:25.311>you <00:11:25.313>define <00:11:25.315>your <00:11:25.317>evaluation <00:11:25.319>set,

00:11:25.320 --> 00:11:28.750 align:start position:0%
<00:11:25.320>Once <00:11:25.436>you <00:11:25.553>define <00:11:25.670>your <00:11:25.786>evaluation <00:11:25.903>set, <00:11:26.020>then <00:11:26.136>you <00:11:26.253>define <00:11:26.370>scores. <00:11:26.486>How <00:11:26.603>the <00:11:26.720>this

00:11:28.750 --> 00:11:28.760 align:start position:0%
<00:11:28.750>then <00:11:28.751>you <00:11:28.753>define <00:11:28.754>scores. <00:11:28.756>How <00:11:28.757>the <00:11:28.759>this

00:11:28.760 --> 00:11:31.350 align:start position:0%
<00:11:28.760>then <00:11:28.860>you <00:11:28.960>define <00:11:29.060>scores. <00:11:29.160>How <00:11:29.260>the <00:11:29.360>this <00:11:29.460>those <00:11:29.560>answers <00:11:29.660>will <00:11:29.760>be <00:11:29.860>judged. <00:11:29.960>It <00:11:30.060>can <00:11:30.160>be

00:11:31.350 --> 00:11:31.360 align:start position:0%
<00:11:31.350>those <00:11:31.351>answers <00:11:31.352>will <00:11:31.353>be <00:11:31.355>judged. <00:11:31.356>It <00:11:31.357>can <00:11:31.359>be

00:11:31.360 --> 00:11:33.830 align:start position:0%
<00:11:31.360>those <00:11:31.453>answers <00:11:31.546>will <00:11:31.640>be <00:11:31.733>judged. <00:11:31.826>It <00:11:31.920>can <00:11:32.013>be <00:11:32.106>a <00:11:32.200>simple <00:11:32.293>Python <00:11:32.386>function, <00:11:32.480>it <00:11:32.573>can <00:11:32.666>be <00:11:32.760>an

00:11:33.830 --> 00:11:33.840 align:start position:0%
<00:11:33.830>a <00:11:33.831>simple <00:11:33.832>Python <00:11:33.833>function, <00:11:33.835>it <00:11:33.836>can <00:11:33.837>be <00:11:33.839>an

00:11:33.840 --> 00:11:35.430 align:start position:0%
<00:11:33.840>a <00:11:33.995>simple <00:11:34.151>Python <00:11:34.306>function, <00:11:34.462>it <00:11:34.617>can <00:11:34.773>be <00:11:34.928>an <00:11:35.084>LLM <00:11:35.240>judge,

00:11:35.430 --> 00:11:35.440 align:start position:0%
<00:11:35.430>LLM <00:11:35.439>judge,

00:11:35.440 --> 00:11:36.630 align:start position:0%
<00:11:35.440>LLM <00:11:35.975>judge, <00:11:36.511>um

00:11:36.630 --> 00:11:36.640 align:start position:0%
um

00:11:36.640 --> 00:11:38.430 align:start position:0%
<00:11:36.640>um <00:11:36.814>or <00:11:36.990>it <00:11:37.165>can <00:11:37.340>be <00:11:37.515>even <00:11:37.689>guidelines <00:11:37.865>that <00:11:38.040>you

00:11:38.430 --> 00:11:38.440 align:start position:0%
<00:11:38.430>or <00:11:38.431>it <00:11:38.432>can <00:11:38.433>be <00:11:38.435>even <00:11:38.436>guidelines <00:11:38.437>that <00:11:38.439>you

00:11:38.440 --> 00:11:41.230 align:start position:0%
<00:11:38.440>or <00:11:38.540>it <00:11:38.640>can <00:11:38.740>be <00:11:38.840>even <00:11:38.940>guidelines <00:11:39.040>that <00:11:39.140>you <00:11:39.240>provide <00:11:39.340>in <00:11:39.440>terms <00:11:39.540>of <00:11:39.640>plain <00:11:39.740>English. <00:11:39.840>Then,

00:11:41.230 --> 00:11:41.240 align:start position:0%
<00:11:41.230>provide <00:11:41.231>in <00:11:41.233>terms <00:11:41.234>of <00:11:41.236>plain <00:11:41.237>English. <00:11:41.239>Then,

00:11:41.240 --> 00:11:44.750 align:start position:0%
<00:11:41.240>provide <00:11:41.356>in <00:11:41.473>terms <00:11:41.590>of <00:11:41.706>plain <00:11:41.823>English. <00:11:41.940>Then, <00:11:42.056>you <00:11:42.173>run <00:11:42.290>MLflow <00:11:42.406>evaluation <00:11:42.523>against <00:11:42.640>those

00:11:44.750 --> 00:11:44.760 align:start position:0%
<00:11:44.750>you <00:11:44.751>run <00:11:44.753>MLflow <00:11:44.755>evaluation <00:11:44.757>against <00:11:44.759>those

00:11:44.760 --> 00:11:46.710 align:start position:0%
<00:11:44.760>you <00:11:44.887>run <00:11:45.014>MLflow <00:11:45.141>evaluation <00:11:45.269>against <00:11:45.396>those <00:11:45.523>uh <00:11:45.650>those <00:11:45.778>guidelines. <00:11:45.905>And <00:11:46.032>what <00:11:46.160>happens,

00:11:46.710 --> 00:11:46.720 align:start position:0%
<00:11:46.710>uh <00:11:46.711>those <00:11:46.713>guidelines. <00:11:46.715>And <00:11:46.717>what <00:11:46.719>happens,

00:11:46.720 --> 00:11:48.750 align:start position:0%
<00:11:46.720>uh <00:11:46.875>those <00:11:47.031>guidelines. <00:11:47.186>And <00:11:47.342>what <00:11:47.497>happens, <00:11:47.653>you <00:11:47.808>get <00:11:47.964>a <00:11:48.120>predicted

00:11:48.750 --> 00:11:48.760 align:start position:0%
<00:11:48.750>you <00:11:48.753>get <00:11:48.756>a <00:11:48.759>predicted

00:11:48.760 --> 00:11:51.270 align:start position:0%
<00:11:48.760>you <00:11:48.900>get <00:11:49.040>a <00:11:49.180>predicted <00:11:49.319>um <00:11:49.460>predicted <00:11:49.600>score, <00:11:49.740>and <00:11:49.880>then <00:11:50.020>you <00:11:50.160>compare

00:11:51.270 --> 00:11:51.280 align:start position:0%
<00:11:51.270>um <00:11:51.271>predicted <00:11:51.273>score, <00:11:51.274>and <00:11:51.276>then <00:11:51.277>you <00:11:51.279>compare

00:11:51.280 --> 00:11:53.710 align:start position:0%
<00:11:51.280>um <00:11:51.373>predicted <00:11:51.466>score, <00:11:51.560>and <00:11:51.653>then <00:11:51.746>you <00:11:51.839>compare <00:11:51.933>it <00:11:52.026>to <00:11:52.120>the <00:11:52.213>exact <00:11:52.306>output, <00:11:52.400>and <00:11:52.493>you <00:11:52.586>get <00:11:52.680>the

00:11:53.710 --> 00:11:53.720 align:start position:0%
<00:11:53.710>it <00:11:53.711>to <00:11:53.712>the <00:11:53.713>exact <00:11:53.714>output, <00:11:53.715>and <00:11:53.716>you <00:11:53.717>get <00:11:53.719>the

00:11:53.720 --> 00:11:55.510 align:start position:0%
<00:11:53.720>it <00:11:53.807>to <00:11:53.895>the <00:11:53.982>exact <00:11:54.070>output, <00:11:54.157>and <00:11:54.245>you <00:11:54.332>get <00:11:54.420>the <00:11:54.507>scores <00:11:54.595>at <00:11:54.682>the <00:11:54.770>end, <00:11:54.857>and <00:11:54.945>then <00:11:55.032>you <00:11:55.120>can

00:11:55.510 --> 00:11:55.520 align:start position:0%
<00:11:55.510>scores <00:11:55.511>at <00:11:55.512>the <00:11:55.513>end, <00:11:55.515>and <00:11:55.516>then <00:11:55.517>you <00:11:55.519>can

00:11:55.520 --> 00:11:58.190 align:start position:0%
<00:11:55.520>scores <00:11:55.627>at <00:11:55.735>the <00:11:55.843>end, <00:11:55.950>and <00:11:56.058>then <00:11:56.166>you <00:11:56.273>can <00:11:56.381>compare <00:11:56.489>your <00:11:56.596>latency, <00:11:56.704>your <00:11:56.812>quality, <00:11:56.920>and

00:11:58.190 --> 00:11:58.200 align:start position:0%
<00:11:58.190>compare <00:11:58.191>your <00:11:58.193>latency, <00:11:58.195>your <00:11:58.197>quality, <00:11:58.199>and

00:11:58.200 --> 00:11:59.990 align:start position:0%
<00:11:58.200>compare <00:11:58.340>your <00:11:58.480>latency, <00:11:58.620>your <00:11:58.760>quality, <00:11:58.900>and <00:11:59.040>different <00:11:59.180>trends <00:11:59.320>between <00:11:59.460>the <00:11:59.600>models.

00:11:59.990 --> 00:12:00.000 align:start position:0%
<00:11:59.990>different <00:11:59.992>trends <00:11:59.994>between <00:11:59.996>the <00:11:59.999>models.

00:12:00.000 --> 00:12:02.870 align:start position:0%
<00:12:00.000>different <00:12:00.116>trends <00:12:00.233>between <00:12:00.350>the <00:12:00.466>models. <00:12:00.583>Now, <00:12:00.700>let <00:12:00.816>me <00:12:00.933>show <00:12:01.050>you <00:12:01.166>a <00:12:01.283>quick <00:12:01.400>demo.

00:12:02.870 --> 00:12:02.880 align:start position:0%
<00:12:02.870>Now, <00:12:02.871>let <00:12:02.872>me <00:12:02.873>show <00:12:02.875>you <00:12:02.876>a <00:12:02.877>quick <00:12:02.879>demo.

00:12:02.880 --> 00:12:06.310 align:start position:0%
<00:12:02.880>Now, <00:12:02.980>let <00:12:03.080>me <00:12:03.180>show <00:12:03.280>you <00:12:03.380>a <00:12:03.480>quick <00:12:03.580>demo. <00:12:03.680>So, <00:12:03.780>first, <00:12:03.880>we <00:12:03.980>create <00:12:04.080>the <00:12:04.180>evaluation <00:12:04.280>set.

00:12:06.310 --> 00:12:06.320 align:start position:0%
<00:12:06.310>So, <00:12:06.311>first, <00:12:06.313>we <00:12:06.314>create <00:12:06.316>the <00:12:06.317>evaluation <00:12:06.319>set.

00:12:06.320 --> 00:12:08.790 align:start position:0%
<00:12:06.320>So, <00:12:06.420>first, <00:12:06.520>we <00:12:06.620>create <00:12:06.720>the <00:12:06.820>evaluation <00:12:06.920>set. <00:12:07.020>So, <00:12:07.120>here <00:12:07.220>you <00:12:07.320>can <00:12:07.420>see <00:12:07.520>I <00:12:07.620>defined <00:12:07.720>eight

00:12:08.790 --> 00:12:08.800 align:start position:0%
<00:12:08.790>So, <00:12:08.791>here <00:12:08.792>you <00:12:08.793>can <00:12:08.795>see <00:12:08.796>I <00:12:08.797>defined <00:12:08.799>eight

00:12:08.800 --> 00:12:10.190 align:start position:0%
<00:12:08.800>So, <00:12:08.956>here <00:12:09.112>you <00:12:09.269>can <00:12:09.425>see <00:12:09.581>I <00:12:09.738>defined <00:12:09.894>eight <00:12:10.051>categories,

00:12:10.190 --> 00:12:10.200 align:start position:0%
categories,

00:12:10.200 --> 00:12:12.230 align:start position:0%
<00:12:10.200>categories, <00:12:10.400>uh <00:12:10.600>which <00:12:10.800>are <00:12:11.000>the <00:12:11.200>different <00:12:11.400>types <00:12:11.600>of

00:12:12.230 --> 00:12:12.240 align:start position:0%
<00:12:12.230>uh <00:12:12.231>which <00:12:12.233>are <00:12:12.234>the <00:12:12.236>different <00:12:12.237>types <00:12:12.239>of

00:12:12.240 --> 00:12:14.670 align:start position:0%
<00:12:12.240>uh <00:12:12.356>which <00:12:12.473>are <00:12:12.590>the <00:12:12.706>different <00:12:12.823>types <00:12:12.940>of <00:12:13.056>messages <00:12:13.173>that <00:12:13.290>I'm <00:12:13.406>trying <00:12:13.523>to <00:12:13.640>classify.

00:12:14.670 --> 00:12:14.680 align:start position:0%
<00:12:14.670>messages <00:12:14.671>that <00:12:14.673>I'm <00:12:14.675>trying <00:12:14.677>to <00:12:14.679>classify.

00:12:14.680 --> 00:12:17.150 align:start position:0%
<00:12:14.680>messages <00:12:14.787>that <00:12:14.895>I'm <00:12:15.003>trying <00:12:15.110>to <00:12:15.218>classify. <00:12:15.326>Then, <00:12:15.433>I <00:12:15.541>define <00:12:15.649>score, <00:12:15.756>and <00:12:15.864>for <00:12:15.972>me <00:12:16.079>the

00:12:17.150 --> 00:12:17.160 align:start position:0%
<00:12:17.150>Then, <00:12:17.151>I <00:12:17.152>define <00:12:17.153>score, <00:12:17.155>and <00:12:17.156>for <00:12:17.157>me <00:12:17.159>the

00:12:17.160 --> 00:12:19.790 align:start position:0%
<00:12:17.160>Then, <00:12:17.260>I <00:12:17.360>define <00:12:17.459>score, <00:12:17.560>and <00:12:17.660>for <00:12:17.760>me <00:12:17.860>the <00:12:17.959>score <00:12:18.060>is <00:12:18.160>whether <00:12:18.260>the <00:12:18.360>model <00:12:18.459>got <00:12:18.560>the

00:12:19.790 --> 00:12:19.800 align:start position:0%
<00:12:19.790>score <00:12:19.791>is <00:12:19.793>whether <00:12:19.794>the <00:12:19.795>model <00:12:19.797>got <00:12:19.799>the

00:12:19.800 --> 00:12:22.270 align:start position:0%
<00:12:19.800>score <00:12:19.907>is <00:12:20.015>whether <00:12:20.123>the <00:12:20.230>model <00:12:20.338>got <00:12:20.446>the <00:12:20.553>classification <00:12:20.661>right <00:12:20.769>or <00:12:20.876>not. <00:12:20.984>And <00:12:21.092>then, <00:12:21.199>I

00:12:22.270 --> 00:12:22.280 align:start position:0%
<00:12:22.270>classification <00:12:22.271>right <00:12:22.273>or <00:12:22.274>not. <00:12:22.276>And <00:12:22.277>then, <00:12:22.279>I

00:12:22.280 --> 00:12:25.270 align:start position:0%
<00:12:22.280>classification <00:12:22.396>right <00:12:22.513>or <00:12:22.630>not. <00:12:22.746>And <00:12:22.863>then, <00:12:22.980>I <00:12:23.096>literally <00:12:23.213>just <00:12:23.329>run <00:12:23.446>one <00:12:23.563>command, <00:12:23.680>MLflow

00:12:25.270 --> 00:12:25.280 align:start position:0%
<00:12:25.270>literally <00:12:25.271>just <00:12:25.273>run <00:12:25.275>one <00:12:25.277>command, <00:12:25.279>MLflow

00:12:25.280 --> 00:12:27.910 align:start position:0%
<00:12:25.280>literally <00:12:25.396>just <00:12:25.513>run <00:12:25.630>one <00:12:25.746>command, <00:12:25.863>MLflow <00:12:25.980>gen <00:12:26.096>AI <00:12:26.213>evaluate, <00:12:26.329>and <00:12:26.446>I <00:12:26.563>provide <00:12:26.680>16

00:12:27.910 --> 00:12:27.920 align:start position:0%
<00:12:27.910>gen <00:12:27.911>AI <00:12:27.913>evaluate, <00:12:27.914>and <00:12:27.915>I <00:12:27.917>provide <00:12:27.919>16

00:12:27.920 --> 00:12:30.070 align:start position:0%
<00:12:27.920>gen <00:12:28.020>AI <00:12:28.120>evaluate, <00:12:28.219>and <00:12:28.319>I <00:12:28.420>provide <00:12:28.520>16 <00:12:28.620>models. <00:12:28.719>And <00:12:28.819>now, <00:12:28.920>you <00:12:29.020>can <00:12:29.120>see <00:12:29.219>the <00:12:29.319>16

00:12:30.070 --> 00:12:30.080 align:start position:0%
<00:12:30.070>models. <00:12:30.071>And <00:12:30.072>now, <00:12:30.073>you <00:12:30.075>can <00:12:30.076>see <00:12:30.077>the <00:12:30.079>16

00:12:30.080 --> 00:12:32.630 align:start position:0%
<00:12:30.080>models. <00:12:30.180>And <00:12:30.280>now, <00:12:30.380>you <00:12:30.480>can <00:12:30.580>see <00:12:30.680>the <00:12:30.780>16 <00:12:30.880>models <00:12:30.980>are <00:12:31.080>being <00:12:31.180>evaluated, <00:12:31.280>and <00:12:31.380>I <00:12:31.480>get

00:12:32.630 --> 00:12:32.640 align:start position:0%
<00:12:32.630>models <00:12:32.631>are <00:12:32.633>being <00:12:32.634>evaluated, <00:12:32.636>and <00:12:32.637>I <00:12:32.639>get

00:12:32.640 --> 00:12:34.590 align:start position:0%
<00:12:32.640>models <00:12:32.740>are <00:12:32.840>being <00:12:32.939>evaluated, <00:12:33.040>and <00:12:33.140>I <00:12:33.240>get <00:12:33.340>the <00:12:33.439>results. <00:12:33.540>And <00:12:33.640>I <00:12:33.740>will <00:12:33.840>show <00:12:33.939>you <00:12:34.040>later

00:12:34.590 --> 00:12:34.600 align:start position:0%
<00:12:34.590>the <00:12:34.591>results. <00:12:34.592>And <00:12:34.593>I <00:12:34.595>will <00:12:34.596>show <00:12:34.597>you <00:12:34.599>later

00:12:34.600 --> 00:12:37.030 align:start position:0%
<00:12:34.600>the <00:12:34.700>results. <00:12:34.800>And <00:12:34.900>I <00:12:35.000>will <00:12:35.100>show <00:12:35.200>you <00:12:35.300>later <00:12:35.400>results <00:12:35.500>in <00:12:35.600>terms <00:12:35.700>of <00:12:35.800>a <00:12:35.900>dashboard. <00:12:36.000>Now,

00:12:37.030 --> 00:12:37.040 align:start position:0%
<00:12:37.030>results <00:12:37.031>in <00:12:37.033>terms <00:12:37.034>of <00:12:37.036>a <00:12:37.037>dashboard. <00:12:37.039>Now,

00:12:37.040 --> 00:12:39.950 align:start position:0%
<00:12:37.040>results <00:12:37.147>in <00:12:37.255>terms <00:12:37.363>of <00:12:37.470>a <00:12:37.578>dashboard. <00:12:37.686>Now, <00:12:37.793>for <00:12:37.901>the <00:12:38.009>second <00:12:38.116>task, <00:12:38.224>for <00:12:38.332>reasoning <00:12:38.439>task,

00:12:39.950 --> 00:12:39.960 align:start position:0%
<00:12:39.950>for <00:12:39.951>the <00:12:39.953>second <00:12:39.954>task, <00:12:39.956>for <00:12:39.957>reasoning <00:12:39.959>task,

00:12:39.960 --> 00:12:41.710 align:start position:0%
<00:12:39.960>for <00:12:40.067>the <00:12:40.175>second <00:12:40.283>task, <00:12:40.390>for <00:12:40.498>reasoning <00:12:40.606>task, <00:12:40.713>it's <00:12:40.821>a <00:12:40.929>bit <00:12:41.036>more <00:12:41.144>complicated <00:12:41.252>because <00:12:41.360>here

00:12:41.710 --> 00:12:41.720 align:start position:0%
<00:12:41.710>it's <00:12:41.711>a <00:12:41.713>bit <00:12:41.714>more <00:12:41.716>complicated <00:12:41.717>because <00:12:41.719>here

00:12:41.720 --> 00:12:43.870 align:start position:0%
<00:12:41.720>it's <00:12:41.813>a <00:12:41.906>bit <00:12:42.000>more <00:12:42.093>complicated <00:12:42.186>because <00:12:42.280>here <00:12:42.373>I <00:12:42.466>have <00:12:42.560>to <00:12:42.653>do <00:12:42.746>more <00:12:42.840>of <00:12:42.933>a <00:12:43.026>semantic <00:12:43.120>search,

00:12:43.870 --> 00:12:43.880 align:start position:0%
<00:12:43.870>I <00:12:43.871>have <00:12:43.872>to <00:12:43.873>do <00:12:43.874>more <00:12:43.875>of <00:12:43.876>a <00:12:43.877>semantic <00:12:43.879>search,

00:12:43.880 --> 00:12:46.070 align:start position:0%
<00:12:43.880>I <00:12:43.980>have <00:12:44.080>to <00:12:44.180>do <00:12:44.280>more <00:12:44.380>of <00:12:44.480>a <00:12:44.580>semantic <00:12:44.680>search, <00:12:44.780>because <00:12:44.880>I'm <00:12:44.980>providing <00:12:45.080>context <00:12:45.180>to <00:12:45.280>human

00:12:46.070 --> 00:12:46.080 align:start position:0%
<00:12:46.070>because <00:12:46.071>I'm <00:12:46.073>providing <00:12:46.075>context <00:12:46.077>to <00:12:46.079>human

00:12:46.080 --> 00:12:47.910 align:start position:0%
<00:12:46.080>because <00:12:46.187>I'm <00:12:46.295>providing <00:12:46.403>context <00:12:46.510>to <00:12:46.618>human <00:12:46.726>reviewer, <00:12:46.833>and <00:12:46.941>I <00:12:47.049>want <00:12:47.156>to <00:12:47.264>make <00:12:47.372>sure <00:12:47.480>that

00:12:47.910 --> 00:12:47.920 align:start position:0%
<00:12:47.910>reviewer, <00:12:47.911>and <00:12:47.912>I <00:12:47.913>want <00:12:47.915>to <00:12:47.916>make <00:12:47.917>sure <00:12:47.919>that

00:12:47.920 --> 00:12:50.230 align:start position:0%
<00:12:47.920>reviewer, <00:12:48.020>and <00:12:48.120>I <00:12:48.219>want <00:12:48.319>to <00:12:48.420>make <00:12:48.520>sure <00:12:48.620>that <00:12:48.719>this <00:12:48.819>context <00:12:48.920>is <00:12:49.020>right. <00:12:49.120>So, <00:12:49.219>what <00:12:49.319>I'm

00:12:50.230 --> 00:12:50.240 align:start position:0%
<00:12:50.230>this <00:12:50.231>context <00:12:50.233>is <00:12:50.234>right. <00:12:50.236>So, <00:12:50.237>what <00:12:50.239>I'm

00:12:50.240 --> 00:12:53.230 align:start position:0%
<00:12:50.240>this <00:12:50.333>context <00:12:50.426>is <00:12:50.520>right. <00:12:50.613>So, <00:12:50.706>what <00:12:50.800>I'm <00:12:50.893>going <00:12:50.986>to <00:12:51.080>do, <00:12:51.173>I'm <00:12:51.266>going <00:12:51.360>to <00:12:51.453>create <00:12:51.546>now <00:12:51.640>LLM

00:12:53.230 --> 00:12:53.240 align:start position:0%
<00:12:53.230>going <00:12:53.231>to <00:12:53.232>do, <00:12:53.233>I'm <00:12:53.234>going <00:12:53.235>to <00:12:53.236>create <00:12:53.237>now <00:12:53.239>LLM

00:12:53.240 --> 00:12:55.910 align:start position:0%
<00:12:53.240>going <00:12:53.322>to <00:12:53.404>do, <00:12:53.487>I'm <00:12:53.569>going <00:12:53.651>to <00:12:53.734>create <00:12:53.816>now <00:12:53.898>LLM <00:12:53.981>as <00:12:54.063>a <00:12:54.145>judge, <00:12:54.228>and <00:12:54.310>I <00:12:54.392>will <00:12:54.475>be <00:12:54.557>utilizing <00:12:54.640>Opus

00:12:55.910 --> 00:12:55.920 align:start position:0%
<00:12:55.910>as <00:12:55.911>a <00:12:55.912>judge, <00:12:55.913>and <00:12:55.914>I <00:12:55.915>will <00:12:55.916>be <00:12:55.917>utilizing <00:12:55.919>Opus

00:12:55.920 --> 00:13:00.829 align:start position:0%
<00:12:55.920>as <00:12:56.007>a <00:12:56.094>judge, <00:12:56.182>and <00:12:56.270>I <00:12:56.357>will <00:12:56.444>be <00:12:56.532>utilizing <00:12:56.620>Opus <00:12:56.707>4.8 <00:12:56.795>to <00:12:56.882>judge <00:12:56.969>how <00:12:57.057>well <00:12:57.145>those <00:12:57.232>uh <00:12:57.319>context

00:13:00.829 --> 00:13:00.839 align:start position:0%
<00:13:00.829>4.8 <00:13:00.830>to <00:13:00.831>judge <00:13:00.832>how <00:13:00.834>well <00:13:00.835>those <00:13:00.836>uh <00:13:00.838>context

00:13:00.839 --> 00:13:03.430 align:start position:0%
<00:13:00.839>4.8 <00:13:00.939>to <00:13:01.039>judge <00:13:01.139>how <00:13:01.239>well <00:13:01.339>those <00:13:01.439>uh <00:13:01.539>context <00:13:01.639>will <00:13:01.739>be <00:13:01.839>provided <00:13:01.939>to <00:13:02.039>human <00:13:02.139>reviewer, <00:13:02.239>and

00:13:03.430 --> 00:13:03.440 align:start position:0%
<00:13:03.430>will <00:13:03.431>be <00:13:03.433>provided <00:13:03.434>to <00:13:03.436>human <00:13:03.437>reviewer, <00:13:03.439>and

00:13:03.440 --> 00:13:04.870 align:start position:0%
<00:13:03.440>will <00:13:03.583>be <00:13:03.726>provided <00:13:03.869>to <00:13:04.012>human <00:13:04.155>reviewer, <00:13:04.298>and <00:13:04.441>I'm <00:13:04.584>going <00:13:04.727>to

00:13:04.870 --> 00:13:04.880 align:start position:0%
<00:13:04.870>I'm <00:13:04.874>going <00:13:04.879>to

00:13:04.880 --> 00:13:06.990 align:start position:0%
<00:13:04.880>I'm <00:13:05.020>going <00:13:05.160>to <00:13:05.300>uh <00:13:05.439>have <00:13:05.580>this <00:13:05.720>criteria <00:13:05.860>from <00:13:06.000>one <00:13:06.140>to <00:13:06.280>five.

00:13:06.990 --> 00:13:07.000 align:start position:0%
<00:13:06.990>uh <00:13:06.991>have <00:13:06.992>this <00:13:06.993>criteria <00:13:06.995>from <00:13:06.996>one <00:13:06.997>to <00:13:06.999>five.

00:13:07.000 --> 00:13:09.630 align:start position:0%
<00:13:07.000>uh <00:13:07.107>have <00:13:07.215>this <00:13:07.323>criteria <00:13:07.430>from <00:13:07.538>one <00:13:07.646>to <00:13:07.753>five. <00:13:07.861>So, <00:13:07.969>five <00:13:08.076>basically <00:13:08.184>the <00:13:08.292>best <00:13:08.400>semantic

00:13:09.630 --> 00:13:09.640 align:start position:0%
<00:13:09.630>So, <00:13:09.631>five <00:13:09.633>basically <00:13:09.635>the <00:13:09.637>best <00:13:09.639>semantic

00:13:09.640 --> 00:13:12.350 align:start position:0%
<00:13:09.640>So, <00:13:09.767>five <00:13:09.894>basically <00:13:10.021>the <00:13:10.149>best <00:13:10.276>semantic <00:13:10.403>search <00:13:10.530>is <00:13:10.658>exactly <00:13:10.785>what <00:13:10.912>was <00:13:11.040>expected.

00:13:12.350 --> 00:13:12.360 align:start position:0%
<00:13:12.350>search <00:13:12.351>is <00:13:12.353>exactly <00:13:12.355>what <00:13:12.357>was <00:13:12.359>expected.

00:13:12.360 --> 00:13:14.590 align:start position:0%
<00:13:12.360>search <00:13:12.487>is <00:13:12.614>exactly <00:13:12.741>what <00:13:12.869>was <00:13:12.996>expected. <00:13:13.123>Again, <00:13:13.250>just <00:13:13.378>utilizing <00:13:13.505>a <00:13:13.632>simple <00:13:13.760>MLflow

00:13:14.590 --> 00:13:14.600 align:start position:0%
<00:13:14.590>Again, <00:13:14.591>just <00:13:14.593>utilizing <00:13:14.595>a <00:13:14.597>simple <00:13:14.599>MLflow

00:13:14.600 --> 00:13:17.990 align:start position:0%
<00:13:14.600>Again, <00:13:14.740>just <00:13:14.880>utilizing <00:13:15.020>a <00:13:15.160>simple <00:13:15.300>MLflow <00:13:15.440>evaluation <00:13:15.580>uh <00:13:15.720>command, <00:13:15.860>I <00:13:16.000>am

00:13:17.990 --> 00:13:18.000 align:start position:0%
<00:13:17.990>evaluation <00:13:17.992>uh <00:13:17.994>command, <00:13:17.996>I <00:13:17.999>am

00:13:18.000 --> 00:13:20.110 align:start position:0%
<00:13:18.000>evaluation <00:13:18.127>uh <00:13:18.254>command, <00:13:18.381>I <00:13:18.509>am <00:13:18.636>going <00:13:18.763>to <00:13:18.890>run <00:13:19.018>it <00:13:19.145>utilizing <00:13:19.272>the <00:13:19.400>provided

00:13:20.110 --> 00:13:20.120 align:start position:0%
<00:13:20.110>going <00:13:20.111>to <00:13:20.113>run <00:13:20.114>it <00:13:20.116>utilizing <00:13:20.117>the <00:13:20.119>provided

00:13:20.120 --> 00:13:22.590 align:start position:0%
<00:13:20.120>going <00:13:20.213>to <00:13:20.306>run <00:13:20.400>it <00:13:20.493>utilizing <00:13:20.586>the <00:13:20.680>provided <00:13:20.773>data <00:13:20.866>set, <00:13:20.960>and <00:13:21.053>then <00:13:21.146>I <00:13:21.240>will <00:13:21.333>get <00:13:21.426>my <00:13:21.520>scores

00:13:22.590 --> 00:13:22.600 align:start position:0%
<00:13:22.590>data <00:13:22.591>set, <00:13:22.592>and <00:13:22.593>then <00:13:22.594>I <00:13:22.595>will <00:13:22.596>get <00:13:22.597>my <00:13:22.599>scores

00:13:22.600 --> 00:13:24.430 align:start position:0%
<00:13:22.600>data <00:13:22.716>set, <00:13:22.833>and <00:13:22.950>then <00:13:23.066>I <00:13:23.183>will <00:13:23.300>get <00:13:23.416>my <00:13:23.533>scores <00:13:23.650>from <00:13:23.766>one <00:13:23.883>to <00:13:24.000>five.

00:13:24.430 --> 00:13:24.440 align:start position:0%
<00:13:24.430>from <00:13:24.433>one <00:13:24.436>to <00:13:24.439>five.

00:13:24.440 --> 00:13:28.310 align:start position:0%
<00:13:24.440>from <00:13:24.567>one <00:13:24.694>to <00:13:24.821>five. <00:13:24.949>When <00:13:25.076>I <00:13:25.203>run <00:13:25.330>this, <00:13:25.458>it's <00:13:25.585>all <00:13:25.712>stored <00:13:25.840>in

00:13:28.310 --> 00:13:28.320 align:start position:0%
<00:13:28.310>When <00:13:28.311>I <00:13:28.312>run <00:13:28.313>this, <00:13:28.315>it's <00:13:28.316>all <00:13:28.317>stored <00:13:28.319>in

00:13:28.320 --> 00:13:31.150 align:start position:0%
<00:13:28.320>When <00:13:28.413>I <00:13:28.506>run <00:13:28.600>this, <00:13:28.693>it's <00:13:28.786>all <00:13:28.880>stored <00:13:28.973>in <00:13:29.066>experiments. <00:13:29.160>So, <00:13:29.253>you <00:13:29.346>can <00:13:29.440>see <00:13:29.533>now <00:13:29.626>all <00:13:29.720>of

00:13:31.150 --> 00:13:31.160 align:start position:0%
<00:13:31.150>experiments. <00:13:31.151>So, <00:13:31.152>you <00:13:31.153>can <00:13:31.155>see <00:13:31.156>now <00:13:31.157>all <00:13:31.159>of

00:13:31.160 --> 00:13:33.230 align:start position:0%
<00:13:31.160>experiments. <00:13:31.260>So, <00:13:31.360>you <00:13:31.459>can <00:13:31.560>see <00:13:31.660>now <00:13:31.760>all <00:13:31.860>of <00:13:31.959>the <00:13:32.060>models, <00:13:32.160>you <00:13:32.260>can <00:13:32.360>see <00:13:32.459>the <00:13:32.560>accuracy,

00:13:33.230 --> 00:13:33.240 align:start position:0%
<00:13:33.230>the <00:13:33.231>models, <00:13:33.233>you <00:13:33.234>can <00:13:33.236>see <00:13:33.237>the <00:13:33.239>accuracy,

00:13:33.240 --> 00:13:35.070 align:start position:0%
<00:13:33.240>the <00:13:33.340>models, <00:13:33.440>you <00:13:33.540>can <00:13:33.640>see <00:13:33.740>the <00:13:33.840>accuracy, <00:13:33.940>you <00:13:34.040>can <00:13:34.140>see <00:13:34.240>F1 <00:13:34.340>score, <00:13:34.440>you <00:13:34.540>can <00:13:34.640>see

00:13:35.070 --> 00:13:35.080 align:start position:0%
<00:13:35.070>you <00:13:35.071>can <00:13:35.072>see <00:13:35.073>F1 <00:13:35.075>score, <00:13:35.076>you <00:13:35.077>can <00:13:35.079>see

00:13:35.080 --> 00:13:37.670 align:start position:0%
<00:13:35.080>you <00:13:35.180>can <00:13:35.280>see <00:13:35.380>F1 <00:13:35.480>score, <00:13:35.580>you <00:13:35.680>can <00:13:35.780>see <00:13:35.880>latency, <00:13:35.980>and <00:13:36.080>all <00:13:36.180>of <00:13:36.280>this <00:13:36.380>information <00:13:36.480>is

00:13:37.670 --> 00:13:37.680 align:start position:0%
<00:13:37.670>latency, <00:13:37.671>and <00:13:37.673>all <00:13:37.674>of <00:13:37.675>this <00:13:37.677>information <00:13:37.679>is

00:13:37.680 --> 00:13:39.950 align:start position:0%
<00:13:37.680>latency, <00:13:37.787>and <00:13:37.895>all <00:13:38.003>of <00:13:38.110>this <00:13:38.218>information <00:13:38.326>is <00:13:38.433>stored <00:13:38.541>in <00:13:38.649>systems <00:13:38.756>table. <00:13:38.864>So, <00:13:38.972>I <00:13:39.079>will

00:13:39.950 --> 00:13:39.960 align:start position:0%
<00:13:39.950>stored <00:13:39.951>in <00:13:39.953>systems <00:13:39.954>table. <00:13:39.956>So, <00:13:39.957>I <00:13:39.959>will

00:13:39.960 --> 00:13:42.550 align:start position:0%
<00:13:39.960>stored <00:13:40.060>in <00:13:40.160>systems <00:13:40.260>table. <00:13:40.360>So, <00:13:40.460>I <00:13:40.560>will <00:13:40.660>later <00:13:40.760>show <00:13:40.860>you <00:13:40.960>the <00:13:41.060>dashboard, <00:13:41.160>so <00:13:41.260>you <00:13:41.360>can

00:13:42.550 --> 00:13:42.560 align:start position:0%
<00:13:42.550>later <00:13:42.551>show <00:13:42.552>you <00:13:42.553>the <00:13:42.555>dashboard, <00:13:42.556>so <00:13:42.557>you <00:13:42.559>can

00:13:42.560 --> 00:13:45.750 align:start position:0%
<00:13:42.560>later <00:13:42.660>show <00:13:42.760>you <00:13:42.859>the <00:13:42.959>dashboard, <00:13:43.060>so <00:13:43.160>you <00:13:43.260>can <00:13:43.359>see <00:13:43.459>how <00:13:43.560>those <00:13:43.660>models <00:13:43.760>compared <00:13:43.859>to <00:13:43.959>each

00:13:45.750 --> 00:13:45.760 align:start position:0%
<00:13:45.750>see <00:13:45.751>how <00:13:45.753>those <00:13:45.754>models <00:13:45.756>compared <00:13:45.757>to <00:13:45.759>each

00:13:45.760 --> 00:13:47.830 align:start position:0%
<00:13:45.760>see <00:13:45.960>how <00:13:46.160>those <00:13:46.360>models <00:13:46.560>compared <00:13:46.760>to <00:13:46.960>each <00:13:47.160>other.

00:13:47.830 --> 00:13:47.840 align:start position:0%
other.

00:13:47.840 --> 00:13:50.510 align:start position:0%
<00:13:47.840>other. <00:13:48.040>So, <00:13:48.240>what <00:13:48.440>I <00:13:48.640>showed <00:13:48.840>right <00:13:49.040>now <00:13:49.240>was

00:13:50.510 --> 00:13:50.520 align:start position:0%
<00:13:50.510>So, <00:13:50.511>what <00:13:50.513>I <00:13:50.514>showed <00:13:50.516>right <00:13:50.517>now <00:13:50.519>was

00:13:50.520 --> 00:13:52.790 align:start position:0%
<00:13:50.520>So, <00:13:50.647>what <00:13:50.774>I <00:13:50.901>showed <00:13:51.029>right <00:13:51.156>now <00:13:51.283>was <00:13:51.410>programmatic <00:13:51.538>evaluation. <00:13:51.665>So, <00:13:51.792>let's <00:13:51.920>say

00:13:52.790 --> 00:13:52.800 align:start position:0%
<00:13:52.790>programmatic <00:13:52.792>evaluation. <00:13:52.794>So, <00:13:52.796>let's <00:13:52.799>say

00:13:52.800 --> 00:13:54.670 align:start position:0%
<00:13:52.800>programmatic <00:13:52.916>evaluation. <00:13:53.033>So, <00:13:53.150>let's <00:13:53.266>say <00:13:53.383>if <00:13:53.500>you <00:13:53.616>changed <00:13:53.733>your <00:13:53.849>prompt, <00:13:53.966>if <00:13:54.083>there's <00:13:54.199>a

00:13:54.670 --> 00:13:54.680 align:start position:0%
<00:13:54.670>if <00:13:54.671>you <00:13:54.672>changed <00:13:54.673>your <00:13:54.675>prompt, <00:13:54.676>if <00:13:54.677>there's <00:13:54.679>a

00:13:54.680 --> 00:13:56.990 align:start position:0%
<00:13:54.680>if <00:13:54.787>you <00:13:54.895>changed <00:13:55.003>your <00:13:55.110>prompt, <00:13:55.218>if <00:13:55.326>there's <00:13:55.433>a <00:13:55.541>new <00:13:55.649>model <00:13:55.756>drops <00:13:55.864>tomorrow, <00:13:55.972>you <00:13:56.079>simply

00:13:56.990 --> 00:13:57.000 align:start position:0%
<00:13:56.990>new <00:13:56.991>model <00:13:56.993>drops <00:13:56.995>tomorrow, <00:13:56.997>you <00:13:56.999>simply

00:13:57.000 --> 00:13:59.670 align:start position:0%
<00:13:57.000>new <00:13:57.127>model <00:13:57.254>drops <00:13:57.381>tomorrow, <00:13:57.509>you <00:13:57.636>simply <00:13:57.763>trigger <00:13:57.890>this <00:13:58.018>workflow, <00:13:58.145>write <00:13:58.272>this <00:13:58.400>job,

00:13:59.670 --> 00:13:59.680 align:start position:0%
<00:13:59.670>trigger <00:13:59.671>this <00:13:59.673>workflow, <00:13:59.675>write <00:13:59.677>this <00:13:59.679>job,

00:13:59.680 --> 00:14:01.710 align:start position:0%
<00:13:59.680>trigger <00:13:59.796>this <00:13:59.913>workflow, <00:14:00.030>write <00:14:00.146>this <00:14:00.263>job, <00:14:00.380>and <00:14:00.496>it <00:14:00.613>will <00:14:00.729>automatically <00:14:00.846>rerun, <00:14:00.963>and <00:14:01.079>you

00:14:01.710 --> 00:14:01.720 align:start position:0%
<00:14:01.710>and <00:14:01.711>it <00:14:01.713>will <00:14:01.714>automatically <00:14:01.716>rerun, <00:14:01.717>and <00:14:01.719>you

00:14:01.720 --> 00:14:04.870 align:start position:0%
<00:14:01.720>and <00:14:01.820>it <00:14:01.920>will <00:14:02.020>automatically <00:14:02.120>rerun, <00:14:02.220>and <00:14:02.320>you <00:14:02.420>will <00:14:02.520>get <00:14:02.620>your <00:14:02.720>scores <00:14:02.820>whether <00:14:02.920>you <00:14:03.020>need <00:14:03.120>to

00:14:04.870 --> 00:14:04.880 align:start position:0%
<00:14:04.870>will <00:14:04.871>get <00:14:04.872>your <00:14:04.873>scores <00:14:04.875>whether <00:14:04.876>you <00:14:04.877>need <00:14:04.879>to

00:14:04.880 --> 00:14:07.590 align:start position:0%
<00:14:04.880>will <00:14:04.980>get <00:14:05.080>your <00:14:05.180>scores <00:14:05.280>whether <00:14:05.380>you <00:14:05.480>need <00:14:05.580>to <00:14:05.680>shift <00:14:05.780>your <00:14:05.880>traffic <00:14:05.980>towards <00:14:06.080>now <00:14:06.180>this <00:14:06.280>new

00:14:07.590 --> 00:14:07.600 align:start position:0%
<00:14:07.590>shift <00:14:07.591>your <00:14:07.593>traffic <00:14:07.594>towards <00:14:07.596>now <00:14:07.597>this <00:14:07.599>new

00:14:07.600 --> 00:14:10.710 align:start position:0%
<00:14:07.600>shift <00:14:07.707>your <00:14:07.815>traffic <00:14:07.923>towards <00:14:08.030>now <00:14:08.138>this <00:14:08.246>new <00:14:08.353>model. <00:14:08.461>The <00:14:08.569>second <00:14:08.676>option <00:14:08.784>is <00:14:08.892>also <00:14:09.000>to

00:14:10.710 --> 00:14:10.720 align:start position:0%
<00:14:10.710>model. <00:14:10.711>The <00:14:10.713>second <00:14:10.714>option <00:14:10.716>is <00:14:10.717>also <00:14:10.719>to

00:14:10.720 --> 00:14:14.030 align:start position:0%
<00:14:10.720>model. <00:14:10.827>The <00:14:10.935>second <00:14:11.043>option <00:14:11.150>is <00:14:11.258>also <00:14:11.366>to <00:14:11.473>utilize <00:14:11.581>human <00:14:11.689>review. <00:14:11.796>If <00:14:11.904>it's <00:14:12.012>your <00:14:12.120>task

00:14:14.030 --> 00:14:14.040 align:start position:0%
<00:14:14.030>utilize <00:14:14.031>human <00:14:14.033>review. <00:14:14.034>If <00:14:14.036>it's <00:14:14.037>your <00:14:14.039>task

00:14:14.040 --> 00:14:17.190 align:start position:0%
<00:14:14.040>utilize <00:14:14.147>human <00:14:14.255>review. <00:14:14.363>If <00:14:14.470>it's <00:14:14.578>your <00:14:14.686>task <00:14:14.793>is <00:14:14.901>more <00:14:15.009>complex, <00:14:15.116>you <00:14:15.224>can <00:14:15.332>get <00:14:15.439>experts

00:14:17.190 --> 00:14:17.200 align:start position:0%
<00:14:17.190>is <00:14:17.191>more <00:14:17.193>complex, <00:14:17.194>you <00:14:17.196>can <00:14:17.197>get <00:14:17.199>experts

00:14:17.200 --> 00:14:19.670 align:start position:0%
<00:14:17.200>is <00:14:17.316>more <00:14:17.433>complex, <00:14:17.550>you <00:14:17.666>can <00:14:17.783>get <00:14:17.900>experts <00:14:18.016>provide <00:14:18.133>feedback, <00:14:18.250>and <00:14:18.366>then <00:14:18.483>this <00:14:18.600>feedback

00:14:19.670 --> 00:14:19.680 align:start position:0%
<00:14:19.670>provide <00:14:19.671>feedback, <00:14:19.673>and <00:14:19.675>then <00:14:19.677>this <00:14:19.679>feedback

00:14:19.680 --> 00:14:22.230 align:start position:0%
<00:14:19.680>provide <00:14:19.787>feedback, <00:14:19.895>and <00:14:20.003>then <00:14:20.110>this <00:14:20.218>feedback <00:14:20.326>will <00:14:20.433>be <00:14:20.541>merged <00:14:20.649>into <00:14:20.756>traces, <00:14:20.864>and <00:14:20.972>then <00:14:21.079>it

00:14:22.230 --> 00:14:22.240 align:start position:0%
<00:14:22.230>will <00:14:22.231>be <00:14:22.232>merged <00:14:22.233>into <00:14:22.235>traces, <00:14:22.236>and <00:14:22.237>then <00:14:22.239>it

00:14:22.240 --> 00:14:26.310 align:start position:0%
<00:14:22.240>will <00:14:22.356>be <00:14:22.473>merged <00:14:22.590>into <00:14:22.706>traces, <00:14:22.823>and <00:14:22.940>then <00:14:23.056>it <00:14:23.173>will <00:14:23.290>be <00:14:23.406>utilized <00:14:23.523>to <00:14:23.640>improve

00:14:26.310 --> 00:14:26.320 align:start position:0%
<00:14:26.310>will <00:14:26.312>be <00:14:26.314>utilized <00:14:26.316>to <00:14:26.319>improve

00:14:26.320 --> 00:14:30.070 align:start position:0%
<00:14:26.320>will <00:14:26.475>be <00:14:26.631>utilized <00:14:26.786>to <00:14:26.942>improve <00:14:27.097>future <00:14:27.253>iteration. <00:14:27.408>And <00:14:27.564>evaluation <00:14:27.720>really

00:14:30.070 --> 00:14:30.080 align:start position:0%
<00:14:30.070>future <00:14:30.072>iteration. <00:14:30.074>And <00:14:30.076>evaluation <00:14:30.079>really

00:14:30.080 --> 00:14:32.670 align:start position:0%
<00:14:30.080>future <00:14:30.187>iteration. <00:14:30.295>And <00:14:30.403>evaluation <00:14:30.510>really <00:14:30.618>is <00:14:30.726>a <00:14:30.833>continuous <00:14:30.941>loop, <00:14:31.049>so <00:14:31.156>once <00:14:31.264>you <00:14:31.372>run <00:14:31.480>it

00:14:32.670 --> 00:14:32.680 align:start position:0%
<00:14:32.670>is <00:14:32.671>a <00:14:32.672>continuous <00:14:32.673>loop, <00:14:32.674>so <00:14:32.675>once <00:14:32.676>you <00:14:32.677>run <00:14:32.679>it

00:14:32.680 --> 00:14:35.350 align:start position:0%
<00:14:32.680>is <00:14:32.773>a <00:14:32.866>continuous <00:14:32.959>loop, <00:14:33.053>so <00:14:33.146>once <00:14:33.239>you <00:14:33.333>run <00:14:33.426>it <00:14:33.520>once, <00:14:33.613>you <00:14:33.706>also <00:14:33.800>do <00:14:33.893>it <00:14:33.986>in <00:14:34.079>production,

00:14:35.350 --> 00:14:35.360 align:start position:0%
<00:14:35.350>once, <00:14:35.351>you <00:14:35.353>also <00:14:35.354>do <00:14:35.356>it <00:14:35.357>in <00:14:35.359>production,

00:14:35.360 --> 00:14:37.870 align:start position:0%
<00:14:35.360>once, <00:14:35.467>you <00:14:35.575>also <00:14:35.683>do <00:14:35.790>it <00:14:35.898>in <00:14:36.006>production, <00:14:36.113>right? <00:14:36.221>So, <00:14:36.329>you <00:14:36.436>collect <00:14:36.544>this <00:14:36.652>traces <00:14:36.760>using

00:14:37.870 --> 00:14:37.880 align:start position:0%
<00:14:37.870>right? <00:14:37.871>So, <00:14:37.873>you <00:14:37.874>collect <00:14:37.876>this <00:14:37.877>traces <00:14:37.879>using

00:14:37.880 --> 00:14:40.630 align:start position:0%
<00:14:37.880>right? <00:14:38.007>So, <00:14:38.134>you <00:14:38.261>collect <00:14:38.389>this <00:14:38.516>traces <00:14:38.643>using <00:14:38.770>open <00:14:38.898>telemetry, <00:14:39.025>and <00:14:39.152>you <00:14:39.280>continuously

00:14:40.630 --> 00:14:40.640 align:start position:0%
<00:14:40.630>open <00:14:40.632>telemetry, <00:14:40.634>and <00:14:40.636>you <00:14:40.639>continuously

00:14:40.640 --> 00:14:42.310 align:start position:0%
<00:14:40.640>open <00:14:40.840>telemetry, <00:14:41.040>and <00:14:41.240>you <00:14:41.439>continuously <00:14:41.640>improve. <00:14:41.840>Maybe <00:14:42.040>you

00:14:42.310 --> 00:14:42.320 align:start position:0%
<00:14:42.310>improve. <00:14:42.314>Maybe <00:14:42.319>you

00:14:42.320 --> 00:14:44.550 align:start position:0%
<00:14:42.320>improve. <00:14:42.447>Maybe <00:14:42.574>you <00:14:42.701>you <00:14:42.829>find <00:14:42.956>some <00:14:43.083>kind <00:14:43.210>of <00:14:43.338>a <00:14:43.465>edge <00:14:43.592>case, <00:14:43.720>so

00:14:44.550 --> 00:14:44.560 align:start position:0%
<00:14:44.550>you <00:14:44.551>find <00:14:44.552>some <00:14:44.553>kind <00:14:44.554>of <00:14:44.555>a <00:14:44.556>edge <00:14:44.557>case, <00:14:44.559>so

00:14:44.560 --> 00:14:47.270 align:start position:0%
<00:14:44.560>you <00:14:44.653>find <00:14:44.746>some <00:14:44.839>kind <00:14:44.933>of <00:14:45.026>a <00:14:45.119>edge <00:14:45.213>case, <00:14:45.306>so <00:14:45.400>you <00:14:45.493>want <00:14:45.586>to <00:14:45.680>make <00:14:45.773>sure <00:14:45.866>that <00:14:45.959>you

00:14:47.270 --> 00:14:47.280 align:start position:0%
<00:14:47.270>you <00:14:47.271>want <00:14:47.273>to <00:14:47.274>make <00:14:47.276>sure <00:14:47.277>that <00:14:47.279>you

00:14:47.280 --> 00:14:49.550 align:start position:0%
<00:14:47.280>you <00:14:47.387>want <00:14:47.495>to <00:14:47.603>make <00:14:47.710>sure <00:14:47.818>that <00:14:47.926>you <00:14:48.033>put <00:14:48.141>this <00:14:48.249>edge <00:14:48.356>case <00:14:48.464>into <00:14:48.572>your <00:14:48.680>evaluation

00:14:49.550 --> 00:14:49.560 align:start position:0%
<00:14:49.550>put <00:14:49.551>this <00:14:49.553>edge <00:14:49.554>case <00:14:49.555>into <00:14:49.557>your <00:14:49.559>evaluation

00:14:49.560 --> 00:14:51.670 align:start position:0%
<00:14:49.560>put <00:14:49.676>this <00:14:49.793>edge <00:14:49.910>case <00:14:50.026>into <00:14:50.143>your <00:14:50.260>evaluation <00:14:50.376>set, <00:14:50.493>and <00:14:50.609>you <00:14:50.726>continuously <00:14:50.843>improve <00:14:50.959>what's

00:14:51.670 --> 00:14:51.680 align:start position:0%
<00:14:51.670>set, <00:14:51.671>and <00:14:51.673>you <00:14:51.675>continuously <00:14:51.677>improve <00:14:51.679>what's

00:14:51.680 --> 00:14:53.710 align:start position:0%
<00:14:51.680>set, <00:14:51.880>and <00:14:52.079>you <00:14:52.280>continuously <00:14:52.479>improve <00:14:52.680>what's <00:14:52.880>in <00:14:53.079>production.

00:14:53.710 --> 00:14:53.720 align:start position:0%
<00:14:53.710>in <00:14:53.719>production.

00:14:53.720 --> 00:14:56.790 align:start position:0%
<00:14:53.720>in <00:14:53.895>production. <00:14:54.070>Now <00:14:54.245>that <00:14:54.420>we <00:14:54.595>evaluated <00:14:54.770>models, <00:14:54.945>the <00:14:55.120>next

00:14:56.790 --> 00:14:56.800 align:start position:0%
<00:14:56.790>Now <00:14:56.791>that <00:14:56.793>we <00:14:56.794>evaluated <00:14:56.795>models, <00:14:56.797>the <00:14:56.799>next

00:14:56.800 --> 00:14:58.910 align:start position:0%
<00:14:56.800>Now <00:14:56.955>that <00:14:57.111>we <00:14:57.266>evaluated <00:14:57.422>models, <00:14:57.577>the <00:14:57.733>next <00:14:57.888>step <00:14:58.044>is <00:14:58.199>deployment.

00:14:58.910 --> 00:14:58.920 align:start position:0%
<00:14:58.910>step <00:14:58.914>is <00:14:58.919>deployment.

00:14:58.920 --> 00:15:01.990 align:start position:0%
<00:14:58.920>step <00:14:59.075>is <00:14:59.231>deployment. <00:14:59.386>What <00:14:59.542>we're <00:14:59.697>seeing <00:14:59.853>with <00:15:00.008>companies <00:15:00.164>now, <00:15:00.319>a

00:15:01.990 --> 00:15:02.000 align:start position:0%
<00:15:01.990>What <00:15:01.991>we're <00:15:01.993>seeing <00:15:01.994>with <00:15:01.996>companies <00:15:01.997>now, <00:15:01.999>a

00:15:02.000 --> 00:15:04.070 align:start position:0%
<00:15:02.000>What <00:15:02.116>we're <00:15:02.233>seeing <00:15:02.350>with <00:15:02.466>companies <00:15:02.583>now, <00:15:02.700>a <00:15:02.816>lot <00:15:02.933>of <00:15:03.050>them <00:15:03.166>is <00:15:03.283>building <00:15:03.400>those

00:15:04.070 --> 00:15:04.080 align:start position:0%
<00:15:04.070>lot <00:15:04.071>of <00:15:04.073>them <00:15:04.075>is <00:15:04.077>building <00:15:04.079>those

00:15:04.080 --> 00:15:06.630 align:start position:0%
<00:15:04.080>lot <00:15:04.220>of <00:15:04.360>them <00:15:04.500>is <00:15:04.640>building <00:15:04.780>those <00:15:04.920>microservices <00:15:05.060>and <00:15:05.200>they <00:15:05.340>embedding <00:15:05.480>APIs,

00:15:06.630 --> 00:15:06.640 align:start position:0%
<00:15:06.630>microservices <00:15:06.632>and <00:15:06.634>they <00:15:06.636>embedding <00:15:06.639>APIs,

00:15:06.640 --> 00:15:09.150 align:start position:0%
<00:15:06.640>microservices <00:15:06.767>and <00:15:06.894>they <00:15:07.021>embedding <00:15:07.149>APIs, <00:15:07.276>and <00:15:07.403>then <00:15:07.530>they <00:15:07.658>create <00:15:07.785>this <00:15:07.912>chaos <00:15:08.040>where

00:15:09.150 --> 00:15:09.160 align:start position:0%
<00:15:09.150>and <00:15:09.151>then <00:15:09.153>they <00:15:09.154>create <00:15:09.156>this <00:15:09.157>chaos <00:15:09.159>where

00:15:09.160 --> 00:15:11.470 align:start position:0%
<00:15:09.160>and <00:15:09.267>then <00:15:09.375>they <00:15:09.483>create <00:15:09.590>this <00:15:09.698>chaos <00:15:09.806>where <00:15:09.913>where <00:15:10.021>they <00:15:10.129>don't <00:15:10.236>even <00:15:10.344>know <00:15:10.452>where <00:15:10.560>exactly

00:15:11.470 --> 00:15:11.480 align:start position:0%
<00:15:11.470>where <00:15:11.471>they <00:15:11.473>don't <00:15:11.474>even <00:15:11.476>know <00:15:11.477>where <00:15:11.479>exactly

00:15:11.480 --> 00:15:13.750 align:start position:0%
<00:15:11.480>where <00:15:11.607>they <00:15:11.734>don't <00:15:11.861>even <00:15:11.989>know <00:15:12.116>where <00:15:12.243>exactly <00:15:12.370>the <00:15:12.498>usage <00:15:12.625>is <00:15:12.752>coming <00:15:12.880>from.

00:15:13.750 --> 00:15:13.760 align:start position:0%
<00:15:13.750>the <00:15:13.752>usage <00:15:13.754>is <00:15:13.756>coming <00:15:13.759>from.

00:15:13.760 --> 00:15:16.430 align:start position:0%
<00:15:13.760>the <00:15:13.900>usage <00:15:14.040>is <00:15:14.180>coming <00:15:14.319>from. <00:15:14.460>So, <00:15:14.600>to <00:15:14.740>address <00:15:14.880>this, <00:15:15.020>Databricks <00:15:15.160>provides

00:15:16.430 --> 00:15:16.440 align:start position:0%
<00:15:16.430>So, <00:15:16.431>to <00:15:16.433>address <00:15:16.435>this, <00:15:16.437>Databricks <00:15:16.439>provides

00:15:16.440 --> 00:15:19.990 align:start position:0%
<00:15:16.440>So, <00:15:16.556>to <00:15:16.673>address <00:15:16.790>this, <00:15:16.906>Databricks <00:15:17.023>provides <00:15:17.140>Unity <00:15:17.256>Catalog <00:15:17.373>so <00:15:17.490>in <00:15:17.606>the <00:15:17.723>Unity <00:15:17.840>Catalog

00:15:19.990 --> 00:15:20.000 align:start position:0%
<00:15:19.990>Unity <00:15:19.991>Catalog <00:15:19.993>so <00:15:19.994>in <00:15:19.996>the <00:15:19.997>Unity <00:15:19.999>Catalog

00:15:20.000 --> 00:15:23.390 align:start position:0%
<00:15:20.000>Unity <00:15:20.107>Catalog <00:15:20.215>so <00:15:20.323>in <00:15:20.430>the <00:15:20.538>Unity <00:15:20.646>Catalog <00:15:20.753>gives <00:15:20.861>you <00:15:20.969>one <00:15:21.076>control <00:15:21.184>plane <00:15:21.292>over <00:15:21.400>your

00:15:23.390 --> 00:15:23.400 align:start position:0%
<00:15:23.390>gives <00:15:23.391>you <00:15:23.393>one <00:15:23.394>control <00:15:23.396>plane <00:15:23.397>over <00:15:23.399>your

00:15:23.400 --> 00:15:26.390 align:start position:0%
<00:15:23.400>gives <00:15:23.507>you <00:15:23.615>one <00:15:23.723>control <00:15:23.830>plane <00:15:23.938>over <00:15:24.046>your <00:15:24.153>entire <00:15:24.261>estate. <00:15:24.369>So, <00:15:24.476>personally, <00:15:24.584>I <00:15:24.692>use <00:15:24.800>it

00:15:26.390 --> 00:15:26.400 align:start position:0%
<00:15:26.390>entire <00:15:26.391>estate. <00:15:26.393>So, <00:15:26.394>personally, <00:15:26.396>I <00:15:26.397>use <00:15:26.399>it

00:15:26.400 --> 00:15:29.230 align:start position:0%
<00:15:26.400>entire <00:15:26.500>estate. <00:15:26.600>So, <00:15:26.699>personally, <00:15:26.800>I <00:15:26.900>use <00:15:27.000>it <00:15:27.100>for <00:15:27.199>my <00:15:27.300>coding <00:15:27.400>work. <00:15:27.500>So, <00:15:27.600>I <00:15:27.699>pointed <00:15:27.800>my

00:15:29.230 --> 00:15:29.240 align:start position:0%
<00:15:29.230>for <00:15:29.231>my <00:15:29.232>coding <00:15:29.233>work. <00:15:29.235>So, <00:15:29.236>I <00:15:29.237>pointed <00:15:29.239>my

00:15:29.240 --> 00:15:32.590 align:start position:0%
<00:15:29.240>for <00:15:29.367>my <00:15:29.494>coding <00:15:29.621>work. <00:15:29.749>So, <00:15:29.876>I <00:15:30.003>pointed <00:15:30.130>my <00:15:30.258>code <00:15:30.385>code, <00:15:30.512>my <00:15:30.640>cursor,

00:15:32.590 --> 00:15:32.600 align:start position:0%
<00:15:32.590>code <00:15:32.593>code, <00:15:32.596>my <00:15:32.599>cursor,

00:15:32.600 --> 00:15:34.830 align:start position:0%
<00:15:32.600>code <00:15:32.727>code, <00:15:32.854>my <00:15:32.981>cursor, <00:15:33.109>um <00:15:33.236>if <00:15:33.363>I <00:15:33.490>use <00:15:33.618>Genie, <00:15:33.745>everything <00:15:33.872>all <00:15:34.000>the

00:15:34.830 --> 00:15:34.840 align:start position:0%
<00:15:34.830>um <00:15:34.831>if <00:15:34.832>I <00:15:34.833>use <00:15:34.835>Genie, <00:15:34.836>everything <00:15:34.837>all <00:15:34.839>the

00:15:34.840 --> 00:15:37.270 align:start position:0%
<00:15:34.840>um <00:15:34.947>if <00:15:35.055>I <00:15:35.163>use <00:15:35.270>Genie, <00:15:35.378>everything <00:15:35.486>all <00:15:35.593>the <00:15:35.701>traffic <00:15:35.809>goes <00:15:35.916>through <00:15:36.024>Unity <00:15:36.132>AI <00:15:36.240>Gateway,

00:15:37.270 --> 00:15:37.280 align:start position:0%
<00:15:37.270>traffic <00:15:37.271>goes <00:15:37.273>through <00:15:37.275>Unity <00:15:37.277>AI <00:15:37.279>Gateway,

00:15:37.280 --> 00:15:39.750 align:start position:0%
<00:15:37.280>traffic <00:15:37.396>goes <00:15:37.513>through <00:15:37.630>Unity <00:15:37.746>AI <00:15:37.863>Gateway, <00:15:37.980>and <00:15:38.096>then <00:15:38.213>I <00:15:38.329>can <00:15:38.446>see <00:15:38.563>the <00:15:38.680>spend.

00:15:39.750 --> 00:15:39.760 align:start position:0%
<00:15:39.750>and <00:15:39.751>then <00:15:39.753>I <00:15:39.754>can <00:15:39.756>see <00:15:39.757>the <00:15:39.759>spend.

00:15:39.760 --> 00:15:41.110 align:start position:0%
<00:15:39.760>and <00:15:39.933>then <00:15:40.107>I <00:15:40.280>can <00:15:40.454>see <00:15:40.627>the <00:15:40.801>spend. <00:15:40.975>Um

00:15:41.110 --> 00:15:41.120 align:start position:0%
Um

00:15:41.120 --> 00:15:43.430 align:start position:0%
<00:15:41.120>Um <00:15:41.275>how <00:15:41.431>much <00:15:41.586>I <00:15:41.742>spend <00:15:41.897>in, <00:15:42.053>and <00:15:42.208>my <00:15:42.364>manager <00:15:42.520>can

00:15:43.430 --> 00:15:43.440 align:start position:0%
<00:15:43.430>how <00:15:43.431>much <00:15:43.432>I <00:15:43.433>spend <00:15:43.434>in, <00:15:43.435>and <00:15:43.436>my <00:15:43.437>manager <00:15:43.439>can

00:15:43.440 --> 00:15:45.790 align:start position:0%
<00:15:43.440>how <00:15:43.527>much <00:15:43.615>I <00:15:43.702>spend <00:15:43.790>in, <00:15:43.877>and <00:15:43.965>my <00:15:44.052>manager <00:15:44.140>can <00:15:44.227>also <00:15:44.315>see <00:15:44.402>my <00:15:44.490>spend. <00:15:44.577>Maybe <00:15:44.665>not <00:15:44.752>so <00:15:44.840>good,

00:15:45.790 --> 00:15:45.800 align:start position:0%
<00:15:45.790>also <00:15:45.791>see <00:15:45.792>my <00:15:45.793>spend. <00:15:45.795>Maybe <00:15:45.796>not <00:15:45.797>so <00:15:45.799>good,

00:15:45.800 --> 00:15:46.630 align:start position:0%
<00:15:45.800>also <00:15:45.893>see <00:15:45.986>my <00:15:46.080>spend. <00:15:46.173>Maybe <00:15:46.266>not <00:15:46.360>so <00:15:46.453>good, <00:15:46.547>but

00:15:46.630 --> 00:15:46.640 align:start position:0%
but

00:15:46.640 --> 00:15:48.750 align:start position:0%
<00:15:46.640>but <00:15:46.873>that's <00:15:47.106>uh <00:15:47.340>what <00:15:47.573>enterprises <00:15:47.806>want. <00:15:48.040>They

00:15:48.750 --> 00:15:48.760 align:start position:0%
<00:15:48.750>that's <00:15:48.751>uh <00:15:48.753>what <00:15:48.755>enterprises <00:15:48.757>want. <00:15:48.759>They

00:15:48.760 --> 00:15:51.510 align:start position:0%
<00:15:48.760>that's <00:15:48.867>uh <00:15:48.975>what <00:15:49.083>enterprises <00:15:49.190>want. <00:15:49.298>They <00:15:49.406>want <00:15:49.513>to <00:15:49.621>see <00:15:49.729>the <00:15:49.836>control, <00:15:49.944>right? <00:15:50.052>Of <00:15:50.160>how

00:15:51.510 --> 00:15:51.520 align:start position:0%
<00:15:51.510>want <00:15:51.511>to <00:15:51.512>see <00:15:51.513>the <00:15:51.515>control, <00:15:51.516>right? <00:15:51.517>Of <00:15:51.519>how

00:15:51.520 --> 00:15:54.390 align:start position:0%
<00:15:51.520>want <00:15:51.620>to <00:15:51.720>see <00:15:51.819>the <00:15:51.920>control, <00:15:52.020>right? <00:15:52.120>Of <00:15:52.220>how <00:15:52.319>much <00:15:52.420>we <00:15:52.520>as <00:15:52.620>organization <00:15:52.720>are <00:15:52.819>spending <00:15:52.920>on

00:15:54.390 --> 00:15:54.400 align:start position:0%
<00:15:54.390>much <00:15:54.391>we <00:15:54.393>as <00:15:54.394>organization <00:15:54.396>are <00:15:54.397>spending <00:15:54.399>on

00:15:54.400 --> 00:15:56.350 align:start position:0%
<00:15:54.400>much <00:15:54.516>we <00:15:54.633>as <00:15:54.750>organization <00:15:54.866>are <00:15:54.983>spending <00:15:55.100>on <00:15:55.216>different <00:15:55.333>things, <00:15:55.449>whether <00:15:55.566>it's <00:15:55.683>a <00:15:55.800>model

00:15:56.350 --> 00:15:56.360 align:start position:0%
<00:15:56.350>different <00:15:56.351>things, <00:15:56.353>whether <00:15:56.355>it's <00:15:56.357>a <00:15:56.359>model

00:15:56.360 --> 00:15:58.830 align:start position:0%
<00:15:56.360>different <00:15:56.476>things, <00:15:56.593>whether <00:15:56.710>it's <00:15:56.826>a <00:15:56.943>model <00:15:57.060>usage, <00:15:57.176>whether <00:15:57.293>it's <00:15:57.410>MCP, <00:15:57.526>you <00:15:57.643>can <00:15:57.760>also

00:15:58.830 --> 00:15:58.840 align:start position:0%
<00:15:58.830>usage, <00:15:58.831>whether <00:15:58.833>it's <00:15:58.834>MCP, <00:15:58.836>you <00:15:58.837>can <00:15:58.839>also

00:15:58.840 --> 00:16:01.470 align:start position:0%
<00:15:58.840>usage, <00:15:58.947>whether <00:15:59.055>it's <00:15:59.163>MCP, <00:15:59.270>you <00:15:59.378>can <00:15:59.486>also <00:15:59.593>utilize <00:15:59.701>partner <00:15:59.809>MCP, <00:15:59.916>or <00:16:00.024>whether <00:16:00.132>it's <00:16:00.240>a

00:16:01.470 --> 00:16:01.480 align:start position:0%
<00:16:01.470>utilize <00:16:01.471>partner <00:16:01.473>MCP, <00:16:01.474>or <00:16:01.476>whether <00:16:01.477>it's <00:16:01.479>a

00:16:01.480 --> 00:16:04.310 align:start position:0%
<00:16:01.480>utilize <00:16:01.587>partner <00:16:01.695>MCP, <00:16:01.803>or <00:16:01.910>whether <00:16:02.018>it's <00:16:02.126>a <00:16:02.233>coding <00:16:02.341>agents. <00:16:02.449>So, <00:16:02.556>think <00:16:02.664>about <00:16:02.772>this <00:16:02.880>as

00:16:04.310 --> 00:16:04.320 align:start position:0%
<00:16:04.310>coding <00:16:04.311>agents. <00:16:04.313>So, <00:16:04.314>think <00:16:04.316>about <00:16:04.317>this <00:16:04.319>as

00:16:04.320 --> 00:16:05.710 align:start position:0%
<00:16:04.320>coding <00:16:04.476>agents. <00:16:04.632>So, <00:16:04.789>think <00:16:04.945>about <00:16:05.101>this <00:16:05.258>as <00:16:05.414>your <00:16:05.571>one

00:16:05.710 --> 00:16:05.720 align:start position:0%
<00:16:05.710>your <00:16:05.719>one

00:16:05.720 --> 00:16:08.350 align:start position:0%
<00:16:05.720>your <00:16:05.895>one <00:16:06.070>shop <00:16:06.245>where <00:16:06.420>you <00:16:06.595>can <00:16:06.770>analyze <00:16:06.945>your <00:16:07.120>cost,

00:16:08.350 --> 00:16:08.360 align:start position:0%
<00:16:08.350>shop <00:16:08.351>where <00:16:08.353>you <00:16:08.354>can <00:16:08.356>analyze <00:16:08.357>your <00:16:08.359>cost,

00:16:08.360 --> 00:16:10.870 align:start position:0%
<00:16:08.360>shop <00:16:08.460>where <00:16:08.560>you <00:16:08.660>can <00:16:08.760>analyze <00:16:08.860>your <00:16:08.960>cost, <00:16:09.060>and <00:16:09.160>you <00:16:09.260>can <00:16:09.360>also <00:16:09.460>route <00:16:09.560>it <00:16:09.660>to <00:16:09.760>different

00:16:10.870 --> 00:16:10.880 align:start position:0%
<00:16:10.870>and <00:16:10.871>you <00:16:10.872>can <00:16:10.873>also <00:16:10.875>route <00:16:10.876>it <00:16:10.877>to <00:16:10.879>different

00:16:10.880 --> 00:16:13.510 align:start position:0%
<00:16:10.880>and <00:16:11.055>you <00:16:11.230>can <00:16:11.405>also <00:16:11.580>route <00:16:11.755>it <00:16:11.930>to <00:16:12.105>different <00:16:12.280>models.

00:16:13.520 --> 00:16:15.030 align:start position:0%
<00:16:13.520>You <00:16:13.714>know, <00:16:13.908>a <00:16:14.102>lot <00:16:14.296>of <00:16:14.490>people <00:16:14.684>when <00:16:14.879>they

00:16:15.030 --> 00:16:15.040 align:start position:0%
<00:16:15.030>You <00:16:15.031>know, <00:16:15.032>a <00:16:15.033>lot <00:16:15.035>of <00:16:15.036>people <00:16:15.037>when <00:16:15.039>they

00:16:15.040 --> 00:16:18.110 align:start position:0%
<00:16:15.040>You <00:16:15.147>know, <00:16:15.255>a <00:16:15.363>lot <00:16:15.470>of <00:16:15.578>people <00:16:15.686>when <00:16:15.793>they <00:16:15.901>think <00:16:16.009>about <00:16:16.116>putting <00:16:16.224>the <00:16:16.332>model, <00:16:16.439>they

00:16:18.110 --> 00:16:18.120 align:start position:0%
<00:16:18.110>think <00:16:18.111>about <00:16:18.113>putting <00:16:18.115>the <00:16:18.117>model, <00:16:18.119>they

00:16:18.120 --> 00:16:20.390 align:start position:0%
<00:16:18.120>think <00:16:18.236>about <00:16:18.353>putting <00:16:18.470>the <00:16:18.586>model, <00:16:18.703>they <00:16:18.820>start <00:16:18.936>with <00:16:19.053>like <00:16:19.170>having <00:16:19.286>a <00:16:19.403>formal, <00:16:19.520>"Oh,

00:16:20.390 --> 00:16:20.400 align:start position:0%
<00:16:20.390>start <00:16:20.391>with <00:16:20.393>like <00:16:20.394>having <00:16:20.396>a <00:16:20.397>formal, <00:16:20.399>"Oh,

00:16:20.400 --> 00:16:22.430 align:start position:0%
<00:16:20.400>start <00:16:20.507>with <00:16:20.615>like <00:16:20.723>having <00:16:20.830>a <00:16:20.938>formal, <00:16:21.046>"Oh, <00:16:21.153>there's <00:16:21.261>this <00:16:21.369>new <00:16:21.476>model <00:16:21.584>that <00:16:21.692>has <00:16:21.800>dropped.

00:16:22.430 --> 00:16:22.440 align:start position:0%
<00:16:22.430>there's <00:16:22.431>this <00:16:22.433>new <00:16:22.434>model <00:16:22.436>that <00:16:22.437>has <00:16:22.439>dropped.

00:16:22.440 --> 00:16:24.950 align:start position:0%
<00:16:22.440>there's <00:16:22.533>this <00:16:22.626>new <00:16:22.720>model <00:16:22.813>that <00:16:22.906>has <00:16:23.000>dropped. <00:16:23.093>Let's <00:16:23.186>say <00:16:23.280>Febel. <00:16:23.373>Oh <00:16:23.466>my <00:16:23.560>god, <00:16:23.653>we <00:16:23.746>have <00:16:23.840>to

00:16:24.950 --> 00:16:24.960 align:start position:0%
<00:16:24.950>Let's <00:16:24.951>say <00:16:24.952>Febel. <00:16:24.953>Oh <00:16:24.954>my <00:16:24.955>god, <00:16:24.956>we <00:16:24.957>have <00:16:24.959>to

00:16:24.960 --> 00:16:27.630 align:start position:0%
<00:16:24.960>Let's <00:16:25.047>say <00:16:25.135>Febel. <00:16:25.222>Oh <00:16:25.310>my <00:16:25.397>god, <00:16:25.485>we <00:16:25.572>have <00:16:25.660>to <00:16:25.747>try <00:16:25.835>it." <00:16:25.922>But, <00:16:26.010>honestly, <00:16:26.097>this <00:16:26.185>is <00:16:26.272>a <00:16:26.360>really

00:16:27.630 --> 00:16:27.640 align:start position:0%
<00:16:27.630>try <00:16:27.631>it." <00:16:27.632>But, <00:16:27.633>honestly, <00:16:27.635>this <00:16:27.636>is <00:16:27.637>a <00:16:27.639>really

00:16:27.640 --> 00:16:30.710 align:start position:0%
<00:16:27.640>try <00:16:27.740>it." <00:16:27.840>But, <00:16:27.939>honestly, <00:16:28.040>this <00:16:28.140>is <00:16:28.240>a <00:16:28.340>really <00:16:28.439>wrong <00:16:28.540>way <00:16:28.640>of <00:16:28.740>thinking <00:16:28.840>about <00:16:28.939>this. <00:16:29.040>If

00:16:30.710 --> 00:16:30.720 align:start position:0%
<00:16:30.710>wrong <00:16:30.711>way <00:16:30.713>of <00:16:30.714>thinking <00:16:30.716>about <00:16:30.717>this. <00:16:30.719>If

00:16:30.720 --> 00:16:34.030 align:start position:0%
<00:16:30.720>wrong <00:16:30.820>way <00:16:30.920>of <00:16:31.020>thinking <00:16:31.120>about <00:16:31.220>this. <00:16:31.320>If <00:16:31.420>your <00:16:31.520>task <00:16:31.620>can <00:16:31.720>be <00:16:31.820>solved <00:16:31.920>by <00:16:32.020>intern, <00:16:32.120>would

00:16:34.030 --> 00:16:34.040 align:start position:0%
<00:16:34.030>your <00:16:34.031>task <00:16:34.032>can <00:16:34.033>be <00:16:34.035>solved <00:16:34.036>by <00:16:34.037>intern, <00:16:34.039>would

00:16:34.040 --> 00:16:36.590 align:start position:0%
<00:16:34.040>your <00:16:34.127>task <00:16:34.214>can <00:16:34.302>be <00:16:34.390>solved <00:16:34.477>by <00:16:34.564>intern, <00:16:34.652>would <00:16:34.740>you <00:16:34.827>give <00:16:34.915>this <00:16:35.002>job <00:16:35.089>to <00:16:35.177>our <00:16:35.265>PhD? <00:16:35.352>No, <00:16:35.439>it

00:16:36.590 --> 00:16:36.600 align:start position:0%
<00:16:36.590>you <00:16:36.591>give <00:16:36.592>this <00:16:36.593>job <00:16:36.594>to <00:16:36.595>our <00:16:36.596>PhD? <00:16:36.597>No, <00:16:36.599>it

00:16:36.600 --> 00:16:38.710 align:start position:0%
<00:16:36.600>you <00:16:36.687>give <00:16:36.775>this <00:16:36.862>job <00:16:36.950>to <00:16:37.037>our <00:16:37.125>PhD? <00:16:37.212>No, <00:16:37.300>it <00:16:37.387>will <00:16:37.475>be <00:16:37.562>a <00:16:37.650>waste <00:16:37.737>of <00:16:37.825>resources, <00:16:37.912>right? <00:16:38.000>So,

00:16:38.710 --> 00:16:38.720 align:start position:0%
<00:16:38.710>will <00:16:38.711>be <00:16:38.712>a <00:16:38.713>waste <00:16:38.715>of <00:16:38.716>resources, <00:16:38.717>right? <00:16:38.719>So,

00:16:38.720 --> 00:16:42.310 align:start position:0%
<00:16:38.720>will <00:16:38.813>be <00:16:38.906>a <00:16:39.000>waste <00:16:39.093>of <00:16:39.186>resources, <00:16:39.280>right? <00:16:39.373>So, <00:16:39.466>the <00:16:39.560>same <00:16:39.653>thing <00:16:39.746>with <00:16:39.840>models. <00:16:39.933>If <00:16:40.026>your <00:16:40.120>task

00:16:42.310 --> 00:16:42.320 align:start position:0%
<00:16:42.310>the <00:16:42.311>same <00:16:42.312>thing <00:16:42.313>with <00:16:42.315>models. <00:16:42.316>If <00:16:42.317>your <00:16:42.319>task

00:16:42.320 --> 00:16:45.230 align:start position:0%
<00:16:42.320>the <00:16:42.413>same <00:16:42.506>thing <00:16:42.600>with <00:16:42.693>models. <00:16:42.786>If <00:16:42.880>your <00:16:42.973>task <00:16:43.066>can <00:16:43.160>be <00:16:43.253>solved <00:16:43.346>with <00:16:43.440>a <00:16:43.533>smaller <00:16:43.626>model, <00:16:43.720>then

00:16:45.230 --> 00:16:45.240 align:start position:0%
<00:16:45.230>can <00:16:45.231>be <00:16:45.232>solved <00:16:45.233>with <00:16:45.235>a <00:16:45.236>smaller <00:16:45.237>model, <00:16:45.239>then

00:16:45.240 --> 00:16:47.190 align:start position:0%
<00:16:45.240>can <00:16:45.356>be <00:16:45.473>solved <00:16:45.590>with <00:16:45.706>a <00:16:45.823>smaller <00:16:45.940>model, <00:16:46.056>then <00:16:46.173>start <00:16:46.290>with <00:16:46.406>smaller <00:16:46.523>model. <00:16:46.640>Evaluate

00:16:47.190 --> 00:16:47.200 align:start position:0%
<00:16:47.190>start <00:16:47.192>with <00:16:47.194>smaller <00:16:47.196>model. <00:16:47.199>Evaluate

00:16:47.200 --> 00:16:49.630 align:start position:0%
<00:16:47.200>start <00:16:47.327>with <00:16:47.454>smaller <00:16:47.581>model. <00:16:47.709>Evaluate <00:16:47.836>against <00:16:47.963>model <00:16:48.090>smaller <00:16:48.218>model. <00:16:48.345>If <00:16:48.472>you <00:16:48.600>see

00:16:49.630 --> 00:16:49.640 align:start position:0%
<00:16:49.630>against <00:16:49.631>model <00:16:49.633>smaller <00:16:49.634>model. <00:16:49.636>If <00:16:49.637>you <00:16:49.639>see

00:16:49.640 --> 00:16:51.670 align:start position:0%
<00:16:49.640>against <00:16:49.740>model <00:16:49.840>smaller <00:16:49.939>model. <00:16:50.040>If <00:16:50.140>you <00:16:50.240>see <00:16:50.340>that <00:16:50.439>those <00:16:50.540>scores <00:16:50.640>are <00:16:50.740>not <00:16:50.840>where <00:16:50.939>you <00:16:51.040>are,

00:16:51.670 --> 00:16:51.680 align:start position:0%
<00:16:51.670>that <00:16:51.671>those <00:16:51.672>scores <00:16:51.673>are <00:16:51.675>not <00:16:51.676>where <00:16:51.677>you <00:16:51.679>are,

00:16:51.680 --> 00:16:54.110 align:start position:0%
<00:16:51.680>that <00:16:51.787>those <00:16:51.895>scores <00:16:52.003>are <00:16:52.110>not <00:16:52.218>where <00:16:52.326>you <00:16:52.433>are, <00:16:52.541>then <00:16:52.649>you <00:16:52.756>know, <00:16:52.864>continuously <00:16:52.972>um <00:16:53.079>start

00:16:54.110 --> 00:16:54.120 align:start position:0%
<00:16:54.110>then <00:16:54.111>you <00:16:54.113>know, <00:16:54.115>continuously <00:16:54.117>um <00:16:54.119>start

00:16:54.120 --> 00:16:56.430 align:start position:0%
<00:16:54.120>then <00:16:54.260>you <00:16:54.400>know, <00:16:54.540>continuously <00:16:54.680>um <00:16:54.820>start <00:16:54.960>increasing <00:16:55.100>the <00:16:55.240>model <00:16:55.380>intelligence. <00:16:55.520>And

00:16:56.430 --> 00:16:56.440 align:start position:0%
<00:16:56.430>increasing <00:16:56.432>the <00:16:56.434>model <00:16:56.436>intelligence. <00:16:56.439>And

00:16:56.440 --> 00:16:59.190 align:start position:0%
<00:16:56.440>increasing <00:16:56.547>the <00:16:56.655>model <00:16:56.763>intelligence. <00:16:56.870>And <00:16:56.978>then <00:16:57.086>you <00:16:57.193>can <00:16:57.301>also <00:16:57.409>do <00:16:57.516>uh <00:16:57.624>traffic <00:16:57.732>in <00:16:57.840>in

00:16:59.190 --> 00:16:59.200 align:start position:0%
<00:16:59.190>then <00:16:59.191>you <00:16:59.192>can <00:16:59.193>also <00:16:59.194>do <00:16:59.195>uh <00:16:59.196>traffic <00:16:59.197>in <00:16:59.199>in

00:16:59.200 --> 00:17:02.670 align:start position:0%
<00:16:59.200>then <00:16:59.287>you <00:16:59.375>can <00:16:59.462>also <00:16:59.550>do <00:16:59.637>uh <00:16:59.725>traffic <00:16:59.812>in <00:16:59.900>in <00:16:59.987>parallel. <00:17:00.075>So, <00:17:00.162>in <00:17:00.250>AI <00:17:00.337>Gateway, <00:17:00.425>you <00:17:00.512>can <00:17:00.600>put

00:17:02.670 --> 00:17:02.680 align:start position:0%
<00:17:02.670>parallel. <00:17:02.671>So, <00:17:02.672>in <00:17:02.673>AI <00:17:02.675>Gateway, <00:17:02.676>you <00:17:02.677>can <00:17:02.679>put

00:17:02.680 --> 00:17:05.150 align:start position:0%
<00:17:02.680>parallel. <00:17:02.780>So, <00:17:02.880>in <00:17:02.979>AI <00:17:03.079>Gateway, <00:17:03.180>you <00:17:03.280>can <00:17:03.380>put <00:17:03.479>90% <00:17:03.579>traffic, <00:17:03.680>let's <00:17:03.780>say, <00:17:03.880>to <00:17:03.979>Haiku, <00:17:04.079>and

00:17:05.150 --> 00:17:05.160 align:start position:0%
<00:17:05.150>90% <00:17:05.151>traffic, <00:17:05.153>let's <00:17:05.154>say, <00:17:05.156>to <00:17:05.157>Haiku, <00:17:05.159>and

00:17:05.160 --> 00:17:08.309 align:start position:0%
<00:17:05.160>90% <00:17:05.267>traffic, <00:17:05.375>let's <00:17:05.483>say, <00:17:05.590>to <00:17:05.698>Haiku, <00:17:05.806>and <00:17:05.913>10% <00:17:06.021>traffic <00:17:06.129>to <00:17:06.236>Sonnet, <00:17:06.344>and <00:17:06.452>then <00:17:06.560>compare

00:17:08.309 --> 00:17:08.319 align:start position:0%
<00:17:08.309>10% <00:17:08.310>traffic <00:17:08.311>to <00:17:08.313>Sonnet, <00:17:08.315>and <00:17:08.316>then <00:17:08.318>compare

00:17:08.319 --> 00:17:10.429 align:start position:0%
<00:17:08.319>10% <00:17:08.426>traffic <00:17:08.534>to <00:17:08.642>Sonnet, <00:17:08.749>and <00:17:08.857>then <00:17:08.965>compare <00:17:09.072>whether <00:17:09.180>you <00:17:09.288>really <00:17:09.395>see <00:17:09.503>the <00:17:09.611>difference <00:17:09.719>in

00:17:10.429 --> 00:17:10.439 align:start position:0%
<00:17:10.429>whether <00:17:10.430>you <00:17:10.432>really <00:17:10.433>see <00:17:10.435>the <00:17:10.436>difference <00:17:10.438>in

00:17:10.439 --> 00:17:12.189 align:start position:0%
<00:17:10.439>whether <00:17:10.539>you <00:17:10.639>really <00:17:10.739>see <00:17:10.839>the <00:17:10.939>difference <00:17:11.039>in <00:17:11.139>those <00:17:11.239>traces. <00:17:11.339>So, <00:17:11.439>you <00:17:11.539>don't <00:17:11.639>have <00:17:11.739>to <00:17:11.839>make

00:17:12.189 --> 00:17:12.199 align:start position:0%
<00:17:12.189>those <00:17:12.190>traces. <00:17:12.191>So, <00:17:12.192>you <00:17:12.194>don't <00:17:12.195>have <00:17:12.196>to <00:17:12.198>make

00:17:12.199 --> 00:17:14.270 align:start position:0%
<00:17:12.199>those <00:17:12.286>traces. <00:17:12.374>So, <00:17:12.461>you <00:17:12.549>don't <00:17:12.636>have <00:17:12.724>to <00:17:12.811>make <00:17:12.899>a <00:17:12.986>decision, <00:17:13.074>"Oh, <00:17:13.161>this <00:17:13.249>is <00:17:13.336>how <00:17:13.424>we <00:17:13.511>going <00:17:13.599>to

00:17:14.270 --> 00:17:14.280 align:start position:0%
<00:17:14.270>a <00:17:14.271>decision, <00:17:14.272>"Oh, <00:17:14.273>this <00:17:14.274>is <00:17:14.275>how <00:17:14.276>we <00:17:14.277>going <00:17:14.279>to

00:17:14.280 --> 00:17:16.790 align:start position:0%
<00:17:14.280>a <00:17:14.362>decision, <00:17:14.444>"Oh, <00:17:14.527>this <00:17:14.609>is <00:17:14.691>how <00:17:14.774>we <00:17:14.856>going <00:17:14.938>to <00:17:15.021>do." <00:17:15.103>You <00:17:15.185>can <00:17:15.268>You <00:17:15.350>can <00:17:15.432>put <00:17:15.515>five <00:17:15.597>models <00:17:15.680>and

00:17:16.790 --> 00:17:16.800 align:start position:0%
<00:17:16.790>do." <00:17:16.791>You <00:17:16.792>can <00:17:16.793>You <00:17:16.794>can <00:17:16.795>put <00:17:16.796>five <00:17:16.797>models <00:17:16.799>and

00:17:16.800 --> 00:17:19.750 align:start position:0%
<00:17:16.800>do." <00:17:16.907>You <00:17:17.015>can <00:17:17.123>You <00:17:17.230>can <00:17:17.338>put <00:17:17.446>five <00:17:17.553>models <00:17:17.661>and <00:17:17.769>split <00:17:17.876>percentage <00:17:17.984>traffic <00:17:18.092>between <00:17:18.200>them.

00:17:19.750 --> 00:17:19.760 align:start position:0%
<00:17:19.750>split <00:17:19.752>percentage <00:17:19.754>traffic <00:17:19.756>between <00:17:19.759>them.

00:17:19.760 --> 00:17:23.790 align:start position:0%
<00:17:19.760>split <00:17:19.859>percentage <00:17:19.960>traffic <00:17:20.060>between <00:17:20.160>them. <00:17:20.260>Uh <00:17:20.359>so <00:17:20.460>in <00:17:20.560>the <00:17:20.660>first <00:17:20.760>demo <00:17:20.859>I <00:17:20.960>showed <00:17:21.060>you <00:17:21.160>how

00:17:23.790 --> 00:17:23.800 align:start position:0%
<00:17:23.790>Uh <00:17:23.790>so <00:17:23.791>in <00:17:23.792>the <00:17:23.793>first <00:17:23.795>demo <00:17:23.796>I <00:17:23.797>showed <00:17:23.798>you <00:17:23.799>how

00:17:23.800 --> 00:17:26.270 align:start position:0%
<00:17:23.800>Uh <00:17:23.882>so <00:17:23.964>in <00:17:24.047>the <00:17:24.129>first <00:17:24.211>demo <00:17:24.294>I <00:17:24.376>showed <00:17:24.458>you <00:17:24.541>how <00:17:24.623>we <00:17:24.705>can <00:17:24.788>run <00:17:24.870>evaluation. <00:17:24.952>So <00:17:25.035>now <00:17:25.117>let's <00:17:25.200>see

00:17:26.270 --> 00:17:26.280 align:start position:0%
<00:17:26.270>we <00:17:26.271>can <00:17:26.272>run <00:17:26.273>evaluation. <00:17:26.275>So <00:17:26.276>now <00:17:26.277>let's <00:17:26.279>see

00:17:26.280 --> 00:17:29.230 align:start position:0%
<00:17:26.280>we <00:17:26.373>can <00:17:26.466>run <00:17:26.560>evaluation. <00:17:26.653>So <00:17:26.746>now <00:17:26.839>let's <00:17:26.933>see <00:17:27.026>at <00:17:27.119>the <00:17:27.213>results. <00:17:27.306>So <00:17:27.399>those <00:17:27.493>uh <00:17:27.586>green <00:17:27.680>dots,

00:17:29.230 --> 00:17:29.240 align:start position:0%
<00:17:29.230>at <00:17:29.231>the <00:17:29.232>results. <00:17:29.233>So <00:17:29.235>those <00:17:29.236>uh <00:17:29.237>green <00:17:29.239>dots,

00:17:29.240 --> 00:17:31.630 align:start position:0%
<00:17:29.240>at <00:17:29.356>the <00:17:29.473>results. <00:17:29.590>So <00:17:29.706>those <00:17:29.823>uh <00:17:29.940>green <00:17:30.056>dots, <00:17:30.173>they <00:17:30.290>represent <00:17:30.406>open-source <00:17:30.523>models <00:17:30.640>and

00:17:31.630 --> 00:17:31.640 align:start position:0%
<00:17:31.630>they <00:17:31.632>represent <00:17:31.634>open-source <00:17:31.636>models <00:17:31.639>and

00:17:31.640 --> 00:17:33.590 align:start position:0%
<00:17:31.640>they <00:17:31.780>represent <00:17:31.920>open-source <00:17:32.060>models <00:17:32.200>and <00:17:32.340>you <00:17:32.480>can <00:17:32.620>see <00:17:32.760>that <00:17:32.900>those <00:17:33.040>open-source

00:17:33.590 --> 00:17:33.600 align:start position:0%
<00:17:33.590>you <00:17:33.591>can <00:17:33.593>see <00:17:33.595>that <00:17:33.597>those <00:17:33.599>open-source

00:17:33.600 --> 00:17:36.710 align:start position:0%
<00:17:33.600>you <00:17:33.707>can <00:17:33.815>see <00:17:33.923>that <00:17:34.030>those <00:17:34.138>open-source <00:17:34.246>models <00:17:34.353>in <00:17:34.461>terms <00:17:34.569>of <00:17:34.676>uh <00:17:34.784>F1 <00:17:34.892>score <00:17:35.000>there's

00:17:36.710 --> 00:17:36.720 align:start position:0%
<00:17:36.710>models <00:17:36.711>in <00:17:36.712>terms <00:17:36.713>of <00:17:36.715>uh <00:17:36.716>F1 <00:17:36.717>score <00:17:36.719>there's

00:17:36.720 --> 00:17:38.630 align:start position:0%
<00:17:36.720>models <00:17:36.875>in <00:17:37.031>terms <00:17:37.186>of <00:17:37.342>uh <00:17:37.497>F1 <00:17:37.653>score <00:17:37.808>there's <00:17:37.964>quite <00:17:38.120>comparable.

00:17:38.630 --> 00:17:38.640 align:start position:0%
<00:17:38.630>quite <00:17:38.639>comparable.

00:17:38.640 --> 00:17:41.670 align:start position:0%
<00:17:38.640>quite <00:17:38.815>comparable. <00:17:38.990>Uh <00:17:39.165>so <00:17:39.340>for <00:17:39.515>example, <00:17:39.690>this <00:17:39.865>Gemma <00:17:40.040>12B,

00:17:41.670 --> 00:17:41.680 align:start position:0%
<00:17:41.670>Uh <00:17:41.671>so <00:17:41.673>for <00:17:41.674>example, <00:17:41.676>this <00:17:41.677>Gemma <00:17:41.679>12B,

00:17:41.680 --> 00:17:44.190 align:start position:0%
<00:17:41.680>Uh <00:17:41.780>so <00:17:41.880>for <00:17:41.980>example, <00:17:42.080>this <00:17:42.180>Gemma <00:17:42.280>12B, <00:17:42.380>very <00:17:42.480>small <00:17:42.580>model, <00:17:42.680>but <00:17:42.780>got <00:17:42.880>quite <00:17:42.980>a <00:17:43.080>good

00:17:44.190 --> 00:17:44.200 align:start position:0%
<00:17:44.190>very <00:17:44.191>small <00:17:44.192>model, <00:17:44.193>but <00:17:44.195>got <00:17:44.196>quite <00:17:44.197>a <00:17:44.199>good

00:17:44.200 --> 00:17:47.630 align:start position:0%
<00:17:44.200>very <00:17:44.293>small <00:17:44.386>model, <00:17:44.480>but <00:17:44.573>got <00:17:44.666>quite <00:17:44.760>a <00:17:44.853>good <00:17:44.946>score. <00:17:45.040>But <00:17:45.133>then <00:17:45.226>the <00:17:45.320>cost <00:17:45.413>you <00:17:45.506>barely <00:17:45.600>can

00:17:47.630 --> 00:17:47.640 align:start position:0%
<00:17:47.630>score. <00:17:47.631>But <00:17:47.632>then <00:17:47.633>the <00:17:47.635>cost <00:17:47.636>you <00:17:47.637>barely <00:17:47.639>can

00:17:47.640 --> 00:17:49.310 align:start position:0%
<00:17:47.640>score. <00:17:47.740>But <00:17:47.840>then <00:17:47.940>the <00:17:48.040>cost <00:17:48.140>you <00:17:48.240>barely <00:17:48.340>can <00:17:48.440>see <00:17:48.540>this <00:17:48.640>line, <00:17:48.740>right? <00:17:48.840>Like <00:17:48.940>compared <00:17:49.040>to

00:17:49.310 --> 00:17:49.320 align:start position:0%
<00:17:49.310>see <00:17:49.311>this <00:17:49.312>line, <00:17:49.314>right? <00:17:49.316>Like <00:17:49.317>compared <00:17:49.319>to

00:17:49.320 --> 00:17:52.630 align:start position:0%
<00:17:49.320>see <00:17:49.419>this <00:17:49.520>line, <00:17:49.620>right? <00:17:49.720>Like <00:17:49.820>compared <00:17:49.919>to <00:17:50.020>Opus, <00:17:50.120>it's <00:17:50.220>just <00:17:50.320>so <00:17:50.419>much <00:17:50.520>cheaper. <00:17:50.620>And <00:17:50.720>the

00:17:52.630 --> 00:17:52.640 align:start position:0%
<00:17:52.630>Opus, <00:17:52.631>it's <00:17:52.632>just <00:17:52.633>so <00:17:52.635>much <00:17:52.636>cheaper. <00:17:52.637>And <00:17:52.639>the

00:17:52.640 --> 00:17:55.470 align:start position:0%
<00:17:52.640>Opus, <00:17:52.767>it's <00:17:52.894>just <00:17:53.021>so <00:17:53.149>much <00:17:53.276>cheaper. <00:17:53.403>And <00:17:53.530>the <00:17:53.658>same <00:17:53.785>thing <00:17:53.912>with <00:17:54.040>latency.

00:17:55.470 --> 00:17:55.480 align:start position:0%
<00:17:55.470>same <00:17:55.473>thing <00:17:55.476>with <00:17:55.479>latency.

00:17:55.480 --> 00:17:58.230 align:start position:0%
<00:17:55.480>same <00:17:55.607>thing <00:17:55.734>with <00:17:55.861>latency. <00:17:55.989>So <00:17:56.116>now <00:17:56.243>you <00:17:56.370>can <00:17:56.498>compare <00:17:56.625>based <00:17:56.752>on <00:17:56.880>what

00:17:58.230 --> 00:17:58.240 align:start position:0%
<00:17:58.230>So <00:17:58.231>now <00:17:58.232>you <00:17:58.233>can <00:17:58.235>compare <00:17:58.236>based <00:17:58.237>on <00:17:58.239>what

00:17:58.240 --> 00:18:00.470 align:start position:0%
<00:17:58.240>So <00:17:58.347>now <00:17:58.455>you <00:17:58.563>can <00:17:58.670>compare <00:17:58.778>based <00:17:58.886>on <00:17:58.993>what <00:17:59.101>truly <00:17:59.209>benefits <00:17:59.316>you, <00:17:59.424>whether <00:17:59.532>it's <00:17:59.640>a

00:18:00.470 --> 00:18:00.480 align:start position:0%
<00:18:00.470>truly <00:18:00.471>benefits <00:18:00.473>you, <00:18:00.475>whether <00:18:00.477>it's <00:18:00.479>a

00:18:00.480 --> 00:18:03.070 align:start position:0%
<00:18:00.480>truly <00:18:00.596>benefits <00:18:00.713>you, <00:18:00.830>whether <00:18:00.946>it's <00:18:01.063>a <00:18:01.180>latency, <00:18:01.296>whether <00:18:01.413>it's <00:18:01.530>a <00:18:01.646>cost. <00:18:01.763>Since <00:18:01.880>I'm

00:18:03.070 --> 00:18:03.080 align:start position:0%
<00:18:03.070>latency, <00:18:03.071>whether <00:18:03.072>it's <00:18:03.074>a <00:18:03.076>cost. <00:18:03.077>Since <00:18:03.079>I'm

00:18:03.080 --> 00:18:04.990 align:start position:0%
<00:18:03.080>latency, <00:18:03.187>whether <00:18:03.295>it's <00:18:03.403>a <00:18:03.510>cost. <00:18:03.618>Since <00:18:03.726>I'm <00:18:03.833>doing <00:18:03.941>such <00:18:04.049>a <00:18:04.156>simple <00:18:04.264>task <00:18:04.372>as <00:18:04.480>a

00:18:04.990 --> 00:18:05.000 align:start position:0%
<00:18:04.990>doing <00:18:04.991>such <00:18:04.993>a <00:18:04.994>simple <00:18:04.996>task <00:18:04.997>as <00:18:04.999>a

00:18:05.000 --> 00:18:07.270 align:start position:0%
<00:18:05.000>doing <00:18:05.116>such <00:18:05.233>a <00:18:05.350>simple <00:18:05.466>task <00:18:05.583>as <00:18:05.700>a <00:18:05.816>classification <00:18:05.933>and <00:18:06.050>there <00:18:06.166>are <00:18:06.283>so <00:18:06.400>many

00:18:07.270 --> 00:18:07.280 align:start position:0%
<00:18:07.270>classification <00:18:07.271>and <00:18:07.273>there <00:18:07.275>are <00:18:07.277>so <00:18:07.279>many

00:18:07.280 --> 00:18:09.390 align:start position:0%
<00:18:07.280>classification <00:18:07.396>and <00:18:07.513>there <00:18:07.629>are <00:18:07.746>so <00:18:07.863>many <00:18:07.980>messages <00:18:08.096>coming, <00:18:08.213>I'm <00:18:08.330>going <00:18:08.446>to <00:18:08.563>be <00:18:08.680>really

00:18:09.390 --> 00:18:09.400 align:start position:0%
<00:18:09.390>messages <00:18:09.391>coming, <00:18:09.393>I'm <00:18:09.394>going <00:18:09.396>to <00:18:09.397>be <00:18:09.399>really

00:18:09.400 --> 00:18:11.910 align:start position:0%
<00:18:09.400>messages <00:18:09.500>coming, <00:18:09.600>I'm <00:18:09.700>going <00:18:09.800>to <00:18:09.900>be <00:18:10.000>really <00:18:10.100>concerned <00:18:10.200>about <00:18:10.300>cost. <00:18:10.400>So <00:18:10.500>as <00:18:10.600>you <00:18:10.700>can <00:18:10.800>see,

00:18:11.910 --> 00:18:11.920 align:start position:0%
<00:18:11.910>concerned <00:18:11.911>about <00:18:11.912>cost. <00:18:11.913>So <00:18:11.915>as <00:18:11.916>you <00:18:11.917>can <00:18:11.919>see,

00:18:11.920 --> 00:18:15.790 align:start position:0%
<00:18:11.920>concerned <00:18:12.027>about <00:18:12.135>cost. <00:18:12.243>So <00:18:12.350>as <00:18:12.458>you <00:18:12.566>can <00:18:12.673>see, <00:18:12.781>Sonnet <00:18:12.889>4.6 <00:18:12.996>got <00:18:13.104>me <00:18:13.212>accuracy <00:18:13.320>0.9,

00:18:15.790 --> 00:18:15.800 align:start position:0%
<00:18:15.790>Sonnet <00:18:15.791>4.6 <00:18:15.793>got <00:18:15.795>me <00:18:15.797>accuracy <00:18:15.799>0.9,

00:18:15.800 --> 00:18:21.910 align:start position:0%
<00:18:15.800>Sonnet <00:18:15.907>4.6 <00:18:16.015>got <00:18:16.123>me <00:18:16.230>accuracy <00:18:16.338>0.9, <00:18:16.446>but <00:18:16.553>the <00:18:16.661>GPT-5 <00:18:16.769>4 <00:18:16.876>Nano <00:18:16.984>got <00:18:17.092>accuracy <00:18:17.200>0.85,

00:18:21.910 --> 00:18:21.920 align:start position:0%
<00:18:21.910>but <00:18:21.911>the <00:18:21.912>GPT-5 <00:18:21.913>4 <00:18:21.915>Nano <00:18:21.916>got <00:18:21.917>accuracy <00:18:21.919>0.85,

00:18:21.920 --> 00:18:25.950 align:start position:0%
<00:18:21.920>but <00:18:22.027>the <00:18:22.135>GPT-5 <00:18:22.243>4 <00:18:22.350>Nano <00:18:22.458>got <00:18:22.566>accuracy <00:18:22.673>0.85, <00:18:22.781>but <00:18:22.889>the <00:18:22.996>cost <00:18:23.104>$9 <00:18:23.212>versus <00:18:23.320>540.

00:18:25.950 --> 00:18:25.960 align:start position:0%
<00:18:25.950>but <00:18:25.951>the <00:18:25.953>cost <00:18:25.955>$9 <00:18:25.957>versus <00:18:25.959>540.

00:18:25.960 --> 00:18:28.830 align:start position:0%
<00:18:25.960>but <00:18:26.087>the <00:18:26.214>cost <00:18:26.341>$9 <00:18:26.469>versus <00:18:26.596>540. <00:18:26.723>For <00:18:26.850>me <00:18:26.978>the <00:18:27.105>drop <00:18:27.232>in <00:18:27.360>0.05

00:18:28.830 --> 00:18:28.840 align:start position:0%
<00:18:28.830>For <00:18:28.831>me <00:18:28.833>the <00:18:28.835>drop <00:18:28.837>in <00:18:28.839>0.05

00:18:28.840 --> 00:18:31.110 align:start position:0%
<00:18:28.840>For <00:18:28.956>me <00:18:29.073>the <00:18:29.189>drop <00:18:29.306>in <00:18:29.423>0.05 <00:18:29.540>accuracy <00:18:29.656>is <00:18:29.773>going <00:18:29.889>to <00:18:30.006>justify <00:18:30.123>the <00:18:30.240>cost,

00:18:31.110 --> 00:18:31.120 align:start position:0%
<00:18:31.110>accuracy <00:18:31.111>is <00:18:31.112>going <00:18:31.114>to <00:18:31.116>justify <00:18:31.117>the <00:18:31.119>cost,

00:18:31.120 --> 00:18:33.070 align:start position:0%
<00:18:31.120>accuracy <00:18:31.227>is <00:18:31.335>going <00:18:31.443>to <00:18:31.550>justify <00:18:31.658>the <00:18:31.766>cost, <00:18:31.873>right? <00:18:31.981>Because <00:18:32.089>it's <00:18:32.196>like <00:18:32.304>more <00:18:32.412>than <00:18:32.520>50

00:18:33.070 --> 00:18:33.080 align:start position:0%
<00:18:33.070>right? <00:18:33.071>Because <00:18:33.072>it's <00:18:33.074>like <00:18:33.076>more <00:18:33.077>than <00:18:33.079>50

00:18:33.080 --> 00:18:35.350 align:start position:0%
<00:18:33.080>right? <00:18:33.187>Because <00:18:33.295>it's <00:18:33.403>like <00:18:33.510>more <00:18:33.618>than <00:18:33.726>50 <00:18:33.833>times <00:18:33.941>more <00:18:34.049>expensive. <00:18:34.156>So <00:18:34.264>of <00:18:34.372>course <00:18:34.480>in

00:18:35.350 --> 00:18:35.360 align:start position:0%
<00:18:35.350>times <00:18:35.351>more <00:18:35.352>expensive. <00:18:35.354>So <00:18:35.356>of <00:18:35.357>course <00:18:35.359>in

00:18:35.360 --> 00:18:37.790 align:start position:0%
<00:18:35.360>times <00:18:35.459>more <00:18:35.560>expensive. <00:18:35.659>So <00:18:35.760>of <00:18:35.860>course <00:18:35.959>in <00:18:36.060>this <00:18:36.159>case, <00:18:36.260>I <00:18:36.360>would <00:18:36.459>go <00:18:36.560>for <00:18:36.659>a <00:18:36.760>smaller

00:18:37.790 --> 00:18:37.800 align:start position:0%
<00:18:37.790>this <00:18:37.791>case, <00:18:37.792>I <00:18:37.793>would <00:18:37.795>go <00:18:37.796>for <00:18:37.797>a <00:18:37.799>smaller

00:18:37.800 --> 00:18:39.670 align:start position:0%
<00:18:37.800>this <00:18:37.975>case, <00:18:38.149>I <00:18:38.325>would <00:18:38.500>go <00:18:38.675>for <00:18:38.850>a <00:18:39.024>smaller <00:18:39.200>model.

00:18:39.670 --> 00:18:39.680 align:start position:0%
model.

00:18:39.680 --> 00:18:41.590 align:start position:0%
<00:18:39.680>model. <00:18:39.855>Uh <00:18:40.030>but <00:18:40.205>it <00:18:40.380>really <00:18:40.555>depends <00:18:40.730>on <00:18:40.905>your <00:18:41.080>use

00:18:41.590 --> 00:18:41.600 align:start position:0%
<00:18:41.590>Uh <00:18:41.591>but <00:18:41.592>it <00:18:41.593>really <00:18:41.595>depends <00:18:41.596>on <00:18:41.597>your <00:18:41.599>use

00:18:41.600 --> 00:18:45.390 align:start position:0%
<00:18:41.600>Uh <00:18:41.699>but <00:18:41.800>it <00:18:41.899>really <00:18:42.000>depends <00:18:42.100>on <00:18:42.199>your <00:18:42.300>use <00:18:42.399>case. <00:18:42.500>Maybe <00:18:42.600>this <00:18:42.699>0.05 <00:18:42.800>accuracy <00:18:42.899>is <00:18:43.000>going

00:18:45.390 --> 00:18:45.400 align:start position:0%
<00:18:45.390>case. <00:18:45.391>Maybe <00:18:45.393>this <00:18:45.394>0.05 <00:18:45.396>accuracy <00:18:45.397>is <00:18:45.399>going

00:18:45.400 --> 00:18:47.270 align:start position:0%
<00:18:45.400>case. <00:18:45.507>Maybe <00:18:45.615>this <00:18:45.723>0.05 <00:18:45.830>accuracy <00:18:45.938>is <00:18:46.046>going <00:18:46.153>to <00:18:46.261>result <00:18:46.369>in <00:18:46.476>millions <00:18:46.584>of <00:18:46.692>dollars <00:18:46.800>for

00:18:47.270 --> 00:18:47.280 align:start position:0%
<00:18:47.270>to <00:18:47.271>result <00:18:47.273>in <00:18:47.274>millions <00:18:47.276>of <00:18:47.277>dollars <00:18:47.279>for

00:18:47.280 --> 00:18:49.030 align:start position:0%
<00:18:47.280>to <00:18:47.387>result <00:18:47.495>in <00:18:47.603>millions <00:18:47.710>of <00:18:47.818>dollars <00:18:47.926>for <00:18:48.033>your <00:18:48.141>company, <00:18:48.249>then <00:18:48.356>you'll <00:18:48.464>say, <00:18:48.572>"You <00:18:48.680>know

00:18:49.030 --> 00:18:49.040 align:start position:0%
<00:18:49.030>your <00:18:49.031>company, <00:18:49.033>then <00:18:49.034>you'll <00:18:49.036>say, <00:18:49.037>"You <00:18:49.039>know

00:18:49.040 --> 00:18:50.270 align:start position:0%
<00:18:49.040>your <00:18:49.125>company, <00:18:49.210>then <00:18:49.295>you'll <00:18:49.380>say, <00:18:49.465>"You <00:18:49.550>know <00:18:49.636>what? <00:18:49.721>I'm <00:18:49.806>going <00:18:49.891>to <00:18:49.976>actually <00:18:50.061>going <00:18:50.147>to

00:18:50.270 --> 00:18:50.280 align:start position:0%
<00:18:50.270>what? <00:18:50.271>I'm <00:18:50.273>going <00:18:50.274>to <00:18:50.276>actually <00:18:50.277>going <00:18:50.279>to

00:18:50.280 --> 00:18:52.590 align:start position:0%
<00:18:50.280>what? <00:18:50.407>I'm <00:18:50.534>going <00:18:50.661>to <00:18:50.789>actually <00:18:50.916>going <00:18:51.043>to <00:18:51.170>utilize <00:18:51.298>Sonnet <00:18:51.425>in <00:18:51.552>this <00:18:51.680>case."

00:18:52.590 --> 00:18:52.600 align:start position:0%
<00:18:52.590>utilize <00:18:52.592>Sonnet <00:18:52.594>in <00:18:52.596>this <00:18:52.599>case."

00:18:52.600 --> 00:18:54.910 align:start position:0%
<00:18:52.600>utilize <00:18:52.707>Sonnet <00:18:52.815>in <00:18:52.923>this <00:18:53.030>case." <00:18:53.138>Uh <00:18:53.246>so <00:18:53.353>this <00:18:53.461>gives <00:18:53.569>you <00:18:53.676>at <00:18:53.784>least <00:18:53.892>a <00:18:54.000>very

00:18:54.910 --> 00:18:54.920 align:start position:0%
<00:18:54.910>Uh <00:18:54.911>so <00:18:54.912>this <00:18:54.913>gives <00:18:54.914>you <00:18:54.915>at <00:18:54.916>least <00:18:54.917>a <00:18:54.919>very

00:18:54.920 --> 00:18:57.750 align:start position:0%
<00:18:54.920>Uh <00:18:55.060>so <00:18:55.200>this <00:18:55.340>gives <00:18:55.480>you <00:18:55.620>at <00:18:55.760>least <00:18:55.900>a <00:18:56.040>very <00:18:56.180>clear <00:18:56.320>understanding

00:18:57.750 --> 00:18:57.760 align:start position:0%
<00:18:57.750>clear <00:18:57.759>understanding

00:18:57.760 --> 00:19:00.070 align:start position:0%
<00:18:57.760>clear <00:18:57.935>understanding <00:18:58.110>why <00:18:58.285>you <00:18:58.460>would <00:18:58.635>go <00:18:58.810>with <00:18:58.985>Sonnet <00:18:59.160>versus

00:19:00.070 --> 00:19:00.080 align:start position:0%
<00:19:00.070>why <00:19:00.071>you <00:19:00.072>would <00:19:00.074>go <00:19:00.076>with <00:19:00.077>Sonnet <00:19:00.079>versus

00:19:00.080 --> 00:19:02.150 align:start position:0%
<00:19:00.080>why <00:19:00.235>you <00:19:00.391>would <00:19:00.546>go <00:19:00.702>with <00:19:00.857>Sonnet <00:19:01.013>versus <00:19:01.168>GPT-5 <00:19:01.324>4 <00:19:01.480>Nano.

00:19:02.150 --> 00:19:02.160 align:start position:0%
<00:19:02.150>GPT-5 <00:19:02.154>4 <00:19:02.159>Nano.

00:19:02.160 --> 00:19:05.430 align:start position:0%
<00:19:02.160>GPT-5 <00:19:02.360>4 <00:19:02.560>Nano. <00:19:02.760>Now <00:19:02.960>let's <00:19:03.160>talk <00:19:03.360>about <00:19:03.560>fine-tuning.

00:19:05.430 --> 00:19:05.440 align:start position:0%
<00:19:05.430>Now <00:19:05.432>let's <00:19:05.434>talk <00:19:05.436>about <00:19:05.439>fine-tuning.

00:19:05.440 --> 00:19:08.230 align:start position:0%
<00:19:05.440>Now <00:19:05.567>let's <00:19:05.694>talk <00:19:05.821>about <00:19:05.949>fine-tuning. <00:19:06.076>When <00:19:06.203>should <00:19:06.330>you <00:19:06.458>go <00:19:06.585>with <00:19:06.712>a <00:19:06.840>fine-tuning?

00:19:08.230 --> 00:19:08.240 align:start position:0%
<00:19:08.230>When <00:19:08.231>should <00:19:08.233>you <00:19:08.234>go <00:19:08.236>with <00:19:08.237>a <00:19:08.239>fine-tuning?

00:19:08.240 --> 00:19:10.990 align:start position:0%
<00:19:08.240>When <00:19:08.347>should <00:19:08.455>you <00:19:08.563>go <00:19:08.670>with <00:19:08.778>a <00:19:08.886>fine-tuning? <00:19:08.993>So <00:19:09.101>what <00:19:09.209>we <00:19:09.316>see <00:19:09.424>with <00:19:09.532>the <00:19:09.640>customers,

00:19:10.990 --> 00:19:11.000 align:start position:0%
<00:19:10.990>So <00:19:10.991>what <00:19:10.993>we <00:19:10.994>see <00:19:10.996>with <00:19:10.997>the <00:19:10.999>customers,

00:19:11.000 --> 00:19:13.790 align:start position:0%
<00:19:11.000>So <00:19:11.127>what <00:19:11.254>we <00:19:11.381>see <00:19:11.509>with <00:19:11.636>the <00:19:11.763>customers, <00:19:11.890>they <00:19:12.018>typically <00:19:12.145>start <00:19:12.272>with <00:19:12.400>proprietary

00:19:13.790 --> 00:19:13.800 align:start position:0%
<00:19:13.790>they <00:19:13.792>typically <00:19:13.794>start <00:19:13.796>with <00:19:13.799>proprietary

00:19:13.800 --> 00:19:16.990 align:start position:0%
<00:19:13.800>they <00:19:13.940>typically <00:19:14.080>start <00:19:14.220>with <00:19:14.360>proprietary <00:19:14.500>APIs, <00:19:14.639>then <00:19:14.780>they <00:19:14.919>encounter <00:19:15.060>they <00:19:15.200>encounter

00:19:16.990 --> 00:19:17.000 align:start position:0%
<00:19:16.990>APIs, <00:19:16.991>then <00:19:16.993>they <00:19:16.995>encounter <00:19:16.997>they <00:19:16.999>encounter

00:19:17.000 --> 00:19:19.630 align:start position:0%
<00:19:17.000>APIs, <00:19:17.127>then <00:19:17.254>they <00:19:17.381>encounter <00:19:17.509>they <00:19:17.636>encounter <00:19:17.763>cost <00:19:17.890>challenges, <00:19:18.018>they <00:19:18.145>go <00:19:18.272>with <00:19:18.400>open

00:19:19.630 --> 00:19:19.640 align:start position:0%
<00:19:19.630>cost <00:19:19.631>challenges, <00:19:19.633>they <00:19:19.635>go <00:19:19.637>with <00:19:19.639>open

00:19:19.640 --> 00:19:21.110 align:start position:0%
<00:19:19.640>cost <00:19:19.829>challenges, <00:19:20.018>they <00:19:20.207>go <00:19:20.396>with <00:19:20.585>open <00:19:20.774>weight <00:19:20.963>models,

00:19:21.110 --> 00:19:21.120 align:start position:0%
<00:19:21.110>weight <00:19:21.119>models,

00:19:21.120 --> 00:19:23.550 align:start position:0%
<00:19:21.120>weight <00:19:21.320>models, <00:19:21.520>they <00:19:21.719>encounter <00:19:21.919>that <00:19:22.120>maybe <00:19:22.320>the <00:19:22.520>results

00:19:23.550 --> 00:19:23.560 align:start position:0%
<00:19:23.550>they <00:19:23.551>encounter <00:19:23.553>that <00:19:23.555>maybe <00:19:23.557>the <00:19:23.559>results

00:19:23.560 --> 00:19:26.350 align:start position:0%
<00:19:23.560>they <00:19:23.667>encounter <00:19:23.775>that <00:19:23.883>maybe <00:19:23.990>the <00:19:24.098>results <00:19:24.206>are <00:19:24.313>not <00:19:24.421>exactly <00:19:24.529>as <00:19:24.636>they <00:19:24.744>want <00:19:24.852>to <00:19:24.960>have,

00:19:26.350 --> 00:19:26.360 align:start position:0%
<00:19:26.350>are <00:19:26.351>not <00:19:26.352>exactly <00:19:26.353>as <00:19:26.355>they <00:19:26.356>want <00:19:26.357>to <00:19:26.359>have,

00:19:26.360 --> 00:19:28.870 align:start position:0%
<00:19:26.360>are <00:19:26.459>not <00:19:26.560>exactly <00:19:26.659>as <00:19:26.760>they <00:19:26.860>want <00:19:26.959>to <00:19:27.060>have, <00:19:27.159>and <00:19:27.260>that's <00:19:27.360>when <00:19:27.459>they <00:19:27.560>go <00:19:27.659>to <00:19:27.760>fine-tune.

00:19:28.870 --> 00:19:28.880 align:start position:0%
<00:19:28.870>and <00:19:28.871>that's <00:19:28.873>when <00:19:28.874>they <00:19:28.876>go <00:19:28.877>to <00:19:28.879>fine-tune.

00:19:28.880 --> 00:19:31.510 align:start position:0%
<00:19:28.880>and <00:19:28.987>that's <00:19:29.095>when <00:19:29.203>they <00:19:29.310>go <00:19:29.418>to <00:19:29.526>fine-tune. <00:19:29.633>They <00:19:29.741>understood <00:19:29.849>the <00:19:29.956>exact <00:19:30.064>task <00:19:30.172>that <00:19:30.280>they

00:19:31.510 --> 00:19:31.520 align:start position:0%
<00:19:31.510>They <00:19:31.511>understood <00:19:31.513>the <00:19:31.514>exact <00:19:31.516>task <00:19:31.517>that <00:19:31.519>they

00:19:31.520 --> 00:19:34.230 align:start position:0%
<00:19:31.520>They <00:19:31.620>understood <00:19:31.720>the <00:19:31.820>exact <00:19:31.920>task <00:19:32.020>that <00:19:32.120>they <00:19:32.220>need <00:19:32.320>to <00:19:32.420>solve, <00:19:32.520>and <00:19:32.620>now <00:19:32.720>they're <00:19:32.820>trying <00:19:32.920>to

00:19:34.230 --> 00:19:34.240 align:start position:0%
<00:19:34.230>need <00:19:34.231>to <00:19:34.232>solve, <00:19:34.233>and <00:19:34.235>now <00:19:34.236>they're <00:19:34.237>trying <00:19:34.239>to

00:19:34.240 --> 00:19:36.830 align:start position:0%
<00:19:34.240>need <00:19:34.333>to <00:19:34.426>solve, <00:19:34.520>and <00:19:34.613>now <00:19:34.706>they're <00:19:34.800>trying <00:19:34.893>to <00:19:34.986>solve <00:19:35.080>for <00:19:35.173>this <00:19:35.266>task, <00:19:35.360>get <00:19:35.453>a <00:19:35.546>really <00:19:35.640>high

00:19:36.830 --> 00:19:36.840 align:start position:0%
<00:19:36.830>solve <00:19:36.831>for <00:19:36.832>this <00:19:36.833>task, <00:19:36.835>get <00:19:36.836>a <00:19:36.837>really <00:19:36.839>high

00:19:36.840 --> 00:19:39.390 align:start position:0%
<00:19:36.840>solve <00:19:36.956>for <00:19:37.073>this <00:19:37.189>task, <00:19:37.306>get <00:19:37.423>a <00:19:37.540>really <00:19:37.656>high <00:19:37.773>accuracy <00:19:37.889>at <00:19:38.006>a <00:19:38.123>low <00:19:38.240>cost.

00:19:39.390 --> 00:19:39.400 align:start position:0%
<00:19:39.390>accuracy <00:19:39.392>at <00:19:39.394>a <00:19:39.396>low <00:19:39.399>cost.

00:19:39.400 --> 00:19:41.270 align:start position:0%
<00:19:39.400>accuracy <00:19:39.600>at <00:19:39.800>a <00:19:40.000>low <00:19:40.200>cost. <00:19:40.400>But, <00:19:40.600>there <00:19:40.800>are

00:19:41.270 --> 00:19:41.280 align:start position:0%
<00:19:41.270>But, <00:19:41.274>there <00:19:41.279>are

00:19:41.280 --> 00:19:43.110 align:start position:0%
<00:19:41.280>But, <00:19:41.455>there <00:19:41.629>are <00:19:41.805>also <00:19:41.980>challenges <00:19:42.155>with <00:19:42.330>this. <00:19:42.504>Like, <00:19:42.680>first

00:19:43.110 --> 00:19:43.120 align:start position:0%
<00:19:43.110>also <00:19:43.111>challenges <00:19:43.113>with <00:19:43.115>this. <00:19:43.117>Like, <00:19:43.119>first

00:19:43.120 --> 00:19:44.670 align:start position:0%
<00:19:43.120>also <00:19:43.319>challenges <00:19:43.518>with <00:19:43.717>this. <00:19:43.917>Like, <00:19:44.116>first <00:19:44.315>of <00:19:44.515>all,

00:19:44.670 --> 00:19:44.680 align:start position:0%
<00:19:44.670>of <00:19:44.679>all,

00:19:44.680 --> 00:19:47.190 align:start position:0%
<00:19:44.680>of <00:19:44.855>all, <00:19:45.030>you <00:19:45.205>will <00:19:45.380>fine-tune <00:19:45.555>a <00:19:45.730>model <00:19:45.905>typically <00:19:46.080>on

00:19:47.190 --> 00:19:47.200 align:start position:0%
<00:19:47.190>you <00:19:47.191>will <00:19:47.193>fine-tune <00:19:47.194>a <00:19:47.196>model <00:19:47.197>typically <00:19:47.199>on

00:19:47.200 --> 00:19:49.750 align:start position:0%
<00:19:47.200>you <00:19:47.293>will <00:19:47.386>fine-tune <00:19:47.480>a <00:19:47.573>model <00:19:47.666>typically <00:19:47.760>on <00:19:47.853>a <00:19:47.946>narrow <00:19:48.040>task. <00:19:48.133>And <00:19:48.226>in <00:19:48.320>order <00:19:48.413>for <00:19:48.506>you <00:19:48.600>to

00:19:49.750 --> 00:19:49.760 align:start position:0%
<00:19:49.750>a <00:19:49.751>narrow <00:19:49.752>task. <00:19:49.753>And <00:19:49.754>in <00:19:49.755>order <00:19:49.756>for <00:19:49.757>you <00:19:49.759>to

00:19:49.760 --> 00:19:52.110 align:start position:0%
<00:19:49.760>a <00:19:49.853>narrow <00:19:49.946>task. <00:19:50.040>And <00:19:50.133>in <00:19:50.226>order <00:19:50.320>for <00:19:50.413>you <00:19:50.506>to <00:19:50.600>fine-tune <00:19:50.693>models, <00:19:50.786>you <00:19:50.879>need <00:19:50.973>to <00:19:51.066>have <00:19:51.160>a

00:19:52.110 --> 00:19:52.120 align:start position:0%
<00:19:52.110>fine-tune <00:19:52.111>models, <00:19:52.112>you <00:19:52.114>need <00:19:52.116>to <00:19:52.117>have <00:19:52.119>a

00:19:52.120 --> 00:19:55.870 align:start position:0%
<00:19:52.120>fine-tune <00:19:52.227>models, <00:19:52.335>you <00:19:52.443>need <00:19:52.550>to <00:19:52.658>have <00:19:52.766>a <00:19:52.873>good <00:19:52.981>label <00:19:53.089>data <00:19:53.196>set. <00:19:53.304>So, <00:19:53.412>couple <00:19:53.520>thousand

00:19:55.870 --> 00:19:55.880 align:start position:0%
<00:19:55.870>good <00:19:55.871>label <00:19:55.873>data <00:19:55.874>set. <00:19:55.876>So, <00:19:55.877>couple <00:19:55.879>thousand

00:19:55.880 --> 00:19:58.430 align:start position:0%
<00:19:55.880>good <00:19:55.987>label <00:19:56.095>data <00:19:56.203>set. <00:19:56.310>So, <00:19:56.418>couple <00:19:56.526>thousand <00:19:56.633>pair <00:19:56.741>pairs <00:19:56.849>will <00:19:56.956>be <00:19:57.064>sufficient <00:19:57.172>to <00:19:57.280>get

00:19:58.430 --> 00:19:58.440 align:start position:0%
<00:19:58.430>pair <00:19:58.431>pairs <00:19:58.433>will <00:19:58.434>be <00:19:58.436>sufficient <00:19:58.437>to <00:19:58.439>get

00:19:58.440 --> 00:20:00.630 align:start position:0%
<00:19:58.440>pair <00:19:58.556>pairs <00:19:58.673>will <00:19:58.790>be <00:19:58.906>sufficient <00:19:59.023>to <00:19:59.140>get <00:19:59.256>started, <00:19:59.373>but <00:19:59.490>that's <00:19:59.606>just <00:19:59.723>something <00:19:59.840>that

00:20:00.630 --> 00:20:00.640 align:start position:0%
<00:20:00.630>started, <00:20:00.631>but <00:20:00.633>that's <00:20:00.635>just <00:20:00.637>something <00:20:00.639>that

00:20:00.640 --> 00:20:02.270 align:start position:0%
<00:20:00.640>started, <00:20:00.747>but <00:20:00.855>that's <00:20:00.963>just <00:20:01.070>something <00:20:01.178>that <00:20:01.286>you <00:20:01.393>really <00:20:01.501>need <00:20:01.609>to <00:20:01.716>think <00:20:01.824>about, <00:20:01.932>that <00:20:02.040>you

00:20:02.270 --> 00:20:02.280 align:start position:0%
<00:20:02.270>you <00:20:02.271>really <00:20:02.272>need <00:20:02.273>to <00:20:02.275>think <00:20:02.276>about, <00:20:02.277>that <00:20:02.279>you

00:20:02.280 --> 00:20:04.990 align:start position:0%
<00:20:02.280>you <00:20:02.379>really <00:20:02.480>need <00:20:02.580>to <00:20:02.680>think <00:20:02.780>about, <00:20:02.879>that <00:20:02.980>you <00:20:03.080>need <00:20:03.180>to <00:20:03.280>have <00:20:03.379>data <00:20:03.480>collected. <00:20:03.580>And <00:20:03.680>that's

00:20:04.990 --> 00:20:05.000 align:start position:0%
<00:20:04.990>need <00:20:04.991>to <00:20:04.993>have <00:20:04.994>data <00:20:04.996>collected. <00:20:04.997>And <00:20:04.999>that's

00:20:05.000 --> 00:20:06.710 align:start position:0%
<00:20:05.000>need <00:20:05.100>to <00:20:05.200>have <00:20:05.300>data <00:20:05.400>collected. <00:20:05.500>And <00:20:05.600>that's <00:20:05.700>why, <00:20:05.800>you <00:20:05.900>know, <00:20:06.000>some <00:20:06.100>of <00:20:06.200>them <00:20:06.300>will <00:20:06.400>start

00:20:06.710 --> 00:20:06.720 align:start position:0%
<00:20:06.710>why, <00:20:06.711>you <00:20:06.712>know, <00:20:06.713>some <00:20:06.715>of <00:20:06.716>them <00:20:06.717>will <00:20:06.719>start

00:20:06.720 --> 00:20:08.510 align:start position:0%
<00:20:06.720>why, <00:20:06.836>you <00:20:06.953>know, <00:20:07.070>some <00:20:07.186>of <00:20:07.303>them <00:20:07.420>will <00:20:07.536>start <00:20:07.653>with <00:20:07.770>proprietary, <00:20:07.886>get <00:20:08.003>the <00:20:08.120>data

00:20:08.510 --> 00:20:08.520 align:start position:0%
<00:20:08.510>with <00:20:08.512>proprietary, <00:20:08.514>get <00:20:08.516>the <00:20:08.519>data

00:20:08.520 --> 00:20:11.550 align:start position:0%
<00:20:08.520>with <00:20:08.660>proprietary, <00:20:08.800>get <00:20:08.940>the <00:20:09.080>data <00:20:09.220>collected, <00:20:09.360>and <00:20:09.500>then <00:20:09.639>move <00:20:09.780>to <00:20:09.920>fine-tune.

00:20:11.550 --> 00:20:11.560 align:start position:0%
<00:20:11.550>collected, <00:20:11.551>and <00:20:11.553>then <00:20:11.555>move <00:20:11.557>to <00:20:11.559>fine-tune.

00:20:11.560 --> 00:20:14.590 align:start position:0%
<00:20:11.560>collected, <00:20:11.687>and <00:20:11.814>then <00:20:11.941>move <00:20:12.069>to <00:20:12.196>fine-tune. <00:20:12.323>Um <00:20:12.450>also, <00:20:12.578>before <00:20:12.705>you <00:20:12.832>jumped <00:20:12.960>into

00:20:14.590 --> 00:20:14.600 align:start position:0%
<00:20:14.590>Um <00:20:14.591>also, <00:20:14.593>before <00:20:14.595>you <00:20:14.597>jumped <00:20:14.599>into

00:20:14.600 --> 00:20:15.990 align:start position:0%
<00:20:14.600>Um <00:20:14.808>also, <00:20:15.016>before <00:20:15.225>you <00:20:15.434>jumped <00:20:15.642>into <00:20:15.851>fine-tuning,

00:20:15.990 --> 00:20:16.000 align:start position:0%
fine-tuning,

00:20:16.000 --> 00:20:19.670 align:start position:0%
<00:20:16.000>fine-tuning, <00:20:16.200>try <00:20:16.400>prompt <00:20:16.600>engineering, <00:20:16.800>try <00:20:17.000>rag. <00:20:17.200>And <00:20:17.400>if

00:20:19.670 --> 00:20:19.680 align:start position:0%
<00:20:19.670>try <00:20:19.671>prompt <00:20:19.673>engineering, <00:20:19.674>try <00:20:19.676>rag. <00:20:19.677>And <00:20:19.679>if

00:20:19.680 --> 00:20:21.670 align:start position:0%
<00:20:19.680>try <00:20:19.780>prompt <00:20:19.880>engineering, <00:20:19.980>try <00:20:20.080>rag. <00:20:20.180>And <00:20:20.280>if <00:20:20.380>that's <00:20:20.480>where <00:20:20.580>you <00:20:20.680>see <00:20:20.780>that <00:20:20.880>yes, <00:20:20.980>with <00:20:21.080>all

00:20:21.670 --> 00:20:21.680 align:start position:0%
<00:20:21.670>that's <00:20:21.671>where <00:20:21.672>you <00:20:21.673>see <00:20:21.675>that <00:20:21.676>yes, <00:20:21.677>with <00:20:21.679>all

00:20:21.680 --> 00:20:23.750 align:start position:0%
<00:20:21.680>that's <00:20:21.773>where <00:20:21.866>you <00:20:21.960>see <00:20:22.053>that <00:20:22.146>yes, <00:20:22.240>with <00:20:22.333>all <00:20:22.426>of <00:20:22.520>this <00:20:22.613>I'm <00:20:22.706>still <00:20:22.800>filling <00:20:22.893>up <00:20:22.986>my <00:20:23.080>context

00:20:23.750 --> 00:20:23.760 align:start position:0%
<00:20:23.750>of <00:20:23.751>this <00:20:23.752>I'm <00:20:23.753>still <00:20:23.755>filling <00:20:23.756>up <00:20:23.757>my <00:20:23.759>context

00:20:23.760 --> 00:20:26.150 align:start position:0%
<00:20:23.760>of <00:20:23.853>this <00:20:23.946>I'm <00:20:24.040>still <00:20:24.133>filling <00:20:24.226>up <00:20:24.320>my <00:20:24.413>context <00:20:24.506>window, <00:20:24.600>the <00:20:24.693>latency <00:20:24.786>is <00:20:24.879>too <00:20:24.973>high, <00:20:25.066>and <00:20:25.160>I

00:20:26.150 --> 00:20:26.160 align:start position:0%
<00:20:26.150>window, <00:20:26.151>the <00:20:26.152>latency <00:20:26.153>is <00:20:26.155>too <00:20:26.156>high, <00:20:26.157>and <00:20:26.159>I

00:20:26.160 --> 00:20:27.830 align:start position:0%
<00:20:26.160>window, <00:20:26.276>the <00:20:26.393>latency <00:20:26.510>is <00:20:26.626>too <00:20:26.743>high, <00:20:26.860>and <00:20:26.976>I <00:20:27.093>want <00:20:27.210>to <00:20:27.326>really <00:20:27.443>achieve <00:20:27.560>sub-millisecond

00:20:27.830 --> 00:20:27.840 align:start position:0%
<00:20:27.830>want <00:20:27.832>to <00:20:27.834>really <00:20:27.836>achieve <00:20:27.839>sub-millisecond

00:20:27.840 --> 00:20:30.590 align:start position:0%
<00:20:27.840>want <00:20:27.967>to <00:20:28.094>really <00:20:28.221>achieve <00:20:28.349>sub-millisecond <00:20:28.476>latency, <00:20:28.603>then <00:20:28.730>go <00:20:28.858>and <00:20:28.985>uh <00:20:29.112>fine-tune <00:20:29.240>the

00:20:30.590 --> 00:20:30.600 align:start position:0%
<00:20:30.590>latency, <00:20:30.591>then <00:20:30.592>go <00:20:30.594>and <00:20:30.596>uh <00:20:30.597>fine-tune <00:20:30.599>the

00:20:30.600 --> 00:20:33.510 align:start position:0%
<00:20:30.600>latency, <00:20:30.707>then <00:20:30.815>go <00:20:30.923>and <00:20:31.030>uh <00:20:31.138>fine-tune <00:20:31.246>the <00:20:31.353>model. <00:20:31.461>So, <00:20:31.569>one <00:20:31.676>of <00:20:31.784>our <00:20:31.892>customer, <00:20:32.000>Kantar,

00:20:33.510 --> 00:20:33.520 align:start position:0%
<00:20:33.510>model. <00:20:33.511>So, <00:20:33.513>one <00:20:33.514>of <00:20:33.516>our <00:20:33.517>customer, <00:20:33.519>Kantar,

00:20:33.520 --> 00:20:35.150 align:start position:0%
<00:20:33.520>model. <00:20:33.636>So, <00:20:33.753>one <00:20:33.870>of <00:20:33.986>our <00:20:34.103>customer, <00:20:34.220>Kantar, <00:20:34.336>they <00:20:34.453>what <00:20:34.570>they've <00:20:34.686>done, <00:20:34.803>they <00:20:34.920>actually

00:20:35.150 --> 00:20:35.160 align:start position:0%
<00:20:35.150>they <00:20:35.151>what <00:20:35.153>they've <00:20:35.155>done, <00:20:35.157>they <00:20:35.159>actually

00:20:35.160 --> 00:20:37.990 align:start position:0%
<00:20:35.160>they <00:20:35.287>what <00:20:35.414>they've <00:20:35.541>done, <00:20:35.669>they <00:20:35.796>actually <00:20:35.923>look <00:20:36.050>at <00:20:36.178>their <00:20:36.305>job <00:20:36.432>for <00:20:36.560>onboarding

00:20:37.990 --> 00:20:38.000 align:start position:0%
<00:20:37.990>look <00:20:37.991>at <00:20:37.993>their <00:20:37.995>job <00:20:37.997>for <00:20:37.999>onboarding

00:20:38.000 --> 00:20:40.750 align:start position:0%
<00:20:38.000>look <00:20:38.155>at <00:20:38.311>their <00:20:38.466>job <00:20:38.622>for <00:20:38.777>onboarding <00:20:38.933>contractors, <00:20:39.088>they <00:20:39.244>identified <00:20:39.400>six

00:20:40.750 --> 00:20:40.760 align:start position:0%
<00:20:40.750>contractors, <00:20:40.753>they <00:20:40.756>identified <00:20:40.759>six

00:20:40.760 --> 00:20:44.070 align:start position:0%
<00:20:40.760>contractors, <00:20:40.915>they <00:20:41.071>identified <00:20:41.226>six <00:20:41.382>different <00:20:41.537>tasks, <00:20:41.693>and <00:20:41.848>then <00:20:42.004>they <00:20:42.160>utilized

00:20:44.070 --> 00:20:44.080 align:start position:0%
<00:20:44.070>different <00:20:44.071>tasks, <00:20:44.073>and <00:20:44.075>then <00:20:44.077>they <00:20:44.079>utilized

00:20:44.080 --> 00:20:45.710 align:start position:0%
<00:20:44.080>different <00:20:44.280>tasks, <00:20:44.480>and <00:20:44.679>then <00:20:44.879>they <00:20:45.080>utilized <00:20:45.280>six <00:20:45.480>models

00:20:45.710 --> 00:20:45.720 align:start position:0%
<00:20:45.710>six <00:20:45.719>models

00:20:45.720 --> 00:20:48.150 align:start position:0%
<00:20:45.720>six <00:20:45.895>models <00:20:46.070>to <00:20:46.245>solve <00:20:46.420>for <00:20:46.595>particular <00:20:46.770>task. <00:20:46.945>So, <00:20:47.120>that's

00:20:48.150 --> 00:20:48.160 align:start position:0%
<00:20:48.150>to <00:20:48.151>solve <00:20:48.153>for <00:20:48.154>particular <00:20:48.156>task. <00:20:48.157>So, <00:20:48.159>that's

00:20:48.160 --> 00:20:49.470 align:start position:0%
<00:20:48.160>to <00:20:48.250>solve <00:20:48.341>for <00:20:48.432>particular <00:20:48.522>task. <00:20:48.613>So, <00:20:48.704>that's <00:20:48.794>what <00:20:48.885>That's <00:20:48.976>what <00:20:49.066>I'm <00:20:49.157>saying, <00:20:49.248>that <00:20:49.339>you

00:20:49.470 --> 00:20:49.480 align:start position:0%
<00:20:49.470>what <00:20:49.471>That's <00:20:49.473>what <00:20:49.474>I'm <00:20:49.476>saying, <00:20:49.477>that <00:20:49.479>you

00:20:49.480 --> 00:20:51.590 align:start position:0%
<00:20:49.480>what <00:20:49.587>That's <00:20:49.695>what <00:20:49.803>I'm <00:20:49.910>saying, <00:20:50.018>that <00:20:50.126>you <00:20:50.233>really <00:20:50.341>need <00:20:50.449>to <00:20:50.556>define <00:20:50.664>your <00:20:50.772>narrow <00:20:50.880>task.

00:20:51.590 --> 00:20:51.600 align:start position:0%
<00:20:51.590>really <00:20:51.591>need <00:20:51.592>to <00:20:51.594>define <00:20:51.596>your <00:20:51.597>narrow <00:20:51.599>task.

00:20:51.600 --> 00:20:54.230 align:start position:0%
<00:20:51.600>really <00:20:51.699>need <00:20:51.800>to <00:20:51.899>define <00:20:52.000>your <00:20:52.100>narrow <00:20:52.199>task. <00:20:52.300>And <00:20:52.399>then <00:20:52.500>they <00:20:52.600>were <00:20:52.699>able <00:20:52.800>to <00:20:52.899>achieve <00:20:53.000>94%

00:20:54.230 --> 00:20:54.240 align:start position:0%
<00:20:54.230>And <00:20:54.231>then <00:20:54.232>they <00:20:54.233>were <00:20:54.235>able <00:20:54.236>to <00:20:54.237>achieve <00:20:54.239>94%

00:20:54.240 --> 00:20:57.670 align:start position:0%
<00:20:54.240>And <00:20:54.333>then <00:20:54.426>they <00:20:54.520>were <00:20:54.613>able <00:20:54.706>to <00:20:54.800>achieve <00:20:54.893>94% <00:20:54.986>accuracy, <00:20:55.080>so <00:20:55.173>high <00:20:55.266>accuracy, <00:20:55.360>and <00:20:55.453>uh <00:20:55.546>at <00:20:55.640>a

00:20:57.670 --> 00:20:57.680 align:start position:0%
<00:20:57.670>accuracy, <00:20:57.671>so <00:20:57.672>high <00:20:57.673>accuracy, <00:20:57.675>and <00:20:57.676>uh <00:20:57.677>at <00:20:57.679>a

00:20:57.680 --> 00:20:59.870 align:start position:0%
<00:20:57.680>accuracy, <00:20:57.773>so <00:20:57.866>high <00:20:57.960>accuracy, <00:20:58.053>and <00:20:58.146>uh <00:20:58.240>at <00:20:58.333>a <00:20:58.426>very <00:20:58.520>low <00:20:58.613>cost <00:20:58.706>because <00:20:58.800>the <00:20:58.893>model <00:20:58.986>was <00:20:59.080>8

00:20:59.870 --> 00:20:59.880 align:start position:0%
<00:20:59.870>very <00:20:59.871>low <00:20:59.872>cost <00:20:59.873>because <00:20:59.875>the <00:20:59.876>model <00:20:59.877>was <00:20:59.879>8

00:20:59.880 --> 00:21:02.150 align:start position:0%
<00:20:59.880>very <00:21:00.020>low <00:21:00.160>cost <00:21:00.300>because <00:21:00.440>the <00:21:00.580>model <00:21:00.720>was <00:21:00.860>8 <00:21:01.000>billion <00:21:01.140>parameter <00:21:01.280>model.

00:21:02.150 --> 00:21:02.160 align:start position:0%
<00:21:02.150>billion <00:21:02.154>parameter <00:21:02.159>model.

00:21:02.160 --> 00:21:04.430 align:start position:0%
<00:21:02.160>billion <00:21:02.300>parameter <00:21:02.440>model. <00:21:02.580>Okay, <00:21:02.720>so <00:21:02.860>how <00:21:03.000>do <00:21:03.140>we <00:21:03.280>do <00:21:03.420>fine-tuning? <00:21:03.560>Well,

00:21:04.430 --> 00:21:04.440 align:start position:0%
<00:21:04.430>Okay, <00:21:04.431>so <00:21:04.432>how <00:21:04.433>do <00:21:04.435>we <00:21:04.436>do <00:21:04.437>fine-tuning? <00:21:04.439>Well,

00:21:04.440 --> 00:21:07.630 align:start position:0%
<00:21:04.440>Okay, <00:21:04.527>so <00:21:04.615>how <00:21:04.702>do <00:21:04.790>we <00:21:04.877>do <00:21:04.965>fine-tuning? <00:21:05.052>Well, <00:21:05.140>we <00:21:05.227>can <00:21:05.315>do <00:21:05.402>do <00:21:05.490>with <00:21:05.577>uh <00:21:05.665>AI <00:21:05.752>runtimes. <00:21:05.840>So,

00:21:07.630 --> 00:21:07.640 align:start position:0%
<00:21:07.630>we <00:21:07.631>can <00:21:07.632>do <00:21:07.633>do <00:21:07.634>with <00:21:07.635>uh <00:21:07.636>AI <00:21:07.637>runtimes. <00:21:07.639>So,

00:21:07.640 --> 00:21:09.670 align:start position:0%
<00:21:07.640>we <00:21:07.756>can <00:21:07.873>do <00:21:07.990>do <00:21:08.106>with <00:21:08.223>uh <00:21:08.340>AI <00:21:08.456>runtimes. <00:21:08.573>So, <00:21:08.690>Databricks <00:21:08.806>recently <00:21:08.923>announced <00:21:09.040>together

00:21:09.670 --> 00:21:09.680 align:start position:0%
<00:21:09.670>Databricks <00:21:09.673>recently <00:21:09.676>announced <00:21:09.679>together

00:21:09.680 --> 00:21:12.470 align:start position:0%
<00:21:09.680>Databricks <00:21:09.807>recently <00:21:09.934>announced <00:21:10.061>together <00:21:10.189>with <00:21:10.316>NVIDIA <00:21:10.443>AI <00:21:10.570>run <00:21:10.698>time. <00:21:10.825>So, <00:21:10.952>in <00:21:11.080>the

00:21:12.470 --> 00:21:12.480 align:start position:0%
<00:21:12.470>with <00:21:12.471>NVIDIA <00:21:12.472>AI <00:21:12.473>run <00:21:12.475>time. <00:21:12.476>So, <00:21:12.477>in <00:21:12.479>the

00:21:12.480 --> 00:21:14.910 align:start position:0%
<00:21:12.480>with <00:21:12.596>NVIDIA <00:21:12.713>AI <00:21:12.830>run <00:21:12.946>time. <00:21:13.063>So, <00:21:13.180>in <00:21:13.296>the <00:21:13.413>past, <00:21:13.530>fine-tuning <00:21:13.646>has <00:21:13.763>been <00:21:13.880>challenging

00:21:14.910 --> 00:21:14.920 align:start position:0%
<00:21:14.910>past, <00:21:14.912>fine-tuning <00:21:14.914>has <00:21:14.916>been <00:21:14.919>challenging

00:21:14.920 --> 00:21:17.110 align:start position:0%
<00:21:14.920>past, <00:21:15.036>fine-tuning <00:21:15.153>has <00:21:15.270>been <00:21:15.386>challenging <00:21:15.503>because <00:21:15.620>you <00:21:15.736>had <00:21:15.853>to <00:21:15.970>set <00:21:16.086>up <00:21:16.203>clusters, <00:21:16.320>you

00:21:17.110 --> 00:21:17.120 align:start position:0%
<00:21:17.110>because <00:21:17.111>you <00:21:17.112>had <00:21:17.113>to <00:21:17.115>set <00:21:17.116>up <00:21:17.117>clusters, <00:21:17.119>you

00:21:17.120 --> 00:21:19.670 align:start position:0%
<00:21:17.120>because <00:21:17.213>you <00:21:17.306>had <00:21:17.399>to <00:21:17.493>set <00:21:17.586>up <00:21:17.679>clusters, <00:21:17.773>you <00:21:17.866>had <00:21:17.959>to <00:21:18.053>set <00:21:18.146>all <00:21:18.239>the <00:21:18.333>libraries. <00:21:18.426>Now, <00:21:18.520>AI

00:21:19.670 --> 00:21:19.680 align:start position:0%
<00:21:19.670>had <00:21:19.671>to <00:21:19.672>set <00:21:19.673>all <00:21:19.675>the <00:21:19.676>libraries. <00:21:19.677>Now, <00:21:19.679>AI

00:21:19.680 --> 00:21:23.270 align:start position:0%
<00:21:19.680>had <00:21:19.787>to <00:21:19.895>set <00:21:20.003>all <00:21:20.110>the <00:21:20.218>libraries. <00:21:20.326>Now, <00:21:20.433>AI <00:21:20.541>run <00:21:20.649>time <00:21:20.756>provides <00:21:20.864>you <00:21:20.972>serverless <00:21:21.080>GPU

00:21:23.270 --> 00:21:23.280 align:start position:0%
<00:21:23.270>run <00:21:23.271>time <00:21:23.273>provides <00:21:23.275>you <00:21:23.277>serverless <00:21:23.279>GPU

00:21:23.280 --> 00:21:24.590 align:start position:0%
<00:21:23.280>run <00:21:23.476>time <00:21:23.673>provides <00:21:23.869>you <00:21:24.066>serverless <00:21:24.262>GPU <00:21:24.458>right

00:21:24.590 --> 00:21:24.600 align:start position:0%
right

00:21:24.600 --> 00:21:25.350 align:start position:0%
<00:21:24.600>right <00:21:25.274>uh

00:21:25.350 --> 00:21:25.360 align:start position:0%
uh

00:21:25.360 --> 00:21:28.070 align:start position:0%
<00:21:25.360>uh <00:21:25.515>just <00:21:25.671>select <00:21:25.826>it <00:21:25.982>from <00:21:26.137>your <00:21:26.293>kind <00:21:26.448>of <00:21:26.604>like <00:21:26.760>mm

00:21:28.070 --> 00:21:28.080 align:start position:0%
<00:21:28.070>just <00:21:28.071>select <00:21:28.072>it <00:21:28.073>from <00:21:28.074>your <00:21:28.075>kind <00:21:28.076>of <00:21:28.077>like <00:21:28.079>mm

00:21:28.080 --> 00:21:29.870 align:start position:0%
<00:21:28.080>just <00:21:28.179>select <00:21:28.280>it <00:21:28.379>from <00:21:28.480>your <00:21:28.580>kind <00:21:28.679>of <00:21:28.780>like <00:21:28.879>mm <00:21:28.980>Dropbox, <00:21:29.080>and <00:21:29.179>you <00:21:29.280>can <00:21:29.379>attach <00:21:29.480>your

00:21:29.870 --> 00:21:29.880 align:start position:0%
<00:21:29.870>Dropbox, <00:21:29.871>and <00:21:29.873>you <00:21:29.875>can <00:21:29.877>attach <00:21:29.879>your

00:21:29.880 --> 00:21:32.550 align:start position:0%
<00:21:29.880>Dropbox, <00:21:30.020>and <00:21:30.160>you <00:21:30.300>can <00:21:30.440>attach <00:21:30.580>your <00:21:30.720>notebook <00:21:30.860>and <00:21:31.000>run <00:21:31.140>your <00:21:31.280>jobs.

00:21:32.550 --> 00:21:32.560 align:start position:0%
<00:21:32.550>notebook <00:21:32.552>and <00:21:32.554>run <00:21:32.556>your <00:21:32.559>jobs.

00:21:32.560 --> 00:21:34.670 align:start position:0%
<00:21:32.560>notebook <00:21:32.667>and <00:21:32.775>run <00:21:32.883>your <00:21:32.990>jobs. <00:21:33.098>Uh <00:21:33.206>so, <00:21:33.313>few <00:21:33.421>things <00:21:33.529>you <00:21:33.636>need <00:21:33.744>to <00:21:33.852>do <00:21:33.960>when

00:21:34.670 --> 00:21:34.680 align:start position:0%
<00:21:34.670>Uh <00:21:34.671>so, <00:21:34.672>few <00:21:34.673>things <00:21:34.674>you <00:21:34.675>need <00:21:34.676>to <00:21:34.677>do <00:21:34.679>when

00:21:34.680 --> 00:21:37.350 align:start position:0%
<00:21:34.680>Uh <00:21:34.773>so, <00:21:34.866>few <00:21:34.960>things <00:21:35.053>you <00:21:35.146>need <00:21:35.240>to <00:21:35.333>do <00:21:35.426>when <00:21:35.520>you <00:21:35.613>decide <00:21:35.706>to <00:21:35.800>fine-tune <00:21:35.893>model. <00:21:35.986>First <00:21:36.080>is

00:21:37.350 --> 00:21:37.360 align:start position:0%
<00:21:37.350>you <00:21:37.351>decide <00:21:37.352>to <00:21:37.354>fine-tune <00:21:37.356>model. <00:21:37.357>First <00:21:37.359>is

00:21:37.360 --> 00:21:39.830 align:start position:0%
<00:21:37.360>you <00:21:37.467>decide <00:21:37.575>to <00:21:37.683>fine-tune <00:21:37.790>model. <00:21:37.898>First <00:21:38.006>is <00:21:38.113>uh <00:21:38.221>choose <00:21:38.329>the <00:21:38.436>right <00:21:38.544>uh <00:21:38.652>architecture. <00:21:38.760>So,

00:21:39.830 --> 00:21:39.840 align:start position:0%
<00:21:39.830>uh <00:21:39.831>choose <00:21:39.832>the <00:21:39.834>right <00:21:39.836>uh <00:21:39.837>architecture. <00:21:39.839>So,

00:21:39.840 --> 00:21:42.310 align:start position:0%
<00:21:39.840>uh <00:21:39.947>choose <00:21:40.055>the <00:21:40.163>right <00:21:40.270>uh <00:21:40.378>architecture. <00:21:40.486>So, <00:21:40.593>whether <00:21:40.701>you <00:21:40.809>are <00:21:40.916>going <00:21:41.024>to <00:21:41.132>fine-tune <00:21:41.240>Kimi

00:21:42.310 --> 00:21:42.320 align:start position:0%
<00:21:42.310>whether <00:21:42.311>you <00:21:42.312>are <00:21:42.314>going <00:21:42.316>to <00:21:42.317>fine-tune <00:21:42.319>Kimi

00:21:42.320 --> 00:21:46.150 align:start position:0%
<00:21:42.320>whether <00:21:42.427>you <00:21:42.535>are <00:21:42.643>going <00:21:42.750>to <00:21:42.858>fine-tune <00:21:42.966>Kimi <00:21:43.073>or <00:21:43.181>Llama, <00:21:43.289>you <00:21:43.396>can <00:21:43.504>experiment. <00:21:43.612>Um <00:21:43.720>then,

00:21:46.150 --> 00:21:46.160 align:start position:0%
<00:21:46.150>or <00:21:46.151>Llama, <00:21:46.153>you <00:21:46.154>can <00:21:46.156>experiment. <00:21:46.157>Um <00:21:46.159>then,

00:21:46.160 --> 00:21:48.430 align:start position:0%
<00:21:46.160>or <00:21:46.260>Llama, <00:21:46.360>you <00:21:46.460>can <00:21:46.560>experiment. <00:21:46.660>Um <00:21:46.760>then, <00:21:46.860>you <00:21:46.960>need <00:21:47.060>to <00:21:47.160>save <00:21:47.260>your <00:21:47.360>data, <00:21:47.460>right? <00:21:47.560>You

00:21:48.430 --> 00:21:48.440 align:start position:0%
<00:21:48.430>you <00:21:48.431>need <00:21:48.432>to <00:21:48.433>save <00:21:48.435>your <00:21:48.436>data, <00:21:48.437>right? <00:21:48.439>You

00:21:48.440 --> 00:21:50.630 align:start position:0%
<00:21:48.440>you <00:21:48.540>need <00:21:48.640>to <00:21:48.740>save <00:21:48.840>your <00:21:48.940>data, <00:21:49.040>right? <00:21:49.140>You <00:21:49.240>need <00:21:49.340>to <00:21:49.440>have <00:21:49.540>this <00:21:49.640>labeled <00:21:49.740>data. <00:21:49.840>And

00:21:50.630 --> 00:21:50.640 align:start position:0%
<00:21:50.630>need <00:21:50.631>to <00:21:50.633>have <00:21:50.634>this <00:21:50.636>labeled <00:21:50.637>data. <00:21:50.639>And

00:21:50.640 --> 00:21:53.430 align:start position:0%
<00:21:50.640>need <00:21:50.747>to <00:21:50.855>have <00:21:50.963>this <00:21:51.070>labeled <00:21:51.178>data. <00:21:51.286>And <00:21:51.393>then, <00:21:51.501>you're <00:21:51.609>going <00:21:51.716>to <00:21:51.824>actually <00:21:51.932>call <00:21:52.040>uh

00:21:53.430 --> 00:21:53.440 align:start position:0%
<00:21:53.430>then, <00:21:53.431>you're <00:21:53.433>going <00:21:53.434>to <00:21:53.436>actually <00:21:53.437>call <00:21:53.439>uh

00:21:53.440 --> 00:21:55.110 align:start position:0%
<00:21:53.440>then, <00:21:53.540>you're <00:21:53.640>going <00:21:53.740>to <00:21:53.840>actually <00:21:53.940>call <00:21:54.040>uh <00:21:54.140>one <00:21:54.240>of <00:21:54.340>the <00:21:54.440>ways <00:21:54.540>to <00:21:54.640>fine-tune. <00:21:54.740>You <00:21:54.840>can

00:21:55.110 --> 00:21:55.120 align:start position:0%
<00:21:55.110>one <00:21:55.111>of <00:21:55.112>the <00:21:55.113>ways <00:21:55.115>to <00:21:55.116>fine-tune. <00:21:55.117>You <00:21:55.119>can

00:21:55.120 --> 00:21:58.070 align:start position:0%
<00:21:55.120>one <00:21:55.202>of <00:21:55.284>the <00:21:55.367>ways <00:21:55.449>to <00:21:55.531>fine-tune. <00:21:55.614>You <00:21:55.696>can <00:21:55.778>use <00:21:55.861>it <00:21:55.943>uh <00:21:56.025>using <00:21:56.108>UI, <00:21:56.190>you <00:21:56.272>can <00:21:56.355>also <00:21:56.437>call <00:21:56.520>it

00:21:58.070 --> 00:21:58.080 align:start position:0%
<00:21:58.070>use <00:21:58.071>it <00:21:58.072>uh <00:21:58.072>using <00:21:58.073>UI, <00:21:58.074>you <00:21:58.076>can <00:21:58.077>also <00:21:58.078>call <00:21:58.079>it

00:21:58.080 --> 00:21:59.790 align:start position:0%
<00:21:58.080>use <00:21:58.157>it <00:21:58.235>uh <00:21:58.313>using <00:21:58.391>UI, <00:21:58.468>you <00:21:58.546>can <00:21:58.624>also <00:21:58.702>call <00:21:58.780>it <00:21:58.857>using <00:21:58.935>API, <00:21:59.013>and <00:21:59.091>then <00:21:59.168>I <00:21:59.246>will <00:21:59.324>show <00:21:59.402>you <00:21:59.480>how

00:21:59.790 --> 00:21:59.800 align:start position:0%
<00:21:59.790>using <00:21:59.791>API, <00:21:59.792>and <00:21:59.793>then <00:21:59.794>I <00:21:59.795>will <00:21:59.796>show <00:21:59.797>you <00:21:59.799>how

00:21:59.800 --> 00:22:02.670 align:start position:0%
<00:21:59.800>using <00:21:59.899>API, <00:22:00.000>and <00:22:00.100>then <00:22:00.200>I <00:22:00.300>will <00:22:00.399>show <00:22:00.500>you <00:22:00.600>how <00:22:00.700>I <00:22:00.800>utilized <00:22:00.899>LoRA <00:22:01.000>fine-tuning, <00:22:01.100>where <00:22:01.200>a

00:22:02.670 --> 00:22:02.680 align:start position:0%
<00:22:02.670>I <00:22:02.671>utilized <00:22:02.673>LoRA <00:22:02.675>fine-tuning, <00:22:02.677>where <00:22:02.679>a

00:22:02.680 --> 00:22:04.910 align:start position:0%
<00:22:02.680>I <00:22:02.807>utilized <00:22:02.934>LoRA <00:22:03.061>fine-tuning, <00:22:03.189>where <00:22:03.316>a <00:22:03.443>matrix <00:22:03.570>was <00:22:03.698>freezed <00:22:03.825>and <00:22:03.952>it <00:22:04.080>was

00:22:04.910 --> 00:22:04.920 align:start position:0%
<00:22:04.910>matrix <00:22:04.911>was <00:22:04.913>freezed <00:22:04.915>and <00:22:04.917>it <00:22:04.919>was

00:22:04.920 --> 00:22:06.510 align:start position:0%
<00:22:04.920>matrix <00:22:05.036>was <00:22:05.153>freezed <00:22:05.270>and <00:22:05.386>it <00:22:05.503>was <00:22:05.620>uh <00:22:05.736>open <00:22:05.853>weights <00:22:05.970>were <00:22:06.086>freezed, <00:22:06.203>and <00:22:06.320>the

00:22:06.510 --> 00:22:06.520 align:start position:0%
<00:22:06.510>uh <00:22:06.511>open <00:22:06.513>weights <00:22:06.514>were <00:22:06.516>freezed, <00:22:06.517>and <00:22:06.519>the

00:22:06.520 --> 00:22:08.150 align:start position:0%
<00:22:06.520>uh <00:22:06.627>open <00:22:06.735>weights <00:22:06.843>were <00:22:06.950>freezed, <00:22:07.058>and <00:22:07.166>the <00:22:07.273>the <00:22:07.381>matrix <00:22:07.489>was <00:22:07.596>fine-tuned. <00:22:07.704>So, <00:22:07.812>it <00:22:07.920>was

00:22:08.150 --> 00:22:08.160 align:start position:0%
<00:22:08.150>the <00:22:08.151>matrix <00:22:08.153>was <00:22:08.154>fine-tuned. <00:22:08.156>So, <00:22:08.157>it <00:22:08.159>was

00:22:08.160 --> 00:22:10.470 align:start position:0%
<00:22:08.160>the <00:22:08.253>matrix <00:22:08.346>was <00:22:08.440>fine-tuned. <00:22:08.533>So, <00:22:08.626>it <00:22:08.720>was <00:22:08.813>very <00:22:08.906>simple <00:22:09.000>way <00:22:09.093>to <00:22:09.186>do <00:22:09.280>it. <00:22:09.373>And <00:22:09.466>then, <00:22:09.560>as

00:22:10.470 --> 00:22:10.480 align:start position:0%
<00:22:10.470>very <00:22:10.471>simple <00:22:10.472>way <00:22:10.473>to <00:22:10.474>do <00:22:10.475>it. <00:22:10.476>And <00:22:10.477>then, <00:22:10.479>as

00:22:10.480 --> 00:22:12.870 align:start position:0%
<00:22:10.480>very <00:22:10.573>simple <00:22:10.666>way <00:22:10.760>to <00:22:10.853>do <00:22:10.946>it. <00:22:11.040>And <00:22:11.133>then, <00:22:11.226>as <00:22:11.320>you <00:22:11.413>fine-tune, <00:22:11.506>you <00:22:11.600>will <00:22:11.693>see <00:22:11.786>all <00:22:11.880>the

00:22:12.870 --> 00:22:12.880 align:start position:0%
<00:22:12.870>you <00:22:12.871>fine-tune, <00:22:12.873>you <00:22:12.874>will <00:22:12.876>see <00:22:12.877>all <00:22:12.879>the

00:22:12.880 --> 00:22:16.510 align:start position:0%
<00:22:12.880>you <00:22:12.987>fine-tune, <00:22:13.095>you <00:22:13.203>will <00:22:13.310>see <00:22:13.418>all <00:22:13.526>the <00:22:13.633>metrics <00:22:13.741>will <00:22:13.849>be <00:22:13.956>saved <00:22:14.064>into <00:22:14.172>MLflow, <00:22:14.280>so

00:22:16.510 --> 00:22:16.520 align:start position:0%
<00:22:16.510>metrics <00:22:16.511>will <00:22:16.513>be <00:22:16.514>saved <00:22:16.516>into <00:22:16.517>MLflow, <00:22:16.519>so

00:22:16.520 --> 00:22:18.870 align:start position:0%
<00:22:16.520>metrics <00:22:16.620>will <00:22:16.720>be <00:22:16.820>saved <00:22:16.920>into <00:22:17.020>MLflow, <00:22:17.120>so <00:22:17.220>you <00:22:17.320>can <00:22:17.420>see <00:22:17.520>all <00:22:17.620>the <00:22:17.720>results <00:22:17.820>there. <00:22:17.920>And

00:22:18.870 --> 00:22:18.880 align:start position:0%
<00:22:18.870>you <00:22:18.871>can <00:22:18.872>see <00:22:18.873>all <00:22:18.875>the <00:22:18.876>results <00:22:18.877>there. <00:22:18.879>And

00:22:18.880 --> 00:22:20.510 align:start position:0%
<00:22:18.880>you <00:22:18.980>can <00:22:19.080>see <00:22:19.180>all <00:22:19.280>the <00:22:19.380>results <00:22:19.480>there. <00:22:19.580>And <00:22:19.680>once <00:22:19.780>you're <00:22:19.880>happy <00:22:19.980>with <00:22:20.080>the <00:22:20.180>results, <00:22:20.280>you

00:22:20.510 --> 00:22:20.520 align:start position:0%
<00:22:20.510>once <00:22:20.511>you're <00:22:20.513>happy <00:22:20.514>with <00:22:20.516>the <00:22:20.517>results, <00:22:20.519>you

00:22:20.520 --> 00:22:23.350 align:start position:0%
<00:22:20.520>once <00:22:20.620>you're <00:22:20.720>happy <00:22:20.820>with <00:22:20.920>the <00:22:21.020>results, <00:22:21.120>you <00:22:21.220>can <00:22:21.320>just <00:22:21.420>simply <00:22:21.520>deploy <00:22:21.620>it <00:22:21.720>uh <00:22:21.820>again <00:22:21.920>on

00:22:23.350 --> 00:22:23.360 align:start position:0%
<00:22:23.350>can <00:22:23.351>just <00:22:23.352>simply <00:22:23.353>deploy <00:22:23.355>it <00:22:23.356>uh <00:22:23.357>again <00:22:23.359>on

00:22:23.360 --> 00:22:26.270 align:start position:0%
<00:22:23.360>can <00:22:23.467>just <00:22:23.575>simply <00:22:23.683>deploy <00:22:23.790>it <00:22:23.898>uh <00:22:24.006>again <00:22:24.113>on <00:22:24.221>serverless <00:22:24.329>GPU <00:22:24.436>and <00:22:24.544>start <00:22:24.652>utilizing <00:22:24.760>it.

00:22:26.270 --> 00:22:26.280 align:start position:0%
<00:22:26.270>serverless <00:22:26.271>GPU <00:22:26.273>and <00:22:26.275>start <00:22:26.277>utilizing <00:22:26.279>it.

00:22:26.280 --> 00:22:27.270 align:start position:0%
<00:22:26.280>serverless <00:22:26.428>GPU <00:22:26.577>and <00:22:26.725>start <00:22:26.874>utilizing <00:22:27.022>it. <00:22:27.171>So,

00:22:27.270 --> 00:22:27.280 align:start position:0%
So,

00:22:27.280 --> 00:22:29.390 align:start position:0%
<00:22:27.280>So, <00:22:27.513>now, <00:22:27.746>let's <00:22:27.980>go <00:22:28.213>through <00:22:28.446>the <00:22:28.680>steps.

00:22:29.390 --> 00:22:29.400 align:start position:0%
<00:22:29.390>now, <00:22:29.391>let's <00:22:29.393>go <00:22:29.395>through <00:22:29.397>the <00:22:29.399>steps.

00:22:29.400 --> 00:22:34.110 align:start position:0%
<00:22:29.400>now, <00:22:29.507>let's <00:22:29.615>go <00:22:29.723>through <00:22:29.830>the <00:22:29.938>steps. <00:22:30.046>Uh <00:22:30.153>so, <00:22:30.261>I'm <00:22:30.369>going <00:22:30.476>to <00:22:30.584>fine-tune <00:22:30.692>Qwen <00:22:30.800>1.7

00:22:34.110 --> 00:22:34.120 align:start position:0%
<00:22:34.110>Uh <00:22:34.111>so, <00:22:34.112>I'm <00:22:34.113>going <00:22:34.115>to <00:22:34.116>fine-tune <00:22:34.117>Qwen <00:22:34.119>1.7

00:22:34.120 --> 00:22:35.830 align:start position:0%
<00:22:34.120>Uh <00:22:34.227>so, <00:22:34.335>I'm <00:22:34.443>going <00:22:34.550>to <00:22:34.658>fine-tune <00:22:34.766>Qwen <00:22:34.873>1.7 <00:22:34.981>billion <00:22:35.089>parameters. <00:22:35.196>So, <00:22:35.304>it's <00:22:35.412>a <00:22:35.520>very

00:22:35.830 --> 00:22:35.840 align:start position:0%
<00:22:35.830>billion <00:22:35.831>parameters. <00:22:35.833>So, <00:22:35.835>it's <00:22:35.837>a <00:22:35.839>very

00:22:35.840 --> 00:22:37.230 align:start position:0%
<00:22:35.840>billion <00:22:36.018>parameters. <00:22:36.197>So, <00:22:36.376>it's <00:22:36.554>a <00:22:36.733>very <00:22:36.912>small <00:22:37.091>model.

00:22:37.230 --> 00:22:37.240 align:start position:0%
<00:22:37.230>small <00:22:37.239>model.

00:22:37.240 --> 00:22:39.830 align:start position:0%
<00:22:37.240>small <00:22:37.415>model. <00:22:37.590>And <00:22:37.765>um <00:22:37.940>I <00:22:38.115>will <00:22:38.290>be <00:22:38.465>utilizing <00:22:38.640>LoRA

00:22:39.830 --> 00:22:39.840 align:start position:0%
<00:22:39.830>And <00:22:39.831>um <00:22:39.832>I <00:22:39.834>will <00:22:39.836>be <00:22:39.837>utilizing <00:22:39.839>LoRA

00:22:39.840 --> 00:22:42.390 align:start position:0%
<00:22:39.840>And <00:22:39.947>um <00:22:40.055>I <00:22:40.163>will <00:22:40.270>be <00:22:40.378>utilizing <00:22:40.486>LoRA <00:22:40.593>fine-tuning <00:22:40.701>for <00:22:40.809>this. <00:22:40.916>So, <00:22:41.024>to <00:22:41.132>do <00:22:41.240>this,

00:22:42.390 --> 00:22:42.400 align:start position:0%
<00:22:42.390>fine-tuning <00:22:42.391>for <00:22:42.393>this. <00:22:42.394>So, <00:22:42.396>to <00:22:42.397>do <00:22:42.399>this,

00:22:42.400 --> 00:22:44.950 align:start position:0%
<00:22:42.400>fine-tuning <00:22:42.516>for <00:22:42.633>this. <00:22:42.750>So, <00:22:42.866>to <00:22:42.983>do <00:22:43.100>this, <00:22:43.216>first <00:22:43.333>I <00:22:43.450>just <00:22:43.566>attached <00:22:43.683>the <00:22:43.800>serverless

00:22:44.950 --> 00:22:44.960 align:start position:0%
<00:22:44.950>first <00:22:44.951>I <00:22:44.953>just <00:22:44.955>attached <00:22:44.957>the <00:22:44.959>serverless

00:22:44.960 --> 00:22:49.870 align:start position:0%
<00:22:44.960>first <00:22:45.053>I <00:22:45.146>just <00:22:45.240>attached <00:22:45.333>the <00:22:45.426>serverless <00:22:45.520>GPU. <00:22:45.613>You <00:22:45.706>can <00:22:45.800>do <00:22:45.893>A10, <00:22:45.986>H100, <00:22:46.080>and <00:22:46.173>8 <00:22:46.266>H100. <00:22:46.360>I

00:22:49.870 --> 00:22:49.880 align:start position:0%
<00:22:49.870>GPU. <00:22:49.870>You <00:22:49.871>can <00:22:49.873>do <00:22:49.874>A10, <00:22:49.875>H100, <00:22:49.876>and <00:22:49.877>8 <00:22:49.878>H100. <00:22:49.879>I

00:22:49.880 --> 00:22:52.190 align:start position:0%
<00:22:49.880>GPU. <00:22:49.967>You <00:22:50.055>can <00:22:50.142>do <00:22:50.230>A10, <00:22:50.317>H100, <00:22:50.405>and <00:22:50.492>8 <00:22:50.580>H100. <00:22:50.667>I <00:22:50.755>selected <00:22:50.842>the <00:22:50.930>smallest <00:22:51.017>because <00:22:51.105>for <00:22:51.192>me <00:22:51.280>it

00:22:52.190 --> 00:22:52.200 align:start position:0%
<00:22:52.190>selected <00:22:52.191>the <00:22:52.193>smallest <00:22:52.194>because <00:22:52.196>for <00:22:52.197>me <00:22:52.199>it

00:22:52.200 --> 00:22:54.670 align:start position:0%
<00:22:52.200>selected <00:22:52.307>the <00:22:52.415>smallest <00:22:52.523>because <00:22:52.630>for <00:22:52.738>me <00:22:52.846>it <00:22:52.953>was <00:22:53.061>just <00:22:53.169>a <00:22:53.276>small <00:22:53.384>task <00:22:53.492>of <00:22:53.600>fine-tuning.

00:22:54.670 --> 00:22:54.680 align:start position:0%
<00:22:54.670>was <00:22:54.671>just <00:22:54.673>a <00:22:54.674>small <00:22:54.676>task <00:22:54.677>of <00:22:54.679>fine-tuning.

00:22:54.680 --> 00:22:57.270 align:start position:0%
<00:22:54.680>was <00:22:54.787>just <00:22:54.895>a <00:22:55.003>small <00:22:55.110>task <00:22:55.218>of <00:22:55.326>fine-tuning. <00:22:55.433>Then, <00:22:55.541>you <00:22:55.649>load <00:22:55.756>your <00:22:55.864>training <00:22:55.972>data <00:22:56.080>set.

00:22:57.270 --> 00:22:57.280 align:start position:0%
<00:22:57.270>Then, <00:22:57.271>you <00:22:57.273>load <00:22:57.274>your <00:22:57.276>training <00:22:57.277>data <00:22:57.279>set.

00:22:57.280 --> 00:22:59.190 align:start position:0%
<00:22:57.280>Then, <00:22:57.379>you <00:22:57.480>load <00:22:57.580>your <00:22:57.680>training <00:22:57.780>data <00:22:57.879>set. <00:22:57.980>So, <00:22:58.080>the <00:22:58.180>data <00:22:58.280>set <00:22:58.379>was <00:22:58.480>stored <00:22:58.580>in <00:22:58.680>Delta

00:22:59.190 --> 00:22:59.200 align:start position:0%
<00:22:59.190>So, <00:22:59.191>the <00:22:59.192>data <00:22:59.193>set <00:22:59.195>was <00:22:59.196>stored <00:22:59.197>in <00:22:59.199>Delta

00:22:59.200 --> 00:23:02.070 align:start position:0%
<00:22:59.200>So, <00:22:59.300>the <00:22:59.400>data <00:22:59.500>set <00:22:59.600>was <00:22:59.700>stored <00:22:59.800>in <00:22:59.900>Delta <00:23:00.000>tables. <00:23:00.100>And <00:23:00.200>then, <00:23:00.300>this <00:23:00.400>is <00:23:00.500>where <00:23:00.600>I'm

00:23:02.070 --> 00:23:02.080 align:start position:0%
<00:23:02.070>tables. <00:23:02.071>And <00:23:02.072>then, <00:23:02.074>this <00:23:02.076>is <00:23:02.077>where <00:23:02.079>I'm

00:23:02.080 --> 00:23:04.550 align:start position:0%
<00:23:02.080>tables. <00:23:02.196>And <00:23:02.313>then, <00:23:02.429>this <00:23:02.546>is <00:23:02.663>where <00:23:02.780>I'm <00:23:02.896>fine-tuning <00:23:03.013>now <00:23:03.129>utilizing <00:23:03.246>the <00:23:03.363>Laura. <00:23:03.480>So,

00:23:04.550 --> 00:23:04.560 align:start position:0%
<00:23:04.550>fine-tuning <00:23:04.551>now <00:23:04.553>utilizing <00:23:04.555>the <00:23:04.557>Laura. <00:23:04.559>So,

00:23:04.560 --> 00:23:06.830 align:start position:0%
<00:23:04.560>fine-tuning <00:23:04.659>now <00:23:04.760>utilizing <00:23:04.860>the <00:23:04.960>Laura. <00:23:05.060>So, <00:23:05.159>you <00:23:05.260>can <00:23:05.360>see <00:23:05.460>just <00:23:05.560>a <00:23:05.659>very <00:23:05.760>small <00:23:05.860>block <00:23:05.960>of

00:23:06.830 --> 00:23:06.840 align:start position:0%
<00:23:06.830>you <00:23:06.831>can <00:23:06.832>see <00:23:06.833>just <00:23:06.834>a <00:23:06.835>very <00:23:06.836>small <00:23:06.837>block <00:23:06.839>of

00:23:06.840 --> 00:23:09.670 align:start position:0%
<00:23:06.840>you <00:23:06.947>can <00:23:07.055>see <00:23:07.163>just <00:23:07.270>a <00:23:07.378>very <00:23:07.486>small <00:23:07.593>block <00:23:07.701>of <00:23:07.809>code <00:23:07.916>and <00:23:08.024>it <00:23:08.132>starts <00:23:08.240>fine-tuning.

00:23:09.670 --> 00:23:09.680 align:start position:0%
<00:23:09.670>code <00:23:09.672>and <00:23:09.674>it <00:23:09.676>starts <00:23:09.679>fine-tuning.

00:23:09.680 --> 00:23:13.470 align:start position:0%
<00:23:09.680>code <00:23:09.796>and <00:23:09.913>it <00:23:10.030>starts <00:23:10.146>fine-tuning. <00:23:10.263>Um <00:23:10.380>as <00:23:10.496>the <00:23:10.613>model <00:23:10.730>will <00:23:10.846>fine-tune, <00:23:10.963>you <00:23:11.080>will

00:23:13.470 --> 00:23:13.480 align:start position:0%
<00:23:13.470>Um <00:23:13.471>as <00:23:13.472>the <00:23:13.473>model <00:23:13.475>will <00:23:13.476>fine-tune, <00:23:13.477>you <00:23:13.479>will

00:23:13.480 --> 00:23:15.310 align:start position:0%
<00:23:13.480>Um <00:23:13.620>as <00:23:13.760>the <00:23:13.900>model <00:23:14.040>will <00:23:14.180>fine-tune, <00:23:14.320>you <00:23:14.460>will <00:23:14.600>uh <00:23:14.740>see <00:23:14.880>the

00:23:15.310 --> 00:23:15.320 align:start position:0%
<00:23:15.310>uh <00:23:15.314>see <00:23:15.319>the

00:23:15.320 --> 00:23:17.870 align:start position:0%
<00:23:15.320>uh <00:23:15.460>see <00:23:15.600>the <00:23:15.740>loss <00:23:15.879>the <00:23:16.020>training <00:23:16.159>loss <00:23:16.300>will <00:23:16.439>go <00:23:16.580>down <00:23:16.720>and

00:23:17.870 --> 00:23:17.880 align:start position:0%
<00:23:17.870>loss <00:23:17.871>the <00:23:17.872>training <00:23:17.873>loss <00:23:17.875>will <00:23:17.876>go <00:23:17.877>down <00:23:17.879>and

00:23:17.880 --> 00:23:19.750 align:start position:0%
<00:23:17.880>loss <00:23:17.987>the <00:23:18.095>training <00:23:18.203>loss <00:23:18.310>will <00:23:18.418>go <00:23:18.526>down <00:23:18.633>and <00:23:18.741>the <00:23:18.849>training <00:23:18.956>loss <00:23:19.064>basically <00:23:19.172>gives <00:23:19.280>you

00:23:19.750 --> 00:23:19.760 align:start position:0%
<00:23:19.750>the <00:23:19.751>training <00:23:19.753>loss <00:23:19.755>basically <00:23:19.757>gives <00:23:19.759>you

00:23:19.760 --> 00:23:23.230 align:start position:0%
<00:23:19.760>the <00:23:19.867>training <00:23:19.975>loss <00:23:20.083>basically <00:23:20.190>gives <00:23:20.298>you <00:23:20.406>error <00:23:20.513>rates. <00:23:20.621>So, <00:23:20.729>it <00:23:20.836>starts <00:23:20.944>with <00:23:21.052>over <00:23:21.160>one

00:23:23.230 --> 00:23:23.240 align:start position:0%
<00:23:23.230>error <00:23:23.231>rates. <00:23:23.232>So, <00:23:23.233>it <00:23:23.235>starts <00:23:23.236>with <00:23:23.237>over <00:23:23.239>one

00:23:23.240 --> 00:23:24.750 align:start position:0%
<00:23:23.240>error <00:23:23.330>rates. <00:23:23.421>So, <00:23:23.511>it <00:23:23.602>starts <00:23:23.693>with <00:23:23.783>over <00:23:23.874>one <00:23:23.964>and <00:23:24.055>it's <00:23:24.146>going <00:23:24.236>to <00:23:24.327>start <00:23:24.417>like <00:23:24.508>as <00:23:24.599>the

00:23:24.750 --> 00:23:24.760 align:start position:0%
<00:23:24.750>and <00:23:24.751>it's <00:23:24.752>going <00:23:24.753>to <00:23:24.755>start <00:23:24.756>like <00:23:24.757>as <00:23:24.759>the

00:23:24.760 --> 00:23:27.390 align:start position:0%
<00:23:24.760>and <00:23:24.860>it's <00:23:24.960>going <00:23:25.060>to <00:23:25.160>start <00:23:25.260>like <00:23:25.360>as <00:23:25.460>the <00:23:25.560>model <00:23:25.660>gets <00:23:25.760>better <00:23:25.860>actually <00:23:25.960>3.9. <00:23:26.060>It <00:23:26.160>gets

00:23:27.390 --> 00:23:27.400 align:start position:0%
<00:23:27.390>model <00:23:27.391>gets <00:23:27.393>better <00:23:27.394>actually <00:23:27.396>3.9. <00:23:27.397>It <00:23:27.399>gets

00:23:27.400 --> 00:23:29.270 align:start position:0%
<00:23:27.400>model <00:23:27.527>gets <00:23:27.654>better <00:23:27.781>actually <00:23:27.909>3.9. <00:23:28.036>It <00:23:28.163>gets <00:23:28.290>better <00:23:28.418>and <00:23:28.545>better <00:23:28.672>and <00:23:28.800>better.

00:23:29.270 --> 00:23:29.280 align:start position:0%
<00:23:29.270>better <00:23:29.272>and <00:23:29.274>better <00:23:29.276>and <00:23:29.279>better.

00:23:29.280 --> 00:23:31.590 align:start position:0%
<00:23:29.280>better <00:23:29.396>and <00:23:29.513>better <00:23:29.629>and <00:23:29.746>better. <00:23:29.863>Um <00:23:29.980>it <00:23:30.096>will <00:23:30.213>stop <00:23:30.330>somewhere <00:23:30.446>at <00:23:30.563>one <00:23:30.680>and

00:23:31.590 --> 00:23:31.600 align:start position:0%
<00:23:31.590>Um <00:23:31.591>it <00:23:31.592>will <00:23:31.593>stop <00:23:31.595>somewhere <00:23:31.596>at <00:23:31.597>one <00:23:31.599>and

00:23:31.600 --> 00:23:33.870 align:start position:0%
<00:23:31.600>Um <00:23:31.707>it <00:23:31.815>will <00:23:31.923>stop <00:23:32.030>somewhere <00:23:32.138>at <00:23:32.246>one <00:23:32.353>and <00:23:32.461>then <00:23:32.569>the <00:23:32.676>model <00:23:32.784>will <00:23:32.892>stop <00:23:33.000>this

00:23:33.870 --> 00:23:33.880 align:start position:0%
<00:23:33.870>then <00:23:33.871>the <00:23:33.873>model <00:23:33.875>will <00:23:33.877>stop <00:23:33.879>this

00:23:33.880 --> 00:23:35.910 align:start position:0%
<00:23:33.880>then <00:23:34.080>the <00:23:34.280>model <00:23:34.480>will <00:23:34.680>stop <00:23:34.880>this <00:23:35.080>fine-tuning <00:23:35.280>process.

00:23:35.910 --> 00:23:35.920 align:start position:0%
<00:23:35.910>fine-tuning <00:23:35.919>process.

00:23:35.920 --> 00:23:38.190 align:start position:0%
<00:23:35.920>fine-tuning <00:23:36.075>process. <00:23:36.231>Uh <00:23:36.386>so, <00:23:36.542>then <00:23:36.697>you <00:23:36.853>can <00:23:37.008>go <00:23:37.164>to <00:23:37.320>experiments

00:23:38.190 --> 00:23:38.200 align:start position:0%
<00:23:38.190>Uh <00:23:38.191>so, <00:23:38.192>then <00:23:38.193>you <00:23:38.195>can <00:23:38.196>go <00:23:38.197>to <00:23:38.199>experiments

00:23:38.200 --> 00:23:41.430 align:start position:0%
<00:23:38.200>Uh <00:23:38.287>so, <00:23:38.375>then <00:23:38.462>you <00:23:38.550>can <00:23:38.637>go <00:23:38.725>to <00:23:38.812>experiments <00:23:38.900>and <00:23:38.987>here <00:23:39.075>you <00:23:39.162>can <00:23:39.250>see <00:23:39.337>all <00:23:39.425>the <00:23:39.512>results <00:23:39.600>of

00:23:41.430 --> 00:23:41.440 align:start position:0%
<00:23:41.430>and <00:23:41.431>here <00:23:41.432>you <00:23:41.433>can <00:23:41.434>see <00:23:41.435>all <00:23:41.436>the <00:23:41.437>results <00:23:41.439>of

00:23:41.440 --> 00:23:43.070 align:start position:0%
<00:23:41.440>and <00:23:41.533>here <00:23:41.626>you <00:23:41.720>can <00:23:41.813>see <00:23:41.906>all <00:23:42.000>the <00:23:42.093>results <00:23:42.186>of <00:23:42.280>your <00:23:42.373>fine-tuning. <00:23:42.466>You <00:23:42.560>will <00:23:42.653>be <00:23:42.746>able <00:23:42.840>to

00:23:43.070 --> 00:23:43.080 align:start position:0%
<00:23:43.070>your <00:23:43.071>fine-tuning. <00:23:43.072>You <00:23:43.074>will <00:23:43.076>be <00:23:43.077>able <00:23:43.079>to

00:23:43.080 --> 00:23:47.230 align:start position:0%
<00:23:43.080>your <00:23:43.196>fine-tuning. <00:23:43.313>You <00:23:43.429>will <00:23:43.546>be <00:23:43.663>able <00:23:43.780>to <00:23:43.896>see <00:23:44.013>the <00:23:44.129>CPU <00:23:44.246>usage, <00:23:44.363>memory <00:23:44.480>usage,

00:23:47.230 --> 00:23:47.240 align:start position:0%
<00:23:47.230>see <00:23:47.231>the <00:23:47.233>CPU <00:23:47.235>usage, <00:23:47.237>memory <00:23:47.239>usage,

00:23:47.240 --> 00:23:49.750 align:start position:0%
<00:23:47.240>see <00:23:47.347>the <00:23:47.455>CPU <00:23:47.563>usage, <00:23:47.670>memory <00:23:47.778>usage, <00:23:47.886>learning <00:23:47.993>rate. <00:23:48.101>So, <00:23:48.209>it <00:23:48.316>gives <00:23:48.424>you <00:23:48.532>all <00:23:48.640>of

00:23:49.750 --> 00:23:49.760 align:start position:0%
<00:23:49.750>learning <00:23:49.751>rate. <00:23:49.752>So, <00:23:49.753>it <00:23:49.755>gives <00:23:49.756>you <00:23:49.757>all <00:23:49.759>of

00:23:49.760 --> 00:23:52.110 align:start position:0%
<00:23:49.760>learning <00:23:49.876>rate. <00:23:49.993>So, <00:23:50.110>it <00:23:50.226>gives <00:23:50.343>you <00:23:50.460>all <00:23:50.576>of <00:23:50.693>the <00:23:50.810>information <00:23:50.926>about <00:23:51.043>your <00:23:51.160>fine-tuning

00:23:52.110 --> 00:23:52.120 align:start position:0%
<00:23:52.110>the <00:23:52.112>information <00:23:52.114>about <00:23:52.116>your <00:23:52.119>fine-tuning

00:23:52.120 --> 00:23:55.270 align:start position:0%
<00:23:52.120>the <00:23:52.399>information <00:23:52.679>about <00:23:52.959>your <00:23:53.239>fine-tuning <00:23:53.520>process.

00:23:55.280 --> 00:23:57.270 align:start position:0%
<00:23:55.280>Okay. <00:23:55.746>So, <00:23:56.213>now <00:23:56.680>um

00:23:57.270 --> 00:23:57.280 align:start position:0%
<00:23:57.270>Okay. <00:23:57.273>So, <00:23:57.276>now <00:23:57.279>um

00:23:57.280 --> 00:24:00.510 align:start position:0%
<00:23:57.280>Okay. <00:23:57.420>So, <00:23:57.560>now <00:23:57.700>um <00:23:57.840>let's <00:23:57.980>look <00:23:58.120>at <00:23:58.260>the <00:23:58.399>dashboard. <00:23:58.540>So, <00:23:58.680>before

00:24:00.510 --> 00:24:00.520 align:start position:0%
<00:24:00.510>let's <00:24:00.511>look <00:24:00.513>at <00:24:00.514>the <00:24:00.516>dashboard. <00:24:00.517>So, <00:24:00.519>before

00:24:00.520 --> 00:24:02.110 align:start position:0%
<00:24:00.520>let's <00:24:00.627>look <00:24:00.735>at <00:24:00.843>the <00:24:00.950>dashboard. <00:24:01.058>So, <00:24:01.166>before <00:24:01.273>I <00:24:01.381>showed <00:24:01.489>you <00:24:01.596>a <00:24:01.704>dashboard <00:24:01.812>where <00:24:01.920>we

00:24:02.110 --> 00:24:02.120 align:start position:0%
<00:24:02.110>I <00:24:02.111>showed <00:24:02.112>you <00:24:02.114>a <00:24:02.116>dashboard <00:24:02.117>where <00:24:02.119>we

00:24:02.120 --> 00:24:05.190 align:start position:0%
<00:24:02.120>I <00:24:02.247>showed <00:24:02.374>you <00:24:02.501>a <00:24:02.629>dashboard <00:24:02.756>where <00:24:02.883>we <00:24:03.010>compared <00:24:03.138>proprietary <00:24:03.265>and <00:24:03.392>open <00:24:03.520>source.

00:24:05.190 --> 00:24:05.200 align:start position:0%
<00:24:05.190>compared <00:24:05.192>proprietary <00:24:05.194>and <00:24:05.196>open <00:24:05.199>source.

00:24:05.200 --> 00:24:07.670 align:start position:0%
<00:24:05.200>compared <00:24:05.316>proprietary <00:24:05.433>and <00:24:05.550>open <00:24:05.666>source. <00:24:05.783>Now, <00:24:05.900>we <00:24:06.016>have <00:24:06.133>this <00:24:06.250>new <00:24:06.366>yellow <00:24:06.483>bubble <00:24:06.600>and

00:24:07.670 --> 00:24:07.680 align:start position:0%
<00:24:07.670>Now, <00:24:07.671>we <00:24:07.672>have <00:24:07.673>this <00:24:07.675>new <00:24:07.676>yellow <00:24:07.677>bubble <00:24:07.679>and

00:24:07.680 --> 00:24:10.110 align:start position:0%
<00:24:07.680>Now, <00:24:07.762>we <00:24:07.844>have <00:24:07.927>this <00:24:08.009>new <00:24:08.091>yellow <00:24:08.174>bubble <00:24:08.256>and <00:24:08.338>you <00:24:08.421>can <00:24:08.503>see <00:24:08.585>it's <00:24:08.668>a <00:24:08.750>very <00:24:08.832>very <00:24:08.915>much <00:24:08.997>at <00:24:09.080>a

00:24:10.110 --> 00:24:10.120 align:start position:0%
<00:24:10.110>you <00:24:10.110>can <00:24:10.111>see <00:24:10.112>it's <00:24:10.113>a <00:24:10.114>very <00:24:10.116>very <00:24:10.117>much <00:24:10.118>at <00:24:10.119>a

00:24:10.120 --> 00:24:13.150 align:start position:0%
<00:24:10.120>you <00:24:10.207>can <00:24:10.294>see <00:24:10.382>it's <00:24:10.469>a <00:24:10.557>very <00:24:10.645>very <00:24:10.732>much <00:24:10.820>at <00:24:10.907>a <00:24:10.995>very <00:24:11.082>like <00:24:11.169>nearly <00:24:11.257>zero <00:24:11.344>cost. <00:24:11.432>Um <00:24:11.520>that's

00:24:13.150 --> 00:24:13.160 align:start position:0%
<00:24:13.150>very <00:24:13.151>like <00:24:13.153>nearly <00:24:13.154>zero <00:24:13.156>cost. <00:24:13.157>Um <00:24:13.159>that's

00:24:13.160 --> 00:24:16.230 align:start position:0%
<00:24:13.160>very <00:24:13.253>like <00:24:13.346>nearly <00:24:13.440>zero <00:24:13.533>cost. <00:24:13.626>Um <00:24:13.720>that's <00:24:13.813>how <00:24:13.906>much <00:24:14.000>money <00:24:14.093>we <00:24:14.186>were <00:24:14.280>able <00:24:14.373>to <00:24:14.466>save. <00:24:14.560>So,

00:24:16.230 --> 00:24:16.240 align:start position:0%
<00:24:16.230>how <00:24:16.231>much <00:24:16.232>money <00:24:16.233>we <00:24:16.234>were <00:24:16.235>able <00:24:16.236>to <00:24:16.237>save. <00:24:16.239>So,

00:24:16.240 --> 00:24:18.190 align:start position:0%
<00:24:16.240>how <00:24:16.340>much <00:24:16.440>money <00:24:16.540>we <00:24:16.640>were <00:24:16.740>able <00:24:16.840>to <00:24:16.940>save. <00:24:17.040>So, <00:24:17.140>uh <00:24:17.240>basically <00:24:17.340>we <00:24:17.440>got <00:24:17.540>this <00:24:17.640>fine-tune

00:24:18.190 --> 00:24:18.200 align:start position:0%
<00:24:18.190>uh <00:24:18.191>basically <00:24:18.193>we <00:24:18.195>got <00:24:18.197>this <00:24:18.199>fine-tune

00:24:18.200 --> 00:24:19.710 align:start position:0%
<00:24:18.200>uh <00:24:18.394>basically <00:24:18.588>we <00:24:18.782>got <00:24:18.976>this <00:24:19.170>fine-tune <00:24:19.364>model. <00:24:19.559>It

00:24:19.710 --> 00:24:19.720 align:start position:0%
<00:24:19.710>model. <00:24:19.719>It

00:24:19.720 --> 00:24:22.750 align:start position:0%
<00:24:19.720>model. <00:24:20.000>It <00:24:20.280>it <00:24:20.560>is <00:24:20.840>at <00:24:21.120>0.91

00:24:22.750 --> 00:24:22.760 align:start position:0%
<00:24:22.750>it <00:24:22.753>is <00:24:22.756>at <00:24:22.759>0.91

00:24:22.760 --> 00:24:24.230 align:start position:0%
<00:24:22.760>it <00:24:23.090>is <00:24:23.421>at <00:24:23.752>0.91 <00:24:24.083>accuracy.

00:24:24.230 --> 00:24:24.240 align:start position:0%
accuracy.

00:24:24.240 --> 00:24:28.030 align:start position:0%
<00:24:24.240>accuracy. <00:24:24.395>Um <00:24:24.551>in <00:24:24.706>terms <00:24:24.862>of <00:24:25.017>cost, <00:24:25.173>the <00:24:25.328>line <00:24:25.484>is <00:24:25.640>um

00:24:28.030 --> 00:24:28.040 align:start position:0%
<00:24:28.030>Um <00:24:28.031>in <00:24:28.032>terms <00:24:28.033>of <00:24:28.034>cost, <00:24:28.035>the <00:24:28.036>line <00:24:28.037>is <00:24:28.039>um

00:24:28.040 --> 00:24:30.990 align:start position:0%
<00:24:28.040>Um <00:24:28.147>in <00:24:28.255>terms <00:24:28.363>of <00:24:28.470>cost, <00:24:28.578>the <00:24:28.686>line <00:24:28.793>is <00:24:28.901>um <00:24:29.009>actually <00:24:29.116>barely <00:24:29.224>noticeable <00:24:29.332>because <00:24:29.440>the

00:24:30.990 --> 00:24:31.000 align:start position:0%
<00:24:30.990>actually <00:24:30.992>barely <00:24:30.994>noticeable <00:24:30.996>because <00:24:30.999>the

00:24:31.000 --> 00:24:34.510 align:start position:0%
<00:24:31.000>actually <00:24:31.127>barely <00:24:31.254>noticeable <00:24:31.381>because <00:24:31.509>the <00:24:31.636>Opus <00:24:31.763>kind <00:24:31.890>of <00:24:32.018>like <00:24:32.145>skewed <00:24:32.272>our <00:24:32.400>access

00:24:34.510 --> 00:24:34.520 align:start position:0%
<00:24:34.510>Opus <00:24:34.511>kind <00:24:34.513>of <00:24:34.514>like <00:24:34.516>skewed <00:24:34.517>our <00:24:34.519>access

00:24:34.520 --> 00:24:37.070 align:start position:0%
<00:24:34.520>Opus <00:24:34.620>kind <00:24:34.720>of <00:24:34.820>like <00:24:34.920>skewed <00:24:35.020>our <00:24:35.120>access <00:24:35.220>uh <00:24:35.320>how <00:24:35.420>much <00:24:35.520>it <00:24:35.620>cost. <00:24:35.720>The <00:24:35.820>latency <00:24:35.920>also

00:24:37.070 --> 00:24:37.080 align:start position:0%
<00:24:37.070>uh <00:24:37.071>how <00:24:37.072>much <00:24:37.073>it <00:24:37.075>cost. <00:24:37.076>The <00:24:37.077>latency <00:24:37.079>also

00:24:37.080 --> 00:24:39.990 align:start position:0%
<00:24:37.080>uh <00:24:37.173>how <00:24:37.266>much <00:24:37.360>it <00:24:37.453>cost. <00:24:37.546>The <00:24:37.639>latency <00:24:37.733>also <00:24:37.826>went <00:24:37.919>down. <00:24:38.013>So, <00:24:38.106>now <00:24:38.199>you <00:24:38.293>can <00:24:38.386>see <00:24:38.480>with

00:24:39.990 --> 00:24:40.000 align:start position:0%
<00:24:39.990>went <00:24:39.991>down. <00:24:39.992>So, <00:24:39.993>now <00:24:39.995>you <00:24:39.996>can <00:24:39.997>see <00:24:39.999>with

00:24:40.000 --> 00:24:42.830 align:start position:0%
<00:24:40.000>went <00:24:40.127>down. <00:24:40.254>So, <00:24:40.381>now <00:24:40.509>you <00:24:40.636>can <00:24:40.763>see <00:24:40.890>with <00:24:41.018>Opus, <00:24:41.145>we <00:24:41.272>got <00:24:41.400>0.94.

00:24:42.830 --> 00:24:42.840 align:start position:0%
<00:24:42.830>Opus, <00:24:42.832>we <00:24:42.836>got <00:24:42.839>0.94.

00:24:42.840 --> 00:24:45.830 align:start position:0%
<00:24:42.840>Opus, <00:24:43.014>we <00:24:43.189>got <00:24:43.365>0.94. <00:24:43.540>The <00:24:43.715>fine-tune <00:24:43.889>model, <00:24:44.064>0.91. <00:24:44.240>That's

00:24:45.830 --> 00:24:45.840 align:start position:0%
<00:24:45.830>The <00:24:45.832>fine-tune <00:24:45.834>model, <00:24:45.836>0.91. <00:24:45.839>That's

00:24:45.840 --> 00:24:49.030 align:start position:0%
<00:24:45.840>The <00:24:45.980>fine-tune <00:24:46.120>model, <00:24:46.260>0.91. <00:24:46.399>That's <00:24:46.540>amazing. <00:24:46.679>And <00:24:46.820>because <00:24:46.959>now <00:24:47.100>I'm <00:24:47.240>saving

00:24:49.030 --> 00:24:49.040 align:start position:0%
<00:24:49.030>amazing. <00:24:49.031>And <00:24:49.033>because <00:24:49.035>now <00:24:49.037>I'm <00:24:49.039>saving

00:24:49.040 --> 00:24:53.150 align:start position:0%
<00:24:49.040>amazing. <00:24:49.156>And <00:24:49.273>because <00:24:49.389>now <00:24:49.506>I'm <00:24:49.623>saving <00:24:49.740>nearly <00:24:49.856>500 <00:24:49.973>times <00:24:50.090>on <00:24:50.206>the <00:24:50.323>saving <00:24:50.440>while

00:24:53.150 --> 00:24:53.160 align:start position:0%
<00:24:53.150>nearly <00:24:53.151>500 <00:24:53.153>times <00:24:53.154>on <00:24:53.156>the <00:24:53.157>saving <00:24:53.159>while

00:24:53.160 --> 00:24:56.510 align:start position:0%
<00:24:53.160>nearly <00:24:53.287>500 <00:24:53.414>times <00:24:53.541>on <00:24:53.669>the <00:24:53.796>saving <00:24:53.923>while <00:24:54.050>achieving <00:24:54.178>the <00:24:54.305>accuracy <00:24:54.432>almost <00:24:54.560>accuracy

00:24:56.510 --> 00:24:56.520 align:start position:0%
<00:24:56.510>achieving <00:24:56.512>the <00:24:56.514>accuracy <00:24:56.516>almost <00:24:56.519>accuracy

00:24:56.520 --> 00:24:58.030 align:start position:0%
<00:24:56.520>achieving <00:24:56.746>the <00:24:56.973>accuracy <00:24:57.199>almost <00:24:57.426>accuracy <00:24:57.652>of <00:24:57.879>Opus.

00:24:58.030 --> 00:24:58.040 align:start position:0%
<00:24:58.030>of <00:24:58.039>Opus.

00:24:58.040 --> 00:25:01.830 align:start position:0%
<00:24:58.040>of <00:24:58.195>Opus. <00:24:58.351>Uh <00:24:58.506>but <00:24:58.662>this <00:24:58.817>was <00:24:58.973>because <00:24:59.128>this <00:24:59.284>task <00:24:59.440>was

00:25:01.830 --> 00:25:01.840 align:start position:0%
<00:25:01.830>Uh <00:25:01.831>but <00:25:01.832>this <00:25:01.833>was <00:25:01.835>because <00:25:01.836>this <00:25:01.837>task <00:25:01.839>was

00:25:01.840 --> 00:25:03.910 align:start position:0%
<00:25:01.840>Uh <00:25:01.956>but <00:25:02.073>this <00:25:02.189>was <00:25:02.306>because <00:25:02.423>this <00:25:02.540>task <00:25:02.656>was <00:25:02.773>very <00:25:02.889>narrow, <00:25:03.006>right? <00:25:03.123>It <00:25:03.240>was

00:25:03.910 --> 00:25:03.920 align:start position:0%
<00:25:03.910>very <00:25:03.912>narrow, <00:25:03.914>right? <00:25:03.916>It <00:25:03.919>was

00:25:03.920 --> 00:25:05.430 align:start position:0%
<00:25:03.920>very <00:25:04.191>narrow, <00:25:04.463>right? <00:25:04.735>It <00:25:05.007>was <00:25:05.279>classification.

00:25:05.430 --> 00:25:05.440 align:start position:0%
classification.

00:25:05.440 --> 00:25:08.790 align:start position:0%
<00:25:05.440>classification. <00:25:05.580>I <00:25:05.720>want <00:25:05.860>to <00:25:06.000>show <00:25:06.140>you <00:25:06.280>a <00:25:06.420>second <00:25:06.560>task. <00:25:06.700>Um <00:25:06.840>so

00:25:08.790 --> 00:25:08.800 align:start position:0%
<00:25:08.790>I <00:25:08.791>want <00:25:08.792>to <00:25:08.793>show <00:25:08.793>you <00:25:08.795>a <00:25:08.796>second <00:25:08.797>task. <00:25:08.798>Um <00:25:08.799>so

00:25:08.800 --> 00:25:10.310 align:start position:0%
<00:25:08.800>I <00:25:08.884>want <00:25:08.969>to <00:25:09.054>show <00:25:09.139>you <00:25:09.224>a <00:25:09.309>second <00:25:09.394>task. <00:25:09.479>Um <00:25:09.564>so <00:25:09.649>the <00:25:09.734>second <00:25:09.819>task, <00:25:09.904>if <00:25:09.989>you <00:25:10.074>remember, <00:25:10.158>was

00:25:10.310 --> 00:25:10.320 align:start position:0%
<00:25:10.310>the <00:25:10.311>second <00:25:10.312>task, <00:25:10.314>if <00:25:10.316>you <00:25:10.317>remember, <00:25:10.319>was

00:25:10.320 --> 00:25:13.590 align:start position:0%
<00:25:10.320>the <00:25:10.436>second <00:25:10.553>task, <00:25:10.669>if <00:25:10.786>you <00:25:10.903>remember, <00:25:11.020>was <00:25:11.136>about <00:25:11.253>providing <00:25:11.370>context <00:25:11.486>to <00:25:11.603>reviewer. <00:25:11.720>So

00:25:13.590 --> 00:25:13.600 align:start position:0%
<00:25:13.590>about <00:25:13.591>providing <00:25:13.593>context <00:25:13.595>to <00:25:13.597>reviewer. <00:25:13.599>So

00:25:13.600 --> 00:25:15.830 align:start position:0%
<00:25:13.600>about <00:25:13.707>providing <00:25:13.815>context <00:25:13.923>to <00:25:14.030>reviewer. <00:25:14.138>So <00:25:14.246>I <00:25:14.353>also <00:25:14.461>tried <00:25:14.569>to <00:25:14.676>fine-tune <00:25:14.784>the <00:25:14.892>model <00:25:15.000>on

00:25:15.830 --> 00:25:15.840 align:start position:0%
<00:25:15.830>I <00:25:15.831>also <00:25:15.832>tried <00:25:15.833>to <00:25:15.835>fine-tune <00:25:15.836>the <00:25:15.837>model <00:25:15.839>on

00:25:15.840 --> 00:25:19.750 align:start position:0%
<00:25:15.840>I <00:25:15.956>also <00:25:16.073>tried <00:25:16.189>to <00:25:16.306>fine-tune <00:25:16.423>the <00:25:16.540>model <00:25:16.656>on <00:25:16.773>the <00:25:16.889>semantic <00:25:17.006>search. <00:25:17.123>And <00:25:17.240>unfortunately,

00:25:19.750 --> 00:25:19.760 align:start position:0%
<00:25:19.750>the <00:25:19.752>semantic <00:25:19.754>search. <00:25:19.756>And <00:25:19.759>unfortunately,

00:25:19.760 --> 00:25:21.230 align:start position:0%
<00:25:19.760>the <00:25:19.980>semantic <00:25:20.201>search. <00:25:20.421>And <00:25:20.642>unfortunately, <00:25:20.862>it <00:25:21.083>didn't

00:25:21.230 --> 00:25:21.240 align:start position:0%
<00:25:21.230>it <00:25:21.239>didn't

00:25:21.240 --> 00:25:25.630 align:start position:0%
<00:25:21.240>it <00:25:21.367>didn't <00:25:21.494>do <00:25:21.621>as <00:25:21.749>well. <00:25:21.876>So <00:25:22.003>the <00:25:22.130>the <00:25:22.258>ranking <00:25:22.385>was <00:25:22.512>uh <00:25:22.640>on

00:25:25.630 --> 00:25:25.640 align:start position:0%
<00:25:25.630>do <00:25:25.631>as <00:25:25.632>well. <00:25:25.633>So <00:25:25.634>the <00:25:25.635>the <00:25:25.636>ranking <00:25:25.637>was <00:25:25.638>uh <00:25:25.639>on

00:25:25.640 --> 00:25:28.870 align:start position:0%
<00:25:25.640>do <00:25:25.747>as <00:25:25.855>well. <00:25:25.963>So <00:25:26.070>the <00:25:26.178>the <00:25:26.286>ranking <00:25:26.393>was <00:25:26.501>uh <00:25:26.609>on <00:25:26.716>a <00:25:26.824>fine-tuned <00:25:26.932>model <00:25:27.040>1.3

00:25:28.870 --> 00:25:28.880 align:start position:0%
<00:25:28.870>a <00:25:28.873>fine-tuned <00:25:28.876>model <00:25:28.879>1.3

00:25:28.880 --> 00:25:31.750 align:start position:0%
<00:25:28.880>a <00:25:29.020>fine-tuned <00:25:29.160>model <00:25:29.300>1.3 <00:25:29.440>out <00:25:29.580>of <00:25:29.720>five. <00:25:29.860>But <00:25:30.000>what <00:25:30.140>was <00:25:30.280>interesting,

00:25:31.750 --> 00:25:31.760 align:start position:0%
<00:25:31.750>out <00:25:31.751>of <00:25:31.753>five. <00:25:31.754>But <00:25:31.756>what <00:25:31.757>was <00:25:31.759>interesting,

00:25:31.760 --> 00:25:33.270 align:start position:0%
<00:25:31.760>out <00:25:31.864>of <00:25:31.969>five. <00:25:32.073>But <00:25:32.178>what <00:25:32.282>was <00:25:32.387>interesting, <00:25:32.491>and <00:25:32.596>I <00:25:32.700>I <00:25:32.805>found <00:25:32.909>it <00:25:33.014>interesting, <00:25:33.119>that

00:25:33.270 --> 00:25:33.280 align:start position:0%
<00:25:33.270>and <00:25:33.271>I <00:25:33.273>I <00:25:33.274>found <00:25:33.276>it <00:25:33.277>interesting, <00:25:33.279>that

00:25:33.280 --> 00:25:36.510 align:start position:0%
<00:25:33.280>and <00:25:33.396>I <00:25:33.513>I <00:25:33.629>found <00:25:33.746>it <00:25:33.863>interesting, <00:25:33.980>that <00:25:34.096>Sonnet <00:25:34.213>performed <00:25:34.330>better <00:25:34.446>than <00:25:34.563>Opus. <00:25:34.680>Even

00:25:36.510 --> 00:25:36.520 align:start position:0%
<00:25:36.510>Sonnet <00:25:36.511>performed <00:25:36.513>better <00:25:36.515>than <00:25:36.517>Opus. <00:25:36.519>Even

00:25:36.520 --> 00:25:39.670 align:start position:0%
<00:25:36.520>Sonnet <00:25:36.627>performed <00:25:36.735>better <00:25:36.843>than <00:25:36.950>Opus. <00:25:37.058>Even <00:25:37.166>so <00:25:37.273>that <00:25:37.381>Opus <00:25:37.489>was <00:25:37.596>judging <00:25:37.704>the <00:25:37.812>answers. <00:25:37.920>So

00:25:39.670 --> 00:25:39.680 align:start position:0%
<00:25:39.670>so <00:25:39.671>that <00:25:39.672>Opus <00:25:39.673>was <00:25:39.675>judging <00:25:39.676>the <00:25:39.677>answers. <00:25:39.679>So

00:25:39.680 --> 00:25:42.150 align:start position:0%
<00:25:39.680>so <00:25:39.780>that <00:25:39.880>Opus <00:25:39.980>was <00:25:40.080>judging <00:25:40.180>the <00:25:40.280>answers. <00:25:40.380>So <00:25:40.480>Opus <00:25:40.580>decided <00:25:40.680>that <00:25:40.780>Sonnet <00:25:40.880>was <00:25:40.980>was <00:25:41.080>better.

00:25:42.150 --> 00:25:42.160 align:start position:0%
<00:25:42.150>Opus <00:25:42.151>decided <00:25:42.153>that <00:25:42.154>Sonnet <00:25:42.156>was <00:25:42.157>was <00:25:42.159>better.

00:25:42.160 --> 00:25:44.630 align:start position:0%
<00:25:42.160>Opus <00:25:42.260>decided <00:25:42.360>that <00:25:42.460>Sonnet <00:25:42.560>was <00:25:42.660>was <00:25:42.760>better. <00:25:42.860>So <00:25:42.960>this <00:25:43.060>gives <00:25:43.160>you <00:25:43.260>just <00:25:43.360>again, <00:25:43.460>never <00:25:43.560>go

00:25:44.630 --> 00:25:44.640 align:start position:0%
<00:25:44.630>So <00:25:44.631>this <00:25:44.632>gives <00:25:44.633>you <00:25:44.635>just <00:25:44.636>again, <00:25:44.637>never <00:25:44.639>go

00:25:44.640 --> 00:25:47.030 align:start position:0%
<00:25:44.640>So <00:25:44.756>this <00:25:44.873>gives <00:25:44.990>you <00:25:45.106>just <00:25:45.223>again, <00:25:45.340>never <00:25:45.456>go <00:25:45.573>with <00:25:45.690>your <00:25:45.806>assumptions. <00:25:45.923>Truly <00:25:46.040>use

00:25:47.030 --> 00:25:47.040 align:start position:0%
<00:25:47.030>with <00:25:47.032>your <00:25:47.034>assumptions. <00:25:47.036>Truly <00:25:47.039>use

00:25:47.040 --> 00:25:50.590 align:start position:0%
<00:25:47.040>with <00:25:47.180>your <00:25:47.320>assumptions. <00:25:47.460>Truly <00:25:47.600>use <00:25:47.740>evaluations <00:25:47.879>to <00:25:48.020>identify <00:25:48.159>the <00:25:48.300>right <00:25:48.440>model.

00:25:50.590 --> 00:25:50.600 align:start position:0%
<00:25:50.590>evaluations <00:25:50.591>to <00:25:50.593>identify <00:25:50.595>the <00:25:50.597>right <00:25:50.599>model.

00:25:50.600 --> 00:25:51.870 align:start position:0%
<00:25:50.600>evaluations <00:25:50.763>to <00:25:50.926>identify <00:25:51.089>the <00:25:51.253>right <00:25:51.416>model. <00:25:51.579>Okay, <00:25:51.743>well.

00:25:51.870 --> 00:25:51.880 align:start position:0%
<00:25:51.870>Okay, <00:25:51.879>well.

00:25:51.880 --> 00:25:53.990 align:start position:0%
<00:25:51.880>Okay, <00:25:52.113>well. <00:25:52.346>Now, <00:25:52.580>key <00:25:52.813>takeaways <00:25:53.046>to <00:25:53.280>summarize

00:25:53.990 --> 00:25:54.000 align:start position:0%
<00:25:53.990>Now, <00:25:53.992>key <00:25:53.994>takeaways <00:25:53.996>to <00:25:53.999>summarize

00:25:54.000 --> 00:25:56.750 align:start position:0%
<00:25:54.000>Now, <00:25:54.140>key <00:25:54.280>takeaways <00:25:54.420>to <00:25:54.560>summarize <00:25:54.700>everything <00:25:54.840>that <00:25:54.980>we <00:25:55.120>shared. <00:25:55.260>First, <00:25:55.400>always

00:25:56.750 --> 00:25:56.760 align:start position:0%
<00:25:56.750>everything <00:25:56.751>that <00:25:56.753>we <00:25:56.755>shared. <00:25:56.757>First, <00:25:56.759>always

00:25:56.760 --> 00:26:00.270 align:start position:0%
<00:25:56.760>everything <00:25:56.900>that <00:25:57.040>we <00:25:57.180>shared. <00:25:57.320>First, <00:25:57.460>always <00:25:57.600>start <00:25:57.740>with <00:25:57.879>defining <00:25:58.020>evaluation. <00:25:58.160>Don't

00:26:00.270 --> 00:26:00.280 align:start position:0%
<00:26:00.270>start <00:26:00.272>with <00:26:00.274>defining <00:26:00.276>evaluation. <00:26:00.279>Don't

00:26:00.280 --> 00:26:03.550 align:start position:0%
<00:26:00.280>start <00:26:00.407>with <00:26:00.534>defining <00:26:00.661>evaluation. <00:26:00.789>Don't <00:26:00.916>try <00:26:01.043>to <00:26:01.170>compare <00:26:01.298>apples <00:26:01.425>to <00:26:01.552>oranges. <00:26:01.680>Set

00:26:03.550 --> 00:26:03.560 align:start position:0%
<00:26:03.550>try <00:26:03.551>to <00:26:03.553>compare <00:26:03.554>apples <00:26:03.556>to <00:26:03.557>oranges. <00:26:03.559>Set

00:26:03.560 --> 00:26:06.390 align:start position:0%
<00:26:03.560>try <00:26:03.667>to <00:26:03.775>compare <00:26:03.883>apples <00:26:03.990>to <00:26:04.098>oranges. <00:26:04.206>Set <00:26:04.313>one <00:26:04.421>evaluation <00:26:04.529>set <00:26:04.636>and <00:26:04.744>truly <00:26:04.852>run <00:26:04.960>all

00:26:06.390 --> 00:26:06.400 align:start position:0%
<00:26:06.390>one <00:26:06.391>evaluation <00:26:06.393>set <00:26:06.394>and <00:26:06.396>truly <00:26:06.397>run <00:26:06.399>all

00:26:06.400 --> 00:26:08.510 align:start position:0%
<00:26:06.400>one <00:26:06.516>evaluation <00:26:06.633>set <00:26:06.750>and <00:26:06.866>truly <00:26:06.983>run <00:26:07.100>all <00:26:07.216>your <00:26:07.333>models <00:26:07.450>across <00:26:07.566>the <00:26:07.683>same <00:26:07.800>evaluation

00:26:08.510 --> 00:26:08.520 align:start position:0%
<00:26:08.510>your <00:26:08.511>models <00:26:08.513>across <00:26:08.515>the <00:26:08.517>same <00:26:08.519>evaluation

00:26:08.520 --> 00:26:12.110 align:start position:0%
<00:26:08.520>your <00:26:08.636>models <00:26:08.753>across <00:26:08.870>the <00:26:08.986>same <00:26:09.103>evaluation <00:26:09.220>set. <00:26:09.336>Then, <00:26:09.453>once <00:26:09.570>you <00:26:09.686>decide <00:26:09.803>to <00:26:09.920>deploy,

00:26:12.110 --> 00:26:12.120 align:start position:0%
<00:26:12.110>set. <00:26:12.111>Then, <00:26:12.112>once <00:26:12.114>you <00:26:12.116>decide <00:26:12.117>to <00:26:12.119>deploy,

00:26:12.120 --> 00:26:14.550 align:start position:0%
<00:26:12.120>set. <00:26:12.227>Then, <00:26:12.335>once <00:26:12.443>you <00:26:12.550>decide <00:26:12.658>to <00:26:12.766>deploy, <00:26:12.873>also <00:26:12.981>try <00:26:13.089>to <00:26:13.196>do <00:26:13.304>traffic <00:26:13.412>splitting. <00:26:13.520>Get

00:26:14.550 --> 00:26:14.560 align:start position:0%
<00:26:14.550>also <00:26:14.551>try <00:26:14.553>to <00:26:14.554>do <00:26:14.556>traffic <00:26:14.557>splitting. <00:26:14.559>Get

00:26:14.560 --> 00:26:16.470 align:start position:0%
<00:26:14.560>also <00:26:14.735>try <00:26:14.909>to <00:26:15.085>do <00:26:15.260>traffic <00:26:15.435>splitting. <00:26:15.610>Get <00:26:15.784>more <00:26:15.960>traces.

00:26:16.470 --> 00:26:16.480 align:start position:0%
<00:26:16.470>more <00:26:16.479>traces.

00:26:16.480 --> 00:26:19.390 align:start position:0%
<00:26:16.480>more <00:26:16.655>traces. <00:26:16.830>Analyze <00:26:17.005>what <00:26:17.180>truly <00:26:17.355>works <00:26:17.530>best <00:26:17.705>for <00:26:17.880>you.

00:26:19.390 --> 00:26:19.400 align:start position:0%
<00:26:19.390>Analyze <00:26:19.391>what <00:26:19.393>truly <00:26:19.394>works <00:26:19.396>best <00:26:19.397>for <00:26:19.399>you.

00:26:19.400 --> 00:26:22.030 align:start position:0%
<00:26:19.400>Analyze <00:26:19.507>what <00:26:19.615>truly <00:26:19.723>works <00:26:19.830>best <00:26:19.938>for <00:26:20.046>you. <00:26:20.153>With <00:26:20.261>uh <00:26:20.369>Unity <00:26:20.476>Catalog, <00:26:20.584>it's <00:26:20.692>truly <00:26:20.800>easy,

00:26:22.030 --> 00:26:22.040 align:start position:0%
<00:26:22.030>With <00:26:22.031>uh <00:26:22.033>Unity <00:26:22.034>Catalog, <00:26:22.036>it's <00:26:22.037>truly <00:26:22.039>easy,

00:26:22.040 --> 00:26:24.950 align:start position:0%
<00:26:22.040>With <00:26:22.127>uh <00:26:22.215>Unity <00:26:22.302>Catalog, <00:26:22.389>it's <00:26:22.477>truly <00:26:22.565>easy, <00:26:22.652>and <00:26:22.740>as <00:26:22.827>I <00:26:22.915>said, <00:26:23.002>you <00:26:23.090>can <00:26:23.177>use <00:26:23.264>any <00:26:23.352>model <00:26:23.440>uh

00:26:24.950 --> 00:26:24.960 align:start position:0%
<00:26:24.950>and <00:26:24.951>as <00:26:24.952>I <00:26:24.953>said, <00:26:24.954>you <00:26:24.955>can <00:26:24.956>use <00:26:24.957>any <00:26:24.958>model <00:26:24.959>uh

00:26:24.960 --> 00:26:27.830 align:start position:0%
<00:26:24.960>and <00:26:25.042>as <00:26:25.124>I <00:26:25.207>said, <00:26:25.289>you <00:26:25.371>can <00:26:25.454>use <00:26:25.536>any <00:26:25.618>model <00:26:25.701>uh <00:26:25.783>that <00:26:25.865>you <00:26:25.948>want. <00:26:26.030>And <00:26:26.112>third, <00:26:26.195>when <00:26:26.277>you <00:26:26.360>see

00:26:27.830 --> 00:26:27.840 align:start position:0%
<00:26:27.830>that <00:26:27.831>you <00:26:27.832>want. <00:26:27.833>And <00:26:27.835>third, <00:26:27.836>when <00:26:27.837>you <00:26:27.839>see

00:26:27.840 --> 00:26:30.030 align:start position:0%
<00:26:27.840>that <00:26:27.947>you <00:26:28.055>want. <00:26:28.163>And <00:26:28.270>third, <00:26:28.378>when <00:26:28.486>you <00:26:28.593>see <00:26:28.701>that <00:26:28.809>proprietary <00:26:28.916>models <00:26:29.024>give <00:26:29.132>you <00:26:29.240>good

00:26:30.030 --> 00:26:30.040 align:start position:0%
<00:26:30.030>that <00:26:30.031>proprietary <00:26:30.033>models <00:26:30.035>give <00:26:30.037>you <00:26:30.039>good

00:26:30.040 --> 00:26:32.510 align:start position:0%
<00:26:30.040>that <00:26:30.167>proprietary <00:26:30.294>models <00:26:30.421>give <00:26:30.549>you <00:26:30.676>good <00:26:30.803>results, <00:26:30.930>but <00:26:31.058>it's <00:26:31.185>too <00:26:31.312>expensive, <00:26:31.440>open

00:26:32.510 --> 00:26:32.520 align:start position:0%
<00:26:32.510>results, <00:26:32.511>but <00:26:32.513>it's <00:26:32.515>too <00:26:32.517>expensive, <00:26:32.519>open

00:26:32.520 --> 00:26:35.030 align:start position:0%
<00:26:32.520>results, <00:26:32.647>but <00:26:32.774>it's <00:26:32.901>too <00:26:33.029>expensive, <00:26:33.156>open <00:26:33.283>weight <00:26:33.410>models <00:26:33.538>don't <00:26:33.665>quite <00:26:33.792>get <00:26:33.920>the

00:26:35.030 --> 00:26:35.040 align:start position:0%
<00:26:35.030>weight <00:26:35.031>models <00:26:35.033>don't <00:26:35.035>quite <00:26:35.037>get <00:26:35.039>the

00:26:35.040 --> 00:26:37.350 align:start position:0%
<00:26:35.040>weight <00:26:35.156>models <00:26:35.273>don't <00:26:35.389>quite <00:26:35.506>get <00:26:35.623>the <00:26:35.740>quality <00:26:35.856>you <00:26:35.973>want, <00:26:36.090>then <00:26:36.206>go <00:26:36.323>for <00:26:36.440>a

00:26:37.350 --> 00:26:37.360 align:start position:0%
<00:26:37.350>quality <00:26:37.351>you <00:26:37.352>want, <00:26:37.354>then <00:26:37.356>go <00:26:37.357>for <00:26:37.359>a

00:26:37.360 --> 00:26:41.350 align:start position:0%
<00:26:37.360>quality <00:26:37.476>you <00:26:37.593>want, <00:26:37.709>then <00:26:37.826>go <00:26:37.943>for <00:26:38.060>a <00:26:38.176>fine-tuning. <00:26:38.293>I <00:26:38.409>prepared <00:26:38.526>a <00:26:38.643>few <00:26:38.760>resources

00:26:41.350 --> 00:26:41.360 align:start position:0%
<00:26:41.350>fine-tuning. <00:26:41.351>I <00:26:41.353>prepared <00:26:41.355>a <00:26:41.357>few <00:26:41.359>resources

00:26:41.360 --> 00:26:43.830 align:start position:0%
<00:26:41.360>fine-tuning. <00:26:41.459>I <00:26:41.560>prepared <00:26:41.659>a <00:26:41.760>few <00:26:41.860>resources <00:26:41.959>for <00:26:42.060>you <00:26:42.159>to <00:26:42.260>get <00:26:42.360>started. <00:26:42.459>Uh <00:26:42.560>so <00:26:42.659>the <00:26:42.760>first

00:26:43.830 --> 00:26:43.840 align:start position:0%
<00:26:43.830>for <00:26:43.831>you <00:26:43.832>to <00:26:43.833>get <00:26:43.834>started. <00:26:43.835>Uh <00:26:43.836>so <00:26:43.837>the <00:26:43.839>first

00:26:43.840 --> 00:26:47.470 align:start position:0%
<00:26:43.840>for <00:26:43.927>you <00:26:44.014>to <00:26:44.102>get <00:26:44.189>started. <00:26:44.277>Uh <00:26:44.365>so <00:26:44.452>the <00:26:44.540>first <00:26:44.627>one <00:26:44.715>is <00:26:44.802>Databricks <00:26:44.889>Dev <00:26:44.977>Toolkit. <00:26:45.064>So <00:26:45.152>as <00:26:45.240>I

00:26:47.470 --> 00:26:47.480 align:start position:0%
<00:26:47.470>one <00:26:47.471>is <00:26:47.472>Databricks <00:26:47.473>Dev <00:26:47.475>Toolkit. <00:26:47.476>So <00:26:47.477>as <00:26:47.479>I

00:26:47.480 --> 00:26:48.950 align:start position:0%
<00:26:47.480>one <00:26:47.574>is <00:26:47.669>Databricks <00:26:47.763>Dev <00:26:47.858>Toolkit. <00:26:47.952>So <00:26:48.047>as <00:26:48.141>I <00:26:48.236>was <00:26:48.330>building <00:26:48.425>the <00:26:48.519>demos, <00:26:48.614>of <00:26:48.708>course <00:26:48.803>I

00:26:48.950 --> 00:26:48.960 align:start position:0%
<00:26:48.950>was <00:26:48.951>building <00:26:48.953>the <00:26:48.954>demos, <00:26:48.956>of <00:26:48.957>course <00:26:48.959>I

00:26:48.960 --> 00:26:52.310 align:start position:0%
<00:26:48.960>was <00:26:49.067>building <00:26:49.175>the <00:26:49.283>demos, <00:26:49.390>of <00:26:49.498>course <00:26:49.606>I <00:26:49.713>didn't <00:26:49.821>write <00:26:49.929>the <00:26:50.036>code <00:26:50.144>myself. <00:26:50.252>I <00:26:50.360>utilized

00:26:52.310 --> 00:26:52.320 align:start position:0%
<00:26:52.310>didn't <00:26:52.311>write <00:26:52.312>the <00:26:52.314>code <00:26:52.316>myself. <00:26:52.317>I <00:26:52.319>utilized

00:26:52.320 --> 00:26:52.910 align:start position:0%
<00:26:52.320>didn't <00:26:52.395>write <00:26:52.471>the <00:26:52.547>code <00:26:52.623>myself. <00:26:52.699>I <00:26:52.775>utilized <00:26:52.851>uh

00:26:52.910 --> 00:26:52.920 align:start position:0%
uh

00:26:52.920 --> 00:26:56.110 align:start position:0%
<00:26:52.920>uh <00:26:53.120>my <00:26:53.320>minions <00:26:53.520>uh <00:26:53.720>together <00:26:53.920>with <00:26:54.120>DevKit, <00:26:54.320>it

00:26:56.110 --> 00:26:56.120 align:start position:0%
<00:26:56.110>my <00:26:56.111>minions <00:26:56.112>uh <00:26:56.114>together <00:26:56.116>with <00:26:56.117>DevKit, <00:26:56.119>it

00:26:56.120 --> 00:26:59.190 align:start position:0%
<00:26:56.120>my <00:26:56.219>minions <00:26:56.320>uh <00:26:56.419>together <00:26:56.520>with <00:26:56.620>DevKit, <00:26:56.719>it <00:26:56.820>gives <00:26:56.919>all <00:26:57.020>the <00:26:57.120>MCP <00:26:57.219>tools. <00:26:57.320>So, <00:26:57.419>code <00:26:57.520>code

00:26:59.190 --> 00:26:59.200 align:start position:0%
<00:26:59.190>gives <00:26:59.191>all <00:26:59.192>the <00:26:59.193>MCP <00:26:59.195>tools. <00:26:59.196>So, <00:26:59.197>code <00:26:59.199>code

00:26:59.200 --> 00:27:00.910 align:start position:0%
<00:26:59.200>gives <00:26:59.307>all <00:26:59.415>the <00:26:59.523>MCP <00:26:59.630>tools. <00:26:59.738>So, <00:26:59.846>code <00:26:59.953>code <00:27:00.061>utilized <00:27:00.169>all <00:27:00.276>the <00:27:00.384>different <00:27:00.492>tools <00:27:00.600>and

00:27:00.910 --> 00:27:00.920 align:start position:0%
<00:27:00.910>utilized <00:27:00.911>all <00:27:00.913>the <00:27:00.915>different <00:27:00.917>tools <00:27:00.919>and

00:27:00.920 --> 00:27:03.510 align:start position:0%
<00:27:00.920>utilized <00:27:01.060>all <00:27:01.200>the <00:27:01.340>different <00:27:01.480>tools <00:27:01.620>and <00:27:01.760>just <00:27:01.900>created <00:27:02.040>code, <00:27:02.180>launched <00:27:02.320>jobs,

00:27:03.510 --> 00:27:03.520 align:start position:0%
<00:27:03.510>just <00:27:03.512>created <00:27:03.514>code, <00:27:03.516>launched <00:27:03.519>jobs,

00:27:03.520 --> 00:27:05.950 align:start position:0%
<00:27:03.520>just <00:27:03.647>created <00:27:03.774>code, <00:27:03.901>launched <00:27:04.029>jobs, <00:27:04.156>deployed <00:27:04.283>it <00:27:04.410>on <00:27:04.538>Databricks. <00:27:04.665>So, <00:27:04.792>you <00:27:04.920>can

00:27:05.950 --> 00:27:05.960 align:start position:0%
<00:27:05.950>deployed <00:27:05.951>it <00:27:05.953>on <00:27:05.954>Databricks. <00:27:05.956>So, <00:27:05.957>you <00:27:05.959>can

00:27:05.960 --> 00:27:08.350 align:start position:0%
<00:27:05.960>deployed <00:27:06.060>it <00:27:06.160>on <00:27:06.260>Databricks. <00:27:06.360>So, <00:27:06.460>you <00:27:06.560>can <00:27:06.660>utilize <00:27:06.760>any <00:27:06.860>code <00:27:06.960>and <00:27:07.060>agent <00:27:07.160>you <00:27:07.260>want <00:27:07.360>with

00:27:08.350 --> 00:27:08.360 align:start position:0%
<00:27:08.350>utilize <00:27:08.351>any <00:27:08.352>code <00:27:08.353>and <00:27:08.355>agent <00:27:08.356>you <00:27:08.357>want <00:27:08.359>with

00:27:08.360 --> 00:27:10.590 align:start position:0%
<00:27:08.360>utilize <00:27:08.467>any <00:27:08.575>code <00:27:08.683>and <00:27:08.790>agent <00:27:08.898>you <00:27:09.006>want <00:27:09.113>with <00:27:09.221>this <00:27:09.329>DevKit. <00:27:09.436>If <00:27:09.544>you <00:27:09.652>never <00:27:09.760>tried

00:27:10.590 --> 00:27:10.600 align:start position:0%
<00:27:10.590>this <00:27:10.591>DevKit. <00:27:10.593>If <00:27:10.595>you <00:27:10.597>never <00:27:10.599>tried

00:27:10.600 --> 00:27:11.790 align:start position:0%
<00:27:10.600>this <00:27:10.707>DevKit. <00:27:10.814>If <00:27:10.921>you <00:27:11.028>never <00:27:11.135>tried <00:27:11.242>Databricks, <00:27:11.349>you <00:27:11.456>can <00:27:11.563>actually <00:27:11.671>use

00:27:11.790 --> 00:27:11.800 align:start position:0%
<00:27:11.790>Databricks, <00:27:11.792>you <00:27:11.794>can <00:27:11.796>actually <00:27:11.799>use

00:27:11.800 --> 00:27:15.110 align:start position:0%
<00:27:11.800>Databricks, <00:27:11.927>you <00:27:12.054>can <00:27:12.181>actually <00:27:12.309>use <00:27:12.436>Databricks <00:27:12.563>free <00:27:12.690>edition. <00:27:12.818>And <00:27:12.945>we <00:27:13.072>there <00:27:13.200>is

00:27:15.110 --> 00:27:15.120 align:start position:0%
<00:27:15.110>Databricks <00:27:15.111>free <00:27:15.112>edition. <00:27:15.114>And <00:27:15.116>we <00:27:15.117>there <00:27:15.119>is

00:27:15.120 --> 00:27:18.070 align:start position:0%
<00:27:15.120>Databricks <00:27:15.219>free <00:27:15.320>edition. <00:27:15.419>And <00:27:15.520>we <00:27:15.620>there <00:27:15.719>is <00:27:15.820>no <00:27:15.919>way <00:27:16.020>to <00:27:16.120>exceed <00:27:16.219>free <00:27:16.320>edition, <00:27:16.419>so <00:27:16.520>it's

00:27:18.070 --> 00:27:18.080 align:start position:0%
<00:27:18.070>no <00:27:18.071>way <00:27:18.072>to <00:27:18.073>exceed <00:27:18.075>free <00:27:18.076>edition, <00:27:18.077>so <00:27:18.079>it's

00:27:18.080 --> 00:27:20.470 align:start position:0%
<00:27:18.080>no <00:27:18.207>way <00:27:18.334>to <00:27:18.461>exceed <00:27:18.589>free <00:27:18.716>edition, <00:27:18.843>so <00:27:18.970>it's <00:27:19.098>always <00:27:19.225>free <00:27:19.352>and <00:27:19.480>forever.

00:27:20.470 --> 00:27:20.480 align:start position:0%
<00:27:20.470>always <00:27:20.473>free <00:27:20.476>and <00:27:20.479>forever.

00:27:20.480 --> 00:27:22.110 align:start position:0%
<00:27:20.480>always <00:27:20.635>free <00:27:20.791>and <00:27:20.946>forever. <00:27:21.102>Of <00:27:21.257>course, <00:27:21.413>you <00:27:21.568>cannot <00:27:21.724>run <00:27:21.880>production

00:27:22.110 --> 00:27:22.120 align:start position:0%
<00:27:22.110>Of <00:27:22.111>course, <00:27:22.113>you <00:27:22.115>cannot <00:27:22.117>run <00:27:22.119>production

00:27:22.120 --> 00:27:24.550 align:start position:0%
<00:27:22.120>Of <00:27:22.236>course, <00:27:22.353>you <00:27:22.469>cannot <00:27:22.586>run <00:27:22.703>production <00:27:22.820>workloads, <00:27:22.936>but <00:27:23.053>it <00:27:23.169>definitely <00:27:23.286>gets <00:27:23.403>you <00:27:23.520>to

00:27:24.550 --> 00:27:24.560 align:start position:0%
<00:27:24.550>workloads, <00:27:24.551>but <00:27:24.553>it <00:27:24.554>definitely <00:27:24.556>gets <00:27:24.557>you <00:27:24.559>to

00:27:24.560 --> 00:27:27.270 align:start position:0%
<00:27:24.560>workloads, <00:27:24.667>but <00:27:24.775>it <00:27:24.883>definitely <00:27:24.990>gets <00:27:25.098>you <00:27:25.206>to <00:27:25.313>experiment <00:27:25.421>and <00:27:25.529>try <00:27:25.636>it. <00:27:25.744>And <00:27:25.852>couple <00:27:25.960>other

00:27:27.270 --> 00:27:27.280 align:start position:0%
<00:27:27.270>experiment <00:27:27.271>and <00:27:27.273>try <00:27:27.274>it. <00:27:27.276>And <00:27:27.277>couple <00:27:27.279>other

00:27:27.280 --> 00:27:30.710 align:start position:0%
<00:27:27.280>experiment <00:27:27.396>and <00:27:27.513>try <00:27:27.629>it. <00:27:27.746>And <00:27:27.863>couple <00:27:27.980>other <00:27:28.096>notebooks <00:27:28.213>are <00:27:28.330>example <00:27:28.446>for <00:27:28.563>evaluation <00:27:28.680>as

00:27:30.710 --> 00:27:30.720 align:start position:0%
<00:27:30.710>notebooks <00:27:30.711>are <00:27:30.713>example <00:27:30.715>for <00:27:30.717>evaluation <00:27:30.719>as

00:27:30.720 --> 00:27:33.670 align:start position:0%
<00:27:30.720>notebooks <00:27:30.847>are <00:27:30.974>example <00:27:31.101>for <00:27:31.229>evaluation <00:27:31.356>as <00:27:31.483>well <00:27:31.610>as <00:27:31.738>fine-tuning. <00:27:31.865>So, <00:27:31.992>with <00:27:32.120>this,

00:27:33.670 --> 00:27:33.680 align:start position:0%
<00:27:33.670>well <00:27:33.671>as <00:27:33.673>fine-tuning. <00:27:33.675>So, <00:27:33.677>with <00:27:33.679>this,

00:27:33.680 --> 00:27:35.230 align:start position:0%
<00:27:33.680>well <00:27:33.787>as <00:27:33.894>fine-tuning. <00:27:34.001>So, <00:27:34.109>with <00:27:34.216>this, <00:27:34.323>thank <00:27:34.431>you <00:27:34.538>so <00:27:34.645>much <00:27:34.753>for <00:27:34.860>being <00:27:34.967>such <00:27:35.075>an

00:27:35.230 --> 00:27:35.240 align:start position:0%
<00:27:35.230>thank <00:27:35.231>you <00:27:35.232>so <00:27:35.233>much <00:27:35.235>for <00:27:35.236>being <00:27:35.237>such <00:27:35.239>an

00:27:35.240 --> 00:27:37.830 align:start position:0%
<00:27:35.240>thank <00:27:35.347>you <00:27:35.455>so <00:27:35.563>much <00:27:35.670>for <00:27:35.778>being <00:27:35.886>such <00:27:35.993>an <00:27:36.101>amazing <00:27:36.209>audience. <00:27:36.316>And <00:27:36.424>before <00:27:36.532>you <00:27:36.640>run

00:27:37.830 --> 00:27:37.840 align:start position:0%
<00:27:37.830>amazing <00:27:37.831>audience. <00:27:37.833>And <00:27:37.835>before <00:27:37.837>you <00:27:37.839>run

00:27:37.840 --> 00:27:39.230 align:start position:0%
<00:27:37.840>amazing <00:27:37.936>audience. <00:27:38.032>And <00:27:38.128>before <00:27:38.224>you <00:27:38.321>run <00:27:38.417>away, <00:27:38.513>I'm <00:27:38.609>going <00:27:38.706>to <00:27:38.802>take <00:27:38.898>a <00:27:38.994>picture <00:27:39.091>with

00:27:39.230 --> 00:27:39.240 align:start position:0%
<00:27:39.230>away, <00:27:39.231>I'm <00:27:39.232>going <00:27:39.233>to <00:27:39.235>take <00:27:39.236>a <00:27:39.237>picture <00:27:39.239>with

00:27:39.240 --> 00:27:40.670 align:start position:0%
<00:27:39.240>away, <00:27:39.331>I'm <00:27:39.423>going <00:27:39.515>to <00:27:39.607>take <00:27:39.699>a <00:27:39.791>picture <00:27:39.883>with <00:27:39.975>you <00:27:40.067>because <00:27:40.159>you <00:27:40.251>were <00:27:40.343>so <00:27:40.435>nice <00:27:40.527>and

00:27:40.670 --> 00:27:40.680 align:start position:0%
<00:27:40.670>you <00:27:40.671>because <00:27:40.673>you <00:27:40.674>were <00:27:40.676>so <00:27:40.677>nice <00:27:40.679>and

00:27:40.680 --> 00:27:42.790 align:start position:0%
<00:27:40.680>you <00:27:40.787>because <00:27:40.895>you <00:27:41.003>were <00:27:41.110>so <00:27:41.218>nice <00:27:41.326>and <00:27:41.433>listening <00:27:41.541>and <00:27:41.649>smiling <00:27:41.756>and <00:27:41.864>giving <00:27:41.972>me <00:27:42.080>all

00:27:42.790 --> 00:27:42.800 align:start position:0%
<00:27:42.790>listening <00:27:42.791>and <00:27:42.793>smiling <00:27:42.794>and <00:27:42.796>giving <00:27:42.797>me <00:27:42.799>all

00:27:42.800 --> 00:27:47.070 align:start position:0%
<00:27:42.800>listening <00:27:42.916>and <00:27:43.033>smiling <00:27:43.149>and <00:27:43.266>giving <00:27:43.383>me <00:27:43.500>all <00:27:43.616>the <00:27:43.733>positive <00:27:43.850>energy. <00:27:43.966>Thank <00:27:44.083>you. <00:27:44.200>Enjoy

00:27:47.070 --> 00:27:47.080 align:start position:0%
<00:27:47.070>the <00:27:47.071>positive <00:27:47.073>energy. <00:27:47.075>Thank <00:27:47.077>you. <00:27:47.079>Enjoy

00:27:47.080 --> 00:27:48.310 align:start position:0%
<00:27:47.080>the <00:27:47.190>positive <00:27:47.301>energy. <00:27:47.412>Thank <00:27:47.522>you. <00:27:47.633>Enjoy <00:27:47.744>the <00:27:47.854>rest <00:27:47.965>of <00:27:48.076>the <00:27:48.187>conference.

00:27:48.310 --> 00:27:48.320 align:start position:0%
<00:27:48.310>the <00:27:48.312>rest <00:27:48.314>of <00:27:48.316>the <00:27:48.319>conference.

00:27:48.320 --> 00:27:50.310 align:start position:0%
<00:27:48.320>the <00:27:48.520>rest <00:27:48.720>of <00:27:48.919>the <00:27:49.120>conference. <00:27:49.320>&gt;&gt; <00:27:49.520>much, <00:27:49.720>Victoria.

00:27:50.310 --> 00:27:50.320 align:start position:0%
<00:27:50.310>&gt;&gt; <00:27:50.314>much, <00:27:50.319>Victoria.

00:27:50.320 --> 00:27:51.230 align:start position:0%
<00:27:50.320>&gt;&gt; <00:27:50.592>much, <00:27:50.866>Victoria. <00:27:51.139>Now,

00:27:51.230 --> 00:27:51.240 align:start position:0%
Now,

00:27:51.240 --> 00:27:52.950 align:start position:0%
<00:27:51.240>Now, <00:27:51.440>before <00:27:51.640>you <00:27:51.840>go, <00:27:52.040>there <00:27:52.240>was <00:27:52.440>one <00:27:52.640>question

00:27:52.950 --> 00:27:52.960 align:start position:0%
<00:27:52.950>before <00:27:52.951>you <00:27:52.953>go, <00:27:52.954>there <00:27:52.956>was <00:27:52.957>one <00:27:52.959>question

00:27:52.960 --> 00:27:54.390 align:start position:0%
<00:27:52.960>before <00:27:53.051>you <00:27:53.143>go, <00:27:53.235>there <00:27:53.327>was <00:27:53.419>one <00:27:53.511>question <00:27:53.603>from <00:27:53.695>the <00:27:53.787>crowd <00:27:53.879>and <00:27:53.971>you <00:27:54.063>have <00:27:54.155>time <00:27:54.247>to

00:27:54.390 --> 00:27:54.400 align:start position:0%
<00:27:54.390>from <00:27:54.391>the <00:27:54.392>crowd <00:27:54.393>and <00:27:54.395>you <00:27:54.396>have <00:27:54.397>time <00:27:54.399>to

00:27:54.400 --> 00:27:56.310 align:start position:0%
<00:27:54.400>from <00:27:54.493>the <00:27:54.586>crowd <00:27:54.680>and <00:27:54.773>you <00:27:54.866>have <00:27:54.960>time <00:27:55.053>to <00:27:55.146>answer <00:27:55.240>it <00:27:55.333>if <00:27:55.426>you <00:27:55.520>wanted <00:27:55.613>to. <00:27:55.706>So, <00:27:55.800>we've

00:27:56.310 --> 00:27:56.320 align:start position:0%
<00:27:56.310>answer <00:27:56.311>it <00:27:56.312>if <00:27:56.313>you <00:27:56.315>wanted <00:27:56.316>to. <00:27:56.317>So, <00:27:56.319>we've

00:27:56.320 --> 00:27:59.150 align:start position:0%
<00:27:56.320>answer <00:27:56.427>it <00:27:56.535>if <00:27:56.643>you <00:27:56.750>wanted <00:27:56.858>to. <00:27:56.966>So, <00:27:57.073>we've <00:27:57.181>got <00:27:57.289>a <00:27:57.396>question, <00:27:57.504>does <00:27:57.612>introducing <00:27:57.720>agent

00:27:59.150 --> 00:27:59.160 align:start position:0%
<00:27:59.150>got <00:27:59.151>a <00:27:59.153>question, <00:27:59.155>does <00:27:59.157>introducing <00:27:59.159>agent

00:27:59.160 --> 00:28:01.110 align:start position:0%
<00:27:59.160>got <00:27:59.267>a <00:27:59.375>question, <00:27:59.483>does <00:27:59.590>introducing <00:27:59.698>agent <00:27:59.806>to <00:27:59.913>judge <00:28:00.021>or <00:28:00.129>adding <00:28:00.236>more <00:28:00.344>agents <00:28:00.452>in <00:28:00.560>the

00:28:01.110 --> 00:28:01.120 align:start position:0%
<00:28:01.110>to <00:28:01.111>judge <00:28:01.112>or <00:28:01.113>adding <00:28:01.115>more <00:28:01.116>agents <00:28:01.117>in <00:28:01.119>the

00:28:01.120 --> 00:28:04.470 align:start position:0%
<00:28:01.120>to <00:28:01.247>judge <00:28:01.374>or <00:28:01.501>adding <00:28:01.629>more <00:28:01.756>agents <00:28:01.883>in <00:28:02.010>the <00:28:02.138>system <00:28:02.265>cause <00:28:02.392>more <00:28:02.520>uncertainty?

00:28:04.470 --> 00:28:04.480 align:start position:0%
<00:28:04.470>system <00:28:04.473>cause <00:28:04.476>more <00:28:04.479>uncertainty?

00:28:04.480 --> 00:28:07.270 align:start position:0%
<00:28:04.480>system <00:28:04.680>cause <00:28:04.880>more <00:28:05.080>uncertainty? <00:28:05.280>&gt;&gt; <00:28:05.480>Cause <00:28:05.680>more <00:28:05.880>uncertainty.

00:28:07.270 --> 00:28:07.280 align:start position:0%
<00:28:07.270>&gt;&gt; <00:28:07.273>Cause <00:28:07.276>more <00:28:07.279>uncertainty.

00:28:07.280 --> 00:28:08.670 align:start position:0%
<00:28:07.280>&gt;&gt; <00:28:07.592>Cause <00:28:07.905>more <00:28:08.218>uncertainty. <00:28:08.531>Um

00:28:08.670 --> 00:28:08.680 align:start position:0%
Um

00:28:08.680 --> 00:28:09.990 align:start position:0%
<00:28:08.680>Um <00:28:09.859>Well,

00:28:09.990 --> 00:28:10.000 align:start position:0%
Well,

00:28:10.000 --> 00:28:14.350 align:start position:0%
<00:28:10.000>Well, <00:28:10.200>it <00:28:10.400>really <00:28:10.600>depends. <00:28:10.800>I <00:28:11.000>mean, <00:28:11.200>yes, <00:28:11.400>the

00:28:14.350 --> 00:28:14.360 align:start position:0%
<00:28:14.350>it <00:28:14.351>really <00:28:14.352>depends. <00:28:14.354>I <00:28:14.356>mean, <00:28:14.357>yes, <00:28:14.359>the

00:28:14.360 --> 00:28:16.870 align:start position:0%
<00:28:14.360>it <00:28:14.534>really <00:28:14.709>depends. <00:28:14.885>I <00:28:15.060>mean, <00:28:15.235>yes, <00:28:15.409>the <00:28:15.584>LLMs <00:28:15.760>uh

00:28:16.870 --> 00:28:16.880 align:start position:0%
<00:28:16.870>LLMs <00:28:16.879>uh

00:28:16.880 --> 00:28:19.030 align:start position:0%
<00:28:16.880>LLMs <00:28:17.080>uh <00:28:17.280>they <00:28:17.480>don't <00:28:17.680>have <00:28:17.880>straight <00:28:18.080>logic, <00:28:18.280>right?

00:28:19.030 --> 00:28:19.040 align:start position:0%
<00:28:19.030>they <00:28:19.031>don't <00:28:19.033>have <00:28:19.035>straight <00:28:19.037>logic, <00:28:19.039>right?

00:28:19.040 --> 00:28:21.390 align:start position:0%
<00:28:19.040>they <00:28:19.147>don't <00:28:19.255>have <00:28:19.363>straight <00:28:19.470>logic, <00:28:19.578>right? <00:28:19.686>LLMs <00:28:19.793>can <00:28:19.901>answer <00:28:20.009>or <00:28:20.116>will <00:28:20.224>provide <00:28:20.332>you <00:28:20.440>one

00:28:21.390 --> 00:28:21.400 align:start position:0%
<00:28:21.390>LLMs <00:28:21.391>can <00:28:21.392>answer <00:28:21.393>or <00:28:21.395>will <00:28:21.396>provide <00:28:21.397>you <00:28:21.399>one

00:28:21.400 --> 00:28:24.030 align:start position:0%
<00:28:21.400>LLMs <00:28:21.516>can <00:28:21.633>answer <00:28:21.750>or <00:28:21.866>will <00:28:21.983>provide <00:28:22.100>you <00:28:22.216>one <00:28:22.333>answer <00:28:22.450>in <00:28:22.566>in <00:28:22.683>5 <00:28:22.800>6

00:28:24.030 --> 00:28:24.040 align:start position:0%
<00:28:24.030>answer <00:28:24.032>in <00:28:24.034>in <00:28:24.036>5 <00:28:24.039>6

00:28:24.040 --> 00:28:25.990 align:start position:0%
<00:28:24.040>answer <00:28:24.147>in <00:28:24.255>in <00:28:24.363>5 <00:28:24.470>6 <00:28:24.578>later, <00:28:24.686>they <00:28:24.793>can <00:28:24.901>give <00:28:25.009>you <00:28:25.116>a <00:28:25.224>little <00:28:25.332>bit <00:28:25.440>of

00:28:25.990 --> 00:28:26.000 align:start position:0%
<00:28:25.990>later, <00:28:25.991>they <00:28:25.992>can <00:28:25.993>give <00:28:25.994>you <00:28:25.995>a <00:28:25.996>little <00:28:25.997>bit <00:28:25.999>of

00:28:26.000 --> 00:28:28.950 align:start position:0%
<00:28:26.000>later, <00:28:26.093>they <00:28:26.186>can <00:28:26.280>give <00:28:26.373>you <00:28:26.466>a <00:28:26.560>little <00:28:26.653>bit <00:28:26.746>of <00:28:26.840>a <00:28:26.933>different <00:28:27.026>answer. <00:28:27.120>But, <00:28:27.213>if <00:28:27.306>you <00:28:27.400>think

00:28:28.950 --> 00:28:28.960 align:start position:0%
<00:28:28.950>a <00:28:28.951>different <00:28:28.953>answer. <00:28:28.954>But, <00:28:28.956>if <00:28:28.957>you <00:28:28.959>think

00:28:28.960 --> 00:28:32.190 align:start position:0%
<00:28:28.960>a <00:28:29.067>different <00:28:29.175>answer. <00:28:29.283>But, <00:28:29.390>if <00:28:29.498>you <00:28:29.606>think <00:28:29.713>about <00:28:29.821>this, <00:28:29.929>if <00:28:30.036>you <00:28:30.144>provide <00:28:30.252>good <00:28:30.360>defined

00:28:32.190 --> 00:28:32.200 align:start position:0%
<00:28:32.190>about <00:28:32.191>this, <00:28:32.193>if <00:28:32.194>you <00:28:32.196>provide <00:28:32.197>good <00:28:32.199>defined

00:28:32.200 --> 00:28:35.830 align:start position:0%
<00:28:32.200>about <00:28:32.316>this, <00:28:32.433>if <00:28:32.550>you <00:28:32.666>provide <00:28:32.783>good <00:28:32.900>defined <00:28:33.016>guidelines, <00:28:33.133>if <00:28:33.250>you <00:28:33.366>instruct <00:28:33.483>LLM <00:28:33.600>follow

00:28:35.830 --> 00:28:35.840 align:start position:0%
<00:28:35.830>guidelines, <00:28:35.831>if <00:28:35.833>you <00:28:35.835>instruct <00:28:35.837>LLM <00:28:35.839>follow

00:28:35.840 --> 00:28:38.790 align:start position:0%
<00:28:35.840>guidelines, <00:28:35.967>if <00:28:36.094>you <00:28:36.221>instruct <00:28:36.349>LLM <00:28:36.476>follow <00:28:36.603>those <00:28:36.730>guidelines, <00:28:36.858>you <00:28:36.985>will <00:28:37.112>get <00:28:37.240>certain

00:28:38.790 --> 00:28:38.800 align:start position:0%
<00:28:38.790>those <00:28:38.791>guidelines, <00:28:38.793>you <00:28:38.795>will <00:28:38.797>get <00:28:38.799>certain

00:28:38.800 --> 00:28:41.310 align:start position:0%
<00:28:38.800>those <00:28:38.907>guidelines, <00:28:39.015>you <00:28:39.123>will <00:28:39.230>get <00:28:39.338>certain <00:28:39.446>answers. <00:28:39.553>And <00:28:39.661>what <00:28:39.769>you <00:28:39.876>can <00:28:39.984>also <00:28:40.092>do <00:28:40.200>in

00:28:41.310 --> 00:28:41.320 align:start position:0%
<00:28:41.310>answers. <00:28:41.311>And <00:28:41.312>what <00:28:41.313>you <00:28:41.315>can <00:28:41.316>also <00:28:41.317>do <00:28:41.319>in

00:28:41.320 --> 00:28:44.070 align:start position:0%
<00:28:41.320>answers. <00:28:41.419>And <00:28:41.520>what <00:28:41.620>you <00:28:41.720>can <00:28:41.820>also <00:28:41.919>do <00:28:42.020>in <00:28:42.120>MLflow, <00:28:42.220>you <00:28:42.320>can <00:28:42.419>actually <00:28:42.520>see, <00:28:42.620>so <00:28:42.720>let's

00:28:44.070 --> 00:28:44.080 align:start position:0%
<00:28:44.070>MLflow, <00:28:44.071>you <00:28:44.072>can <00:28:44.074>actually <00:28:44.076>see, <00:28:44.077>so <00:28:44.079>let's

00:28:44.080 --> 00:28:47.270 align:start position:0%
<00:28:44.080>MLflow, <00:28:44.167>you <00:28:44.254>can <00:28:44.342>actually <00:28:44.429>see, <00:28:44.517>so <00:28:44.605>let's <00:28:44.692>say <00:28:44.780>you <00:28:44.867>you <00:28:44.955>in <00:28:45.042>my <00:28:45.129>case, <00:28:45.217>I <00:28:45.304>said, <00:28:45.392>you <00:28:45.480>need

00:28:47.270 --> 00:28:47.280 align:start position:0%
<00:28:47.270>say <00:28:47.271>you <00:28:47.272>you <00:28:47.273>in <00:28:47.274>my <00:28:47.275>case, <00:28:47.276>I <00:28:47.277>said, <00:28:47.278>you <00:28:47.279>need

00:28:47.280 --> 00:28:49.630 align:start position:0%
<00:28:47.280>say <00:28:47.387>you <00:28:47.495>you <00:28:47.603>in <00:28:47.710>my <00:28:47.818>case, <00:28:47.926>I <00:28:48.033>said, <00:28:48.141>you <00:28:48.249>need <00:28:48.356>to <00:28:48.464>pull <00:28:48.572>data <00:28:48.680>from

00:28:49.630 --> 00:28:49.640 align:start position:0%
<00:28:49.630>to <00:28:49.633>pull <00:28:49.636>data <00:28:49.639>from

00:28:49.640 --> 00:28:52.790 align:start position:0%
<00:28:49.640>to <00:28:49.815>pull <00:28:49.990>data <00:28:50.165>from <00:28:50.340>previous <00:28:50.515>interactions <00:28:50.690>of <00:28:50.865>users. <00:28:51.040>Then

00:28:52.790 --> 00:28:52.800 align:start position:0%
<00:28:52.790>previous <00:28:52.792>interactions <00:28:52.794>of <00:28:52.796>users. <00:28:52.799>Then

00:28:52.800 --> 00:28:54.950 align:start position:0%
<00:28:52.800>previous <00:28:53.033>interactions <00:28:53.266>of <00:28:53.500>users. <00:28:53.733>Then <00:28:53.966>agent <00:28:54.200>will

00:28:54.950 --> 00:28:54.960 align:start position:0%
<00:28:54.950>agent <00:28:54.959>will

00:28:54.960 --> 00:28:58.270 align:start position:0%
<00:28:54.960>agent <00:28:55.100>will <00:28:55.240>see <00:28:55.380>this <00:28:55.520>task. <00:28:55.660>It <00:28:55.800>will <00:28:55.940>go <00:28:56.080>and <00:28:56.220>find <00:28:56.360>the

00:28:58.270 --> 00:28:58.280 align:start position:0%
<00:28:58.270>see <00:28:58.271>this <00:28:58.272>task. <00:28:58.273>It <00:28:58.274>will <00:28:58.275>go <00:28:58.276>and <00:28:58.277>find <00:28:58.279>the

00:28:58.280 --> 00:29:00.590 align:start position:0%
<00:28:58.280>see <00:28:58.379>this <00:28:58.480>task. <00:28:58.580>It <00:28:58.680>will <00:28:58.780>go <00:28:58.879>and <00:28:58.980>find <00:28:59.080>the <00:28:59.180>history <00:28:59.280>and <00:28:59.379>then <00:28:59.480>it <00:28:59.580>will <00:28:59.680>actually

00:29:00.590 --> 00:29:00.600 align:start position:0%
<00:29:00.590>history <00:29:00.591>and <00:29:00.593>then <00:29:00.595>it <00:29:00.597>will <00:29:00.599>actually

00:29:00.600 --> 00:29:03.430 align:start position:0%
<00:29:00.600>history <00:29:00.707>and <00:29:00.815>then <00:29:00.923>it <00:29:01.030>will <00:29:01.138>actually <00:29:01.246>explain <00:29:01.353>why <00:29:01.461>it <00:29:01.569>scored <00:29:01.676>a <00:29:01.784>low. <00:29:01.892>It <00:29:02.000>will

00:29:03.430 --> 00:29:03.440 align:start position:0%
<00:29:03.430>explain <00:29:03.431>why <00:29:03.432>it <00:29:03.433>scored <00:29:03.435>a <00:29:03.436>low. <00:29:03.437>It <00:29:03.439>will

00:29:03.440 --> 00:29:06.470 align:start position:0%
<00:29:03.440>explain <00:29:03.533>why <00:29:03.626>it <00:29:03.720>scored <00:29:03.813>a <00:29:03.906>low. <00:29:04.000>It <00:29:04.093>will <00:29:04.186>say, <00:29:04.280>okay, <00:29:04.373>I <00:29:04.466>provided <00:29:04.560>it <00:29:04.653>a <00:29:04.746>score <00:29:04.840>two

00:29:06.470 --> 00:29:06.480 align:start position:0%
<00:29:06.470>say, <00:29:06.471>okay, <00:29:06.472>I <00:29:06.473>provided <00:29:06.475>it <00:29:06.476>a <00:29:06.477>score <00:29:06.479>two

00:29:06.480 --> 00:29:09.870 align:start position:0%
<00:29:06.480>say, <00:29:06.587>okay, <00:29:06.695>I <00:29:06.803>provided <00:29:06.910>it <00:29:07.018>a <00:29:07.126>score <00:29:07.233>two <00:29:07.341>because <00:29:07.449>it's <00:29:07.556>it <00:29:07.664>didn't <00:29:07.772>provide <00:29:07.880>relevant

00:29:09.870 --> 00:29:09.880 align:start position:0%
<00:29:09.870>because <00:29:09.871>it's <00:29:09.873>it <00:29:09.875>didn't <00:29:09.877>provide <00:29:09.879>relevant

00:29:09.880 --> 00:29:12.070 align:start position:0%
<00:29:09.880>because <00:29:09.996>it's <00:29:10.113>it <00:29:10.230>didn't <00:29:10.346>provide <00:29:10.463>relevant <00:29:10.580>information <00:29:10.696>or <00:29:10.813>it <00:29:10.930>could <00:29:11.046>have <00:29:11.163>quoted <00:29:11.280>a

00:29:12.070 --> 00:29:12.080 align:start position:0%
<00:29:12.070>information <00:29:12.071>or <00:29:12.072>it <00:29:12.074>could <00:29:12.076>have <00:29:12.077>quoted <00:29:12.079>a

00:29:12.080 --> 00:29:15.150 align:start position:0%
<00:29:12.080>information <00:29:12.187>or <00:29:12.295>it <00:29:12.403>could <00:29:12.510>have <00:29:12.618>quoted <00:29:12.726>a <00:29:12.833>fluff <00:29:12.941>that <00:29:13.049>was <00:29:13.156>irrelevant. <00:29:13.264>So, <00:29:13.372>you <00:29:13.480>can

00:29:15.150 --> 00:29:15.160 align:start position:0%
<00:29:15.150>fluff <00:29:15.151>that <00:29:15.153>was <00:29:15.154>irrelevant. <00:29:15.156>So, <00:29:15.157>you <00:29:15.159>can

00:29:15.160 --> 00:29:18.830 align:start position:0%
<00:29:15.160>fluff <00:29:15.267>that <00:29:15.375>was <00:29:15.483>irrelevant. <00:29:15.590>So, <00:29:15.698>you <00:29:15.806>can <00:29:15.913>see <00:29:16.021>in <00:29:16.129>traces <00:29:16.236>all <00:29:16.344>the <00:29:16.452>explanations <00:29:16.560>by

00:29:18.830 --> 00:29:18.840 align:start position:0%
<00:29:18.830>see <00:29:18.831>in <00:29:18.832>traces <00:29:18.834>all <00:29:18.836>the <00:29:18.837>explanations <00:29:18.839>by

00:29:18.840 --> 00:29:23.070 align:start position:0%
<00:29:18.840>see <00:29:18.956>in <00:29:19.073>traces <00:29:19.189>all <00:29:19.306>the <00:29:19.423>explanations <00:29:19.540>by <00:29:19.656>LLM <00:29:19.773>why <00:29:19.889>particular <00:29:20.006>score <00:29:20.123>was <00:29:20.240>provided.

00:29:23.070 --> 00:29:23.080 align:start position:0%
<00:29:23.070>LLM <00:29:23.071>why <00:29:23.073>particular <00:29:23.075>score <00:29:23.077>was <00:29:23.079>provided.

00:29:23.080 --> 00:29:26.310 align:start position:0%
<00:29:23.080>LLM <00:29:23.179>why <00:29:23.280>particular <00:29:23.379>score <00:29:23.480>was <00:29:23.580>provided. <00:29:23.679>So, <00:29:23.780>in <00:29:23.879>email <00:29:23.980>flow <00:29:24.080>you <00:29:24.179>can <00:29:24.280>you <00:29:24.379>can <00:29:24.480>get

00:29:26.310 --> 00:29:26.320 align:start position:0%
<00:29:26.310>So, <00:29:26.311>in <00:29:26.312>email <00:29:26.313>flow <00:29:26.314>you <00:29:26.315>can <00:29:26.316>you <00:29:26.317>can <00:29:26.319>get

00:29:26.320 --> 00:29:28.270 align:start position:0%
<00:29:26.320>So, <00:29:26.413>in <00:29:26.506>email <00:29:26.600>flow <00:29:26.693>you <00:29:26.786>can <00:29:26.879>you <00:29:26.973>can <00:29:27.066>get <00:29:27.159>the <00:29:27.253>score <00:29:27.346>and <00:29:27.439>you <00:29:27.533>can <00:29:27.626>understand <00:29:27.720>the

00:29:28.270 --> 00:29:28.280 align:start position:0%
<00:29:28.270>the <00:29:28.271>score <00:29:28.273>and <00:29:28.274>you <00:29:28.276>can <00:29:28.277>understand <00:29:28.279>the

00:29:28.280 --> 00:29:31.310 align:start position:0%
<00:29:28.280>the <00:29:28.379>score <00:29:28.480>and <00:29:28.580>you <00:29:28.680>can <00:29:28.780>understand <00:29:28.879>the <00:29:28.980>reason <00:29:29.080>in <00:29:29.180>behind <00:29:29.280>it. <00:29:29.379>So, <00:29:29.480>I <00:29:29.580>think <00:29:29.680>this

00:29:31.310 --> 00:29:31.320 align:start position:0%
<00:29:31.310>reason <00:29:31.311>in <00:29:31.312>behind <00:29:31.313>it. <00:29:31.315>So, <00:29:31.316>I <00:29:31.317>think <00:29:31.319>this

00:29:31.320 --> 00:29:34.590 align:start position:0%
<00:29:31.320>reason <00:29:31.460>in <00:29:31.600>behind <00:29:31.740>it. <00:29:31.879>So, <00:29:32.020>I <00:29:32.159>think <00:29:32.300>this <00:29:32.439>gives <00:29:32.580>clear <00:29:32.720>transparency.

00:29:34.590 --> 00:29:34.600 align:start position:0%
<00:29:34.590>gives <00:29:34.594>clear <00:29:34.599>transparency.

00:29:34.600 --> 00:29:36.230 align:start position:0%
<00:29:34.600>gives <00:29:34.740>clear <00:29:34.879>transparency. <00:29:35.020>&gt;&gt; <00:29:35.159>Thank <00:29:35.300>you <00:29:35.439>very <00:29:35.580>much, <00:29:35.719>Victoria. <00:29:35.860>Have <00:29:36.000>a

00:29:36.230 --> 00:29:36.240 align:start position:0%
<00:29:36.230>&gt;&gt; <00:29:36.231>Thank <00:29:36.232>you <00:29:36.233>very <00:29:36.235>much, <00:29:36.236>Victoria. <00:29:36.237>Have <00:29:36.239>a

00:29:36.240 --> 00:29:38.335 align:start position:0%
<00:29:36.240>&gt;&gt; <00:29:36.340>Thank <00:29:36.440>you <00:29:36.540>very <00:29:36.640>much, <00:29:36.740>Victoria. <00:29:36.840>Have <00:29:36.940>a <00:29:37.040>one <00:29:37.140>more <00:29:37.240>round <00:29:37.340>of <00:29:37.440>applause. <00:29:37.540>Thank <00:29:37.640>you.

00:29:38.335 --> 00:29:38.345 align:start position:0%
<00:29:38.335>one <00:29:38.336>more <00:29:38.338>round <00:29:38.339>of <00:29:38.341>applause. <00:29:38.342>Thank <00:29:38.344>you.

00:29:38.345 --> 00:29:40.470 align:start position:0%
<00:29:38.345>one <00:29:38.520>more <00:29:38.695>round <00:29:38.870>of <00:29:39.045>applause. <00:29:39.220>Thank <00:29:39.395>you. <00:29:39.570>&gt;&gt; <00:29:39.745>[applause]

00:29:40.480 --> 00:29:42.910 align:start position:0%
<00:29:40.480>&gt;&gt; <00:29:40.760>A <00:29:41.040>fantastic <00:29:41.320>talk <00:29:41.600>that <00:29:41.880>has

00:29:42.910 --> 00:29:42.920 align:start position:0%
<00:29:42.910>&gt;&gt; <00:29:42.911>A <00:29:42.913>fantastic <00:29:42.915>talk <00:29:42.917>that <00:29:42.919>has

00:29:42.920 --> 00:29:44.310 align:start position:0%
<00:29:42.920>&gt;&gt; <00:29:43.024>A <00:29:43.128>fantastic <00:29:43.232>talk <00:29:43.337>that <00:29:43.441>has <00:29:43.545>you <00:29:43.649>know, <00:29:43.754>for <00:29:43.858>the <00:29:43.962>first <00:29:44.066>time <00:29:44.171>this

00:29:44.310 --> 00:29:44.320 align:start position:0%
<00:29:44.310>you <00:29:44.311>know, <00:29:44.312>for <00:29:44.314>the <00:29:44.316>first <00:29:44.317>time <00:29:44.319>this

00:29:44.320 --> 00:29:46.190 align:start position:0%
<00:29:44.320>you <00:29:44.427>know, <00:29:44.535>for <00:29:44.643>the <00:29:44.750>first <00:29:44.858>time <00:29:44.966>this <00:29:45.073>evening <00:29:45.181>filled <00:29:45.289>out <00:29:45.396>the <00:29:45.504>room <00:29:45.612>of <00:29:45.720>stage

00:29:46.190 --> 00:29:46.200 align:start position:0%
<00:29:46.190>evening <00:29:46.191>filled <00:29:46.193>out <00:29:46.194>the <00:29:46.196>room <00:29:46.197>of <00:29:46.199>stage

00:29:46.200 --> 00:29:48.800 align:start position:0%
<00:29:46.200>evening <00:29:46.400>filled <00:29:46.600>out <00:29:46.800>the <00:29:47.000>room <00:29:47.200>of <00:29:47.400>stage <00:29:47.600>nine.