WEBVTT 00:00:17.360 --> 00:00:19.430 align:start position:0% <00:00:17.360>All <00:00:17.826>right <00:00:18.293>[music] <00:00:18.759>everyone. 00:00:19.430 --> 00:00:19.440 align:start position:0% <00:00:19.430>All <00:00:19.433>right <00:00:19.436>[music] <00:00:19.439>everyone. 00:00:19.440 --> 00:00:21.270 align:start position:0% <00:00:19.440>All <00:00:19.580>right <00:00:19.720>[music] <00:00:19.860>everyone. <00:00:20.000>It's <00:00:20.140>actually <00:00:20.280>amazing <00:00:20.420>to <00:00:20.560>have <00:00:20.700>a <00:00:20.840>crowd 00:00:21.270 --> 00:00:21.280 align:start position:0% <00:00:21.270>It's <00:00:21.271>actually <00:00:21.273>amazing <00:00:21.274>to <00:00:21.276>have <00:00:21.277>a <00:00:21.279>crowd 00:00:21.280 --> 00:00:23.470 align:start position:0% <00:00:21.280>It's <00:00:21.396>actually <00:00:21.513>amazing <00:00:21.630>to <00:00:21.746>have <00:00:21.863>a <00:00:21.980>crowd <00:00:22.096>like <00:00:22.213>this <00:00:22.330>on <00:00:22.446>Friday <00:00:22.563>afternoon. <00:00:22.680>It's 00:00:23.470 --> 00:00:23.480 align:start position:0% <00:00:23.470>like <00:00:23.471>this <00:00:23.473>on <00:00:23.475>Friday <00:00:23.477>afternoon. <00:00:23.479>It's 00:00:23.480 --> 00:00:25.270 align:start position:0% <00:00:23.480>like <00:00:23.580>this <00:00:23.680>on <00:00:23.780>Friday <00:00:23.880>afternoon. <00:00:23.980>It's <00:00:24.080>super <00:00:24.180>super <00:00:24.280>cool <00:00:24.380>of <00:00:24.480>all <00:00:24.580>of <00:00:24.680>you <00:00:24.780>to <00:00:24.880>join 00:00:25.270 --> 00:00:25.280 align:start position:0% <00:00:25.270>super <00:00:25.271>super <00:00:25.272>cool <00:00:25.273>of <00:00:25.274>all <00:00:25.275>of <00:00:25.276>you <00:00:25.277>to <00:00:25.279>join 00:00:25.280 --> 00:00:27.510 align:start position:0% <00:00:25.280>super <00:00:25.373>super <00:00:25.466>cool <00:00:25.560>of <00:00:25.653>all <00:00:25.746>of <00:00:25.840>you <00:00:25.933>to <00:00:26.026>join <00:00:26.120>us. <00:00:26.213>But <00:00:26.306>I <00:00:26.400>understand <00:00:26.493>why <00:00:26.586>because <00:00:26.680>the 00:00:27.510 --> 00:00:27.520 align:start position:0% <00:00:27.510>us. <00:00:27.511>But <00:00:27.513>I <00:00:27.514>understand <00:00:27.516>why <00:00:27.517>because <00:00:27.519>the 00:00:27.520 --> 00:00:29.750 align:start position:0% <00:00:27.520>us. <00:00:27.627>But <00:00:27.735>I <00:00:27.843>understand <00:00:27.950>why <00:00:28.058>because <00:00:28.166>the <00:00:28.273>next <00:00:28.381>session <00:00:28.489>is <00:00:28.596>going <00:00:28.704>to <00:00:28.812>be <00:00:28.919>very 00:00:29.750 --> 00:00:29.760 align:start position:0% <00:00:29.750>next <00:00:29.751>session <00:00:29.753>is <00:00:29.754>going <00:00:29.756>to <00:00:29.757>be <00:00:29.759>very 00:00:29.760 --> 00:00:31.710 align:start position:0% <00:00:29.760>next <00:00:29.860>session <00:00:29.960>is <00:00:30.060>going <00:00:30.160>to <00:00:30.260>be <00:00:30.360>very <00:00:30.460>interesting <00:00:30.560>and <00:00:30.660>it's <00:00:30.760>kind <00:00:30.860>of <00:00:30.960>in <00:00:31.060>the <00:00:31.160>same 00:00:31.710 --> 00:00:31.720 align:start position:0% <00:00:31.710>interesting <00:00:31.711>and <00:00:31.712>it's <00:00:31.713>kind <00:00:31.715>of <00:00:31.716>in <00:00:31.717>the <00:00:31.718>same 00:00:31.720 --> 00:00:34.270 align:start position:0% <00:00:31.720>interesting <00:00:31.836>and <00:00:31.953>it's <00:00:32.070>kind <00:00:32.186>of <00:00:32.303>in <00:00:32.420>the <00:00:32.536>same <00:00:32.653>area <00:00:32.769>as <00:00:32.886>the <00:00:33.003>last <00:00:33.120>talk. 00:00:34.270 --> 00:00:34.280 align:start position:0% <00:00:34.270>area <00:00:34.272>as <00:00:34.274>the <00:00:34.276>last <00:00:34.279>talk. 00:00:34.280 --> 00:00:35.870 align:start position:0% <00:00:34.280>area <00:00:34.420>as <00:00:34.560>the <00:00:34.700>last <00:00:34.840>talk. <00:00:34.980>They're <00:00:35.120>cheering <00:00:35.260>for <00:00:35.400>us. <00:00:35.540>Very <00:00:35.680>nice. 00:00:35.870 --> 00:00:35.880 align:start position:0% <00:00:35.870>They're <00:00:35.871>cheering <00:00:35.873>for <00:00:35.875>us. <00:00:35.877>Very <00:00:35.879>nice. 00:00:35.880 --> 00:00:37.950 align:start position:0% <00:00:35.880>They're <00:00:35.987>cheering <00:00:36.095>for <00:00:36.203>us. <00:00:36.310>Very <00:00:36.418>nice. <00:00:36.526>Thank <00:00:36.633>you. <00:00:36.741>Let's <00:00:36.849>cheer <00:00:36.956>back. <00:00:37.064>Give <00:00:37.172>a <00:00:37.280>big 00:00:37.950 --> 00:00:37.960 align:start position:0% <00:00:37.950>Thank <00:00:37.951>you. <00:00:37.952>Let's <00:00:37.953>cheer <00:00:37.955>back. <00:00:37.956>Give <00:00:37.957>a <00:00:37.959>big 00:00:37.960 --> 00:00:40.030 align:start position:0% <00:00:37.960>Thank <00:00:38.060>you. <00:00:38.160>Let's <00:00:38.260>cheer <00:00:38.360>back. <00:00:38.460>Give <00:00:38.560>a <00:00:38.660>big <00:00:38.760>round <00:00:38.860>of <00:00:38.960>applause <00:00:39.060>for <00:00:39.160>them. <00:00:39.260>Let's <00:00:39.360>hear 00:00:40.030 --> 00:00:40.040 align:start position:0% <00:00:40.030>round <00:00:40.031>of <00:00:40.033>applause <00:00:40.034>for <00:00:40.036>them. <00:00:40.037>Let's <00:00:40.039>hear 00:00:40.040 --> 00:00:41.550 align:start position:0% <00:00:40.040>round <00:00:40.234>of <00:00:40.428>applause <00:00:40.622>for <00:00:40.816>them. <00:00:41.010>Let's <00:00:41.204>hear <00:00:41.399>ourselves. 00:00:41.550 --> 00:00:41.560 align:start position:0% ourselves. 00:00:41.560 --> 00:00:43.220 align:start position:0% <00:00:41.560>ourselves. <00:00:42.960>Perfect. 00:00:43.220 --> 00:00:43.230 align:start position:0% Perfect. 00:00:43.230 --> 00:00:43.910 align:start position:0% <00:00:43.230>Perfect. <00:00:43.535>>> <00:00:43.842>[applause] 00:00:43.910 --> 00:00:43.920 align:start position:0% <00:00:43.910>>> <00:00:43.919>[applause] 00:00:43.920 --> 00:00:45.750 align:start position:0% <00:00:43.920>>> <00:00:44.060>[applause] <00:00:44.200>>> <00:00:44.340>All <00:00:44.480>right, <00:00:44.620>for <00:00:44.760>the <00:00:44.900>next <00:00:45.040>session <00:00:45.180>we <00:00:45.320>have 00:00:45.750 --> 00:00:45.760 align:start position:0% <00:00:45.750>>> <00:00:45.751>All <00:00:45.752>right, <00:00:45.753>for <00:00:45.754>the <00:00:45.755>next <00:00:45.756>session <00:00:45.757>we <00:00:45.759>have 00:00:45.760 --> 00:00:49.110 align:start position:0% <00:00:45.760>>> <00:00:45.853>All <00:00:45.946>right, <00:00:46.040>for <00:00:46.133>the <00:00:46.226>next <00:00:46.320>session <00:00:46.413>we <00:00:46.506>have <00:00:46.599>Kesha <00:00:46.693>Mikhailov <00:00:46.786>and <00:00:46.879>he's <00:00:46.973>going <00:00:47.066>to <00:00:47.160>tell 00:00:49.110 --> 00:00:49.120 align:start position:0% <00:00:49.110>Kesha <00:00:49.111>Mikhailov <00:00:49.113>and <00:00:49.114>he's <00:00:49.116>going <00:00:49.117>to <00:00:49.119>tell 00:00:49.120 --> 00:00:53.190 align:start position:0% <00:00:49.120>Kesha <00:00:49.213>Mikhailov <00:00:49.306>and <00:00:49.400>he's <00:00:49.493>going <00:00:49.586>to <00:00:49.680>tell <00:00:49.773>us <00:00:49.866>how <00:00:49.959>he <00:00:50.053>teaches <00:00:50.146>an <00:00:50.239>AI <00:00:50.333>LLM <00:00:50.426>to <00:00:50.519>review 00:00:53.190 --> 00:00:53.200 align:start position:0% <00:00:53.190>us <00:00:53.191>how <00:00:53.192>he <00:00:53.193>teaches <00:00:53.194>an <00:00:53.195>AI <00:00:53.196>LLM <00:00:53.197>to <00:00:53.199>review 00:00:53.200 --> 00:00:55.750 align:start position:0% <00:00:53.200>us <00:00:53.287>how <00:00:53.375>he <00:00:53.462>teaches <00:00:53.550>an <00:00:53.637>AI <00:00:53.725>LLM <00:00:53.812>to <00:00:53.900>review <00:00:53.987>code. <00:00:54.075>Not <00:00:54.162>just <00:00:54.250>like <00:00:54.337>a <00:00:54.425>beginner, <00:00:54.512>not <00:00:54.600>just 00:00:55.750 --> 00:00:55.760 align:start position:0% <00:00:55.750>code. <00:00:55.751>Not <00:00:55.752>just <00:00:55.753>like <00:00:55.755>a <00:00:55.756>beginner, <00:00:55.757>not <00:00:55.759>just 00:00:55.760 --> 00:00:57.870 align:start position:0% <00:00:55.760>code. <00:00:55.860>Not <00:00:55.960>just <00:00:56.059>like <00:00:56.160>a <00:00:56.260>beginner, <00:00:56.360>not <00:00:56.460>just <00:00:56.559>like <00:00:56.660>a <00:00:56.760>junior, <00:00:56.860>but <00:00:56.960>like <00:00:57.059>a <00:00:57.160>senior 00:00:57.870 --> 00:00:57.880 align:start position:0% <00:00:57.870>like <00:00:57.871>a <00:00:57.873>junior, <00:00:57.874>but <00:00:57.876>like <00:00:57.877>a <00:00:57.879>senior 00:00:57.880 --> 00:01:02.070 align:start position:0% <00:00:57.880>like <00:00:57.996>a <00:00:58.113>junior, <00:00:58.230>but <00:00:58.346>like <00:00:58.463>a <00:00:58.580>senior <00:00:58.696>developer. <00:00:58.813>A <00:00:58.930>super <00:00:59.046>interesting <00:00:59.163>topic <00:00:59.280>and 00:01:02.070 --> 00:01:02.080 align:start position:0% <00:01:02.070>developer. <00:01:02.071>A <00:01:02.073>super <00:01:02.075>interesting <00:01:02.077>topic <00:01:02.079>and 00:01:02.080 --> 00:01:02.710 align:start position:0% <00:01:02.080>developer. <00:01:02.174>A <00:01:02.269>super <00:01:02.363>interesting <00:01:02.458>topic <00:01:02.552>and <00:01:02.647>um 00:01:02.710 --> 00:01:02.720 align:start position:0% um 00:01:02.720 --> 00:01:05.189 align:start position:0% <00:01:02.720>um <00:01:02.875>Kesha <00:01:03.031>said <00:01:03.186>he <00:01:03.342>might <00:01:03.497>not <00:01:03.653>have <00:01:03.808>time <00:01:03.964>for <00:01:04.120>a 00:01:05.189 --> 00:01:05.199 align:start position:0% <00:01:05.188>Kesha <00:01:05.190>said <00:01:05.191>he <00:01:05.192>might <00:01:05.193>not <00:01:05.194>have <00:01:05.195>time <00:01:05.196>for <00:01:05.197>a 00:01:05.199 --> 00:01:07.110 align:start position:0% <00:01:05.199>Kesha <00:01:05.286>said <00:01:05.373>he <00:01:05.461>might <00:01:05.548>not <00:01:05.636>have <00:01:05.724>time <00:01:05.811>for <00:01:05.899>a <00:01:05.986>Q&A <00:01:06.074>afterwards. <00:01:06.161>So <00:01:06.249>you <00:01:06.336>don't <00:01:06.423>need <00:01:06.511>to <00:01:06.599>ask 00:01:07.110 --> 00:01:07.120 align:start position:0% <00:01:07.110>Q&A <00:01:07.111>afterwards. <00:01:07.112>So <00:01:07.113>you <00:01:07.115>don't <00:01:07.116>need <00:01:07.117>to <00:01:07.119>ask 00:01:07.120 --> 00:01:09.030 align:start position:0% <00:01:07.120>Q&A <00:01:07.220>afterwards. <00:01:07.320>So <00:01:07.420>you <00:01:07.520>don't <00:01:07.620>need <00:01:07.720>to <00:01:07.820>ask <00:01:07.920>questions, <00:01:08.020>but <00:01:08.120>you <00:01:08.220>can <00:01:08.320>just <00:01:08.420>approach <00:01:08.520>him 00:01:09.030 --> 00:01:09.040 align:start position:0% <00:01:09.030>questions, <00:01:09.031>but <00:01:09.033>you <00:01:09.034>can <00:01:09.036>just <00:01:09.037>approach <00:01:09.038>him 00:01:09.040 --> 00:01:11.510 align:start position:0% <00:01:09.039>questions, <00:01:09.147>but <00:01:09.255>you <00:01:09.363>can <00:01:09.470>just <00:01:09.578>approach <00:01:09.686>him <00:01:09.793>afterwards <00:01:09.901>and <00:01:10.009>yeah, <00:01:10.116>talk <00:01:10.224>to <00:01:10.332>him <00:01:10.440>about 00:01:11.510 --> 00:01:11.520 align:start position:0% <00:01:11.510>afterwards <00:01:11.511>and <00:01:11.513>yeah, <00:01:11.514>talk <00:01:11.516>to <00:01:11.517>him <00:01:11.518>about 00:01:11.520 --> 00:01:12.470 align:start position:0% <00:01:11.520>afterwards <00:01:11.642>and <00:01:11.764>yeah, <00:01:11.886>talk <00:01:12.008>to <00:01:12.130>him <00:01:12.252>about <00:01:12.375>stuff. 00:01:12.470 --> 00:01:12.480 align:start position:0% stuff. 00:01:12.480 --> 00:01:14.190 align:start position:0% <00:01:12.480>stuff. <00:01:12.655>All <00:01:12.830>right, <00:01:13.005>so <00:01:13.180>give <00:01:13.355>a <00:01:13.530>big <00:01:13.705>round <00:01:13.880>of 00:01:14.190 --> 00:01:14.200 align:start position:0% <00:01:14.190>All <00:01:14.191>right, <00:01:14.192>so <00:01:14.193>give <00:01:14.195>a <00:01:14.196>big <00:01:14.197>round <00:01:14.199>of 00:01:14.200 --> 00:01:17.280 align:start position:0% <00:01:14.200>All <00:01:14.327>right, <00:01:14.454>so <00:01:14.581>give <00:01:14.709>a <00:01:14.836>big <00:01:14.963>round <00:01:15.090>of <00:01:15.218>applause <00:01:15.345>please <00:01:15.472>for <00:01:15.600>Kesha. 00:01:17.280 --> 00:01:17.290 align:start position:0% <00:01:17.280>applause <00:01:17.283>please <00:01:17.286>for <00:01:17.288>Kesha. 00:01:17.290 --> 00:01:25.230 align:start position:0% <00:01:17.289>applause <00:01:17.570>please <00:01:17.850>for <00:01:18.130>Kesha. <00:01:18.410>>> <00:01:18.690>[music] 00:01:25.240 --> 00:01:27.190 align:start position:0% <00:01:25.240>>> <00:01:25.473>Great. <00:01:25.706>Uh <00:01:25.940>welcome <00:01:26.173>everyone. <00:01:26.406>Yeah, <00:01:26.640>we're 00:01:27.190 --> 00:01:27.200 align:start position:0% <00:01:27.190>>> <00:01:27.191>Great. <00:01:27.193>Uh <00:01:27.194>welcome <00:01:27.196>everyone. <00:01:27.197>Yeah, <00:01:27.199>we're 00:01:27.200 --> 00:01:28.630 align:start position:0% <00:01:27.200>>> <00:01:27.299>Great. <00:01:27.398>Uh <00:01:27.497>welcome <00:01:27.596>everyone. <00:01:27.695>Yeah, <00:01:27.794>we're <00:01:27.893>going <00:01:27.992>to <00:01:28.091>talk <00:01:28.190>about <00:01:28.289>teaching <00:01:28.387>LLM <00:01:28.487>to 00:01:28.630 --> 00:01:28.640 align:start position:0% <00:01:28.630>going <00:01:28.631>to <00:01:28.633>talk <00:01:28.634>about <00:01:28.636>teaching <00:01:28.637>LLM <00:01:28.639>to 00:01:28.640 --> 00:01:30.990 align:start position:0% <00:01:28.640>going <00:01:28.747>to <00:01:28.855>talk <00:01:28.963>about <00:01:29.070>teaching <00:01:29.178>LLM <00:01:29.286>to <00:01:29.393>review <00:01:29.501>code <00:01:29.609>like <00:01:29.716>a <00:01:29.824>senior <00:01:29.932>engineer <00:01:30.040>or 00:01:30.990 --> 00:01:31.000 align:start position:0% <00:01:30.990>review <00:01:30.991>code <00:01:30.993>like <00:01:30.994>a <00:01:30.996>senior <00:01:30.997>engineer <00:01:30.999>or 00:01:31.000 --> 00:01:32.990 align:start position:0% <00:01:31.000>review <00:01:31.100>code <00:01:31.200>like <00:01:31.300>a <00:01:31.400>senior <00:01:31.500>engineer <00:01:31.600>or <00:01:31.700>maybe <00:01:31.800>even <00:01:31.900>approve <00:01:32.000>the <00:01:32.100>code <00:01:32.200>as <00:01:32.300>a <00:01:32.400>senior 00:01:32.990 --> 00:01:33.000 align:start position:0% <00:01:32.990>maybe <00:01:32.991>even <00:01:32.992>approve <00:01:32.993>the <00:01:32.995>code <00:01:32.996>as <00:01:32.997>a <00:01:32.999>senior 00:01:33.000 --> 00:01:34.790 align:start position:0% <00:01:33.000>maybe <00:01:33.100>even <00:01:33.200>approve <00:01:33.300>the <00:01:33.400>code <00:01:33.500>as <00:01:33.600>a <00:01:33.700>senior <00:01:33.800>engineer. <00:01:33.900>That <00:01:34.000>sounds <00:01:34.100>that <00:01:34.200>sounds <00:01:34.300>like <00:01:34.400>a 00:01:34.790 --> 00:01:34.800 align:start position:0% <00:01:34.789>engineer. <00:01:34.791>That <00:01:34.792>sounds <00:01:34.794>that <00:01:34.795>sounds <00:01:34.797>like <00:01:34.798>a 00:01:34.800 --> 00:01:36.670 align:start position:0% <00:01:34.800>engineer. <00:01:34.927>That <00:01:35.054>sounds <00:01:35.181>that <00:01:35.309>sounds <00:01:35.436>like <00:01:35.563>a <00:01:35.690>different <00:01:35.818>ball <00:01:35.945>game, <00:01:36.072>isn't <00:01:36.200>it? 00:01:36.670 --> 00:01:36.680 align:start position:0% <00:01:36.670>different <00:01:36.672>ball <00:01:36.674>game, <00:01:36.676>isn't <00:01:36.679>it? 00:01:36.680 --> 00:01:38.550 align:start position:0% <00:01:36.680>different <00:01:36.787>ball <00:01:36.895>game, <00:01:37.003>isn't <00:01:37.110>it? <00:01:37.218>So <00:01:37.326>my <00:01:37.433>whole <00:01:37.541>talk <00:01:37.649>is <00:01:37.756>going <00:01:37.864>to <00:01:37.972>be <00:01:38.080>trying 00:01:38.550 --> 00:01:38.560 align:start position:0% <00:01:38.550>So <00:01:38.551>my <00:01:38.552>whole <00:01:38.553>talk <00:01:38.554>is <00:01:38.555>going <00:01:38.556>to <00:01:38.557>be <00:01:38.559>trying 00:01:38.560 --> 00:01:40.710 align:start position:0% <00:01:38.560>So <00:01:38.653>my <00:01:38.746>whole <00:01:38.840>talk <00:01:38.933>is <00:01:39.026>going <00:01:39.120>to <00:01:39.213>be <00:01:39.306>trying <00:01:39.400>to <00:01:39.493>convince <00:01:39.586>you <00:01:39.680>that <00:01:39.773>building <00:01:39.866>agent <00:01:39.960>AI 00:01:40.710 --> 00:01:40.720 align:start position:0% <00:01:40.710>to <00:01:40.711>convince <00:01:40.713>you <00:01:40.714>that <00:01:40.716>building <00:01:40.717>agent <00:01:40.719>AI 00:01:40.720 --> 00:01:43.110 align:start position:0% <00:01:40.720>to <00:01:40.827>convince <00:01:40.935>you <00:01:41.043>that <00:01:41.150>building <00:01:41.258>agent <00:01:41.366>AI <00:01:41.473>agent <00:01:41.581>which <00:01:41.689>is <00:01:41.796>consistent <00:01:41.904>and <00:01:42.012>works <00:01:42.120>well 00:01:43.110 --> 00:01:43.120 align:start position:0% <00:01:43.110>agent <00:01:43.111>which <00:01:43.113>is <00:01:43.114>consistent <00:01:43.116>and <00:01:43.117>works <00:01:43.119>well 00:01:43.120 --> 00:01:44.470 align:start position:0% <00:01:43.120>agent <00:01:43.213>which <00:01:43.306>is <00:01:43.400>consistent <00:01:43.493>and <00:01:43.587>works <00:01:43.680>well <00:01:43.774>is <00:01:43.867>really <00:01:43.961>really <00:01:44.054>hard, <00:01:44.148>but <00:01:44.241>it <00:01:44.335>is 00:01:44.470 --> 00:01:44.480 align:start position:0% <00:01:44.470>is <00:01:44.471>really <00:01:44.473>really <00:01:44.474>hard, <00:01:44.476>but <00:01:44.477>it <00:01:44.478>is 00:01:44.480 --> 00:01:46.110 align:start position:0% <00:01:44.479>is <00:01:44.596>really <00:01:44.713>really <00:01:44.829>hard, <00:01:44.946>but <00:01:45.063>it <00:01:45.179>is <00:01:45.296>possible. <00:01:45.413>So <00:01:45.529>there <00:01:45.646>will <00:01:45.763>be <00:01:45.880>some 00:01:46.110 --> 00:01:46.120 align:start position:0% <00:01:46.110>possible. <00:01:46.111>So <00:01:46.113>there <00:01:46.115>will <00:01:46.117>be <00:01:46.119>some 00:01:46.120 --> 00:01:47.710 align:start position:0% <00:01:46.120>possible. <00:01:46.260>So <00:01:46.400>there <00:01:46.540>will <00:01:46.680>be <00:01:46.820>some <00:01:46.960>confidential <00:01:47.100>material, <00:01:47.240>so <00:01:47.380>put <00:01:47.520>your 00:01:47.710 --> 00:01:47.720 align:start position:0% <00:01:47.710>confidential <00:01:47.712>material, <00:01:47.714>so <00:01:47.716>put <00:01:47.719>your 00:01:47.720 --> 00:01:49.070 align:start position:0% <00:01:47.720>confidential <00:01:47.922>material, <00:01:48.125>so <00:01:48.327>put <00:01:48.530>your <00:01:48.732>phones <00:01:48.934>down. 00:01:49.070 --> 00:01:49.080 align:start position:0% <00:01:49.070>phones <00:01:49.079>down. 00:01:49.080 --> 00:01:50.750 align:start position:0% <00:01:49.080>phones <00:01:49.255>down. <00:01:49.429>We <00:01:49.605>have <00:01:49.780>to <00:01:49.955>stop <00:01:50.130>with <00:01:50.304>recording. <00:01:50.480>There 00:01:50.750 --> 00:01:50.760 align:start position:0% <00:01:50.750>We <00:01:50.751>have <00:01:50.753>to <00:01:50.754>stop <00:01:50.756>with <00:01:50.757>recording. <00:01:50.758>There 00:01:50.760 --> 00:01:52.230 align:start position:0% <00:01:50.759>We <00:01:50.842>have <00:01:50.925>to <00:01:51.008>stop <00:01:51.090>with <00:01:51.173>recording. <00:01:51.256>There <00:01:51.338>will <00:01:51.421>be <00:01:51.504>a <00:01:51.586>live <00:01:51.669>demo. <00:01:51.752>I'm <00:01:51.834>going <00:01:51.917>to <00:01:52.000>try <00:01:52.082>it 00:01:52.230 --> 00:01:52.240 align:start position:0% <00:01:52.229>will <00:01:52.231>be <00:01:52.232>a <00:01:52.232>live <00:01:52.234>demo. <00:01:52.235>I'm <00:01:52.236>going <00:01:52.237>to <00:01:52.238>try <00:01:52.239>it 00:01:52.240 --> 00:01:53.710 align:start position:0% <00:01:52.240>will <00:01:52.350>be <00:01:52.460>a <00:01:52.570>live <00:01:52.681>demo. <00:01:52.791>I'm <00:01:52.901>going <00:01:53.011>to <00:01:53.122>try <00:01:53.232>it <00:01:53.342>out <00:01:53.452>on <00:01:53.563>stage. 00:01:53.710 --> 00:01:53.720 align:start position:0% <00:01:53.710>out <00:01:53.714>on <00:01:53.719>stage. 00:01:53.720 --> 00:01:55.670 align:start position:0% <00:01:53.720>out <00:01:53.860>on <00:01:54.000>stage. <00:01:54.140>Uh <00:01:54.280>there <00:01:54.420>will <00:01:54.560>be <00:01:54.700>some <00:01:54.840>quotes <00:01:54.980>from <00:01:55.120>famous 00:01:55.670 --> 00:01:55.680 align:start position:0% <00:01:55.670>Uh <00:01:55.671>there <00:01:55.672>will <00:01:55.673>be <00:01:55.675>some <00:01:55.676>quotes <00:01:55.677>from <00:01:55.679>famous 00:01:55.680 --> 00:01:56.990 align:start position:0% <00:01:55.680>Uh <00:01:55.770>there <00:01:55.861>will <00:01:55.952>be <00:01:56.042>some <00:01:56.133>quotes <00:01:56.224>from <00:01:56.314>famous <00:01:56.405>leaders <00:01:56.496>in <00:01:56.586>the <00:01:56.677>industry, <00:01:56.768>so <00:01:56.859>pay 00:01:56.990 --> 00:01:57.000 align:start position:0% <00:01:56.990>leaders <00:01:56.991>in <00:01:56.993>the <00:01:56.995>industry, <00:01:56.997>so <00:01:56.999>pay 00:01:57.000 --> 00:01:58.270 align:start position:0% <00:01:57.000>leaders <00:01:57.103>in <00:01:57.207>the <00:01:57.311>industry, <00:01:57.415>so <00:01:57.519>pay <00:01:57.623>attention <00:01:57.727>for <00:01:57.831>those. <00:01:57.935>You're <00:01:58.039>going <00:01:58.143>to 00:01:58.270 --> 00:01:58.280 align:start position:0% <00:01:58.270>attention <00:01:58.271>for <00:01:58.273>those. <00:01:58.275>You're <00:01:58.277>going <00:01:58.279>to 00:01:58.280 --> 00:01:59.790 align:start position:0% <00:01:58.280>attention <00:01:58.384>for <00:01:58.489>those. <00:01:58.593>You're <00:01:58.698>going <00:01:58.802>to <00:01:58.907>You're <00:01:59.011>going <00:01:59.116>to <00:01:59.220>might <00:01:59.325>want <00:01:59.429>to <00:01:59.534>write <00:01:59.639>them 00:01:59.790 --> 00:01:59.800 align:start position:0% <00:01:59.789>You're <00:01:59.791>going <00:01:59.792>to <00:01:59.793>might <00:01:59.795>want <00:01:59.796>to <00:01:59.797>write <00:01:59.798>them 00:01:59.800 --> 00:02:02.990 align:start position:0% <00:01:59.800>You're <00:01:59.893>going <00:01:59.986>to <00:02:00.080>might <00:02:00.173>want <00:02:00.266>to <00:02:00.360>write <00:02:00.453>them <00:02:00.546>down. <00:02:00.640>And <00:02:00.733>I'm <00:02:00.826>going <00:02:00.920>to <00:02:01.013>have <00:02:01.106>120 <00:02:01.200>slides. 00:02:02.990 --> 00:02:03.000 align:start position:0% <00:02:02.990>down. <00:02:02.991>And <00:02:02.992>I'm <00:02:02.993>going <00:02:02.995>to <00:02:02.996>have <00:02:02.997>120 <00:02:02.999>slides. 00:02:03.000 --> 00:02:04.950 align:start position:0% <00:02:03.000>down. <00:02:03.087>And <00:02:03.175>I'm <00:02:03.262>going <00:02:03.350>to <00:02:03.437>have <00:02:03.525>120 <00:02:03.612>slides. <00:02:03.700>So, <00:02:03.787>if <00:02:03.875>we <00:02:03.962>get <00:02:04.050>lucky <00:02:04.137>and <00:02:04.225>I <00:02:04.312>get <00:02:04.400>overtime, 00:02:04.950 --> 00:02:04.960 align:start position:0% <00:02:04.950>So, <00:02:04.951>if <00:02:04.952>we <00:02:04.953>get <00:02:04.954>lucky <00:02:04.955>and <00:02:04.956>I <00:02:04.957>get <00:02:04.958>overtime, 00:02:04.960 --> 00:02:06.910 align:start position:0% <00:02:04.960>So, <00:02:05.053>if <00:02:05.146>we <00:02:05.240>get <00:02:05.333>lucky <00:02:05.426>and <00:02:05.520>I <00:02:05.613>get <00:02:05.706>overtime, <00:02:05.800>organizers <00:02:05.893>will <00:02:05.986>drag <00:02:06.080>me <00:02:06.173>on <00:02:06.266>stage <00:02:06.360>first 00:02:06.910 --> 00:02:06.920 align:start position:0% <00:02:06.910>organizers <00:02:06.911>will <00:02:06.913>drag <00:02:06.914>me <00:02:06.916>on <00:02:06.917>stage <00:02:06.919>first 00:02:06.920 --> 00:02:08.630 align:start position:0% <00:02:06.920>organizers <00:02:07.027>will <00:02:07.135>drag <00:02:07.243>me <00:02:07.350>on <00:02:07.458>stage <00:02:07.566>first <00:02:07.673>time <00:02:07.781>ever <00:02:07.889>and <00:02:07.996>we <00:02:08.104>are <00:02:08.212>developers. <00:02:08.320>So, 00:02:08.630 --> 00:02:08.640 align:start position:0% <00:02:08.630>time <00:02:08.631>ever <00:02:08.632>and <00:02:08.634>we <00:02:08.636>are <00:02:08.637>developers. <00:02:08.638>So, 00:02:08.640 --> 00:02:10.150 align:start position:0% <00:02:08.639>time <00:02:08.737>ever <00:02:08.834>and <00:02:08.931>we <00:02:09.028>are <00:02:09.125>developers. <00:02:09.222>So, <00:02:09.319>make <00:02:09.416>sure <00:02:09.513>that <00:02:09.610>you <00:02:09.707>stay <00:02:09.804>till <00:02:09.901>the <00:02:09.999>very 00:02:10.150 --> 00:02:10.160 align:start position:0% <00:02:10.150>make <00:02:10.151>sure <00:02:10.152>that <00:02:10.153>you <00:02:10.155>stay <00:02:10.156>till <00:02:10.157>the <00:02:10.158>very 00:02:10.160 --> 00:02:11.710 align:start position:0% <00:02:10.160>make <00:02:10.315>sure <00:02:10.470>that <00:02:10.625>you <00:02:10.780>stay <00:02:10.935>till <00:02:11.090>the <00:02:11.245>very <00:02:11.400>end, <00:02:11.555>okay? 00:02:11.710 --> 00:02:11.720 align:start position:0% <00:02:11.710>end, <00:02:11.719>okay? 00:02:11.720 --> 00:02:13.430 align:start position:0% <00:02:11.720>end, <00:02:11.875>okay? <00:02:12.031>So, <00:02:12.186>let's <00:02:12.342>keep <00:02:12.497>going. <00:02:12.653>Not <00:02:12.808>going <00:02:12.964>to <00:02:13.120>waste 00:02:13.430 --> 00:02:13.440 align:start position:0% <00:02:13.430>So, <00:02:13.431>let's <00:02:13.432>keep <00:02:13.433>going. <00:02:13.435>Not <00:02:13.436>going <00:02:13.437>to <00:02:13.439>waste 00:02:13.440 --> 00:02:15.070 align:start position:0% <00:02:13.440>So, <00:02:13.547>let's <00:02:13.655>keep <00:02:13.763>going. <00:02:13.870>Not <00:02:13.978>going <00:02:14.086>to <00:02:14.193>waste <00:02:14.301>your <00:02:14.409>time <00:02:14.516>trying <00:02:14.624>to <00:02:14.732>introduce <00:02:14.840>myself. 00:02:15.070 --> 00:02:15.080 align:start position:0% <00:02:15.070>your <00:02:15.071>time <00:02:15.073>trying <00:02:15.075>to <00:02:15.077>introduce <00:02:15.079>myself. 00:02:15.080 --> 00:02:16.430 align:start position:0% <00:02:15.080>your <00:02:15.173>time <00:02:15.266>trying <00:02:15.360>to <00:02:15.453>introduce <00:02:15.547>myself. <00:02:15.640>Instead, <00:02:15.734>I'm <00:02:15.827>going <00:02:15.921>to <00:02:16.014>tell <00:02:16.108>you <00:02:16.201>what <00:02:16.295>my 00:02:16.430 --> 00:02:16.440 align:start position:0% <00:02:16.430>Instead, <00:02:16.431>I'm <00:02:16.432>going <00:02:16.433>to <00:02:16.435>tell <00:02:16.436>you <00:02:16.437>what <00:02:16.439>my 00:02:16.440 --> 00:02:17.910 align:start position:0% <00:02:16.440>Instead, <00:02:16.541>I'm <00:02:16.643>going <00:02:16.745>to <00:02:16.847>tell <00:02:16.948>you <00:02:17.050>what <00:02:17.152>my <00:02:17.254>company <00:02:17.355>does <00:02:17.457>because <00:02:17.559>this <00:02:17.661>is <00:02:17.763>really 00:02:17.910 --> 00:02:17.920 align:start position:0% <00:02:17.910>company <00:02:17.911>does <00:02:17.913>because <00:02:17.915>this <00:02:17.917>is <00:02:17.919>really 00:02:17.920 --> 00:02:19.910 align:start position:0% <00:02:17.920>company <00:02:18.047>does <00:02:18.174>because <00:02:18.301>this <00:02:18.429>is <00:02:18.556>really <00:02:18.683>important <00:02:18.810>to <00:02:18.938>understand <00:02:19.065>why <00:02:19.192>building <00:02:19.320>AI 00:02:19.910 --> 00:02:19.920 align:start position:0% <00:02:19.910>important <00:02:19.911>to <00:02:19.913>understand <00:02:19.915>why <00:02:19.917>building <00:02:19.919>AI 00:02:19.920 --> 00:02:22.110 align:start position:0% <00:02:19.920>important <00:02:20.060>to <00:02:20.200>understand <00:02:20.340>why <00:02:20.480>building <00:02:20.620>AI <00:02:20.760>agent <00:02:20.900>is <00:02:21.040>really, <00:02:21.180>really <00:02:21.320>hard. 00:02:22.110 --> 00:02:22.120 align:start position:0% <00:02:22.110>agent <00:02:22.112>is <00:02:22.114>really, <00:02:22.116>really <00:02:22.119>hard. 00:02:22.120 --> 00:02:24.230 align:start position:0% <00:02:22.120>agent <00:02:22.236>is <00:02:22.353>really, <00:02:22.470>really <00:02:22.586>hard. <00:02:22.703>So, <00:02:22.820>we <00:02:22.936>built <00:02:23.053>Finn, <00:02:23.170>an <00:02:23.286>AI <00:02:23.403>agent, <00:02:23.520>of 00:02:24.230 --> 00:02:24.240 align:start position:0% <00:02:24.230>So, <00:02:24.231>we <00:02:24.232>built <00:02:24.233>Finn, <00:02:24.235>an <00:02:24.236>AI <00:02:24.237>agent, <00:02:24.239>of 00:02:24.240 --> 00:02:25.670 align:start position:0% <00:02:24.240>So, <00:02:24.331>we <00:02:24.423>built <00:02:24.515>Finn, <00:02:24.607>an <00:02:24.699>AI <00:02:24.791>agent, <00:02:24.883>of <00:02:24.975>course. <00:02:25.067>We <00:02:25.159>used <00:02:25.251>to <00:02:25.343>be <00:02:25.435>called <00:02:25.527>Intercom, 00:02:25.670 --> 00:02:25.680 align:start position:0% <00:02:25.670>course. <00:02:25.671>We <00:02:25.673>used <00:02:25.674>to <00:02:25.676>be <00:02:25.677>called <00:02:25.679>Intercom, 00:02:25.680 --> 00:02:27.710 align:start position:0% <00:02:25.680>course. <00:02:25.773>We <00:02:25.866>used <00:02:25.960>to <00:02:26.053>be <00:02:26.146>called <00:02:26.240>Intercom, <00:02:26.333>but <00:02:26.426>we <00:02:26.520>have <00:02:26.613>so <00:02:26.706>much <00:02:26.800>trust <00:02:26.893>in <00:02:26.986>our <00:02:27.080>agent 00:02:27.710 --> 00:02:27.720 align:start position:0% <00:02:27.710>but <00:02:27.711>we <00:02:27.712>have <00:02:27.713>so <00:02:27.714>much <00:02:27.715>trust <00:02:27.716>in <00:02:27.717>our <00:02:27.719>agent 00:02:27.720 --> 00:02:29.310 align:start position:0% <00:02:27.720>but <00:02:27.813>we <00:02:27.906>have <00:02:28.000>so <00:02:28.093>much <00:02:28.186>trust <00:02:28.280>in <00:02:28.373>our <00:02:28.466>agent <00:02:28.560>that <00:02:28.653>we <00:02:28.746>renamed <00:02:28.840>the <00:02:28.933>whole <00:02:29.026>company <00:02:29.120>after 00:02:29.310 --> 00:02:29.320 align:start position:0% <00:02:29.310>that <00:02:29.311>we <00:02:29.313>renamed <00:02:29.314>the <00:02:29.316>whole <00:02:29.317>company <00:02:29.319>after 00:02:29.320 --> 00:02:30.949 align:start position:0% <00:02:29.320>that <00:02:29.420>we <00:02:29.519>renamed <00:02:29.620>the <00:02:29.720>whole <00:02:29.820>company <00:02:29.920>after <00:02:30.019>Finn. <00:02:30.120>So, <00:02:30.220>what <00:02:30.320>is <00:02:30.420>Finn? <00:02:30.519>Finn <00:02:30.620>is <00:02:30.720>a 00:02:30.949 --> 00:02:30.959 align:start position:0% <00:02:30.949>Finn. <00:02:30.950>So, <00:02:30.951>what <00:02:30.952>is <00:02:30.954>Finn? <00:02:30.955>Finn <00:02:30.956>is <00:02:30.958>a 00:02:30.959 --> 00:02:33.190 align:start position:0% <00:02:30.959>Finn. <00:02:31.066>So, <00:02:31.174>what <00:02:31.282>is <00:02:31.389>Finn? <00:02:31.497>Finn <00:02:31.605>is <00:02:31.712>a <00:02:31.820>customer <00:02:31.928>agent. <00:02:32.035>Whenever <00:02:32.143>your <00:02:32.251>end <00:02:32.359>users 00:02:33.190 --> 00:02:33.200 align:start position:0% <00:02:33.190>customer <00:02:33.191>agent. <00:02:33.193>Whenever <00:02:33.195>your <00:02:33.197>end <00:02:33.198>users 00:02:33.200 --> 00:02:35.110 align:start position:0% <00:02:33.200>customer <00:02:33.327>agent. <00:02:33.454>Whenever <00:02:33.581>your <00:02:33.709>end <00:02:33.836>users <00:02:33.963>have <00:02:34.090>questions <00:02:34.218>to <00:02:34.345>your <00:02:34.472>business, <00:02:34.600>Finn 00:02:35.110 --> 00:02:35.120 align:start position:0% <00:02:35.110>have <00:02:35.111>questions <00:02:35.113>to <00:02:35.115>your <00:02:35.117>business, <00:02:35.119>Finn 00:02:35.120 --> 00:02:36.510 align:start position:0% <00:02:35.120>have <00:02:35.233>questions <00:02:35.347>to <00:02:35.461>your <00:02:35.574>business, <00:02:35.688>Finn <00:02:35.802>can <00:02:35.916>answer <00:02:36.029>those <00:02:36.143>questions <00:02:36.257>on <00:02:36.370>your 00:02:36.510 --> 00:02:36.520 align:start position:0% <00:02:36.510>can <00:02:36.511>answer <00:02:36.513>those <00:02:36.515>questions <00:02:36.517>on <00:02:36.519>your 00:02:36.520 --> 00:02:37.510 align:start position:0% <00:02:36.520>can <00:02:36.668>answer <00:02:36.817>those <00:02:36.965>questions <00:02:37.114>on <00:02:37.262>your <00:02:37.411>behalf. 00:02:37.510 --> 00:02:37.520 align:start position:0% behalf. 00:02:37.520 --> 00:02:38.830 align:start position:0% <00:02:37.520>behalf. <00:02:37.716>So, <00:02:37.913>whenever <00:02:38.109>Finn <00:02:38.305>has <00:02:38.502>a <00:02:38.698>conversation 00:02:38.830 --> 00:02:38.840 align:start position:0% <00:02:38.829>So, <00:02:38.831>whenever <00:02:38.833>Finn <00:02:38.835>has <00:02:38.837>a <00:02:38.839>conversation 00:02:38.840 --> 00:02:40.910 align:start position:0% <00:02:38.840>So, <00:02:38.956>whenever <00:02:39.073>Finn <00:02:39.190>has <00:02:39.306>a <00:02:39.423>conversation <00:02:39.540>with <00:02:39.656>an <00:02:39.773>end <00:02:39.890>user, <00:02:40.006>if <00:02:40.123>that <00:02:40.240>conversation 00:02:40.910 --> 00:02:40.920 align:start position:0% <00:02:40.910>with <00:02:40.911>an <00:02:40.913>end <00:02:40.914>user, <00:02:40.916>if <00:02:40.917>that <00:02:40.919>conversation 00:02:40.920 --> 00:02:43.110 align:start position:0% <00:02:40.920>with <00:02:41.020>an <00:02:41.120>end <00:02:41.220>user, <00:02:41.320>if <00:02:41.420>that <00:02:41.520>conversation <00:02:41.620>is <00:02:41.720>answered <00:02:41.820>and <00:02:41.920>Finn <00:02:42.020>is <00:02:42.120>able <00:02:42.220>to <00:02:42.320>make 00:02:43.110 --> 00:02:43.120 align:start position:0% <00:02:43.110>is <00:02:43.111>answered <00:02:43.112>and <00:02:43.113>Finn <00:02:43.115>is <00:02:43.116>able <00:02:43.117>to <00:02:43.119>make 00:02:43.120 --> 00:02:44.550 align:start position:0% <00:02:43.120>is <00:02:43.211>answered <00:02:43.303>and <00:02:43.395>Finn <00:02:43.487>is <00:02:43.579>able <00:02:43.671>to <00:02:43.763>make <00:02:43.855>that <00:02:43.947>user <00:02:44.039>happy, <00:02:44.131>then <00:02:44.223>we <00:02:44.315>consider <00:02:44.407>that 00:02:44.550 --> 00:02:44.560 align:start position:0% <00:02:44.550>that <00:02:44.551>user <00:02:44.553>happy, <00:02:44.554>then <00:02:44.556>we <00:02:44.557>consider <00:02:44.559>that 00:02:44.560 --> 00:02:46.590 align:start position:0% <00:02:44.560>that <00:02:44.700>user <00:02:44.840>happy, <00:02:44.980>then <00:02:45.120>we <00:02:45.260>consider <00:02:45.400>that <00:02:45.540>conversation <00:02:45.680>as <00:02:45.820>being <00:02:45.960>resolved. 00:02:46.590 --> 00:02:46.600 align:start position:0% <00:02:46.590>conversation <00:02:46.593>as <00:02:46.596>being <00:02:46.599>resolved. 00:02:46.600 --> 00:02:48.990 align:start position:0% <00:02:46.600>conversation <00:02:46.739>as <00:02:46.880>being <00:02:47.019>resolved. <00:02:47.160>And <00:02:47.299>of <00:02:47.440>course, <00:02:47.579>the <00:02:47.720>most <00:02:47.859>important <00:02:48.000>metric 00:02:48.990 --> 00:02:49.000 align:start position:0% <00:02:48.990>And <00:02:48.991>of <00:02:48.993>course, <00:02:48.994>the <00:02:48.996>most <00:02:48.997>important <00:02:48.999>metric 00:02:49.000 --> 00:02:51.430 align:start position:0% <00:02:49.000>And <00:02:49.107>of <00:02:49.215>course, <00:02:49.323>the <00:02:49.430>most <00:02:49.538>important <00:02:49.646>metric <00:02:49.753>of <00:02:49.861>our <00:02:49.969>agent <00:02:50.076>is <00:02:50.184>the <00:02:50.292>resolution <00:02:50.400>rate. 00:02:51.430 --> 00:02:51.440 align:start position:0% <00:02:51.430>of <00:02:51.431>our <00:02:51.433>agent <00:02:51.434>is <00:02:51.436>the <00:02:51.437>resolution <00:02:51.439>rate. 00:02:51.440 --> 00:02:52.830 align:start position:0% <00:02:51.440>of <00:02:51.553>our <00:02:51.667>agent <00:02:51.781>is <00:02:51.894>the <00:02:52.008>resolution <00:02:52.122>rate. <00:02:52.236>Confidential <00:02:52.349>material, <00:02:52.463>put <00:02:52.577>your <00:02:52.690>phones 00:02:52.830 --> 00:02:52.840 align:start position:0% <00:02:52.829>Confidential <00:02:52.832>material, <00:02:52.834>put <00:02:52.836>your <00:02:52.839>phones 00:02:52.840 --> 00:02:54.910 align:start position:0% <00:02:52.840>Confidential <00:02:52.980>material, <00:02:53.120>put <00:02:53.260>your <00:02:53.400>phones <00:02:53.540>down. <00:02:53.680>Please, <00:02:53.820>don't <00:02:53.960>make <00:02:54.100>that <00:02:54.240>photo. 00:02:54.910 --> 00:02:54.920 align:start position:0% <00:02:54.910>down. <00:02:54.911>Please, <00:02:54.913>don't <00:02:54.915>make <00:02:54.917>that <00:02:54.919>photo. 00:02:54.920 --> 00:02:57.110 align:start position:0% <00:02:54.920>down. <00:02:55.027>Please, <00:02:55.135>don't <00:02:55.243>make <00:02:55.350>that <00:02:55.458>photo. <00:02:55.566>So, <00:02:55.673>we <00:02:55.781>were <00:02:55.889>able <00:02:55.996>to <00:02:56.104>drive <00:02:56.212>the <00:02:56.320>resolution 00:02:57.110 --> 00:02:57.120 align:start position:0% <00:02:57.110>So, <00:02:57.111>we <00:02:57.112>were <00:02:57.113>able <00:02:57.115>to <00:02:57.116>drive <00:02:57.117>the <00:02:57.119>resolution 00:02:57.120 --> 00:02:59.870 align:start position:0% <00:02:57.120>So, <00:02:57.207>we <00:02:57.295>were <00:02:57.382>able <00:02:57.470>to <00:02:57.557>drive <00:02:57.645>the <00:02:57.732>resolution <00:02:57.820>rate <00:02:57.907>to <00:02:57.995>76% <00:02:58.082>over <00:02:58.170>the <00:02:58.257>last <00:02:58.345>3 <00:02:58.432>years. <00:02:58.520>It's 00:02:59.870 --> 00:02:59.880 align:start position:0% <00:02:59.870>rate <00:02:59.871>to <00:02:59.872>76% <00:02:59.873>over <00:02:59.874>the <00:02:59.875>last <00:02:59.876>3 <00:02:59.877>years. <00:02:59.879>It's 00:02:59.880 --> 00:03:02.430 align:start position:0% <00:02:59.880>rate <00:02:59.980>to <00:03:00.079>76% <00:03:00.180>over <00:03:00.280>the <00:03:00.380>last <00:03:00.480>3 <00:03:00.579>years. <00:03:00.680>It's <00:03:00.780>growing <00:03:00.880>consistently <00:03:00.980>on <00:03:01.079>average <00:03:01.180>by <00:03:01.280>1% 00:03:02.430 --> 00:03:02.440 align:start position:0% <00:03:02.430>growing <00:03:02.431>consistently <00:03:02.433>on <00:03:02.435>average <00:03:02.437>by <00:03:02.439>1% 00:03:02.440 --> 00:03:03.470 align:start position:0% <00:03:02.440>growing <00:03:02.524>consistently <00:03:02.608>on <00:03:02.692>average <00:03:02.777>by <00:03:02.861>1% <00:03:02.945>every <00:03:03.029>month. <00:03:03.114>This <00:03:03.198>is <00:03:03.282>a <00:03:03.367>massive 00:03:03.470 --> 00:03:03.480 align:start position:0% <00:03:03.470>every <00:03:03.471>month. <00:03:03.473>This <00:03:03.475>is <00:03:03.477>a <00:03:03.478>massive 00:03:03.480 --> 00:03:05.830 align:start position:0% <00:03:03.480>every <00:03:03.679>month. <00:03:03.880>This <00:03:04.079>is <00:03:04.280>a <00:03:04.480>massive <00:03:04.679>achievement, <00:03:04.880>right? 00:03:05.830 --> 00:03:05.840 align:start position:0% <00:03:05.830>achievement, <00:03:05.839>right? 00:03:05.840 --> 00:03:07.150 align:start position:0% <00:03:05.840>achievement, <00:03:05.971>right? <00:03:06.102>How <00:03:06.233>do <00:03:06.364>we <00:03:06.495>do <00:03:06.626>this? <00:03:06.757>Well, <00:03:06.888>there's <00:03:07.019>no 00:03:07.150 --> 00:03:07.160 align:start position:0% <00:03:07.150>How <00:03:07.151>do <00:03:07.152>we <00:03:07.153>do <00:03:07.155>this? <00:03:07.156>Well, <00:03:07.157>there's <00:03:07.159>no 00:03:07.160 --> 00:03:09.190 align:start position:0% <00:03:07.160>How <00:03:07.260>do <00:03:07.359>we <00:03:07.460>do <00:03:07.560>this? <00:03:07.660>Well, <00:03:07.760>there's <00:03:07.859>no <00:03:07.960>secret <00:03:08.060>sauce. <00:03:08.160>We <00:03:08.260>have <00:03:08.359>dozens <00:03:08.460>and <00:03:08.560>dozens 00:03:09.190 --> 00:03:09.200 align:start position:0% <00:03:09.190>secret <00:03:09.191>sauce. <00:03:09.192>We <00:03:09.194>have <00:03:09.196>dozens <00:03:09.197>and <00:03:09.198>dozens 00:03:09.200 --> 00:03:11.030 align:start position:0% <00:03:09.200>secret <00:03:09.299>sauce. <00:03:09.399>We <00:03:09.500>have <00:03:09.600>dozens <00:03:09.700>and <00:03:09.799>dozens <00:03:09.899>of <00:03:10.000>AB <00:03:10.100>tests <00:03:10.200>in <00:03:10.299>production <00:03:10.399>at <00:03:10.500>any <00:03:10.600>given 00:03:11.030 --> 00:03:11.040 align:start position:0% <00:03:11.030>of <00:03:11.031>AB <00:03:11.032>tests <00:03:11.033>in <00:03:11.035>production <00:03:11.036>at <00:03:11.037>any <00:03:11.039>given 00:03:11.040 --> 00:03:12.949 align:start position:0% <00:03:11.040>of <00:03:11.133>AB <00:03:11.226>tests <00:03:11.320>in <00:03:11.413>production <00:03:11.506>at <00:03:11.600>any <00:03:11.693>given <00:03:11.786>point <00:03:11.880>in <00:03:11.973>time. <00:03:12.066>Every <00:03:12.160>AB <00:03:12.253>test <00:03:12.346>gives <00:03:12.440>you 00:03:12.949 --> 00:03:12.959 align:start position:0% <00:03:12.949>point <00:03:12.950>in <00:03:12.951>time. <00:03:12.952>Every <00:03:12.954>AB <00:03:12.955>test <00:03:12.956>gives <00:03:12.958>you 00:03:12.959 --> 00:03:14.470 align:start position:0% <00:03:12.959>point <00:03:13.063>in <00:03:13.168>time. <00:03:13.272>Every <00:03:13.377>AB <00:03:13.482>test <00:03:13.586>gives <00:03:13.691>you <00:03:13.795>like <00:03:13.900>maybe <00:03:14.005>a <00:03:14.109>decimal <00:03:14.214>percentage <00:03:14.318>point 00:03:14.470 --> 00:03:14.480 align:start position:0% <00:03:14.470>like <00:03:14.471>maybe <00:03:14.473>a <00:03:14.475>decimal <00:03:14.477>percentage <00:03:14.478>point 00:03:14.480 --> 00:03:15.790 align:start position:0% <00:03:14.480>like <00:03:14.578>maybe <00:03:14.676>a <00:03:14.774>decimal <00:03:14.873>percentage <00:03:14.971>point <00:03:15.069>improvement <00:03:15.167>and <00:03:15.266>you <00:03:15.364>have <00:03:15.462>you <00:03:15.560>sweat <00:03:15.659>those 00:03:15.790 --> 00:03:15.800 align:start position:0% <00:03:15.790>improvement <00:03:15.791>and <00:03:15.793>you <00:03:15.794>have <00:03:15.796>you <00:03:15.797>sweat <00:03:15.799>those 00:03:15.800 --> 00:03:17.390 align:start position:0% <00:03:15.800>improvement <00:03:15.900>and <00:03:16.000>you <00:03:16.100>have <00:03:16.200>you <00:03:16.300>sweat <00:03:16.400>those <00:03:16.500>AB <00:03:16.600>tests <00:03:16.700>over <00:03:16.800>and <00:03:16.900>over <00:03:17.000>again <00:03:17.100>and <00:03:17.200>stack 00:03:17.390 --> 00:03:17.400 align:start position:0% <00:03:17.390>AB <00:03:17.391>tests <00:03:17.392>over <00:03:17.393>and <00:03:17.395>over <00:03:17.396>again <00:03:17.397>and <00:03:17.399>stack 00:03:17.400 --> 00:03:18.949 align:start position:0% <00:03:17.400>AB <00:03:17.507>tests <00:03:17.614>over <00:03:17.721>and <00:03:17.828>over <00:03:17.936>again <00:03:18.043>and <00:03:18.150>stack <00:03:18.257>them <00:03:18.365>up <00:03:18.472>together <00:03:18.579>to <00:03:18.686>gather <00:03:18.794>that 00:03:18.949 --> 00:03:18.959 align:start position:0% <00:03:18.949>them <00:03:18.950>up <00:03:18.952>together <00:03:18.954>to <00:03:18.956>gather <00:03:18.958>that 00:03:18.959 --> 00:03:20.390 align:start position:0% <00:03:18.959>them <00:03:19.173>up <00:03:19.388>together <00:03:19.602>to <00:03:19.817>gather <00:03:20.032>that <00:03:20.246>improvement. 00:03:20.390 --> 00:03:20.400 align:start position:0% improvement. 00:03:20.400 --> 00:03:22.350 align:start position:0% <00:03:20.400>improvement. <00:03:20.575>But <00:03:20.750>not <00:03:20.925>only <00:03:21.100>that, <00:03:21.275>we <00:03:21.450>also <00:03:21.625>train <00:03:21.800>our 00:03:22.350 --> 00:03:22.360 align:start position:0% <00:03:22.350>But <00:03:22.351>not <00:03:22.352>only <00:03:22.353>that, <00:03:22.355>we <00:03:22.356>also <00:03:22.357>train <00:03:22.359>our 00:03:22.360 --> 00:03:24.229 align:start position:0% <00:03:22.360>But <00:03:22.460>not <00:03:22.560>only <00:03:22.660>that, <00:03:22.760>we <00:03:22.860>also <00:03:22.960>train <00:03:23.060>our <00:03:23.160>custom <00:03:23.260>models. <00:03:23.360>In <00:03:23.460>fact, <00:03:23.560>those <00:03:23.660>models <00:03:23.760>are 00:03:24.229 --> 00:03:24.239 align:start position:0% <00:03:24.228>custom <00:03:24.230>models. <00:03:24.232>In <00:03:24.233>fact, <00:03:24.234>those <00:03:24.236>models <00:03:24.238>are 00:03:24.239 --> 00:03:26.830 align:start position:0% <00:03:24.239>custom <00:03:24.379>models. <00:03:24.519>In <00:03:24.659>fact, <00:03:24.799>those <00:03:24.939>models <00:03:25.079>are <00:03:25.219>cheaper, <00:03:25.359>faster, <00:03:25.499>better, <00:03:25.639>hallucinate 00:03:26.830 --> 00:03:26.840 align:start position:0% <00:03:26.829>cheaper, <00:03:26.833>faster, <00:03:26.835>better, <00:03:26.839>hallucinate 00:03:26.840 --> 00:03:28.350 align:start position:0% <00:03:26.840>cheaper, <00:03:26.975>faster, <00:03:27.111>better, <00:03:27.247>hallucinate <00:03:27.383>less <00:03:27.519>than <00:03:27.655>all <00:03:27.791>the <00:03:27.927>frontier <00:03:28.063>models <00:03:28.198>for 00:03:28.350 --> 00:03:28.360 align:start position:0% <00:03:28.350>less <00:03:28.351>than <00:03:28.353>all <00:03:28.354>the <00:03:28.356>frontier <00:03:28.357>models <00:03:28.359>for 00:03:28.360 --> 00:03:30.509 align:start position:0% <00:03:28.360>less <00:03:28.500>than <00:03:28.640>all <00:03:28.780>the <00:03:28.920>frontier <00:03:29.060>models <00:03:29.200>for <00:03:29.340>our <00:03:29.480>customer <00:03:29.620>use <00:03:29.760>case. 00:03:30.509 --> 00:03:30.519 align:start position:0% <00:03:30.509>our <00:03:30.512>customer <00:03:30.515>use <00:03:30.518>case. 00:03:30.519 --> 00:03:31.830 align:start position:0% <00:03:30.519>our <00:03:30.617>customer <00:03:30.715>use <00:03:30.813>case. <00:03:30.912>And <00:03:31.010>you <00:03:31.108>might <00:03:31.207>ask <00:03:31.305>like, <00:03:31.403>why <00:03:31.502>are <00:03:31.600>we <00:03:31.698>so 00:03:31.830 --> 00:03:31.840 align:start position:0% <00:03:31.829>And <00:03:31.831>you <00:03:31.832>might <00:03:31.833>ask <00:03:31.834>like, <00:03:31.835>why <00:03:31.836>are <00:03:31.837>we <00:03:31.839>so 00:03:31.840 --> 00:03:33.470 align:start position:0% <00:03:31.840>And <00:03:31.940>you <00:03:32.040>might <00:03:32.140>ask <00:03:32.240>like, <00:03:32.340>why <00:03:32.440>are <00:03:32.540>we <00:03:32.640>so <00:03:32.740>obsessed <00:03:32.840>with <00:03:32.940>this <00:03:33.040>resolution <00:03:33.140>rate? <00:03:33.240>Or 00:03:33.470 --> 00:03:33.480 align:start position:0% <00:03:33.470>obsessed <00:03:33.471>with <00:03:33.473>this <00:03:33.475>resolution <00:03:33.477>rate? <00:03:33.478>Or 00:03:33.480 --> 00:03:34.750 align:start position:0% <00:03:33.480>obsessed <00:03:33.567>with <00:03:33.655>this <00:03:33.743>resolution <00:03:33.831>rate? <00:03:33.919>Or <00:03:34.007>why <00:03:34.095>is <00:03:34.183>that <00:03:34.271>such <00:03:34.359>a <00:03:34.447>big <00:03:34.535>deal? <00:03:34.623>Well, 00:03:34.750 --> 00:03:34.760 align:start position:0% <00:03:34.750>why <00:03:34.751>is <00:03:34.752>that <00:03:34.753>such <00:03:34.755>a <00:03:34.756>big <00:03:34.757>deal? <00:03:34.759>Well, 00:03:34.760 --> 00:03:36.509 align:start position:0% <00:03:34.760>why <00:03:34.867>is <00:03:34.975>that <00:03:35.083>such <00:03:35.190>a <00:03:35.298>big <00:03:35.406>deal? <00:03:35.513>Well, <00:03:35.621>because <00:03:35.729>we <00:03:35.836>have <00:03:35.944>value-based <00:03:36.052>pricing. <00:03:36.160>If 00:03:36.509 --> 00:03:36.519 align:start position:0% <00:03:36.509>because <00:03:36.510>we <00:03:36.512>have <00:03:36.514>value-based <00:03:36.516>pricing. <00:03:36.518>If 00:03:36.519 --> 00:03:38.030 align:start position:0% <00:03:36.519>because <00:03:36.623>we <00:03:36.728>have <00:03:36.832>value-based <00:03:36.937>pricing. <00:03:37.042>If <00:03:37.146>Finn <00:03:37.251>is <00:03:37.355>unable <00:03:37.460>to <00:03:37.565>make <00:03:37.669>your <00:03:37.774>end <00:03:37.878>user 00:03:38.030 --> 00:03:38.040 align:start position:0% <00:03:38.030>Finn <00:03:38.031>is <00:03:38.032>unable <00:03:38.033>to <00:03:38.035>make <00:03:38.036>your <00:03:38.037>end <00:03:38.039>user 00:03:38.040 --> 00:03:39.670 align:start position:0% <00:03:38.040>Finn <00:03:38.140>is <00:03:38.239>unable <00:03:38.340>to <00:03:38.440>make <00:03:38.540>your <00:03:38.640>end <00:03:38.739>user <00:03:38.840>happy <00:03:38.940>and <00:03:39.040>is <00:03:39.140>unable <00:03:39.239>to <00:03:39.340>resolve <00:03:39.440>that 00:03:39.670 --> 00:03:39.680 align:start position:0% <00:03:39.670>happy <00:03:39.671>and <00:03:39.673>is <00:03:39.674>unable <00:03:39.676>to <00:03:39.677>resolve <00:03:39.679>that 00:03:39.680 --> 00:03:41.350 align:start position:0% <00:03:39.680>happy <00:03:39.796>and <00:03:39.913>is <00:03:40.030>unable <00:03:40.146>to <00:03:40.263>resolve <00:03:40.380>that <00:03:40.496>conversation, <00:03:40.613>we're <00:03:40.730>not <00:03:40.846>going <00:03:40.963>to <00:03:41.080>charge 00:03:41.350 --> 00:03:41.360 align:start position:0% <00:03:41.350>conversation, <00:03:41.351>we're <00:03:41.353>not <00:03:41.355>going <00:03:41.357>to <00:03:41.359>charge 00:03:41.360 --> 00:03:43.430 align:start position:0% <00:03:41.360>conversation, <00:03:41.476>we're <00:03:41.593>not <00:03:41.710>going <00:03:41.826>to <00:03:41.943>charge <00:03:42.060>you <00:03:42.176>anything <00:03:42.293>at <00:03:42.410>all. <00:03:42.526>So, <00:03:42.643>we <00:03:42.760>literally 00:03:43.430 --> 00:03:43.440 align:start position:0% <00:03:43.430>you <00:03:43.431>anything <00:03:43.433>at <00:03:43.434>all. <00:03:43.436>So, <00:03:43.437>we <00:03:43.439>literally 00:03:43.440 --> 00:03:45.430 align:start position:0% <00:03:43.440>you <00:03:43.540>anything <00:03:43.640>at <00:03:43.740>all. <00:03:43.840>So, <00:03:43.940>we <00:03:44.040>literally <00:03:44.140>put <00:03:44.240>the <00:03:44.340>whole <00:03:44.440>business <00:03:44.540>on <00:03:44.640>the <00:03:44.740>line <00:03:44.840>that 00:03:45.430 --> 00:03:45.440 align:start position:0% <00:03:45.430>put <00:03:45.431>the <00:03:45.432>whole <00:03:45.433>business <00:03:45.435>on <00:03:45.436>the <00:03:45.437>line <00:03:45.439>that 00:03:45.440 --> 00:03:46.790 align:start position:0% <00:03:45.440>put <00:03:45.541>the <00:03:45.642>whole <00:03:45.743>business <00:03:45.845>on <00:03:45.946>the <00:03:46.047>line <00:03:46.148>that <00:03:46.250>is <00:03:46.351>attached <00:03:46.452>directly <00:03:46.553>to <00:03:46.655>the 00:03:46.790 --> 00:03:46.800 align:start position:0% <00:03:46.790>is <00:03:46.792>attached <00:03:46.794>directly <00:03:46.796>to <00:03:46.799>the 00:03:46.800 --> 00:03:49.509 align:start position:0% <00:03:46.800>is <00:03:46.975>attached <00:03:47.150>directly <00:03:47.325>to <00:03:47.500>the <00:03:47.675>effectiveness <00:03:47.850>of <00:03:48.025>our <00:03:48.200>agent. 00:03:49.509 --> 00:03:49.519 align:start position:0% <00:03:49.509>effectiveness <00:03:49.512>of <00:03:49.515>our <00:03:49.518>agent. 00:03:49.519 --> 00:03:50.830 align:start position:0% <00:03:49.519>effectiveness <00:03:49.636>of <00:03:49.754>our <00:03:49.872>agent. <00:03:49.990>So, <00:03:50.108>what <00:03:50.226>happened <00:03:50.344>to <00:03:50.462>the <00:03:50.580>business? <00:03:50.698>Well, 00:03:50.830 --> 00:03:50.840 align:start position:0% <00:03:50.829>So, <00:03:50.831>what <00:03:50.833>happened <00:03:50.834>to <00:03:50.835>the <00:03:50.837>business? <00:03:50.839>Well, 00:03:50.840 --> 00:03:52.470 align:start position:0% <00:03:50.840>So, <00:03:50.947>what <00:03:51.055>happened <00:03:51.163>to <00:03:51.270>the <00:03:51.378>business? <00:03:51.486>Well, <00:03:51.593>you <00:03:51.701>probably <00:03:51.809>saw <00:03:51.916>this <00:03:52.024>chart <00:03:52.132>from <00:03:52.240>Brian's 00:03:52.470 --> 00:03:52.480 align:start position:0% <00:03:52.470>you <00:03:52.471>probably <00:03:52.472>saw <00:03:52.474>this <00:03:52.476>chart <00:03:52.477>from <00:03:52.478>Brian's 00:03:52.480 --> 00:03:54.470 align:start position:0% <00:03:52.480>you <00:03:52.607>probably <00:03:52.734>saw <00:03:52.861>this <00:03:52.989>chart <00:03:53.116>from <00:03:53.243>Brian's <00:03:53.370>talk. <00:03:53.498>This <00:03:53.625>is <00:03:53.752>confidential <00:03:53.880>material. 00:03:54.470 --> 00:03:54.480 align:start position:0% <00:03:54.470>talk. <00:03:54.472>This <00:03:54.474>is <00:03:54.476>confidential <00:03:54.478>material. 00:03:54.480 --> 00:03:56.750 align:start position:0% <00:03:54.480>talk. <00:03:54.596>This <00:03:54.713>is <00:03:54.829>confidential <00:03:54.946>material. <00:03:55.063>Make <00:03:55.179>sure <00:03:55.296>no <00:03:55.413>any <00:03:55.530>photos, <00:03:55.646>okay? <00:03:55.763>So, <00:03:55.880>our 00:03:56.750 --> 00:03:56.760 align:start position:0% <00:03:56.750>Make <00:03:56.751>sure <00:03:56.752>no <00:03:56.753>any <00:03:56.755>photos, <00:03:56.756>okay? <00:03:56.757>So, <00:03:56.759>our 00:03:56.760 --> 00:03:58.870 align:start position:0% <00:03:56.760>Make <00:03:56.876>sure <00:03:56.993>no <00:03:57.109>any <00:03:57.226>photos, <00:03:57.343>okay? <00:03:57.459>So, <00:03:57.576>our <00:03:57.693>revenue <00:03:57.810>growth <00:03:57.926>rate <00:03:58.043>just <00:03:58.160>skyrocketed. 00:03:58.870 --> 00:03:58.880 align:start position:0% <00:03:58.870>revenue <00:03:58.872>growth <00:03:58.874>rate <00:03:58.876>just <00:03:58.879>skyrocketed. 00:03:58.880 --> 00:04:00.750 align:start position:0% <00:03:58.880>revenue <00:03:59.019>growth <00:03:59.160>rate <00:03:59.299>just <00:03:59.440>skyrocketed. <00:03:59.579>While <00:03:59.720>all <00:03:59.859>the <00:04:00.000>other <00:04:00.140>SaaS's <00:04:00.280>are 00:04:00.750 --> 00:04:00.760 align:start position:0% <00:04:00.750>While <00:04:00.751>all <00:04:00.753>the <00:04:00.755>other <00:04:00.757>SaaS's <00:04:00.759>are 00:04:00.760 --> 00:04:03.310 align:start position:0% <00:04:00.760>While <00:04:00.876>all <00:04:00.993>the <00:04:01.109>other <00:04:01.226>SaaS's <00:04:01.343>are <00:04:01.459>stagnating, <00:04:01.576>our <00:04:01.693>revenue <00:04:01.810>goes <00:04:01.926>up. <00:04:02.043>And <00:04:02.160>we 00:04:03.310 --> 00:04:03.320 align:start position:0% <00:04:03.310>stagnating, <00:04:03.311>our <00:04:03.313>revenue <00:04:03.314>goes <00:04:03.316>up. <00:04:03.317>And <00:04:03.319>we 00:04:03.320 --> 00:04:05.230 align:start position:0% <00:04:03.320>stagnating, <00:04:03.436>our <00:04:03.553>revenue <00:04:03.670>goes <00:04:03.786>up. <00:04:03.903>And <00:04:04.019>we <00:04:04.136>are <00:04:04.253>like <00:04:04.370>a <00:04:04.486>15-years-old <00:04:04.603>SaaS <00:04:04.720>company, 00:04:05.230 --> 00:04:05.240 align:start position:0% <00:04:05.230>are <00:04:05.231>like <00:04:05.233>a <00:04:05.235>15-years-old <00:04:05.237>SaaS <00:04:05.239>company, 00:04:05.240 --> 00:04:06.870 align:start position:0% <00:04:05.240>are <00:04:05.340>like <00:04:05.440>a <00:04:05.540>15-years-old <00:04:05.640>SaaS <00:04:05.740>company, <00:04:05.840>but <00:04:05.940>we <00:04:06.040>managed <00:04:06.140>to <00:04:06.240>turn <00:04:06.340>the <00:04:06.440>tide <00:04:06.540>and <00:04:06.640>and 00:04:06.870 --> 00:04:06.880 align:start position:0% <00:04:06.870>but <00:04:06.871>we <00:04:06.872>managed <00:04:06.873>to <00:04:06.874>turn <00:04:06.875>the <00:04:06.876>tide <00:04:06.877>and <00:04:06.879>and 00:04:06.880 --> 00:04:08.910 align:start position:0% <00:04:06.880>but <00:04:06.973>we <00:04:07.066>managed <00:04:07.160>to <00:04:07.253>turn <00:04:07.346>the <00:04:07.440>tide <00:04:07.533>and <00:04:07.626>and <00:04:07.720>grow <00:04:07.813>like <00:04:07.906>this. <00:04:08.000>This <00:04:08.093>is <00:04:08.186>super <00:04:08.280>rare. 00:04:08.910 --> 00:04:08.920 align:start position:0% <00:04:08.910>grow <00:04:08.911>like <00:04:08.912>this. <00:04:08.914>This <00:04:08.916>is <00:04:08.917>super <00:04:08.918>rare. 00:04:08.920 --> 00:04:10.630 align:start position:0% <00:04:08.920>grow <00:04:09.047>like <00:04:09.174>this. <00:04:09.301>This <00:04:09.429>is <00:04:09.556>super <00:04:09.683>rare. <00:04:09.810>Like, <00:04:09.938>no <00:04:10.065>one <00:04:10.192>does <00:04:10.320>that. 00:04:10.630 --> 00:04:10.640 align:start position:0% <00:04:10.630>Like, <00:04:10.632>no <00:04:10.634>one <00:04:10.636>does <00:04:10.638>that. 00:04:10.640 --> 00:04:11.590 align:start position:0% <00:04:10.640>Like, <00:04:10.725>no <00:04:10.810>one <00:04:10.896>does <00:04:10.982>that. <00:04:11.067>And <00:04:11.153>now <00:04:11.238>you're <00:04:11.324>probably <00:04:11.409>connecting <00:04:11.495>the 00:04:11.590 --> 00:04:11.600 align:start position:0% <00:04:11.590>And <00:04:11.591>now <00:04:11.593>you're <00:04:11.595>probably <00:04:11.597>connecting <00:04:11.599>the 00:04:11.600 --> 00:04:12.949 align:start position:0% <00:04:11.600>And <00:04:11.701>now <00:04:11.802>you're <00:04:11.903>probably <00:04:12.004>connecting <00:04:12.105>the <00:04:12.207>dots <00:04:12.308>and <00:04:12.409>asking <00:04:12.510>the <00:04:12.611>question <00:04:12.712>like, <00:04:12.814>why 00:04:12.949 --> 00:04:12.959 align:start position:0% <00:04:12.949>dots <00:04:12.950>and <00:04:12.952>asking <00:04:12.953>the <00:04:12.955>question <00:04:12.956>like, <00:04:12.958>why 00:04:12.959 --> 00:04:16.310 align:start position:0% <00:04:12.959>dots <00:04:13.059>and <00:04:13.159>asking <00:04:13.259>the <00:04:13.359>question <00:04:13.459>like, <00:04:13.559>why <00:04:13.659>the <00:04:13.759>hell <00:04:13.859>only <00:04:13.959>76%? <00:04:14.059>Can <00:04:14.159>Can't <00:04:14.259>you <00:04:14.359>do 00:04:16.310 --> 00:04:16.320 align:start position:0% <00:04:16.310>the <00:04:16.311>hell <00:04:16.312>only <00:04:16.313>76%? <00:04:16.315>Can <00:04:16.316>Can't <00:04:16.317>you <00:04:16.319>do 00:04:16.320 --> 00:04:18.030 align:start position:0% <00:04:16.320>the <00:04:16.436>hell <00:04:16.553>only <00:04:16.670>76%? <00:04:16.786>Can <00:04:16.903>Can't <00:04:17.019>you <00:04:17.136>do <00:04:17.253>better? <00:04:17.370>Like, <00:04:17.486>every <00:04:17.603>percentage <00:04:17.719>point 00:04:18.030 --> 00:04:18.040 align:start position:0% <00:04:18.029>better? <00:04:18.032>Like, <00:04:18.034>every <00:04:18.036>percentage <00:04:18.039>point 00:04:18.040 --> 00:04:20.430 align:start position:0% <00:04:18.040>better? <00:04:18.167>Like, <00:04:18.294>every <00:04:18.421>percentage <00:04:18.549>point <00:04:18.676>here <00:04:18.803>is <00:04:18.930>like <00:04:19.058>millions <00:04:19.185>in <00:04:19.312>revenue. <00:04:19.440>Right? 00:04:20.430 --> 00:04:20.440 align:start position:0% <00:04:20.430>here <00:04:20.431>is <00:04:20.433>like <00:04:20.434>millions <00:04:20.435>in <00:04:20.437>revenue. <00:04:20.439>Right? 00:04:20.440 --> 00:04:21.910 align:start position:0% <00:04:20.440>here <00:04:20.534>is <00:04:20.629>like <00:04:20.723>millions <00:04:20.817>in <00:04:20.912>revenue. <00:04:21.007>Right? <00:04:21.101>So, <00:04:21.196>surely <00:04:21.290>you <00:04:21.385>can <00:04:21.479>do <00:04:21.574>better. <00:04:21.668>But <00:04:21.763>turns 00:04:21.910 --> 00:04:21.920 align:start position:0% <00:04:21.910>So, <00:04:21.911>surely <00:04:21.912>you <00:04:21.913>can <00:04:21.915>do <00:04:21.916>better. <00:04:21.917>But <00:04:21.919>turns 00:04:21.920 --> 00:04:24.030 align:start position:0% <00:04:21.920>So, <00:04:22.020>surely <00:04:22.120>you <00:04:22.220>can <00:04:22.320>do <00:04:22.420>better. <00:04:22.520>But <00:04:22.620>turns <00:04:22.720>out <00:04:22.820>we <00:04:22.920>can't <00:04:23.020>just <00:04:23.120>because <00:04:23.220>building <00:04:23.320>agent 00:04:24.030 --> 00:04:24.040 align:start position:0% <00:04:24.030>out <00:04:24.031>we <00:04:24.033>can't <00:04:24.034>just <00:04:24.036>because <00:04:24.037>building <00:04:24.039>agent 00:04:24.040 --> 00:04:25.390 align:start position:0% <00:04:24.040>out <00:04:24.133>we <00:04:24.226>can't <00:04:24.320>just <00:04:24.413>because <00:04:24.507>building <00:04:24.600>agent <00:04:24.694>is <00:04:24.787>really, <00:04:24.881>really <00:04:24.974>hard. <00:04:25.068>But <00:04:25.161>it <00:04:25.255>is 00:04:25.390 --> 00:04:25.400 align:start position:0% <00:04:25.390>is <00:04:25.391>really, <00:04:25.393>really <00:04:25.394>hard. <00:04:25.395>But <00:04:25.397>it <00:04:25.399>is 00:04:25.400 --> 00:04:26.750 align:start position:0% <00:04:25.400>is <00:04:25.501>really, <00:04:25.602>really <00:04:25.703>hard. <00:04:25.805>But <00:04:25.906>it <00:04:26.007>is <00:04:26.108>possible, <00:04:26.210>and <00:04:26.311>we <00:04:26.412>built <00:04:26.513>a <00:04:26.615>successful 00:04:26.750 --> 00:04:26.760 align:start position:0% <00:04:26.750>possible, <00:04:26.751>and <00:04:26.753>we <00:04:26.755>built <00:04:26.757>a <00:04:26.759>successful 00:04:26.760 --> 00:04:28.150 align:start position:0% <00:04:26.760>possible, <00:04:26.968>and <00:04:27.176>we <00:04:27.385>built <00:04:27.594>a <00:04:27.802>successful <00:04:28.010>business. 00:04:28.150 --> 00:04:28.160 align:start position:0% business. 00:04:28.160 --> 00:04:29.590 align:start position:0% <00:04:28.160>business. <00:04:28.343>Okay. <00:04:28.527>Well, <00:04:28.711>I'm <00:04:28.895>being <00:04:29.079>cheeky. <00:04:29.263>All <00:04:29.447>of 00:04:29.590 --> 00:04:29.600 align:start position:0% <00:04:29.590>Okay. <00:04:29.591>Well, <00:04:29.592>I'm <00:04:29.594>being <00:04:29.596>cheeky. <00:04:29.597>All <00:04:29.599>of 00:04:29.600 --> 00:04:31.150 align:start position:0% <00:04:29.600>Okay. <00:04:29.707>Well, <00:04:29.814>I'm <00:04:29.921>being <00:04:30.029>cheeky. <00:04:30.136>All <00:04:30.243>of <00:04:30.351>this <00:04:30.458>is <00:04:30.565>a <00:04:30.673>public <00:04:30.780>information. <00:04:30.887>We <00:04:30.995>have 00:04:31.150 --> 00:04:31.160 align:start position:0% <00:04:31.150>this <00:04:31.151>is <00:04:31.153>a <00:04:31.154>public <00:04:31.156>information. <00:04:31.157>We <00:04:31.159>have 00:04:31.160 --> 00:04:32.950 align:start position:0% <00:04:31.160>this <00:04:31.267>is <00:04:31.375>a <00:04:31.483>public <00:04:31.590>information. <00:04:31.698>We <00:04:31.806>have <00:04:31.913>this <00:04:32.021>chart <00:04:32.129>on <00:04:32.236>our <00:04:32.344>public <00:04:32.452>website. <00:04:32.560>Our 00:04:32.950 --> 00:04:32.960 align:start position:0% <00:04:32.950>this <00:04:32.951>chart <00:04:32.953>on <00:04:32.954>our <00:04:32.955>public <00:04:32.957>website. <00:04:32.959>Our 00:04:32.960 --> 00:04:34.390 align:start position:0% <00:04:32.960>this <00:04:33.067>chart <00:04:33.174>on <00:04:33.281>our <00:04:33.389>public <00:04:33.496>website. <00:04:33.603>Our <00:04:33.710>CEO <00:04:33.818>just <00:04:33.925>casually <00:04:34.032>tweets <00:04:34.139>all <00:04:34.246>the 00:04:34.390 --> 00:04:34.400 align:start position:0% <00:04:34.390>CEO <00:04:34.391>just <00:04:34.393>casually <00:04:34.395>tweets <00:04:34.397>all <00:04:34.399>the 00:04:34.400 --> 00:04:36.030 align:start position:0% <00:04:34.400>CEO <00:04:34.527>just <00:04:34.654>casually <00:04:34.781>tweets <00:04:34.909>all <00:04:35.036>the <00:04:35.163>financial <00:04:35.290>data <00:04:35.418>on <00:04:35.545>Twitter, <00:04:35.672>of <00:04:35.799>course, 00:04:36.030 --> 00:04:36.040 align:start position:0% <00:04:36.030>financial <00:04:36.031>data <00:04:36.033>on <00:04:36.035>Twitter, <00:04:36.037>of <00:04:36.039>course, 00:04:36.040 --> 00:04:37.670 align:start position:0% <00:04:36.040>financial <00:04:36.156>data <00:04:36.273>on <00:04:36.390>Twitter, <00:04:36.506>of <00:04:36.623>course, <00:04:36.740>where <00:04:36.856>it <00:04:36.973>belongs. <00:04:37.090>So, <00:04:37.206>yeah, <00:04:37.323>I'm <00:04:37.440>being 00:04:37.670 --> 00:04:37.680 align:start position:0% <00:04:37.670>where <00:04:37.671>it <00:04:37.673>belongs. <00:04:37.674>So, <00:04:37.676>yeah, <00:04:37.677>I'm <00:04:37.679>being 00:04:37.680 --> 00:04:38.909 align:start position:0% <00:04:37.680>where <00:04:37.759>it <00:04:37.838>belongs. <00:04:37.917>So, <00:04:37.996>yeah, <00:04:38.075>I'm <00:04:38.154>being <00:04:38.233>cheeky. <00:04:38.312>It's <00:04:38.391>not <00:04:38.470>a <00:04:38.549>secret. <00:04:38.628>So, <00:04:38.707>you <00:04:38.786>can 00:04:38.909 --> 00:04:38.919 align:start position:0% <00:04:38.909>cheeky. <00:04:38.910>It's <00:04:38.911>not <00:04:38.912>a <00:04:38.914>secret. <00:04:38.915>So, <00:04:38.916>you <00:04:38.918>can 00:04:38.919 --> 00:04:40.670 align:start position:0% <00:04:38.919>cheeky. <00:04:39.035>It's <00:04:39.152>not <00:04:39.269>a <00:04:39.385>secret. <00:04:39.502>So, <00:04:39.619>you <00:04:39.735>can <00:04:39.852>you <00:04:39.969>can <00:04:40.085>keep <00:04:40.202>the <00:04:40.318>photos. 00:04:40.670 --> 00:04:40.680 align:start position:0% <00:04:40.670>you <00:04:40.672>can <00:04:40.674>keep <00:04:40.676>the <00:04:40.679>photos. 00:04:40.680 --> 00:04:42.270 align:start position:0% <00:04:40.680>you <00:04:40.796>can <00:04:40.913>keep <00:04:41.030>the <00:04:41.146>photos. <00:04:41.263>But <00:04:41.380>this <00:04:41.496>talk <00:04:41.613>is <00:04:41.730>not <00:04:41.846>about <00:04:41.963>Finn, <00:04:42.080>right? 00:04:42.270 --> 00:04:42.280 align:start position:0% <00:04:42.270>But <00:04:42.271>this <00:04:42.272>talk <00:04:42.273>is <00:04:42.275>not <00:04:42.276>about <00:04:42.277>Finn, <00:04:42.279>right? 00:04:42.280 --> 00:04:43.630 align:start position:0% <00:04:42.280>But <00:04:42.373>this <00:04:42.466>talk <00:04:42.560>is <00:04:42.653>not <00:04:42.747>about <00:04:42.840>Finn, <00:04:42.934>right? <00:04:43.027>It's <00:04:43.121>not <00:04:43.214>about <00:04:43.308>that <00:04:43.401>super <00:04:43.495>successful 00:04:43.630 --> 00:04:43.640 align:start position:0% <00:04:43.630>It's <00:04:43.631>not <00:04:43.633>about <00:04:43.635>that <00:04:43.637>super <00:04:43.639>successful 00:04:43.640 --> 00:04:45.270 align:start position:0% <00:04:43.640>It's <00:04:43.767>not <00:04:43.894>about <00:04:44.021>that <00:04:44.149>super <00:04:44.276>successful <00:04:44.403>business. <00:04:44.530>It's <00:04:44.658>about <00:04:44.785>AI <00:04:44.912>agents <00:04:45.039>for 00:04:45.270 --> 00:04:45.280 align:start position:0% <00:04:45.270>business. <00:04:45.271>It's <00:04:45.273>about <00:04:45.275>AI <00:04:45.277>agents <00:04:45.279>for 00:04:45.280 --> 00:04:47.230 align:start position:0% <00:04:45.280>business. <00:04:45.455>It's <00:04:45.630>about <00:04:45.804>AI <00:04:45.979>agents <00:04:46.155>for <00:04:46.330>developers, <00:04:46.505>for <00:04:46.679>you. 00:04:47.230 --> 00:04:47.240 align:start position:0% <00:04:47.230>developers, <00:04:47.234>for <00:04:47.239>you. 00:04:47.240 --> 00:04:49.030 align:start position:0% <00:04:47.240>developers, <00:04:47.367>for <00:04:47.494>you. <00:04:47.621>What <00:04:47.749>about <00:04:47.876>them? <00:04:48.003>Well, <00:04:48.130>let <00:04:48.258>me <00:04:48.385>tell <00:04:48.512>you <00:04:48.640>a 00:04:49.030 --> 00:04:49.040 align:start position:0% <00:04:49.030>What <00:04:49.031>about <00:04:49.032>them? <00:04:49.033>Well, <00:04:49.034>let <00:04:49.035>me <00:04:49.036>tell <00:04:49.037>you <00:04:49.039>a 00:04:49.040 --> 00:04:51.710 align:start position:0% <00:04:49.040>What <00:04:49.133>about <00:04:49.226>them? <00:04:49.320>Well, <00:04:49.413>let <00:04:49.506>me <00:04:49.600>tell <00:04:49.693>you <00:04:49.786>a <00:04:49.880>story. <00:04:49.973>In <00:04:50.066>early <00:04:50.160>2025, <00:04:50.253>when <00:04:50.346>the <00:04:50.440>models 00:04:51.710 --> 00:04:51.720 align:start position:0% <00:04:51.710>story. <00:04:51.711>In <00:04:51.712>early <00:04:51.714>2025, <00:04:51.716>when <00:04:51.717>the <00:04:51.719>models 00:04:51.720 --> 00:04:53.510 align:start position:0% <00:04:51.720>story. <00:04:51.836>In <00:04:51.953>early <00:04:52.070>2025, <00:04:52.186>when <00:04:52.303>the <00:04:52.420>models <00:04:52.536>got <00:04:52.653>sufficiently <00:04:52.770>better, <00:04:52.886>I <00:04:53.003>bet <00:04:53.120>every 00:04:53.510 --> 00:04:53.520 align:start position:0% <00:04:53.510>got <00:04:53.511>sufficiently <00:04:53.513>better, <00:04:53.515>I <00:04:53.517>bet <00:04:53.519>every 00:04:53.520 --> 00:04:55.630 align:start position:0% <00:04:53.520>got <00:04:53.647>sufficiently <00:04:53.774>better, <00:04:53.901>I <00:04:54.029>bet <00:04:54.156>every <00:04:54.283>company <00:04:54.410>had <00:04:54.538>this <00:04:54.665>Cambrian <00:04:54.792>explosion <00:04:54.919>of 00:04:55.630 --> 00:04:55.640 align:start position:0% <00:04:55.630>company <00:04:55.631>had <00:04:55.633>this <00:04:55.635>Cambrian <00:04:55.637>explosion <00:04:55.639>of 00:04:55.640 --> 00:04:57.270 align:start position:0% <00:04:55.640>company <00:04:55.795>had <00:04:55.951>this <00:04:56.106>Cambrian <00:04:56.262>explosion <00:04:56.417>of <00:04:56.573>artificial <00:04:56.728>intelligence. <00:04:56.884>Everyone <00:04:57.039>got 00:04:57.270 --> 00:04:57.280 align:start position:0% <00:04:57.270>artificial <00:04:57.272>intelligence. <00:04:57.275>Everyone <00:04:57.279>got 00:04:57.280 --> 00:04:59.030 align:start position:0% <00:04:57.280>artificial <00:04:57.435>intelligence. <00:04:57.591>Everyone <00:04:57.746>got <00:04:57.902>excited. <00:04:58.057>Everyone <00:04:58.213>built <00:04:58.368>an <00:04:58.524>agent <00:04:58.679>for 00:04:59.030 --> 00:04:59.040 align:start position:0% <00:04:59.030>excited. <00:04:59.031>Everyone <00:04:59.033>built <00:04:59.035>an <00:04:59.037>agent <00:04:59.039>for 00:04:59.040 --> 00:05:01.150 align:start position:0% <00:04:59.040>excited. <00:04:59.180>Everyone <00:04:59.320>built <00:04:59.460>an <00:04:59.600>agent <00:04:59.740>for <00:04:59.880>developer <00:05:00.020>productivity. <00:05:00.160>It's <00:05:00.300>so <00:05:00.440>great. 00:05:01.150 --> 00:05:01.160 align:start position:0% <00:05:01.150>developer <00:05:01.152>productivity. <00:05:01.154>It's <00:05:01.156>so <00:05:01.159>great. 00:05:01.160 --> 00:05:03.270 align:start position:0% <00:05:01.160>developer <00:05:01.276>productivity. <00:05:01.393>It's <00:05:01.510>so <00:05:01.626>great. <00:05:01.743>We <00:05:01.860>had <00:05:01.976>tons <00:05:02.093>of <00:05:02.210>those <00:05:02.326>agents, <00:05:02.443>but <00:05:02.560>the 00:05:03.270 --> 00:05:03.280 align:start position:0% <00:05:03.270>We <00:05:03.271>had <00:05:03.272>tons <00:05:03.273>of <00:05:03.275>those <00:05:03.276>agents, <00:05:03.277>but <00:05:03.279>the 00:05:03.280 --> 00:05:04.870 align:start position:0% <00:05:03.280>We <00:05:03.373>had <00:05:03.466>tons <00:05:03.559>of <00:05:03.653>those <00:05:03.746>agents, <00:05:03.840>but <00:05:03.933>the <00:05:04.026>worst <00:05:04.119>part <00:05:04.213>about <00:05:04.306>them <00:05:04.400>is <00:05:04.493>that <00:05:04.586>they <00:05:04.679>were 00:05:04.870 --> 00:05:04.880 align:start position:0% <00:05:04.870>worst <00:05:04.871>part <00:05:04.872>about <00:05:04.873>them <00:05:04.875>is <00:05:04.876>that <00:05:04.877>they <00:05:04.879>were 00:05:04.880 --> 00:05:07.070 align:start position:0% <00:05:04.880>worst <00:05:04.980>part <00:05:05.080>about <00:05:05.180>them <00:05:05.280>is <00:05:05.380>that <00:05:05.480>they <00:05:05.580>were <00:05:05.680>wiped <00:05:05.780>coded <00:05:05.880>and <00:05:05.980>wiped <00:05:06.080>tested <00:05:06.180>at <00:05:06.280>best. 00:05:07.070 --> 00:05:07.080 align:start position:0% <00:05:07.070>wiped <00:05:07.071>coded <00:05:07.073>and <00:05:07.074>wiped <00:05:07.075>tested <00:05:07.077>at <00:05:07.079>best. 00:05:07.080 --> 00:05:08.830 align:start position:0% <00:05:07.080>wiped <00:05:07.180>coded <00:05:07.280>and <00:05:07.380>wiped <00:05:07.479>tested <00:05:07.580>at <00:05:07.680>best. <00:05:07.780>So, <00:05:07.880>long <00:05:07.979>story <00:05:08.080>short, <00:05:08.180>by <00:05:08.280>the <00:05:08.380>end <00:05:08.479>of 00:05:08.830 --> 00:05:08.840 align:start position:0% <00:05:08.830>So, <00:05:08.831>long <00:05:08.832>story <00:05:08.833>short, <00:05:08.835>by <00:05:08.836>the <00:05:08.837>end <00:05:08.839>of 00:05:08.840 --> 00:05:11.630 align:start position:0% <00:05:08.840>So, <00:05:08.947>long <00:05:09.055>story <00:05:09.163>short, <00:05:09.270>by <00:05:09.378>the <00:05:09.486>end <00:05:09.593>of <00:05:09.701>2025, <00:05:09.809>those <00:05:09.916>agents <00:05:10.024>became <00:05:10.132>extinct. <00:05:10.239>They 00:05:11.630 --> 00:05:11.640 align:start position:0% <00:05:11.630>2025, <00:05:11.631>those <00:05:11.633>agents <00:05:11.635>became <00:05:11.637>extinct. <00:05:11.639>They 00:05:11.640 --> 00:05:13.110 align:start position:0% <00:05:11.640>2025, <00:05:11.750>those <00:05:11.860>agents <00:05:11.970>became <00:05:12.081>extinct. <00:05:12.191>They <00:05:12.301>became <00:05:12.411>fossils. <00:05:12.522>No <00:05:12.632>one <00:05:12.742>used <00:05:12.852>them. <00:05:12.963>They 00:05:13.110 --> 00:05:13.120 align:start position:0% <00:05:13.110>became <00:05:13.111>fossils. <00:05:13.113>No <00:05:13.114>one <00:05:13.116>used <00:05:13.117>them. <00:05:13.119>They 00:05:13.120 --> 00:05:14.830 align:start position:0% <00:05:13.120>became <00:05:13.260>fossils. <00:05:13.400>No <00:05:13.540>one <00:05:13.680>used <00:05:13.820>them. <00:05:13.960>They <00:05:14.100>were <00:05:14.240>not <00:05:14.380>really <00:05:14.520>good. 00:05:14.830 --> 00:05:14.840 align:start position:0% <00:05:14.830>were <00:05:14.832>not <00:05:14.835>really <00:05:14.839>good. 00:05:14.840 --> 00:05:16.590 align:start position:0% <00:05:14.840>were <00:05:14.967>not <00:05:15.094>really <00:05:15.221>good. <00:05:15.349>So, <00:05:15.476>we <00:05:15.603>took <00:05:15.730>on <00:05:15.858>a <00:05:15.985>mission. <00:05:16.112>We <00:05:16.239>created 00:05:16.590 --> 00:05:16.600 align:start position:0% <00:05:16.590>So, <00:05:16.591>we <00:05:16.592>took <00:05:16.593>on <00:05:16.595>a <00:05:16.596>mission. <00:05:16.597>We <00:05:16.599>created 00:05:16.600 --> 00:05:19.390 align:start position:0% <00:05:16.600>So, <00:05:16.700>we <00:05:16.800>took <00:05:16.900>on <00:05:17.000>a <00:05:17.100>mission. <00:05:17.200>We <00:05:17.300>created <00:05:17.400>team <00:05:17.500>2x <00:05:17.600>to <00:05:17.700>double <00:05:17.800>the <00:05:17.900>productivity <00:05:18.000>and 00:05:19.390 --> 00:05:19.400 align:start position:0% <00:05:19.390>team <00:05:19.391>2x <00:05:19.393>to <00:05:19.394>double <00:05:19.395>the <00:05:19.397>productivity <00:05:19.399>and 00:05:19.400 --> 00:05:21.550 align:start position:0% <00:05:19.400>team <00:05:19.539>2x <00:05:19.679>to <00:05:19.820>double <00:05:19.960>the <00:05:20.099>productivity <00:05:20.239>and <00:05:20.380>efficiency <00:05:20.520>of <00:05:20.659>our <00:05:20.799>R&D. 00:05:21.550 --> 00:05:21.560 align:start position:0% <00:05:21.550>efficiency <00:05:21.553>of <00:05:21.556>our <00:05:21.559>R&D. 00:05:21.560 --> 00:05:23.190 align:start position:0% <00:05:21.560>efficiency <00:05:21.687>of <00:05:21.814>our <00:05:21.941>R&D. <00:05:22.069>Of <00:05:22.196>course, <00:05:22.323>with <00:05:22.450>AI, <00:05:22.578>everything <00:05:22.705>has <00:05:22.832>to <00:05:22.960>be 00:05:23.190 --> 00:05:23.200 align:start position:0% <00:05:23.190>Of <00:05:23.191>course, <00:05:23.192>with <00:05:23.193>AI, <00:05:23.195>everything <00:05:23.196>has <00:05:23.197>to <00:05:23.199>be 00:05:23.200 --> 00:05:24.430 align:start position:0% <00:05:23.200>Of <00:05:23.323>course, <00:05:23.445>with <00:05:23.569>AI, <00:05:23.692>everything <00:05:23.815>has <00:05:23.938>to <00:05:24.061>be <00:05:24.184>with <00:05:24.307>AI. 00:05:24.430 --> 00:05:24.440 align:start position:0% <00:05:24.430>with <00:05:24.439>AI. 00:05:24.440 --> 00:05:25.830 align:start position:0% <00:05:24.440>with <00:05:24.596>AI. <00:05:24.752>And <00:05:24.909>the <00:05:25.065>first <00:05:25.221>problem <00:05:25.378>we <00:05:25.534>decided <00:05:25.691>to 00:05:25.830 --> 00:05:25.840 align:start position:0% <00:05:25.830>And <00:05:25.831>the <00:05:25.832>first <00:05:25.834>problem <00:05:25.835>we <00:05:25.837>decided <00:05:25.839>to 00:05:25.840 --> 00:05:28.470 align:start position:0% <00:05:25.840>And <00:05:25.956>the <00:05:26.073>first <00:05:26.190>problem <00:05:26.306>we <00:05:26.423>decided <00:05:26.539>to <00:05:26.656>tackle <00:05:26.773>were <00:05:26.890>the <00:05:27.006>pull <00:05:27.123>request <00:05:27.239>reviews. 00:05:28.470 --> 00:05:28.480 align:start position:0% <00:05:28.470>tackle <00:05:28.471>were <00:05:28.473>the <00:05:28.475>pull <00:05:28.477>request <00:05:28.479>reviews. 00:05:28.480 --> 00:05:30.270 align:start position:0% <00:05:28.480>tackle <00:05:28.596>were <00:05:28.713>the <00:05:28.830>pull <00:05:28.946>request <00:05:29.063>reviews. <00:05:29.180>Let's <00:05:29.296>take <00:05:29.413>a <00:05:29.530>this <00:05:29.646>typical <00:05:29.763>pull <00:05:29.880>request 00:05:30.270 --> 00:05:30.280 align:start position:0% <00:05:30.270>Let's <00:05:30.271>take <00:05:30.272>a <00:05:30.274>this <00:05:30.275>typical <00:05:30.277>pull <00:05:30.279>request 00:05:30.280 --> 00:05:31.990 align:start position:0% <00:05:30.280>Let's <00:05:30.367>take <00:05:30.455>a <00:05:30.542>this <00:05:30.630>typical <00:05:30.717>pull <00:05:30.804>request <00:05:30.892>in <00:05:30.979>the <00:05:31.067>age <00:05:31.155>of <00:05:31.242>AI. <00:05:31.330>Can <00:05:31.417>you <00:05:31.505>see <00:05:31.592>a <00:05:31.679>little 00:05:31.990 --> 00:05:32.000 align:start position:0% <00:05:31.990>in <00:05:31.991>the <00:05:31.992>age <00:05:31.993>of <00:05:31.994>AI. <00:05:31.995>Can <00:05:31.996>you <00:05:31.997>see <00:05:31.998>a <00:05:31.999>little 00:05:32.000 --> 00:05:33.830 align:start position:0% <00:05:32.000>in <00:05:32.093>the <00:05:32.186>age <00:05:32.280>of <00:05:32.373>AI. <00:05:32.466>Can <00:05:32.560>you <00:05:32.653>see <00:05:32.746>a <00:05:32.840>little <00:05:32.933>problem <00:05:33.026>here? <00:05:33.120>Raise <00:05:33.213>your <00:05:33.306>hands. <00:05:33.400>Like, 00:05:33.830 --> 00:05:33.840 align:start position:0% <00:05:33.830>problem <00:05:33.831>here? <00:05:33.833>Raise <00:05:33.835>your <00:05:33.837>hands. <00:05:33.839>Like, 00:05:33.840 --> 00:05:35.070 align:start position:0% <00:05:33.840>problem <00:05:33.932>here? <00:05:34.024>Raise <00:05:34.116>your <00:05:34.209>hands. <00:05:34.301>Like, <00:05:34.393>have <00:05:34.485>you <00:05:34.578>ever <00:05:34.670>experienced <00:05:34.762>a <00:05:34.854>pull <00:05:34.947>request 00:05:35.070 --> 00:05:35.080 align:start position:0% <00:05:35.070>have <00:05:35.071>you <00:05:35.073>ever <00:05:35.074>experienced <00:05:35.075>a <00:05:35.077>pull <00:05:35.079>request 00:05:35.080 --> 00:05:37.350 align:start position:0% <00:05:35.080>have <00:05:35.196>you <00:05:35.313>ever <00:05:35.430>experienced <00:05:35.546>a <00:05:35.663>pull <00:05:35.780>request <00:05:35.896>like <00:05:36.013>this? <00:05:36.130>Yeah? <00:05:36.246>Few <00:05:36.363>hands? <00:05:36.479>Yeah? 00:05:37.350 --> 00:05:37.360 align:start position:0% <00:05:37.350>like <00:05:37.351>this? <00:05:37.353>Yeah? <00:05:37.355>Few <00:05:37.357>hands? <00:05:37.359>Yeah? 00:05:37.360 --> 00:05:38.990 align:start position:0% <00:05:37.360>like <00:05:37.487>this? <00:05:37.614>Yeah? <00:05:37.741>Few <00:05:37.869>hands? <00:05:37.996>Yeah? <00:05:38.123>Yeah, <00:05:38.250>the <00:05:38.378>problem <00:05:38.505>is <00:05:38.632>quite <00:05:38.760>small, 00:05:38.990 --> 00:05:39.000 align:start position:0% <00:05:38.990>Yeah, <00:05:38.991>the <00:05:38.993>problem <00:05:38.995>is <00:05:38.997>quite <00:05:38.999>small, 00:05:39.000 --> 00:05:40.710 align:start position:0% <00:05:39.000>Yeah, <00:05:39.140>the <00:05:39.280>problem <00:05:39.420>is <00:05:39.560>quite <00:05:39.700>small, <00:05:39.840>actually, <00:05:39.980>because <00:05:40.120>now <00:05:40.260>someone <00:05:40.400>someone 00:05:40.710 --> 00:05:40.720 align:start position:0% <00:05:40.710>actually, <00:05:40.712>because <00:05:40.714>now <00:05:40.716>someone <00:05:40.719>someone 00:05:40.720 --> 00:05:42.070 align:start position:0% <00:05:40.720>actually, <00:05:40.830>because <00:05:40.940>now <00:05:41.051>someone <00:05:41.161>someone <00:05:41.272>has <00:05:41.382>to <00:05:41.493>take <00:05:41.603>that <00:05:41.714>pull <00:05:41.824>request <00:05:41.935>and 00:05:42.070 --> 00:05:42.080 align:start position:0% <00:05:42.070>has <00:05:42.071>to <00:05:42.073>take <00:05:42.074>that <00:05:42.075>pull <00:05:42.077>request <00:05:42.079>and 00:05:42.080 --> 00:05:44.430 align:start position:0% <00:05:42.080>has <00:05:42.196>to <00:05:42.313>take <00:05:42.430>that <00:05:42.546>pull <00:05:42.663>request <00:05:42.780>and <00:05:42.896>actually <00:05:43.013>review <00:05:43.130>this <00:05:43.246>massive <00:05:43.363>diff, <00:05:43.479>those 00:05:44.430 --> 00:05:44.440 align:start position:0% <00:05:44.430>actually <00:05:44.431>review <00:05:44.433>this <00:05:44.435>massive <00:05:44.437>diff, <00:05:44.439>those 00:05:44.440 --> 00:05:46.190 align:start position:0% <00:05:44.440>actually <00:05:44.556>review <00:05:44.673>this <00:05:44.790>massive <00:05:44.906>diff, <00:05:45.023>those <00:05:45.140>hundreds <00:05:45.256>of <00:05:45.373>thousands <00:05:45.490>of <00:05:45.606>lines <00:05:45.723>of <00:05:45.840>code. 00:05:46.190 --> 00:05:46.200 align:start position:0% <00:05:46.190>hundreds <00:05:46.191>of <00:05:46.193>thousands <00:05:46.194>of <00:05:46.195>lines <00:05:46.197>of <00:05:46.199>code. 00:05:46.200 --> 00:05:47.670 align:start position:0% <00:05:46.200>hundreds <00:05:46.347>of <00:05:46.494>thousands <00:05:46.641>of <00:05:46.788>lines <00:05:46.935>of <00:05:47.082>code. <00:05:47.229>This <00:05:47.376>is <00:05:47.523>ridiculous. 00:05:47.670 --> 00:05:47.680 align:start position:0% <00:05:47.670>This <00:05:47.674>is <00:05:47.679>ridiculous. 00:05:47.680 --> 00:05:49.510 align:start position:0% <00:05:47.680>This <00:05:47.820>is <00:05:47.960>ridiculous. <00:05:48.100>The <00:05:48.240>first <00:05:48.380>people <00:05:48.520>who <00:05:48.660>felt <00:05:48.800>the <00:05:48.940>pain <00:05:49.080>of 00:05:49.510 --> 00:05:49.520 align:start position:0% <00:05:49.510>The <00:05:49.511>first <00:05:49.512>people <00:05:49.513>who <00:05:49.515>felt <00:05:49.516>the <00:05:49.517>pain <00:05:49.519>of 00:05:49.520 --> 00:05:51.790 align:start position:0% <00:05:49.520>The <00:05:49.636>first <00:05:49.753>people <00:05:49.870>who <00:05:49.986>felt <00:05:50.103>the <00:05:50.219>pain <00:05:50.336>of <00:05:50.453>this <00:05:50.570>were <00:05:50.686>our <00:05:50.803>front-end <00:05:50.919>experts. 00:05:51.790 --> 00:05:51.800 align:start position:0% <00:05:51.790>this <00:05:51.792>were <00:05:51.794>our <00:05:51.796>front-end <00:05:51.799>experts. 00:05:51.800 --> 00:05:53.550 align:start position:0% <00:05:51.800>this <00:05:52.000>were <00:05:52.200>our <00:05:52.400>front-end <00:05:52.600>experts. <00:05:52.800>When <00:05:53.000>they <00:05:53.200>were 00:05:53.550 --> 00:05:53.560 align:start position:0% <00:05:53.550>When <00:05:53.554>they <00:05:53.559>were 00:05:53.560 --> 00:05:54.950 align:start position:0% <00:05:53.560>When <00:05:53.738>they <00:05:53.917>were <00:05:54.096>doing <00:05:54.274>this <00:05:54.453>migration, <00:05:54.632>they <00:05:54.811>start 00:05:54.950 --> 00:05:54.960 align:start position:0% <00:05:54.950>doing <00:05:54.952>this <00:05:54.954>migration, <00:05:54.956>they <00:05:54.959>start 00:05:54.960 --> 00:05:56.950 align:start position:0% <00:05:54.960>doing <00:05:55.115>this <00:05:55.271>migration, <00:05:55.426>they <00:05:55.582>start <00:05:55.737>migration <00:05:55.893>from <00:05:56.048>Ember.js <00:05:56.204>framework <00:05:56.359>to 00:05:56.950 --> 00:05:56.960 align:start position:0% <00:05:56.950>migration <00:05:56.952>from <00:05:56.954>Ember.js <00:05:56.956>framework <00:05:56.959>to 00:05:56.960 --> 00:05:58.750 align:start position:0% <00:05:56.960>migration <00:05:57.087>from <00:05:57.214>Ember.js <00:05:57.341>framework <00:05:57.469>to <00:05:57.596>React.js, <00:05:57.723>they <00:05:57.850>they <00:05:57.978>had <00:05:58.105>to <00:05:58.232>review <00:05:58.359>tons 00:05:58.750 --> 00:05:58.760 align:start position:0% <00:05:58.750>React.js, <00:05:58.751>they <00:05:58.753>they <00:05:58.754>had <00:05:58.756>to <00:05:58.757>review <00:05:58.759>tons 00:05:58.760 --> 00:06:00.030 align:start position:0% <00:05:58.760>React.js, <00:05:58.855>they <00:05:58.950>they <00:05:59.045>had <00:05:59.140>to <00:05:59.236>review <00:05:59.331>tons <00:05:59.426>of <00:05:59.522>pull <00:05:59.617>requests, <00:05:59.712>tons <00:05:59.807>of <00:05:59.902>that 00:06:00.030 --> 00:06:00.040 align:start position:0% <00:06:00.030>of <00:06:00.031>pull <00:06:00.033>requests, <00:06:00.035>tons <00:06:00.037>of <00:06:00.039>that 00:06:00.040 --> 00:06:02.190 align:start position:0% <00:06:00.040>of <00:06:00.167>pull <00:06:00.294>requests, <00:06:00.421>tons <00:06:00.549>of <00:06:00.676>that <00:06:00.803>AI-generated <00:06:00.930>slop <00:06:01.058>just <00:06:01.185>fell <00:06:01.312>on <00:06:01.440>their 00:06:02.190 --> 00:06:02.200 align:start position:0% <00:06:02.190>AI-generated <00:06:02.191>slop <00:06:02.193>just <00:06:02.195>fell <00:06:02.197>on <00:06:02.199>their 00:06:02.200 --> 00:06:04.830 align:start position:0% <00:06:02.200>AI-generated <00:06:02.316>slop <00:06:02.433>just <00:06:02.550>fell <00:06:02.666>on <00:06:02.783>their <00:06:02.900>shoulders <00:06:03.016>and <00:06:03.133>and <00:06:03.250>they <00:06:03.366>were <00:06:03.483>dealing <00:06:03.599>with 00:06:04.830 --> 00:06:04.840 align:start position:0% <00:06:04.830>shoulders <00:06:04.831>and <00:06:04.832>and <00:06:04.834>they <00:06:04.835>were <00:06:04.837>dealing <00:06:04.839>with 00:06:04.840 --> 00:06:06.510 align:start position:0% <00:06:04.840>shoulders <00:06:04.947>and <00:06:05.055>and <00:06:05.163>they <00:06:05.270>were <00:06:05.378>dealing <00:06:05.486>with <00:06:05.593>all <00:06:05.701>those <00:06:05.809>massive <00:06:05.916>pull <00:06:06.024>requests <00:06:06.132>and <00:06:06.239>they 00:06:06.510 --> 00:06:06.520 align:start position:0% <00:06:06.510>all <00:06:06.511>those <00:06:06.513>massive <00:06:06.514>pull <00:06:06.515>requests <00:06:06.517>and <00:06:06.519>they 00:06:06.520 --> 00:06:08.550 align:start position:0% <00:06:06.520>all <00:06:06.647>those <00:06:06.774>massive <00:06:06.901>pull <00:06:07.029>requests <00:06:07.156>and <00:06:07.283>they <00:06:07.410>were <00:06:07.538>posting <00:06:07.665>comments <00:06:07.792>repeating <00:06:07.919>things 00:06:08.550 --> 00:06:08.560 align:start position:0% <00:06:08.550>were <00:06:08.552>posting <00:06:08.554>comments <00:06:08.556>repeating <00:06:08.559>things 00:06:08.560 --> 00:06:10.310 align:start position:0% <00:06:08.560>were <00:06:08.687>posting <00:06:08.814>comments <00:06:08.941>repeating <00:06:09.069>things <00:06:09.196>over <00:06:09.323>and <00:06:09.450>over <00:06:09.578>again, <00:06:09.705>don't <00:06:09.832>use <00:06:09.960>this 00:06:10.310 --> 00:06:10.320 align:start position:0% <00:06:10.310>over <00:06:10.311>and <00:06:10.313>over <00:06:10.314>again, <00:06:10.316>don't <00:06:10.317>use <00:06:10.319>this 00:06:10.320 --> 00:06:12.190 align:start position:0% <00:06:10.320>over <00:06:10.427>and <00:06:10.535>over <00:06:10.643>again, <00:06:10.750>don't <00:06:10.858>use <00:06:10.966>this <00:06:11.073>antipattern, <00:06:11.181>use <00:06:11.289>this <00:06:11.396>thing <00:06:11.504>and <00:06:11.612>use <00:06:11.719>that 00:06:12.190 --> 00:06:12.200 align:start position:0% <00:06:12.190>antipattern, <00:06:12.191>use <00:06:12.193>this <00:06:12.194>thing <00:06:12.195>and <00:06:12.197>use <00:06:12.199>that 00:06:12.200 --> 00:06:13.750 align:start position:0% <00:06:12.200>antipattern, <00:06:12.299>use <00:06:12.399>this <00:06:12.498>thing <00:06:12.598>and <00:06:12.698>use <00:06:12.797>that <00:06:12.897>thing. <00:06:12.997>So, <00:06:13.096>they <00:06:13.196>were <00:06:13.296>wasting <00:06:13.395>a <00:06:13.495>lot <00:06:13.595>of 00:06:13.750 --> 00:06:13.760 align:start position:0% <00:06:13.750>thing. <00:06:13.751>So, <00:06:13.752>they <00:06:13.753>were <00:06:13.755>wasting <00:06:13.756>a <00:06:13.757>lot <00:06:13.759>of 00:06:13.760 --> 00:06:16.590 align:start position:0% <00:06:13.760>thing. <00:06:13.876>So, <00:06:13.993>they <00:06:14.110>were <00:06:14.226>wasting <00:06:14.343>a <00:06:14.460>lot <00:06:14.576>of <00:06:14.693>time. <00:06:14.810>They <00:06:14.926>were <00:06:15.043>burning <00:06:15.159>out. 00:06:16.590 --> 00:06:16.600 align:start position:0% <00:06:16.590>time. <00:06:16.592>They <00:06:16.594>were <00:06:16.596>burning <00:06:16.599>out. 00:06:16.600 --> 00:06:18.390 align:start position:0% <00:06:16.600>time. <00:06:16.716>They <00:06:16.833>were <00:06:16.950>burning <00:06:17.066>out. <00:06:17.183>Surely <00:06:17.300>we <00:06:17.416>had <00:06:17.533>an <00:06:17.650>agent <00:06:17.766>for <00:06:17.883>that, <00:06:18.000>right? 00:06:18.390 --> 00:06:18.400 align:start position:0% <00:06:18.390>Surely <00:06:18.391>we <00:06:18.392>had <00:06:18.393>an <00:06:18.395>agent <00:06:18.396>for <00:06:18.397>that, <00:06:18.399>right? 00:06:18.400 --> 00:06:20.110 align:start position:0% <00:06:18.400>Surely <00:06:18.500>we <00:06:18.599>had <00:06:18.700>an <00:06:18.799>agent <00:06:18.900>for <00:06:19.000>that, <00:06:19.099>right? <00:06:19.200>So, <00:06:19.299>we <00:06:19.400>picked <00:06:19.500>one <00:06:19.599>of <00:06:19.700>those <00:06:19.799>Cambrian 00:06:20.110 --> 00:06:20.120 align:start position:0% <00:06:20.110>So, <00:06:20.111>we <00:06:20.113>picked <00:06:20.114>one <00:06:20.116>of <00:06:20.117>those <00:06:20.119>Cambrian 00:06:20.120 --> 00:06:22.310 align:start position:0% <00:06:20.120>So, <00:06:20.227>we <00:06:20.335>picked <00:06:20.443>one <00:06:20.550>of <00:06:20.658>those <00:06:20.766>Cambrian <00:06:20.873>explosion <00:06:20.981>types <00:06:21.089>of <00:06:21.196>agents <00:06:21.304>off <00:06:21.412>the <00:06:21.520>shelf. 00:06:22.310 --> 00:06:22.320 align:start position:0% <00:06:22.310>explosion <00:06:22.311>types <00:06:22.313>of <00:06:22.314>agents <00:06:22.316>off <00:06:22.317>the <00:06:22.319>shelf. 00:06:22.320 --> 00:06:23.470 align:start position:0% <00:06:22.320>explosion <00:06:22.393>types <00:06:22.467>of <00:06:22.541>agents <00:06:22.615>off <00:06:22.689>the <00:06:22.763>shelf. <00:06:22.837>It <00:06:22.911>was <00:06:22.985>just <00:06:23.059>a <00:06:23.133>cloud <00:06:23.207>code <00:06:23.281>running <00:06:23.355>in 00:06:23.470 --> 00:06:23.480 align:start position:0% <00:06:23.470>It <00:06:23.471>was <00:06:23.472>just <00:06:23.473>a <00:06:23.475>cloud <00:06:23.476>code <00:06:23.477>running <00:06:23.479>in 00:06:23.480 --> 00:06:24.710 align:start position:0% <00:06:23.480>It <00:06:23.603>was <00:06:23.726>just <00:06:23.849>a <00:06:23.972>cloud <00:06:24.095>code <00:06:24.218>running <00:06:24.341>in <00:06:24.464>GitHub <00:06:24.587>action. 00:06:24.710 --> 00:06:24.720 align:start position:0% <00:06:24.710>GitHub <00:06:24.719>action. 00:06:24.720 --> 00:06:25.790 align:start position:0% <00:06:24.720>GitHub <00:06:24.840>action. <00:06:24.960>So, <00:06:25.081>you <00:06:25.201>can <00:06:25.321>ask, <00:06:25.442>"Hey <00:06:25.562>Claude, <00:06:25.683>review 00:06:25.790 --> 00:06:25.800 align:start position:0% <00:06:25.790>So, <00:06:25.791>you <00:06:25.793>can <00:06:25.794>ask, <00:06:25.796>"Hey <00:06:25.797>Claude, <00:06:25.799>review 00:06:25.800 --> 00:06:27.470 align:start position:0% <00:06:25.800>So, <00:06:25.900>you <00:06:26.000>can <00:06:26.100>ask, <00:06:26.200>"Hey <00:06:26.300>Claude, <00:06:26.400>review <00:06:26.500>this <00:06:26.600>pull <00:06:26.700>request <00:06:26.800>for <00:06:26.900>me." <00:06:27.000>And <00:06:27.100>then <00:06:27.200>it 00:06:27.470 --> 00:06:27.480 align:start position:0% <00:06:27.470>this <00:06:27.471>pull <00:06:27.472>request <00:06:27.473>for <00:06:27.475>me." <00:06:27.476>And <00:06:27.477>then <00:06:27.479>it 00:06:27.480 --> 00:06:29.310 align:start position:0% <00:06:27.480>this <00:06:27.573>pull <00:06:27.666>request <00:06:27.760>for <00:06:27.853>me." <00:06:27.946>And <00:06:28.040>then <00:06:28.133>it <00:06:28.226>posts <00:06:28.320>it <00:06:28.413>gives <00:06:28.506>you <00:06:28.600>this <00:06:28.693>this <00:06:28.786>thing <00:06:28.880>on 00:06:29.310 --> 00:06:29.320 align:start position:0% <00:06:29.310>posts <00:06:29.311>it <00:06:29.312>gives <00:06:29.313>you <00:06:29.315>this <00:06:29.316>this <00:06:29.317>thing <00:06:29.319>on 00:06:29.320 --> 00:06:32.310 align:start position:0% <00:06:29.320>posts <00:06:29.413>it <00:06:29.506>gives <00:06:29.599>you <00:06:29.693>this <00:06:29.786>this <00:06:29.880>thing <00:06:29.973>on <00:06:30.066>the <00:06:30.159>right. <00:06:30.253>This <00:06:30.346>is <00:06:30.440>what <00:06:30.533>you <00:06:30.626>get, <00:06:30.719>right? 00:06:32.310 --> 00:06:32.320 align:start position:0% <00:06:32.310>the <00:06:32.311>right. <00:06:32.312>This <00:06:32.313>is <00:06:32.315>what <00:06:32.316>you <00:06:32.317>get, <00:06:32.319>right? 00:06:32.320 --> 00:06:34.510 align:start position:0% <00:06:32.320>the <00:06:32.413>right. <00:06:32.506>This <00:06:32.599>is <00:06:32.693>what <00:06:32.786>you <00:06:32.880>get, <00:06:32.973>right? <00:06:33.066>So, <00:06:33.159>let <00:06:33.253>me <00:06:33.346>do <00:06:33.440>a <00:06:33.533>close-up. <00:06:33.626>Like, <00:06:33.719>what 00:06:34.510 --> 00:06:34.520 align:start position:0% <00:06:34.510>So, <00:06:34.511>let <00:06:34.512>me <00:06:34.513>do <00:06:34.515>a <00:06:34.516>close-up. <00:06:34.517>Like, <00:06:34.519>what 00:06:34.520 --> 00:06:36.430 align:start position:0% <00:06:34.520>So, <00:06:34.613>let <00:06:34.706>me <00:06:34.799>do <00:06:34.893>a <00:06:34.986>close-up. <00:06:35.080>Like, <00:06:35.173>what <00:06:35.266>what <00:06:35.359>was <00:06:35.453>that <00:06:35.546>thing? <00:06:35.640>So, <00:06:35.733>first <00:06:35.826>it <00:06:35.919>starts 00:06:36.430 --> 00:06:36.440 align:start position:0% <00:06:36.430>what <00:06:36.431>was <00:06:36.432>that <00:06:36.433>thing? <00:06:36.435>So, <00:06:36.436>first <00:06:36.437>it <00:06:36.439>starts 00:06:36.440 --> 00:06:38.030 align:start position:0% <00:06:36.440>what <00:06:36.533>was <00:06:36.626>that <00:06:36.719>thing? <00:06:36.813>So, <00:06:36.906>first <00:06:37.000>it <00:06:37.093>starts <00:06:37.186>with <00:06:37.280>a <00:06:37.373>love <00:06:37.466>letter. <00:06:37.560>Like, <00:06:37.653>it <00:06:37.746>tells <00:06:37.840>how 00:06:38.030 --> 00:06:38.040 align:start position:0% <00:06:38.030>with <00:06:38.031>a <00:06:38.032>love <00:06:38.033>letter. <00:06:38.035>Like, <00:06:38.036>it <00:06:38.037>tells <00:06:38.039>how 00:06:38.040 --> 00:06:39.790 align:start position:0% <00:06:38.040>with <00:06:38.133>a <00:06:38.226>love <00:06:38.320>letter. <00:06:38.413>Like, <00:06:38.506>it <00:06:38.600>tells <00:06:38.693>how <00:06:38.786>beautiful <00:06:38.880>your <00:06:38.973>code <00:06:39.066>is <00:06:39.160>and <00:06:39.253>how <00:06:39.346>it <00:06:39.440>loved 00:06:39.790 --> 00:06:39.800 align:start position:0% <00:06:39.790>beautiful <00:06:39.791>your <00:06:39.792>code <00:06:39.793>is <00:06:39.795>and <00:06:39.796>how <00:06:39.797>it <00:06:39.799>loved 00:06:39.800 --> 00:06:41.670 align:start position:0% <00:06:39.800>beautiful <00:06:39.900>your <00:06:40.000>code <00:06:40.100>is <00:06:40.200>and <00:06:40.300>how <00:06:40.400>it <00:06:40.500>loved <00:06:40.600>the <00:06:40.700>methods <00:06:40.800>and <00:06:40.900>attribute <00:06:41.000>names <00:06:41.100>and <00:06:41.200>like 00:06:41.670 --> 00:06:41.680 align:start position:0% <00:06:41.670>the <00:06:41.671>methods <00:06:41.673>and <00:06:41.674>attribute <00:06:41.676>names <00:06:41.677>and <00:06:41.679>like 00:06:41.680 --> 00:06:43.190 align:start position:0% <00:06:41.680>the <00:06:41.784>methods <00:06:41.889>and <00:06:41.993>attribute <00:06:42.098>names <00:06:42.202>and <00:06:42.307>like <00:06:42.411>look <00:06:42.516>at <00:06:42.620>those <00:06:42.725>tests. <00:06:42.829>This <00:06:42.934>is <00:06:43.039>amazing. 00:06:43.190 --> 00:06:43.200 align:start position:0% <00:06:43.190>look <00:06:43.191>at <00:06:43.193>those <00:06:43.194>tests. <00:06:43.195>This <00:06:43.197>is <00:06:43.199>amazing. 00:06:43.200 --> 00:06:45.790 align:start position:0% <00:06:43.200>look <00:06:43.300>at <00:06:43.400>those <00:06:43.500>tests. <00:06:43.599>This <00:06:43.700>is <00:06:43.800>amazing. <00:06:43.900>So, <00:06:44.000>love <00:06:44.099>letter. <00:06:44.200>And <00:06:44.300>then <00:06:44.400>it <00:06:44.500>becomes <00:06:44.599>a 00:06:45.790 --> 00:06:45.800 align:start position:0% <00:06:45.790>So, <00:06:45.791>love <00:06:45.792>letter. <00:06:45.793>And <00:06:45.795>then <00:06:45.796>it <00:06:45.797>becomes <00:06:45.799>a 00:06:45.800 --> 00:06:46.909 align:start position:0% <00:06:45.800>So, <00:06:45.876>love <00:06:45.953>letter. <00:06:46.030>And <00:06:46.107>then <00:06:46.183>it <00:06:46.260>becomes <00:06:46.337>a <00:06:46.414>little <00:06:46.490>bit <00:06:46.567>skeptical. <00:06:46.644>You <00:06:46.721>know <00:06:46.798>what? 00:06:46.909 --> 00:06:46.919 align:start position:0% <00:06:46.909>little <00:06:46.910>bit <00:06:46.912>skeptical. <00:06:46.914>You <00:06:46.916>know <00:06:46.918>what? 00:06:46.919 --> 00:06:48.470 align:start position:0% <00:06:46.919>little <00:06:47.026>bit <00:06:47.133>skeptical. <00:06:47.241>You <00:06:47.348>know <00:06:47.455>what? <00:06:47.563>Like, <00:06:47.670>there <00:06:47.778>is <00:06:47.885>some <00:06:47.992>side <00:06:48.100>effects <00:06:48.207>in <00:06:48.314>here 00:06:48.470 --> 00:06:48.480 align:start position:0% <00:06:48.470>Like, <00:06:48.471>there <00:06:48.472>is <00:06:48.473>some <00:06:48.475>side <00:06:48.476>effects <00:06:48.477>in <00:06:48.479>here 00:06:48.480 --> 00:06:49.550 align:start position:0% <00:06:48.480>Like, <00:06:48.548>there <00:06:48.617>is <00:06:48.686>some <00:06:48.755>side <00:06:48.823>effects <00:06:48.892>in <00:06:48.961>here <00:06:49.030>and <00:06:49.099>maybe <00:06:49.167>you <00:06:49.236>shouldn't <00:06:49.305>be <00:06:49.374>using <00:06:49.443>this 00:06:49.550 --> 00:06:49.560 align:start position:0% <00:06:49.550>and <00:06:49.551>maybe <00:06:49.553>you <00:06:49.554>shouldn't <00:06:49.556>be <00:06:49.557>using <00:06:49.559>this 00:06:49.560 --> 00:06:50.870 align:start position:0% <00:06:49.560>and <00:06:49.650>maybe <00:06:49.741>you <00:06:49.832>shouldn't <00:06:49.922>be <00:06:50.013>using <00:06:50.104>this <00:06:50.194>thing <00:06:50.285>and <00:06:50.376>your <00:06:50.466>test <00:06:50.557>coverage <00:06:50.648>is <00:06:50.739>not 00:06:50.870 --> 00:06:50.880 align:start position:0% <00:06:50.870>thing <00:06:50.871>and <00:06:50.873>your <00:06:50.874>test <00:06:50.876>coverage <00:06:50.877>is <00:06:50.879>not 00:06:50.880 --> 00:06:52.630 align:start position:0% <00:06:50.880>thing <00:06:50.980>and <00:06:51.080>your <00:06:51.180>test <00:06:51.280>coverage <00:06:51.380>is <00:06:51.480>not <00:06:51.580>really <00:06:51.680>great. <00:06:51.780>And <00:06:51.880>then <00:06:51.980>it <00:06:52.080>goes <00:06:52.180>on <00:06:52.280>and 00:06:52.630 --> 00:06:52.640 align:start position:0% <00:06:52.630>really <00:06:52.631>great. <00:06:52.632>And <00:06:52.633>then <00:06:52.635>it <00:06:52.636>goes <00:06:52.637>on <00:06:52.639>and 00:06:52.640 --> 00:06:53.990 align:start position:0% <00:06:52.640>really <00:06:52.726>great. <00:06:52.813>And <00:06:52.900>then <00:06:52.987>it <00:06:53.073>goes <00:06:53.160>on <00:06:53.247>and <00:06:53.334>on. <00:06:53.421>If <00:06:53.507>you <00:06:53.594>get <00:06:53.681>there, <00:06:53.768>you're <00:06:53.855>already 00:06:53.990 --> 00:06:54.000 align:start position:0% <00:06:53.990>on. <00:06:53.991>If <00:06:53.993>you <00:06:53.994>get <00:06:53.996>there, <00:06:53.997>you're <00:06:53.999>already 00:06:54.000 --> 00:06:55.630 align:start position:0% <00:06:54.000>on. <00:06:54.107>If <00:06:54.215>you <00:06:54.323>get <00:06:54.430>there, <00:06:54.538>you're <00:06:54.646>already <00:06:54.753>melting. <00:06:54.861>Like, <00:06:54.969>you <00:06:55.076>had <00:06:55.184>enough. <00:06:55.292>No <00:06:55.400>one 00:06:55.630 --> 00:06:55.640 align:start position:0% <00:06:55.630>melting. <00:06:55.631>Like, <00:06:55.633>you <00:06:55.634>had <00:06:55.635>enough. <00:06:55.637>No <00:06:55.639>one 00:06:55.640 --> 00:06:57.470 align:start position:0% <00:06:55.640>melting. <00:06:55.747>Like, <00:06:55.855>you <00:06:55.963>had <00:06:56.070>enough. <00:06:56.178>No <00:06:56.286>one <00:06:56.393>has <00:06:56.501>time <00:06:56.609>to <00:06:56.716>read <00:06:56.824>those. <00:06:56.932>But <00:06:57.039>more 00:06:57.470 --> 00:06:57.480 align:start position:0% <00:06:57.470>has <00:06:57.471>time <00:06:57.473>to <00:06:57.474>read <00:06:57.476>those. <00:06:57.477>But <00:06:57.479>more 00:06:57.480 --> 00:06:59.070 align:start position:0% <00:06:57.480>has <00:06:57.587>time <00:06:57.695>to <00:06:57.803>read <00:06:57.910>those. <00:06:58.018>But <00:06:58.126>more <00:06:58.233>importantly, <00:06:58.341>most <00:06:58.449>of <00:06:58.556>that <00:06:58.664>stuff <00:06:58.772>is <00:06:58.880>kind 00:06:59.070 --> 00:06:59.080 align:start position:0% <00:06:59.070>importantly, <00:06:59.071>most <00:06:59.073>of <00:06:59.074>that <00:06:59.075>stuff <00:06:59.077>is <00:06:59.079>kind 00:06:59.080 --> 00:07:00.790 align:start position:0% <00:06:59.080>importantly, <00:06:59.187>most <00:06:59.295>of <00:06:59.403>that <00:06:59.510>stuff <00:06:59.618>is <00:06:59.726>kind <00:06:59.833>of <00:06:59.941>irrelevant. <00:07:00.049>And <00:07:00.156>you <00:07:00.264>know <00:07:00.372>what? <00:07:00.479>Why 00:07:00.790 --> 00:07:00.800 align:start position:0% <00:07:00.790>of <00:07:00.791>irrelevant. <00:07:00.793>And <00:07:00.794>you <00:07:00.796>know <00:07:00.797>what? <00:07:00.799>Why 00:07:00.800 --> 00:07:01.909 align:start position:0% <00:07:00.800>of <00:07:00.883>irrelevant. <00:07:00.966>And <00:07:01.049>you <00:07:01.132>know <00:07:01.215>what? <00:07:01.299>Why <00:07:01.382>why <00:07:01.465>is <00:07:01.548>that <00:07:01.631>irrelevant? <00:07:01.714>Well, <00:07:01.798>because 00:07:01.909 --> 00:07:01.919 align:start position:0% <00:07:01.909>why <00:07:01.910>is <00:07:01.912>that <00:07:01.914>irrelevant? <00:07:01.916>Well, <00:07:01.918>because 00:07:01.919 --> 00:07:03.950 align:start position:0% <00:07:01.919>why <00:07:02.046>is <00:07:02.173>that <00:07:02.300>irrelevant? <00:07:02.428>Well, <00:07:02.555>because <00:07:02.682>LLM <00:07:02.809>knows <00:07:02.937>nothing <00:07:03.064>about <00:07:03.191>your <00:07:03.318>specific 00:07:03.950 --> 00:07:03.960 align:start position:0% <00:07:03.950>LLM <00:07:03.951>knows <00:07:03.953>nothing <00:07:03.955>about <00:07:03.957>your <00:07:03.959>specific 00:07:03.960 --> 00:07:06.310 align:start position:0% <00:07:03.960>LLM <00:07:04.067>knows <00:07:04.175>nothing <00:07:04.283>about <00:07:04.390>your <00:07:04.498>specific <00:07:04.606>React <00:07:04.713>stack. <00:07:04.821>Cuz <00:07:04.929>in <00:07:05.036>fact, <00:07:05.144>React <00:07:05.252>is <00:07:05.359>just 00:07:06.310 --> 00:07:06.320 align:start position:0% <00:07:06.310>React <00:07:06.311>stack. <00:07:06.312>Cuz <00:07:06.313>in <00:07:06.315>fact, <00:07:06.316>React <00:07:06.317>is <00:07:06.319>just 00:07:06.320 --> 00:07:07.310 align:start position:0% <00:07:06.320>React <00:07:06.383>stack. <00:07:06.447>Cuz <00:07:06.510>in <00:07:06.574>fact, <00:07:06.638>React <00:07:06.701>is <00:07:06.765>just <00:07:06.829>it's <00:07:06.892>it's <00:07:06.956>not <00:07:07.020>a <00:07:07.083>framework. <00:07:07.147>It's <00:07:07.211>a 00:07:07.310 --> 00:07:07.320 align:start position:0% <00:07:07.310>it's <00:07:07.311>it's <00:07:07.313>not <00:07:07.314>a <00:07:07.316>framework. <00:07:07.317>It's <00:07:07.319>a 00:07:07.320 --> 00:07:08.710 align:start position:0% <00:07:07.320>it's <00:07:07.416>it's <00:07:07.512>not <00:07:07.608>a <00:07:07.704>framework. <00:07:07.801>It's <00:07:07.897>a <00:07:07.993>library. <00:07:08.089>You <00:07:08.186>pick <00:07:08.282>and <00:07:08.378>choose <00:07:08.474>all <00:07:08.570>the 00:07:08.710 --> 00:07:08.720 align:start position:0% <00:07:08.710>library. <00:07:08.711>You <00:07:08.712>pick <00:07:08.714>and <00:07:08.716>choose <00:07:08.717>all <00:07:08.719>the 00:07:08.720 --> 00:07:10.670 align:start position:0% <00:07:08.720>library. <00:07:08.836>You <00:07:08.953>pick <00:07:09.070>and <00:07:09.186>choose <00:07:09.303>all <00:07:09.420>the <00:07:09.536>components. <00:07:09.653>You <00:07:09.770>create <00:07:09.886>your <00:07:10.003>own <00:07:10.120>stack. 00:07:10.670 --> 00:07:10.680 align:start position:0% <00:07:10.670>components. <00:07:10.671>You <00:07:10.673>create <00:07:10.675>your <00:07:10.677>own <00:07:10.679>stack. 00:07:10.680 --> 00:07:12.590 align:start position:0% <00:07:10.680>components. <00:07:10.787>You <00:07:10.895>create <00:07:11.003>your <00:07:11.110>own <00:07:11.218>stack. <00:07:11.326>You <00:07:11.433>are <00:07:11.541>the <00:07:11.649>main <00:07:11.756>expert. <00:07:11.864>You <00:07:11.972>figure <00:07:12.080>out 00:07:12.590 --> 00:07:12.600 align:start position:0% <00:07:12.590>You <00:07:12.591>are <00:07:12.592>the <00:07:12.593>main <00:07:12.595>expert. <00:07:12.596>You <00:07:12.597>figure <00:07:12.599>out 00:07:12.600 --> 00:07:15.030 align:start position:0% <00:07:12.600>You <00:07:12.693>are <00:07:12.786>the <00:07:12.880>main <00:07:12.973>expert. <00:07:13.066>You <00:07:13.160>figure <00:07:13.253>out <00:07:13.346>what <00:07:13.440>your <00:07:13.533>stack <00:07:13.626>is. <00:07:13.720>LLM <00:07:13.813>has <00:07:13.906>only <00:07:14.000>generic 00:07:15.030 --> 00:07:15.040 align:start position:0% <00:07:15.030>what <00:07:15.031>your <00:07:15.032>stack <00:07:15.033>is. <00:07:15.035>LLM <00:07:15.036>has <00:07:15.037>only <00:07:15.039>generic 00:07:15.040 --> 00:07:16.909 align:start position:0% <00:07:15.040>what <00:07:15.156>your <00:07:15.273>stack <00:07:15.390>is. <00:07:15.506>LLM <00:07:15.623>has <00:07:15.740>only <00:07:15.856>generic <00:07:15.973>information <00:07:16.090>from <00:07:16.206>its <00:07:16.323>training <00:07:16.440>material. 00:07:16.909 --> 00:07:16.919 align:start position:0% <00:07:16.909>information <00:07:16.911>from <00:07:16.913>its <00:07:16.915>training <00:07:16.918>material. 00:07:16.919 --> 00:07:19.150 align:start position:0% <00:07:16.919>information <00:07:17.046>from <00:07:17.173>its <00:07:17.300>training <00:07:17.428>material. <00:07:17.555>So, <00:07:17.682>most <00:07:17.809>of <00:07:17.937>that <00:07:18.064>stuff <00:07:18.191>was <00:07:18.318>irrelevant. 00:07:19.150 --> 00:07:19.160 align:start position:0% <00:07:19.150>So, <00:07:19.151>most <00:07:19.153>of <00:07:19.154>that <00:07:19.156>stuff <00:07:19.157>was <00:07:19.159>irrelevant. 00:07:19.160 --> 00:07:20.590 align:start position:0% <00:07:19.160>So, <00:07:19.245>most <00:07:19.331>of <00:07:19.417>that <00:07:19.503>stuff <00:07:19.589>was <00:07:19.674>irrelevant. <00:07:19.760>We <00:07:19.846>took <00:07:19.932>on <00:07:20.018>a <00:07:20.103>mission. <00:07:20.189>Like, <00:07:20.275>we <00:07:20.361>have <00:07:20.447>to 00:07:20.590 --> 00:07:20.600 align:start position:0% <00:07:20.590>We <00:07:20.591>took <00:07:20.592>on <00:07:20.593>a <00:07:20.594>mission. <00:07:20.595>Like, <00:07:20.596>we <00:07:20.597>have <00:07:20.599>to 00:07:20.600 --> 00:07:22.070 align:start position:0% <00:07:20.600>We <00:07:20.688>took <00:07:20.776>on <00:07:20.864>a <00:07:20.952>mission. <00:07:21.041>Like, <00:07:21.129>we <00:07:21.217>have <00:07:21.305>to <00:07:21.393>make <00:07:21.482>this <00:07:21.570>agent <00:07:21.658>better, <00:07:21.746>right? <00:07:21.834>We <00:07:21.923>have 00:07:22.070 --> 00:07:22.080 align:start position:0% <00:07:22.070>make <00:07:22.071>this <00:07:22.073>agent <00:07:22.074>better, <00:07:22.075>right? <00:07:22.077>We <00:07:22.079>have 00:07:22.080 --> 00:07:24.390 align:start position:0% <00:07:22.080>make <00:07:22.173>this <00:07:22.266>agent <00:07:22.359>better, <00:07:22.453>right? <00:07:22.546>We <00:07:22.640>have <00:07:22.733>to <00:07:22.826>make <00:07:22.919>that <00:07:23.013>agent <00:07:23.106>to <00:07:23.200>post <00:07:23.293>comments <00:07:23.386>as <00:07:23.479>a 00:07:24.390 --> 00:07:24.400 align:start position:0% <00:07:24.390>to <00:07:24.391>make <00:07:24.392>that <00:07:24.393>agent <00:07:24.394>to <00:07:24.395>post <00:07:24.396>comments <00:07:24.397>as <00:07:24.399>a 00:07:24.400 --> 00:07:25.870 align:start position:0% <00:07:24.400>to <00:07:24.488>make <00:07:24.576>that <00:07:24.664>agent <00:07:24.752>to <00:07:24.841>post <00:07:24.929>comments <00:07:25.017>as <00:07:25.105>a <00:07:25.193>senior <00:07:25.282>engineer. <00:07:25.370>They <00:07:25.458>have <00:07:25.546>to <00:07:25.634>be <00:07:25.723>short. 00:07:25.870 --> 00:07:25.880 align:start position:0% <00:07:25.870>senior <00:07:25.871>engineer. <00:07:25.873>They <00:07:25.874>have <00:07:25.876>to <00:07:25.877>be <00:07:25.879>short. 00:07:25.880 --> 00:07:27.750 align:start position:0% <00:07:25.880>senior <00:07:25.980>engineer. <00:07:26.080>They <00:07:26.180>have <00:07:26.280>to <00:07:26.380>be <00:07:26.480>short. <00:07:26.580>They <00:07:26.680>have <00:07:26.780>to <00:07:26.880>be <00:07:26.980>attached <00:07:27.080>to <00:07:27.180>the <00:07:27.280>code. 00:07:27.750 --> 00:07:27.760 align:start position:0% <00:07:27.750>They <00:07:27.751>have <00:07:27.752>to <00:07:27.753>be <00:07:27.755>attached <00:07:27.756>to <00:07:27.757>the <00:07:27.759>code. 00:07:27.760 --> 00:07:29.310 align:start position:0% <00:07:27.760>They <00:07:27.867>have <00:07:27.974>to <00:07:28.081>be <00:07:28.189>attached <00:07:28.296>to <00:07:28.403>the <00:07:28.511>code. <00:07:28.618>They <00:07:28.725>should <00:07:28.833>have <00:07:28.940>real <00:07:29.047>suggestions, <00:07:29.155>no 00:07:29.310 --> 00:07:29.320 align:start position:0% <00:07:29.310>They <00:07:29.311>should <00:07:29.313>have <00:07:29.315>real <00:07:29.317>suggestions, <00:07:29.319>no 00:07:29.320 --> 00:07:31.030 align:start position:0% <00:07:29.320>They <00:07:29.475>should <00:07:29.631>have <00:07:29.786>real <00:07:29.942>suggestions, <00:07:30.097>no <00:07:30.253>nice-to-haves, <00:07:30.408>no <00:07:30.564>nitpicks, <00:07:30.719>but 00:07:31.030 --> 00:07:31.040 align:start position:0% <00:07:31.030>nice-to-haves, <00:07:31.033>no <00:07:31.036>nitpicks, <00:07:31.039>but 00:07:31.040 --> 00:07:34.830 align:start position:0% <00:07:31.040>nice-to-haves, <00:07:31.195>no <00:07:31.351>nitpicks, <00:07:31.506>but <00:07:31.662>crucially, <00:07:31.817>it <00:07:31.973>should <00:07:32.128>know <00:07:32.284>our <00:07:32.440>stack. 00:07:34.830 --> 00:07:34.840 align:start position:0% <00:07:34.830>crucially, <00:07:34.831>it <00:07:34.833>should <00:07:34.835>know <00:07:34.837>our <00:07:34.839>stack. 00:07:34.840 --> 00:07:36.510 align:start position:0% <00:07:34.840>crucially, <00:07:34.947>it <00:07:35.055>should <00:07:35.163>know <00:07:35.270>our <00:07:35.378>stack. <00:07:35.486>And <00:07:35.593>now <00:07:35.701>it's <00:07:35.809>time <00:07:35.916>for <00:07:36.024>live <00:07:36.132>demo. <00:07:36.240>Yeah? 00:07:36.510 --> 00:07:36.520 align:start position:0% <00:07:36.510>And <00:07:36.511>now <00:07:36.512>it's <00:07:36.513>time <00:07:36.515>for <00:07:36.516>live <00:07:36.517>demo. <00:07:36.519>Yeah? 00:07:36.520 --> 00:07:38.070 align:start position:0% <00:07:36.520>And <00:07:36.619>now <00:07:36.719>it's <00:07:36.818>time <00:07:36.918>for <00:07:37.018>live <00:07:37.117>demo. <00:07:37.217>Yeah? <00:07:37.317>Everyone <00:07:37.416>excited? <00:07:37.516>Should <00:07:37.616>we <00:07:37.715>do <00:07:37.815>it? <00:07:37.914>I 00:07:38.070 --> 00:07:38.080 align:start position:0% <00:07:38.070>Everyone <00:07:38.071>excited? <00:07:38.073>Should <00:07:38.074>we <00:07:38.075>do <00:07:38.077>it? <00:07:38.079>I 00:07:38.080 --> 00:07:39.070 align:start position:0% <00:07:38.080>Everyone <00:07:38.191>excited? <00:07:38.302>Should <00:07:38.414>we <00:07:38.525>do <00:07:38.636>it? <00:07:38.748>I <00:07:38.859>don't <00:07:38.971>know. 00:07:39.070 --> 00:07:39.080 align:start position:0% <00:07:39.070>don't <00:07:39.079>know. 00:07:39.080 --> 00:07:40.310 align:start position:0% <00:07:39.080>don't <00:07:39.190>know. <00:07:39.301>Oh <00:07:39.412>my <00:07:39.522>god. <00:07:39.633>So, <00:07:39.744>I <00:07:39.854>have <00:07:39.965>a <00:07:40.076>little <00:07:40.187>pull 00:07:40.310 --> 00:07:40.320 align:start position:0% <00:07:40.310>Oh <00:07:40.311>my <00:07:40.312>god. <00:07:40.313>So, <00:07:40.314>I <00:07:40.315>have <00:07:40.316>a <00:07:40.317>little <00:07:40.319>pull 00:07:40.320 --> 00:07:41.710 align:start position:0% <00:07:40.320>Oh <00:07:40.433>my <00:07:40.547>god. <00:07:40.661>So, <00:07:40.774>I <00:07:40.888>have <00:07:41.002>a <00:07:41.116>little <00:07:41.229>pull <00:07:41.343>request <00:07:41.457>in <00:07:41.570>here. 00:07:41.710 --> 00:07:41.720 align:start position:0% <00:07:41.710>request <00:07:41.714>in <00:07:41.719>here. 00:07:41.720 --> 00:07:43.510 align:start position:0% <00:07:41.720>request <00:07:41.895>in <00:07:42.070>here. <00:07:42.245>It's <00:07:42.420>nothing <00:07:42.595>fancy, <00:07:42.770>just <00:07:42.945>small <00:07:43.120>stats 00:07:43.510 --> 00:07:43.520 align:start position:0% <00:07:43.510>It's <00:07:43.511>nothing <00:07:43.513>fancy, <00:07:43.515>just <00:07:43.517>small <00:07:43.519>stats 00:07:43.520 --> 00:07:45.710 align:start position:0% <00:07:43.520>It's <00:07:43.636>nothing <00:07:43.753>fancy, <00:07:43.870>just <00:07:43.986>small <00:07:44.103>stats <00:07:44.219>tweaks. <00:07:44.336>It's <00:07:44.453>still <00:07:44.570>in <00:07:44.686>draft, <00:07:44.803>like <00:07:44.919>minor 00:07:45.710 --> 00:07:45.720 align:start position:0% <00:07:45.710>tweaks. <00:07:45.711>It's <00:07:45.712>still <00:07:45.714>in <00:07:45.716>draft, <00:07:45.717>like <00:07:45.719>minor 00:07:45.720 --> 00:07:47.390 align:start position:0% <00:07:45.720>tweaks. <00:07:45.847>It's <00:07:45.974>still <00:07:46.101>in <00:07:46.229>draft, <00:07:46.356>like <00:07:46.483>minor <00:07:46.610>cleanup, <00:07:46.738>short <00:07:46.865>description, <00:07:46.992>all <00:07:47.120>good. 00:07:47.390 --> 00:07:47.400 align:start position:0% <00:07:47.390>cleanup, <00:07:47.392>short <00:07:47.394>description, <00:07:47.396>all <00:07:47.399>good. 00:07:47.400 --> 00:07:49.950 align:start position:0% <00:07:47.400>cleanup, <00:07:47.527>short <00:07:47.654>description, <00:07:47.781>all <00:07:47.909>good. <00:07:48.036>Just <00:07:48.163>19 <00:07:48.290>lines <00:07:48.418>of <00:07:48.545>code. <00:07:48.672>Nothing <00:07:48.799>nothing 00:07:49.950 --> 00:07:49.960 align:start position:0% <00:07:49.950>Just <00:07:49.951>19 <00:07:49.953>lines <00:07:49.954>of <00:07:49.955>code. <00:07:49.957>Nothing <00:07:49.959>nothing 00:07:49.960 --> 00:07:51.510 align:start position:0% <00:07:49.960>Just <00:07:50.059>19 <00:07:50.159>lines <00:07:50.258>of <00:07:50.358>code. <00:07:50.458>Nothing <00:07:50.557>nothing <00:07:50.657>fancy, <00:07:50.757>a <00:07:50.856>few <00:07:50.956>methods <00:07:51.056>here <00:07:51.155>and <00:07:51.255>there. <00:07:51.355>So, 00:07:51.510 --> 00:07:51.520 align:start position:0% <00:07:51.510>fancy, <00:07:51.511>a <00:07:51.512>few <00:07:51.513>methods <00:07:51.515>here <00:07:51.516>and <00:07:51.517>there. <00:07:51.519>So, 00:07:51.520 --> 00:07:53.430 align:start position:0% <00:07:51.520>fancy, <00:07:51.613>a <00:07:51.706>few <00:07:51.799>methods <00:07:51.893>here <00:07:51.986>and <00:07:52.080>there. <00:07:52.173>So, <00:07:52.266>I'm <00:07:52.359>going <00:07:52.453>to <00:07:52.546>mark <00:07:52.640>it <00:07:52.733>as <00:07:52.826>review, <00:07:52.919>and 00:07:53.430 --> 00:07:53.440 align:start position:0% <00:07:53.430>I'm <00:07:53.431>going <00:07:53.432>to <00:07:53.433>mark <00:07:53.435>it <00:07:53.436>as <00:07:53.437>review, <00:07:53.439>and 00:07:53.440 --> 00:07:55.870 align:start position:0% <00:07:53.440>I'm <00:07:53.540>going <00:07:53.640>to <00:07:53.740>mark <00:07:53.840>it <00:07:53.940>as <00:07:54.040>review, <00:07:54.140>and <00:07:54.240>let's <00:07:54.340>see <00:07:54.440>what <00:07:54.540>we <00:07:54.640>get <00:07:54.740>from <00:07:54.840>our 00:07:55.870 --> 00:07:55.880 align:start position:0% <00:07:55.870>let's <00:07:55.871>see <00:07:55.873>what <00:07:55.874>we <00:07:55.876>get <00:07:55.877>from <00:07:55.879>our 00:07:55.880 --> 00:07:58.550 align:start position:0% <00:07:55.880>let's <00:07:56.020>see <00:07:56.159>what <00:07:56.300>we <00:07:56.440>get <00:07:56.580>from <00:07:56.719>our <00:07:56.860>agent <00:07:57.000>ready <00:07:57.140>for <00:07:57.280>review. 00:07:58.550 --> 00:07:58.560 align:start position:0% <00:07:58.550>agent <00:07:58.553>ready <00:07:58.556>for <00:07:58.559>review. 00:07:58.560 --> 00:08:02.670 align:start position:0% <00:07:58.560>agent <00:07:58.687>ready <00:07:58.814>for <00:07:58.941>review. <00:07:59.069>Okay. <00:07:59.196>So, <00:07:59.323>let's <00:07:59.450>get <00:07:59.578>back <00:07:59.705>to <00:07:59.832>the <00:07:59.960>slides. 00:08:02.670 --> 00:08:02.680 align:start position:0% <00:08:02.670>Okay. <00:08:02.671>So, <00:08:02.672>let's <00:08:02.673>get <00:08:02.675>back <00:08:02.676>to <00:08:02.677>the <00:08:02.679>slides. 00:08:02.680 --> 00:08:03.790 align:start position:0% <00:08:02.680>Okay. <00:08:02.742>So, <00:08:02.804>let's <00:08:02.867>get <00:08:02.929>back <00:08:02.992>to <00:08:03.054>the <00:08:03.117>slides. <00:08:03.179>And <00:08:03.241>we'll <00:08:03.304>come <00:08:03.366>back <00:08:03.429>to <00:08:03.491>it <00:08:03.554>later <00:08:03.616>and <00:08:03.679>see 00:08:03.790 --> 00:08:03.800 align:start position:0% <00:08:03.790>And <00:08:03.791>we'll <00:08:03.792>come <00:08:03.793>back <00:08:03.794>to <00:08:03.795>it <00:08:03.796>later <00:08:03.797>and <00:08:03.799>see 00:08:03.800 --> 00:08:04.950 align:start position:0% <00:08:03.800>And <00:08:03.903>we'll <00:08:04.007>come <00:08:04.110>back <00:08:04.214>to <00:08:04.317>it <00:08:04.421>later <00:08:04.524>and <00:08:04.628>see <00:08:04.731>what <00:08:04.835>happens. 00:08:04.950 --> 00:08:04.960 align:start position:0% <00:08:04.950>what <00:08:04.959>happens. 00:08:04.960 --> 00:08:06.150 align:start position:0% <00:08:04.960>what <00:08:05.067>happens. <00:08:05.174>So, <00:08:05.281>we <00:08:05.388>are <00:08:05.495>on <00:08:05.602>a <00:08:05.709>mission. <00:08:05.816>We <00:08:05.923>want <00:08:06.030>to 00:08:06.150 --> 00:08:06.160 align:start position:0% <00:08:06.150>So, <00:08:06.151>we <00:08:06.152>are <00:08:06.153>on <00:08:06.154>a <00:08:06.155>mission. <00:08:06.156>We <00:08:06.157>want <00:08:06.159>to 00:08:06.160 --> 00:08:08.590 align:start position:0% <00:08:06.160>So, <00:08:06.253>we <00:08:06.346>are <00:08:06.440>on <00:08:06.533>a <00:08:06.626>mission. <00:08:06.720>We <00:08:06.813>want <00:08:06.906>to <00:08:07.000>build <00:08:07.093>an <00:08:07.186>agent <00:08:07.280>that <00:08:07.373>knows <00:08:07.466>our <00:08:07.560>stack. 00:08:08.590 --> 00:08:08.600 align:start position:0% <00:08:08.590>build <00:08:08.591>an <00:08:08.592>agent <00:08:08.594>that <00:08:08.596>knows <00:08:08.597>our <00:08:08.599>stack. 00:08:08.600 --> 00:08:10.230 align:start position:0% <00:08:08.600>build <00:08:08.707>an <00:08:08.815>agent <00:08:08.923>that <00:08:09.030>knows <00:08:09.138>our <00:08:09.246>stack. <00:08:09.353>Where <00:08:09.461>do <00:08:09.569>you <00:08:09.676>get <00:08:09.784>that <00:08:09.892>context? <00:08:10.000>This 00:08:10.230 --> 00:08:10.240 align:start position:0% <00:08:10.230>Where <00:08:10.231>do <00:08:10.233>you <00:08:10.234>get <00:08:10.236>that <00:08:10.237>context? <00:08:10.239>This 00:08:10.240 --> 00:08:12.310 align:start position:0% <00:08:10.240>Where <00:08:10.347>do <00:08:10.455>you <00:08:10.563>get <00:08:10.670>that <00:08:10.778>context? <00:08:10.886>This <00:08:10.993>context <00:08:11.101>that <00:08:11.209>know <00:08:11.316>like <00:08:11.424>what <00:08:11.532>is <00:08:11.640>our 00:08:12.310 --> 00:08:12.320 align:start position:0% <00:08:12.310>context <00:08:12.311>that <00:08:12.313>know <00:08:12.314>like <00:08:12.316>what <00:08:12.317>is <00:08:12.319>our 00:08:12.320 --> 00:08:13.510 align:start position:0% <00:08:12.320>context <00:08:12.409>that <00:08:12.498>know <00:08:12.587>like <00:08:12.677>what <00:08:12.766>is <00:08:12.855>our <00:08:12.944>stack? <00:08:13.034>Where <00:08:13.123>do <00:08:13.212>you <00:08:13.301>get <00:08:13.390>that 00:08:13.510 --> 00:08:13.520 align:start position:0% <00:08:13.510>stack? <00:08:13.511>Where <00:08:13.513>do <00:08:13.515>you <00:08:13.517>get <00:08:13.519>that 00:08:13.520 --> 00:08:15.190 align:start position:0% <00:08:13.520>stack? <00:08:13.647>Where <00:08:13.774>do <00:08:13.901>you <00:08:14.029>get <00:08:14.156>that <00:08:14.283>information? <00:08:14.410>This <00:08:14.538>These <00:08:14.665>are <00:08:14.792>all <00:08:14.919>golden 00:08:15.190 --> 00:08:15.200 align:start position:0% <00:08:15.190>information? <00:08:15.191>This <00:08:15.193>These <00:08:15.195>are <00:08:15.197>all <00:08:15.199>golden 00:08:15.200 --> 00:08:17.030 align:start position:0% <00:08:15.200>information? <00:08:15.316>This <00:08:15.433>These <00:08:15.550>are <00:08:15.666>all <00:08:15.783>golden <00:08:15.900>nuggets <00:08:16.016>pieces. <00:08:16.133>Where <00:08:16.250>are <00:08:16.366>they <00:08:16.483>are? <00:08:16.599>They 00:08:17.030 --> 00:08:17.040 align:start position:0% <00:08:17.030>nuggets <00:08:17.031>pieces. <00:08:17.033>Where <00:08:17.034>are <00:08:17.036>they <00:08:17.037>are? <00:08:17.039>They 00:08:17.040 --> 00:08:19.590 align:start position:0% <00:08:17.040>nuggets <00:08:17.156>pieces. <00:08:17.273>Where <00:08:17.390>are <00:08:17.506>they <00:08:17.623>are? <00:08:17.740>They <00:08:17.856>scattered <00:08:17.973>in <00:08:18.090>a <00:08:18.206>human <00:08:18.323>brains, <00:08:18.440>right? 00:08:19.590 --> 00:08:19.600 align:start position:0% <00:08:19.590>scattered <00:08:19.591>in <00:08:19.593>a <00:08:19.595>human <00:08:19.597>brains, <00:08:19.599>right? 00:08:19.600 --> 00:08:20.830 align:start position:0% <00:08:19.600>scattered <00:08:19.685>in <00:08:19.770>a <00:08:19.855>human <00:08:19.940>brains, <00:08:20.025>right? <00:08:20.110>Turns <00:08:20.196>out <00:08:20.281>they <00:08:20.366>were <00:08:20.451>right <00:08:20.536>in <00:08:20.621>front <00:08:20.707>of 00:08:20.830 --> 00:08:20.840 align:start position:0% <00:08:20.830>Turns <00:08:20.831>out <00:08:20.832>they <00:08:20.833>were <00:08:20.835>right <00:08:20.836>in <00:08:20.837>front <00:08:20.839>of 00:08:20.840 --> 00:08:22.150 align:start position:0% <00:08:20.840>Turns <00:08:20.918>out <00:08:20.997>they <00:08:21.075>were <00:08:21.154>right <00:08:21.232>in <00:08:21.311>front <00:08:21.390>of <00:08:21.468>us. <00:08:21.547>All <00:08:21.626>of <00:08:21.704>those <00:08:21.783>comments <00:08:21.861>that <00:08:21.940>they <00:08:22.019>were 00:08:22.150 --> 00:08:22.160 align:start position:0% <00:08:22.150>us. <00:08:22.151>All <00:08:22.152>of <00:08:22.153>those <00:08:22.155>comments <00:08:22.156>that <00:08:22.157>they <00:08:22.159>were 00:08:22.160 --> 00:08:23.470 align:start position:0% <00:08:22.160>us. <00:08:22.250>All <00:08:22.341>of <00:08:22.432>those <00:08:22.522>comments <00:08:22.613>that <00:08:22.704>they <00:08:22.794>were <00:08:22.885>posted <00:08:22.976>on <00:08:23.066>pull <00:08:23.157>request, <00:08:23.248>we <00:08:23.339>just 00:08:23.470 --> 00:08:23.480 align:start position:0% <00:08:23.470>posted <00:08:23.471>on <00:08:23.473>pull <00:08:23.475>request, <00:08:23.477>we <00:08:23.479>just 00:08:23.480 --> 00:08:25.390 align:start position:0% <00:08:23.480>posted <00:08:23.596>on <00:08:23.713>pull <00:08:23.830>request, <00:08:23.946>we <00:08:24.063>just <00:08:24.180>harvested <00:08:24.296>all <00:08:24.413>of <00:08:24.530>this. <00:08:24.646>And <00:08:24.763>luckily, <00:08:24.880>we 00:08:25.390 --> 00:08:25.400 align:start position:0% <00:08:25.390>harvested <00:08:25.391>all <00:08:25.393>of <00:08:25.394>this. <00:08:25.395>And <00:08:25.397>luckily, <00:08:25.399>we 00:08:25.400 --> 00:08:26.790 align:start position:0% <00:08:25.400>harvested <00:08:25.496>all <00:08:25.592>of <00:08:25.688>this. <00:08:25.784>And <00:08:25.881>luckily, <00:08:25.977>we <00:08:26.073>had <00:08:26.169>integration <00:08:26.266>enabled. <00:08:26.362>So, <00:08:26.458>all <00:08:26.554>of <00:08:26.651>the 00:08:26.790 --> 00:08:26.800 align:start position:0% <00:08:26.790>had <00:08:26.791>integration <00:08:26.793>enabled. <00:08:26.794>So, <00:08:26.796>all <00:08:26.797>of <00:08:26.799>the 00:08:26.800 --> 00:08:28.150 align:start position:0% <00:08:26.800>had <00:08:26.910>integration <00:08:27.020>enabled. <00:08:27.131>So, <00:08:27.241>all <00:08:27.352>of <00:08:27.462>the <00:08:27.573>GitHub <00:08:27.683>comments <00:08:27.794>were <00:08:27.904>flowing <00:08:28.015>to 00:08:28.150 --> 00:08:28.160 align:start position:0% <00:08:28.150>GitHub <00:08:28.152>comments <00:08:28.154>were <00:08:28.156>flowing <00:08:28.159>to 00:08:28.160 --> 00:08:30.270 align:start position:0% <00:08:28.160>GitHub <00:08:28.300>comments <00:08:28.440>were <00:08:28.580>flowing <00:08:28.720>to <00:08:28.860>Snowflake. <00:08:29.000>Shout <00:08:29.140>out <00:08:29.280>to <00:08:29.420>Snow <00:08:29.560>Snowflake 00:08:30.270 --> 00:08:30.280 align:start position:0% <00:08:30.270>Snowflake. <00:08:30.271>Shout <00:08:30.273>out <00:08:30.275>to <00:08:30.277>Snow <00:08:30.279>Snowflake 00:08:30.280 --> 00:08:32.070 align:start position:0% <00:08:30.280>Snowflake. <00:08:30.380>Shout <00:08:30.479>out <00:08:30.580>to <00:08:30.679>Snow <00:08:30.780>Snowflake <00:08:30.880>folks, <00:08:30.979>love <00:08:31.080>you. <00:08:31.179>So, <00:08:31.280>we <00:08:31.380>had <00:08:31.479>all <00:08:31.580>of <00:08:31.679>those 00:08:32.070 --> 00:08:32.080 align:start position:0% <00:08:32.070>folks, <00:08:32.071>love <00:08:32.072>you. <00:08:32.073>So, <00:08:32.074>we <00:08:32.075>had <00:08:32.076>all <00:08:32.077>of <00:08:32.079>those 00:08:32.080 --> 00:08:33.750 align:start position:0% <00:08:32.080>folks, <00:08:32.180>love <00:08:32.280>you. <00:08:32.380>So, <00:08:32.480>we <00:08:32.580>had <00:08:32.680>all <00:08:32.780>of <00:08:32.880>those <00:08:32.980>comments <00:08:33.080>there. <00:08:33.180>So, <00:08:33.280>we <00:08:33.380>accumulated <00:08:33.480>them, 00:08:33.750 --> 00:08:33.760 align:start position:0% <00:08:33.750>comments <00:08:33.751>there. <00:08:33.753>So, <00:08:33.755>we <00:08:33.757>accumulated <00:08:33.759>them, 00:08:33.760 --> 00:08:36.110 align:start position:0% <00:08:33.760>comments <00:08:33.900>there. <00:08:34.039>So, <00:08:34.179>we <00:08:34.319>accumulated <00:08:34.460>them, <00:08:34.600>processed, <00:08:34.740>sliced <00:08:34.880>them, <00:08:35.020>summarized, <00:08:35.159>and 00:08:36.110 --> 00:08:36.120 align:start position:0% <00:08:36.110>processed, <00:08:36.112>sliced <00:08:36.114>them, <00:08:36.116>summarized, <00:08:36.119>and 00:08:36.120 --> 00:08:38.390 align:start position:0% <00:08:36.120>processed, <00:08:36.275>sliced <00:08:36.431>them, <00:08:36.586>summarized, <00:08:36.742>and <00:08:36.897>created <00:08:37.053>a <00:08:37.208>cloud <00:08:37.364>code <00:08:37.520>skill. 00:08:38.390 --> 00:08:38.400 align:start position:0% <00:08:38.390>created <00:08:38.392>a <00:08:38.394>cloud <00:08:38.396>code <00:08:38.399>skill. 00:08:38.400 --> 00:08:40.950 align:start position:0% <00:08:38.400>created <00:08:38.516>a <00:08:38.633>cloud <00:08:38.750>code <00:08:38.866>skill. <00:08:38.983>This <00:08:39.100>was <00:08:39.216>a <00:08:39.333>pinnacle <00:08:39.449>of <00:08:39.566>late <00:08:39.683>2025. <00:08:39.799>The 00:08:40.950 --> 00:08:40.960 align:start position:0% <00:08:40.950>This <00:08:40.951>was <00:08:40.952>a <00:08:40.953>pinnacle <00:08:40.955>of <00:08:40.956>late <00:08:40.957>2025. <00:08:40.959>The 00:08:40.960 --> 00:08:42.990 align:start position:0% <00:08:40.960>This <00:08:41.060>was <00:08:41.160>a <00:08:41.260>pinnacle <00:08:41.360>of <00:08:41.460>late <00:08:41.560>2025. <00:08:41.660>The <00:08:41.760>skills <00:08:41.860>were <00:08:41.960>new <00:08:42.060>thing. <00:08:42.160>So, <00:08:42.260>we <00:08:42.360>created 00:08:42.990 --> 00:08:43.000 align:start position:0% <00:08:42.990>skills <00:08:42.991>were <00:08:42.993>new <00:08:42.994>thing. <00:08:42.996>So, <00:08:42.997>we <00:08:42.999>created 00:08:43.000 --> 00:08:44.430 align:start position:0% <00:08:43.000>skills <00:08:43.107>were <00:08:43.214>new <00:08:43.321>thing. <00:08:43.429>So, <00:08:43.536>we <00:08:43.643>created <00:08:43.750>massive <00:08:43.857>markdown <00:08:43.965>files <00:08:44.072>with <00:08:44.179>all <00:08:44.286>the 00:08:44.430 --> 00:08:44.440 align:start position:0% <00:08:44.430>massive <00:08:44.431>markdown <00:08:44.433>files <00:08:44.435>with <00:08:44.437>all <00:08:44.439>the 00:08:44.440 --> 00:08:46.390 align:start position:0% <00:08:44.440>massive <00:08:44.595>markdown <00:08:44.751>files <00:08:44.906>with <00:08:45.062>all <00:08:45.217>the <00:08:45.373>patterns, <00:08:45.528>anti-patterns, <00:08:45.684>and <00:08:45.840>best 00:08:46.390 --> 00:08:46.400 align:start position:0% <00:08:46.390>patterns, <00:08:46.393>anti-patterns, <00:08:46.396>and <00:08:46.399>best 00:08:46.400 --> 00:08:47.950 align:start position:0% <00:08:46.400>patterns, <00:08:46.574>anti-patterns, <00:08:46.748>and <00:08:46.923>best <00:08:47.097>practices <00:08:47.271>encoded <00:08:47.446>curated <00:08:47.620>by <00:08:47.795>the 00:08:47.950 --> 00:08:47.960 align:start position:0% <00:08:47.950>practices <00:08:47.952>encoded <00:08:47.954>curated <00:08:47.956>by <00:08:47.959>the 00:08:47.960 --> 00:08:50.150 align:start position:0% <00:08:47.960>practices <00:08:48.087>encoded <00:08:48.214>curated <00:08:48.341>by <00:08:48.469>the <00:08:48.596>experts. <00:08:48.723>And <00:08:48.850>we <00:08:48.978>were <00:08:49.105>hoping <00:08:49.232>that <00:08:49.360>we're 00:08:50.150 --> 00:08:50.160 align:start position:0% <00:08:50.150>experts. <00:08:50.151>And <00:08:50.153>we <00:08:50.154>were <00:08:50.156>hoping <00:08:50.157>that <00:08:50.159>we're 00:08:50.160 --> 00:08:51.790 align:start position:0% <00:08:50.160>experts. <00:08:50.260>And <00:08:50.360>we <00:08:50.459>were <00:08:50.560>hoping <00:08:50.660>that <00:08:50.760>we're <00:08:50.860>going <00:08:50.959>to <00:08:51.060>get <00:08:51.160>our <00:08:51.260>agent <00:08:51.360>to <00:08:51.459>increase <00:08:51.560>the 00:08:51.790 --> 00:08:51.800 align:start position:0% <00:08:51.790>going <00:08:51.791>to <00:08:51.792>get <00:08:51.793>our <00:08:51.795>agent <00:08:51.796>to <00:08:51.797>increase <00:08:51.799>the 00:08:51.800 --> 00:08:53.350 align:start position:0% <00:08:51.800>going <00:08:51.916>to <00:08:52.032>get <00:08:52.148>our <00:08:52.265>agent <00:08:52.381>to <00:08:52.497>increase <00:08:52.613>the <00:08:52.730>signal-to-noise <00:08:52.846>ratio, <00:08:52.962>right? <00:08:53.078>We <00:08:53.195>wanted 00:08:53.350 --> 00:08:53.360 align:start position:0% <00:08:53.350>signal-to-noise <00:08:53.352>ratio, <00:08:53.354>right? <00:08:53.356>We <00:08:53.359>wanted 00:08:53.360 --> 00:08:56.070 align:start position:0% <00:08:53.360>signal-to-noise <00:08:53.476>ratio, <00:08:53.593>right? <00:08:53.710>We <00:08:53.826>wanted <00:08:53.943>those <00:08:54.060>super <00:08:54.176>cool <00:08:54.293>comments <00:08:54.410>that <00:08:54.526>is <00:08:54.643>if <00:08:54.760>an 00:08:56.070 --> 00:08:56.080 align:start position:0% <00:08:56.070>those <00:08:56.071>super <00:08:56.072>cool <00:08:56.073>comments <00:08:56.075>that <00:08:56.076>is <00:08:56.077>if <00:08:56.079>an 00:08:56.080 --> 00:08:57.470 align:start position:0% <00:08:56.080>those <00:08:56.169>super <00:08:56.258>cool <00:08:56.348>comments <00:08:56.437>that <00:08:56.526>is <00:08:56.616>if <00:08:56.705>an <00:08:56.794>expert <00:08:56.884>would <00:08:56.973>post <00:08:57.062>them. <00:08:57.152>And <00:08:57.241>we <00:08:57.331>didn't 00:08:57.470 --> 00:08:57.480 align:start position:0% <00:08:57.470>expert <00:08:57.471>would <00:08:57.473>post <00:08:57.474>them. <00:08:57.476>And <00:08:57.477>we <00:08:57.479>didn't 00:08:57.480 --> 00:09:00.750 align:start position:0% <00:08:57.480>expert <00:08:57.596>would <00:08:57.713>post <00:08:57.830>them. <00:08:57.946>And <00:08:58.063>we <00:08:58.180>didn't <00:08:58.296>want <00:08:58.413>those <00:08:58.530>massive <00:08:58.646>AI <00:08:58.763>generated <00:08:58.880>reviews. 00:09:00.750 --> 00:09:00.760 align:start position:0% <00:09:00.750>want <00:09:00.751>those <00:09:00.753>massive <00:09:00.755>AI <00:09:00.757>generated <00:09:00.759>reviews. 00:09:00.760 --> 00:09:01.950 align:start position:0% <00:09:00.760>want <00:09:00.842>those <00:09:00.924>massive <00:09:01.007>AI <00:09:01.089>generated <00:09:01.171>reviews. <00:09:01.254>Can <00:09:01.336>you <00:09:01.419>guess <00:09:01.501>what <00:09:01.583>happened <00:09:01.666>when <00:09:01.748>we <00:09:01.831>put 00:09:01.950 --> 00:09:01.960 align:start position:0% <00:09:01.950>Can <00:09:01.951>you <00:09:01.952>guess <00:09:01.953>what <00:09:01.955>happened <00:09:01.956>when <00:09:01.957>we <00:09:01.959>put 00:09:01.960 --> 00:09:04.230 align:start position:0% <00:09:01.960>Can <00:09:02.076>you <00:09:02.193>guess <00:09:02.310>what <00:09:02.426>happened <00:09:02.543>when <00:09:02.660>we <00:09:02.776>put <00:09:02.893>it <00:09:03.010>in <00:09:03.126>production? <00:09:03.243>Any <00:09:03.360>guesses? 00:09:04.230 --> 00:09:04.240 align:start position:0% <00:09:04.230>it <00:09:04.232>in <00:09:04.234>production? <00:09:04.236>Any <00:09:04.239>guesses? 00:09:04.240 --> 00:09:06.510 align:start position:0% <00:09:04.240>it <00:09:04.367>in <00:09:04.494>production? <00:09:04.621>Any <00:09:04.749>guesses? <00:09:04.876>Massive <00:09:05.003>failure. <00:09:05.130>We <00:09:05.258>got <00:09:05.385>so <00:09:05.512>much <00:09:05.640>more 00:09:06.510 --> 00:09:06.520 align:start position:0% <00:09:06.510>Massive <00:09:06.511>failure. <00:09:06.513>We <00:09:06.514>got <00:09:06.516>so <00:09:06.517>much <00:09:06.519>more 00:09:06.520 --> 00:09:08.670 align:start position:0% <00:09:06.520>Massive <00:09:06.636>failure. <00:09:06.753>We <00:09:06.870>got <00:09:06.986>so <00:09:07.103>much <00:09:07.220>more <00:09:07.336>noise. <00:09:07.453>Like, <00:09:07.569>it <00:09:07.686>was <00:09:07.803>ridiculous. <00:09:07.920>Like, 00:09:08.670 --> 00:09:08.680 align:start position:0% <00:09:08.670>noise. <00:09:08.671>Like, <00:09:08.673>it <00:09:08.675>was <00:09:08.677>ridiculous. <00:09:08.679>Like, 00:09:08.680 --> 00:09:10.310 align:start position:0% <00:09:08.680>noise. <00:09:08.796>Like, <00:09:08.913>it <00:09:09.030>was <00:09:09.146>ridiculous. <00:09:09.263>Like, <00:09:09.380>this <00:09:09.496>agent <00:09:09.613>started <00:09:09.729>to <00:09:09.846>post <00:09:09.963>dozens <00:09:10.079>and 00:09:10.310 --> 00:09:10.320 align:start position:0% <00:09:10.310>this <00:09:10.311>agent <00:09:10.313>started <00:09:10.314>to <00:09:10.316>post <00:09:10.317>dozens <00:09:10.319>and 00:09:10.320 --> 00:09:12.190 align:start position:0% <00:09:10.320>this <00:09:10.427>agent <00:09:10.535>started <00:09:10.643>to <00:09:10.750>post <00:09:10.858>dozens <00:09:10.966>and <00:09:11.073>dozens <00:09:11.181>of <00:09:11.289>comments <00:09:11.396>on <00:09:11.504>pull <00:09:11.612>requests, <00:09:11.720>and 00:09:12.190 --> 00:09:12.200 align:start position:0% <00:09:12.190>dozens <00:09:12.191>of <00:09:12.193>comments <00:09:12.194>on <00:09:12.196>pull <00:09:12.197>requests, <00:09:12.199>and 00:09:12.200 --> 00:09:13.950 align:start position:0% <00:09:12.200>dozens <00:09:12.293>of <00:09:12.386>comments <00:09:12.480>on <00:09:12.573>pull <00:09:12.666>requests, <00:09:12.760>and <00:09:12.853>we <00:09:12.946>had <00:09:13.040>to <00:09:13.133>turn <00:09:13.226>it <00:09:13.320>off <00:09:13.413>literally <00:09:13.506>the <00:09:13.600>same 00:09:13.950 --> 00:09:13.960 align:start position:0% <00:09:13.950>we <00:09:13.951>had <00:09:13.952>to <00:09:13.953>turn <00:09:13.954>it <00:09:13.955>off <00:09:13.956>literally <00:09:13.957>the <00:09:13.959>same 00:09:13.960 --> 00:09:15.350 align:start position:0% <00:09:13.960>we <00:09:14.099>had <00:09:14.238>to <00:09:14.377>turn <00:09:14.516>it <00:09:14.655>off <00:09:14.794>literally <00:09:14.933>the <00:09:15.072>same <00:09:15.211>day. 00:09:15.350 --> 00:09:15.360 align:start position:0% day. 00:09:15.360 --> 00:09:17.150 align:start position:0% <00:09:15.360>day. <00:09:15.535>So, <00:09:15.710>we <00:09:15.885>learned <00:09:16.060>the <00:09:16.235>hard <00:09:16.410>way <00:09:16.585>that <00:09:16.760>you 00:09:17.150 --> 00:09:17.160 align:start position:0% <00:09:17.150>So, <00:09:17.151>we <00:09:17.152>learned <00:09:17.153>the <00:09:17.155>hard <00:09:17.156>way <00:09:17.157>that <00:09:17.159>you 00:09:17.160 --> 00:09:18.829 align:start position:0% <00:09:17.160>So, <00:09:17.253>we <00:09:17.346>learned <00:09:17.439>the <00:09:17.533>hard <00:09:17.626>way <00:09:17.719>that <00:09:17.813>you <00:09:17.906>actually <00:09:18.000>need <00:09:18.093>some <00:09:18.186>tests. <00:09:18.280>But <00:09:18.373>we <00:09:18.466>have <00:09:18.560>a 00:09:18.829 --> 00:09:18.839 align:start position:0% <00:09:18.829>actually <00:09:18.830>need <00:09:18.831>some <00:09:18.832>tests. <00:09:18.834>But <00:09:18.835>we <00:09:18.836>have <00:09:18.838>a 00:09:18.839 --> 00:09:20.710 align:start position:0% <00:09:18.839>actually <00:09:18.926>need <00:09:19.013>some <00:09:19.101>tests. <00:09:19.189>But <00:09:19.276>we <00:09:19.363>have <00:09:19.451>a <00:09:19.539>fancy <00:09:19.626>word <00:09:19.714>for <00:09:19.801>tests <00:09:19.888>in <00:09:19.976>the <00:09:20.064>age <00:09:20.151>of <00:09:20.238>AI, 00:09:20.710 --> 00:09:20.720 align:start position:0% <00:09:20.710>fancy <00:09:20.711>word <00:09:20.712>for <00:09:20.713>tests <00:09:20.714>in <00:09:20.715>the <00:09:20.716>age <00:09:20.717>of <00:09:20.719>AI, 00:09:20.720 --> 00:09:22.630 align:start position:0% <00:09:20.720>fancy <00:09:20.813>word <00:09:20.906>for <00:09:21.000>tests <00:09:21.093>in <00:09:21.186>the <00:09:21.280>age <00:09:21.373>of <00:09:21.466>AI, <00:09:21.560>right? <00:09:21.653>They <00:09:21.746>call <00:09:21.840>evals. <00:09:21.933>Great. <00:09:22.026>Okay. <00:09:22.120>So, 00:09:22.630 --> 00:09:22.640 align:start position:0% <00:09:22.630>right? <00:09:22.631>They <00:09:22.633>call <00:09:22.634>evals. <00:09:22.636>Great. <00:09:22.637>Okay. <00:09:22.639>So, 00:09:22.640 --> 00:09:23.950 align:start position:0% <00:09:22.640>right? <00:09:22.718>They <00:09:22.797>call <00:09:22.875>evals. <00:09:22.954>Great. <00:09:23.033>Okay. <00:09:23.111>So, <00:09:23.190>we <00:09:23.268>need <00:09:23.347>some <00:09:23.426>evals. <00:09:23.504>So, <00:09:23.583>we <00:09:23.661>built <00:09:23.740>a <00:09:23.819>mock 00:09:23.950 --> 00:09:23.960 align:start position:0% <00:09:23.950>we <00:09:23.951>need <00:09:23.952>some <00:09:23.953>evals. <00:09:23.954>So, <00:09:23.955>we <00:09:23.956>built <00:09:23.957>a <00:09:23.959>mock 00:09:23.960 --> 00:09:26.470 align:start position:0% <00:09:23.960>we <00:09:24.053>need <00:09:24.146>some <00:09:24.240>evals. <00:09:24.333>So, <00:09:24.426>we <00:09:24.520>built <00:09:24.613>a <00:09:24.706>mock <00:09:24.800>PR <00:09:24.893>review <00:09:24.986>system. <00:09:25.080>Nothing <00:09:25.173>fancy. <00:09:25.266>We <00:09:25.360>spin 00:09:26.470 --> 00:09:26.480 align:start position:0% <00:09:26.470>PR <00:09:26.471>review <00:09:26.473>system. <00:09:26.474>Nothing <00:09:26.476>fancy. <00:09:26.477>We <00:09:26.479>spin 00:09:26.480 --> 00:09:28.190 align:start position:0% <00:09:26.480>PR <00:09:26.587>review <00:09:26.695>system. <00:09:26.803>Nothing <00:09:26.910>fancy. <00:09:27.018>We <00:09:27.126>spin <00:09:27.233>up <00:09:27.341>a <00:09:27.449>Docker <00:09:27.556>container. <00:09:27.664>We <00:09:27.772>take <00:09:27.880>the 00:09:28.190 --> 00:09:28.200 align:start position:0% <00:09:28.190>up <00:09:28.191>a <00:09:28.193>Docker <00:09:28.194>container. <00:09:28.196>We <00:09:28.197>take <00:09:28.199>the 00:09:28.200 --> 00:09:30.150 align:start position:0% <00:09:28.200>up <00:09:28.300>a <00:09:28.400>Docker <00:09:28.500>container. <00:09:28.600>We <00:09:28.700>take <00:09:28.800>the <00:09:28.900>branch <00:09:29.000>off <00:09:29.100>of <00:09:29.200>GitHub. <00:09:29.300>We <00:09:29.400>check <00:09:29.500>check <00:09:29.600>out 00:09:30.150 --> 00:09:30.160 align:start position:0% <00:09:30.150>branch <00:09:30.151>off <00:09:30.152>of <00:09:30.153>GitHub. <00:09:30.155>We <00:09:30.156>check <00:09:30.157>check <00:09:30.159>out 00:09:30.160 --> 00:09:31.710 align:start position:0% <00:09:30.160>branch <00:09:30.247>off <00:09:30.334>of <00:09:30.421>GitHub. <00:09:30.508>We <00:09:30.595>check <00:09:30.683>check <00:09:30.770>out <00:09:30.857>all <00:09:30.944>the <00:09:31.031>code. <00:09:31.119>We <00:09:31.206>revert <00:09:31.293>the <00:09:31.380>code <00:09:31.467>to <00:09:31.555>a 00:09:31.710 --> 00:09:31.720 align:start position:0% <00:09:31.710>all <00:09:31.711>the <00:09:31.712>code. <00:09:31.713>We <00:09:31.714>revert <00:09:31.715>the <00:09:31.716>code <00:09:31.717>to <00:09:31.719>a 00:09:31.720 --> 00:09:33.870 align:start position:0% <00:09:31.720>all <00:09:31.813>the <00:09:31.906>code. <00:09:32.000>We <00:09:32.093>revert <00:09:32.186>the <00:09:32.280>code <00:09:32.373>to <00:09:32.466>a <00:09:32.560>specific <00:09:32.653>sha <00:09:32.746>that <00:09:32.840>we <00:09:32.933>want <00:09:33.026>to <00:09:33.120>review, 00:09:33.870 --> 00:09:33.880 align:start position:0% <00:09:33.870>specific <00:09:33.871>sha <00:09:33.873>that <00:09:33.874>we <00:09:33.876>want <00:09:33.877>to <00:09:33.879>review, 00:09:33.880 --> 00:09:35.270 align:start position:0% <00:09:33.880>specific <00:09:33.976>sha <00:09:34.072>that <00:09:34.168>we <00:09:34.264>want <00:09:34.361>to <00:09:34.457>review, <00:09:34.553>right? <00:09:34.649>As <00:09:34.746>a <00:09:34.842>historical <00:09:34.938>pull <00:09:35.034>request. <00:09:35.131>If 00:09:35.270 --> 00:09:35.280 align:start position:0% <00:09:35.270>right? <00:09:35.271>As <00:09:35.273>a <00:09:35.274>historical <00:09:35.276>pull <00:09:35.277>request. <00:09:35.279>If 00:09:35.280 --> 00:09:36.829 align:start position:0% <00:09:35.280>right? <00:09:35.379>As <00:09:35.479>a <00:09:35.578>historical <00:09:35.678>pull <00:09:35.777>request. <00:09:35.877>If <00:09:35.977>you <00:09:36.076>review <00:09:36.176>the <00:09:36.275>end <00:09:36.375>state, <00:09:36.474>the <00:09:36.574>bugs <00:09:36.674>might 00:09:36.829 --> 00:09:36.839 align:start position:0% <00:09:36.829>you <00:09:36.830>review <00:09:36.831>the <00:09:36.832>end <00:09:36.834>state, <00:09:36.835>the <00:09:36.836>bugs <00:09:36.838>might 00:09:36.839 --> 00:09:38.070 align:start position:0% <00:09:36.839>you <00:09:36.908>review <00:09:36.977>the <00:09:37.046>end <00:09:37.115>state, <00:09:37.185>the <00:09:37.254>bugs <00:09:37.323>might <00:09:37.392>not <00:09:37.462>be <00:09:37.531>there, <00:09:37.600>so <00:09:37.669>you <00:09:37.739>have <00:09:37.808>to <00:09:37.877>roll <00:09:37.946>it 00:09:38.070 --> 00:09:38.080 align:start position:0% <00:09:38.070>not <00:09:38.071>be <00:09:38.072>there, <00:09:38.073>so <00:09:38.074>you <00:09:38.075>have <00:09:38.076>to <00:09:38.077>roll <00:09:38.079>it 00:09:38.080 --> 00:09:40.830 align:start position:0% <00:09:38.080>not <00:09:38.180>be <00:09:38.280>there, <00:09:38.380>so <00:09:38.480>you <00:09:38.580>have <00:09:38.680>to <00:09:38.780>roll <00:09:38.880>it <00:09:38.980>back <00:09:39.080>to <00:09:39.180>a <00:09:39.280>certain <00:09:39.380>middle <00:09:39.480>point. 00:09:40.830 --> 00:09:40.840 align:start position:0% <00:09:40.830>back <00:09:40.831>to <00:09:40.833>a <00:09:40.835>certain <00:09:40.837>middle <00:09:40.839>point. 00:09:40.840 --> 00:09:43.270 align:start position:0% <00:09:40.840>back <00:09:40.947>to <00:09:41.055>a <00:09:41.163>certain <00:09:41.270>middle <00:09:41.378>point. <00:09:41.486>And <00:09:41.593>then <00:09:41.701>we <00:09:41.809>take <00:09:41.916>that <00:09:42.024>thing, <00:09:42.132>we <00:09:42.240>run 00:09:43.270 --> 00:09:43.280 align:start position:0% <00:09:43.270>And <00:09:43.271>then <00:09:43.272>we <00:09:43.273>take <00:09:43.275>that <00:09:43.276>thing, <00:09:43.277>we <00:09:43.279>run 00:09:43.280 --> 00:09:44.590 align:start position:0% <00:09:43.280>And <00:09:43.364>then <00:09:43.448>we <00:09:43.532>take <00:09:43.616>that <00:09:43.701>thing, <00:09:43.785>we <00:09:43.869>run <00:09:43.953>Claude <00:09:44.037>in <00:09:44.122>that <00:09:44.206>same <00:09:44.290>container <00:09:44.374>and <00:09:44.459>say, 00:09:44.590 --> 00:09:44.600 align:start position:0% <00:09:44.590>Claude <00:09:44.591>in <00:09:44.593>that <00:09:44.594>same <00:09:44.596>container <00:09:44.597>and <00:09:44.599>say, 00:09:44.600 --> 00:09:45.870 align:start position:0% <00:09:44.600>Claude <00:09:44.695>in <00:09:44.790>that <00:09:44.885>same <00:09:44.981>container <00:09:45.076>and <00:09:45.171>say, <00:09:45.266>"Hey <00:09:45.362>Claude, <00:09:45.457>review <00:09:45.552>this <00:09:45.647>pull <00:09:45.743>request. 00:09:45.870 --> 00:09:45.880 align:start position:0% <00:09:45.870>"Hey <00:09:45.871>Claude, <00:09:45.873>review <00:09:45.875>this <00:09:45.877>pull <00:09:45.879>request. 00:09:45.880 --> 00:09:47.390 align:start position:0% <00:09:45.880>"Hey <00:09:45.984>Claude, <00:09:46.089>review <00:09:46.193>this <00:09:46.298>pull <00:09:46.402>request. <00:09:46.507>This <00:09:46.611>is <00:09:46.716>the <00:09:46.820>prompt. <00:09:46.925>This <00:09:47.029>is <00:09:47.134>the <00:09:47.239>diff. 00:09:47.390 --> 00:09:47.400 align:start position:0% <00:09:47.390>This <00:09:47.391>is <00:09:47.392>the <00:09:47.393>prompt. <00:09:47.395>This <00:09:47.396>is <00:09:47.397>the <00:09:47.399>diff. 00:09:47.400 --> 00:09:50.110 align:start position:0% <00:09:47.400>This <00:09:47.516>is <00:09:47.633>the <00:09:47.750>prompt. <00:09:47.866>This <00:09:47.983>is <00:09:48.100>the <00:09:48.216>diff. <00:09:48.333>Like <00:09:48.449>do <00:09:48.566>do <00:09:48.683>your <00:09:48.800>thing." 00:09:50.110 --> 00:09:50.120 align:start position:0% <00:09:50.110>Like <00:09:50.112>do <00:09:50.114>do <00:09:50.116>your <00:09:50.119>thing." 00:09:50.120 --> 00:09:51.710 align:start position:0% <00:09:50.120>Like <00:09:50.236>do <00:09:50.353>do <00:09:50.470>your <00:09:50.586>thing." <00:09:50.703>But <00:09:50.820>the <00:09:50.936>trick <00:09:51.053>is <00:09:51.170>that <00:09:51.286>when <00:09:51.403>Claude <00:09:51.520>is 00:09:51.710 --> 00:09:51.720 align:start position:0% <00:09:51.710>But <00:09:51.711>the <00:09:51.712>trick <00:09:51.713>is <00:09:51.715>that <00:09:51.716>when <00:09:51.717>Claude <00:09:51.719>is 00:09:51.720 --> 00:09:53.510 align:start position:0% <00:09:51.720>But <00:09:51.820>the <00:09:51.920>trick <00:09:52.020>is <00:09:52.120>that <00:09:52.220>when <00:09:52.320>Claude <00:09:52.420>is <00:09:52.520>about <00:09:52.620>to <00:09:52.720>post <00:09:52.820>those <00:09:52.920>comments <00:09:53.020>to <00:09:53.120>GitHub, 00:09:53.510 --> 00:09:53.520 align:start position:0% <00:09:53.510>about <00:09:53.511>to <00:09:53.513>post <00:09:53.514>those <00:09:53.516>comments <00:09:53.517>to <00:09:53.519>GitHub, 00:09:53.520 --> 00:09:55.550 align:start position:0% <00:09:53.520>about <00:09:53.613>to <00:09:53.706>post <00:09:53.800>those <00:09:53.893>comments <00:09:53.986>to <00:09:54.079>GitHub, <00:09:54.173>we <00:09:54.266>put <00:09:54.360>in <00:09:54.453>a <00:09:54.546>mock <00:09:54.640>MCP <00:09:54.733>server <00:09:54.826>that <00:09:54.920>instead 00:09:55.550 --> 00:09:55.560 align:start position:0% <00:09:55.550>we <00:09:55.551>put <00:09:55.552>in <00:09:55.553>a <00:09:55.554>mock <00:09:55.555>MCP <00:09:55.556>server <00:09:55.557>that <00:09:55.559>instead 00:09:55.560 --> 00:09:57.350 align:start position:0% <00:09:55.560>we <00:09:55.647>put <00:09:55.734>in <00:09:55.822>a <00:09:55.910>mock <00:09:55.997>MCP <00:09:56.084>server <00:09:56.172>that <00:09:56.260>instead <00:09:56.347>of <00:09:56.435>posting <00:09:56.522>them <00:09:56.609>to <00:09:56.697>GitHub <00:09:56.785>puts <00:09:56.872>them <00:09:56.959>into 00:09:57.350 --> 00:09:57.360 align:start position:0% <00:09:57.350>of <00:09:57.351>posting <00:09:57.352>them <00:09:57.353>to <00:09:57.355>GitHub <00:09:57.356>puts <00:09:57.357>them <00:09:57.359>into 00:09:57.360 --> 00:09:59.670 align:start position:0% <00:09:57.360>of <00:09:57.453>posting <00:09:57.546>them <00:09:57.640>to <00:09:57.733>GitHub <00:09:57.826>puts <00:09:57.920>them <00:09:58.013>into <00:09:58.106>the <00:09:58.200>file, <00:09:58.293>markdown <00:09:58.386>file <00:09:58.480>on <00:09:58.573>this <00:09:58.666>that <00:09:58.760>we 00:09:59.670 --> 00:09:59.680 align:start position:0% <00:09:59.670>the <00:09:59.671>file, <00:09:59.672>markdown <00:09:59.673>file <00:09:59.675>on <00:09:59.676>this <00:09:59.677>that <00:09:59.679>we 00:09:59.680 --> 00:10:02.030 align:start position:0% <00:09:59.680>the <00:09:59.796>file, <00:09:59.913>markdown <00:10:00.030>file <00:10:00.146>on <00:10:00.263>this <00:10:00.380>that <00:10:00.496>we <00:10:00.613>can <00:10:00.729>eyeball <00:10:00.846>for <00:10:00.963>those <00:10:01.079>comments. 00:10:02.030 --> 00:10:02.040 align:start position:0% <00:10:02.030>can <00:10:02.032>eyeball <00:10:02.034>for <00:10:02.036>those <00:10:02.039>comments. 00:10:02.040 --> 00:10:03.550 align:start position:0% <00:10:02.040>can <00:10:02.144>eyeball <00:10:02.249>for <00:10:02.353>those <00:10:02.458>comments. <00:10:02.562>So <00:10:02.667>now <00:10:02.771>we <00:10:02.876>were <00:10:02.980>able <00:10:03.085>to <00:10:03.189>do <00:10:03.294>like <00:10:03.399>an 00:10:03.550 --> 00:10:03.560 align:start position:0% <00:10:03.550>So <00:10:03.551>now <00:10:03.552>we <00:10:03.553>were <00:10:03.554>able <00:10:03.555>to <00:10:03.556>do <00:10:03.557>like <00:10:03.559>an 00:10:03.560 --> 00:10:05.310 align:start position:0% <00:10:03.560>So <00:10:03.647>now <00:10:03.734>we <00:10:03.822>were <00:10:03.910>able <00:10:03.997>to <00:10:04.084>do <00:10:04.172>like <00:10:04.260>an <00:10:04.347>evaluation <00:10:04.435>of <00:10:04.522>our <00:10:04.609>agent. <00:10:04.697>We <00:10:04.785>were <00:10:04.872>able <00:10:04.959>to 00:10:05.310 --> 00:10:05.320 align:start position:0% <00:10:05.310>evaluation <00:10:05.311>of <00:10:05.312>our <00:10:05.313>agent. <00:10:05.315>We <00:10:05.316>were <00:10:05.317>able <00:10:05.319>to 00:10:05.320 --> 00:10:06.670 align:start position:0% <00:10:05.320>evaluation <00:10:05.406>of <00:10:05.493>our <00:10:05.580>agent. <00:10:05.667>We <00:10:05.753>were <00:10:05.840>able <00:10:05.927>to <00:10:06.014>see <00:10:06.101>the <00:10:06.187>comments <00:10:06.274>before <00:10:06.361>we <00:10:06.448>put <00:10:06.535>that 00:10:06.670 --> 00:10:06.680 align:start position:0% <00:10:06.670>see <00:10:06.671>the <00:10:06.673>comments <00:10:06.674>before <00:10:06.675>we <00:10:06.677>put <00:10:06.679>that 00:10:06.680 --> 00:10:08.270 align:start position:0% <00:10:06.680>see <00:10:06.787>the <00:10:06.895>comments <00:10:07.003>before <00:10:07.110>we <00:10:07.218>put <00:10:07.326>that <00:10:07.433>thing <00:10:07.541>in <00:10:07.649>production <00:10:07.756>and <00:10:07.864>confuse <00:10:07.972>of <00:10:08.079>all 00:10:08.270 --> 00:10:08.280 align:start position:0% <00:10:08.270>thing <00:10:08.271>in <00:10:08.273>production <00:10:08.274>and <00:10:08.276>confuse <00:10:08.277>of <00:10:08.279>all 00:10:08.280 --> 00:10:10.670 align:start position:0% <00:10:08.280>thing <00:10:08.387>in <00:10:08.495>production <00:10:08.603>and <00:10:08.710>confuse <00:10:08.818>of <00:10:08.926>all <00:10:09.033>of <00:10:09.141>our <00:10:09.249>engineers. <00:10:09.356>But <00:10:09.464>then <00:10:09.572>we <00:10:09.680>quickly 00:10:10.670 --> 00:10:10.680 align:start position:0% <00:10:10.670>of <00:10:10.671>our <00:10:10.673>engineers. <00:10:10.674>But <00:10:10.675>then <00:10:10.677>we <00:10:10.679>quickly 00:10:10.680 --> 00:10:12.110 align:start position:0% <00:10:10.680>of <00:10:10.779>our <00:10:10.877>engineers. <00:10:10.977>But <00:10:11.076>then <00:10:11.175>we <00:10:11.274>quickly <00:10:11.372>realized <00:10:11.472>one <00:10:11.571>pull <00:10:11.670>request <00:10:11.769>is <00:10:11.868>not <00:10:11.967>enough, 00:10:12.110 --> 00:10:12.120 align:start position:0% <00:10:12.110>realized <00:10:12.111>one <00:10:12.113>pull <00:10:12.114>request <00:10:12.116>is <00:10:12.117>not <00:10:12.119>enough, 00:10:12.120 --> 00:10:13.790 align:start position:0% <00:10:12.120>realized <00:10:12.227>one <00:10:12.335>pull <00:10:12.443>request <00:10:12.550>is <00:10:12.658>not <00:10:12.766>enough, <00:10:12.873>right? <00:10:12.981>You <00:10:13.089>need <00:10:13.196>like <00:10:13.304>dozens <00:10:13.412>and <00:10:13.520>dozens 00:10:13.790 --> 00:10:13.800 align:start position:0% <00:10:13.790>right? <00:10:13.791>You <00:10:13.793>need <00:10:13.794>like <00:10:13.795>dozens <00:10:13.797>and <00:10:13.799>dozens 00:10:13.800 --> 00:10:14.910 align:start position:0% <00:10:13.800>right? <00:10:13.871>You <00:10:13.942>need <00:10:14.014>like <00:10:14.085>dozens <00:10:14.156>and <00:10:14.228>dozens <00:10:14.299>of <00:10:14.370>those <00:10:14.442>pull <00:10:14.513>requests <00:10:14.584>to <00:10:14.656>see <00:10:14.727>all <00:10:14.799>of 00:10:14.910 --> 00:10:14.920 align:start position:0% <00:10:14.910>of <00:10:14.911>those <00:10:14.912>pull <00:10:14.913>requests <00:10:14.915>to <00:10:14.916>see <00:10:14.917>all <00:10:14.919>of 00:10:14.920 --> 00:10:16.310 align:start position:0% <00:10:14.920>of <00:10:15.009>those <00:10:15.098>pull <00:10:15.188>requests <00:10:15.277>to <00:10:15.366>see <00:10:15.456>all <00:10:15.545>of <00:10:15.634>those <00:10:15.724>comments <00:10:15.813>and <00:10:15.902>service <00:10:15.992>all <00:10:16.081>of <00:10:16.170>the 00:10:16.310 --> 00:10:16.320 align:start position:0% <00:10:16.310>those <00:10:16.311>comments <00:10:16.313>and <00:10:16.314>service <00:10:16.316>all <00:10:16.317>of <00:10:16.319>the 00:10:16.320 --> 00:10:18.750 align:start position:0% <00:10:16.320>those <00:10:16.427>comments <00:10:16.535>and <00:10:16.643>service <00:10:16.750>all <00:10:16.858>of <00:10:16.966>the <00:10:17.073>edge <00:10:17.181>cases <00:10:17.289>and <00:10:17.396>like <00:10:17.504>fix <00:10:17.612>the <00:10:17.720>prompts. 00:10:18.750 --> 00:10:18.760 align:start position:0% <00:10:18.750>edge <00:10:18.751>cases <00:10:18.753>and <00:10:18.754>like <00:10:18.756>fix <00:10:18.757>the <00:10:18.759>prompts. 00:10:18.760 --> 00:10:20.110 align:start position:0% <00:10:18.760>edge <00:10:18.846>cases <00:10:18.933>and <00:10:19.020>like <00:10:19.107>fix <00:10:19.193>the <00:10:19.280>prompts. <00:10:19.367>So <00:10:19.454>we <00:10:19.541>were <00:10:19.627>able <00:10:19.714>to <00:10:19.801>run <00:10:19.888>hundreds <00:10:19.975>pull 00:10:20.110 --> 00:10:20.120 align:start position:0% <00:10:20.110>So <00:10:20.111>we <00:10:20.112>were <00:10:20.113>able <00:10:20.115>to <00:10:20.116>run <00:10:20.117>hundreds <00:10:20.119>pull 00:10:20.120 --> 00:10:21.430 align:start position:0% <00:10:20.120>So <00:10:20.218>we <00:10:20.316>were <00:10:20.414>able <00:10:20.513>to <00:10:20.611>run <00:10:20.709>hundreds <00:10:20.807>pull <00:10:20.906>request <00:10:21.004>reviews <00:10:21.102>in <00:10:21.200>that <00:10:21.299>offline 00:10:21.430 --> 00:10:21.440 align:start position:0% <00:10:21.430>request <00:10:21.432>reviews <00:10:21.434>in <00:10:21.436>that <00:10:21.439>offline 00:10:21.440 --> 00:10:23.110 align:start position:0% <00:10:21.440>request <00:10:21.580>reviews <00:10:21.720>in <00:10:21.860>that <00:10:22.000>offline <00:10:22.140>evaluation <00:10:22.280>system. <00:10:22.420>They <00:10:22.560>were <00:10:22.700>not <00:10:22.840>posting 00:10:23.110 --> 00:10:23.120 align:start position:0% <00:10:23.110>evaluation <00:10:23.111>system. <00:10:23.113>They <00:10:23.115>were <00:10:23.117>not <00:10:23.119>posting 00:10:23.120 --> 00:10:24.510 align:start position:0% <00:10:23.120>evaluation <00:10:23.224>system. <00:10:23.328>They <00:10:23.432>were <00:10:23.537>not <00:10:23.641>posting <00:10:23.745>anything <00:10:23.849>to <00:10:23.954>GitHub, <00:10:24.058>but <00:10:24.162>they <00:10:24.266>were <00:10:24.371>giving 00:10:24.510 --> 00:10:24.520 align:start position:0% <00:10:24.510>anything <00:10:24.511>to <00:10:24.513>GitHub, <00:10:24.514>but <00:10:24.516>they <00:10:24.517>were <00:10:24.519>giving 00:10:24.520 --> 00:10:26.110 align:start position:0% <00:10:24.520>anything <00:10:24.627>to <00:10:24.735>GitHub, <00:10:24.843>but <00:10:24.950>they <00:10:25.058>were <00:10:25.166>giving <00:10:25.273>us <00:10:25.381>those <00:10:25.489>comments <00:10:25.596>that <00:10:25.704>we <00:10:25.812>could <00:10:25.920>eyeball 00:10:26.110 --> 00:10:26.120 align:start position:0% <00:10:26.110>us <00:10:26.111>those <00:10:26.113>comments <00:10:26.114>that <00:10:26.116>we <00:10:26.117>could <00:10:26.119>eyeball 00:10:26.120 --> 00:10:27.270 align:start position:0% <00:10:26.120>us <00:10:26.193>those <00:10:26.267>comments <00:10:26.341>that <00:10:26.415>we <00:10:26.489>could <00:10:26.563>eyeball <00:10:26.637>and <00:10:26.711>figure <00:10:26.785>out <00:10:26.859>what <00:10:26.933>the <00:10:27.007>hell <00:10:27.081>is <00:10:27.155>going 00:10:27.270 --> 00:10:27.280 align:start position:0% <00:10:27.270>and <00:10:27.271>figure <00:10:27.272>out <00:10:27.273>what <00:10:27.275>the <00:10:27.276>hell <00:10:27.277>is <00:10:27.279>going 00:10:27.280 --> 00:10:28.030 align:start position:0% <00:10:27.280>and <00:10:27.364>figure <00:10:27.448>out <00:10:27.533>what <00:10:27.617>the <00:10:27.701>hell <00:10:27.786>is <00:10:27.870>going <00:10:27.954>on. 00:10:28.030 --> 00:10:28.040 align:start position:0% on. 00:10:28.040 --> 00:10:29.470 align:start position:0% <00:10:28.040>on. <00:10:28.200>But <00:10:28.361>no <00:10:28.522>one <00:10:28.683>has <00:10:28.844>time <00:10:29.005>to <00:10:29.166>eyeball <00:10:29.327>hundreds 00:10:29.470 --> 00:10:29.480 align:start position:0% <00:10:29.470>But <00:10:29.471>no <00:10:29.472>one <00:10:29.473>has <00:10:29.475>time <00:10:29.476>to <00:10:29.477>eyeball <00:10:29.479>hundreds 00:10:29.480 --> 00:10:30.990 align:start position:0% <00:10:29.480>But <00:10:29.570>no <00:10:29.661>one <00:10:29.751>has <00:10:29.842>time <00:10:29.933>to <00:10:30.023>eyeball <00:10:30.114>hundreds <00:10:30.204>of <00:10:30.295>comments, <00:10:30.386>right? <00:10:30.476>We <00:10:30.567>had <00:10:30.657>to <00:10:30.748>build <00:10:30.839>an 00:10:30.990 --> 00:10:31.000 align:start position:0% <00:10:30.990>of <00:10:30.991>comments, <00:10:30.992>right? <00:10:30.993>We <00:10:30.995>had <00:10:30.996>to <00:10:30.997>build <00:10:30.999>an 00:10:31.000 --> 00:10:32.750 align:start position:0% <00:10:31.000>of <00:10:31.107>comments, <00:10:31.215>right? <00:10:31.323>We <00:10:31.430>had <00:10:31.538>to <00:10:31.646>build <00:10:31.753>an <00:10:31.861>LLM <00:10:31.969>judge <00:10:32.076>which <00:10:32.184>assesses <00:10:32.292>the <00:10:32.400>comments 00:10:32.750 --> 00:10:32.760 align:start position:0% <00:10:32.750>LLM <00:10:32.751>judge <00:10:32.753>which <00:10:32.755>assesses <00:10:32.757>the <00:10:32.759>comments 00:10:32.760 --> 00:10:34.710 align:start position:0% <00:10:32.760>LLM <00:10:32.915>judge <00:10:33.071>which <00:10:33.226>assesses <00:10:33.382>the <00:10:33.537>comments <00:10:33.693>quality <00:10:33.848>against <00:10:34.004>correctness, <00:10:34.160>severity, 00:10:34.710 --> 00:10:34.720 align:start position:0% <00:10:34.710>quality <00:10:34.713>against <00:10:34.716>correctness, <00:10:34.719>severity, 00:10:34.720 --> 00:10:35.750 align:start position:0% <00:10:34.720>quality <00:10:34.852>against <00:10:34.984>correctness, <00:10:35.117>severity, <00:10:35.249>whether <00:10:35.382>they're <00:10:35.514>brief <00:10:35.647>enough, 00:10:35.750 --> 00:10:35.760 align:start position:0% <00:10:35.750>whether <00:10:35.753>they're <00:10:35.756>brief <00:10:35.759>enough, 00:10:35.760 --> 00:10:37.150 align:start position:0% <00:10:35.760>whether <00:10:35.899>they're <00:10:36.038>brief <00:10:36.177>enough, <00:10:36.316>actionable. <00:10:36.454>Are <00:10:36.593>they <00:10:36.733>attached <00:10:36.872>to <00:10:37.011>the 00:10:37.150 --> 00:10:37.160 align:start position:0% <00:10:37.150>actionable. <00:10:37.151>Are <00:10:37.153>they <00:10:37.155>attached <00:10:37.157>to <00:10:37.159>the 00:10:37.160 --> 00:10:38.310 align:start position:0% <00:10:37.160>actionable. <00:10:37.332>Are <00:10:37.505>they <00:10:37.677>attached <00:10:37.849>to <00:10:38.022>the <00:10:38.194>real 00:10:38.310 --> 00:10:38.320 align:start position:0% real 00:10:38.320 --> 00:10:40.790 align:start position:0% <00:10:38.320>real <00:10:38.495>code? <00:10:38.670>Like <00:10:38.845>was <00:10:39.020>there <00:10:39.195>a <00:10:39.370>problem <00:10:39.545>in <00:10:39.720>there? 00:10:40.790 --> 00:10:40.800 align:start position:0% <00:10:40.790>code? <00:10:40.791>Like <00:10:40.792>was <00:10:40.793>there <00:10:40.795>a <00:10:40.796>problem <00:10:40.797>in <00:10:40.799>there? 00:10:40.800 --> 00:10:43.110 align:start position:0% <00:10:40.800>code? <00:10:40.900>Like <00:10:41.000>was <00:10:41.099>there <00:10:41.199>a <00:10:41.300>problem <00:10:41.400>in <00:10:41.500>there? <00:10:41.599>Adhere <00:10:41.699>to <00:10:41.800>the <00:10:41.900>guidance <00:10:42.000>that <00:10:42.099>our <00:10:42.199>experts 00:10:43.110 --> 00:10:43.120 align:start position:0% <00:10:43.110>Adhere <00:10:43.111>to <00:10:43.113>the <00:10:43.114>guidance <00:10:43.116>that <00:10:43.117>our <00:10:43.119>experts 00:10:43.120 --> 00:10:44.350 align:start position:0% <00:10:43.120>Adhere <00:10:43.278>to <00:10:43.436>the <00:10:43.594>guidance <00:10:43.752>that <00:10:43.910>our <00:10:44.068>experts <00:10:44.227>created. 00:10:44.350 --> 00:10:44.360 align:start position:0% created. 00:10:44.360 --> 00:10:46.230 align:start position:0% <00:10:44.360>created. <00:10:44.593>Finally, <00:10:44.826>we <00:10:45.060>had <00:10:45.293>batch <00:10:45.526>evaluations, <00:10:45.760>we 00:10:46.230 --> 00:10:46.240 align:start position:0% <00:10:46.230>Finally, <00:10:46.231>we <00:10:46.233>had <00:10:46.235>batch <00:10:46.237>evaluations, <00:10:46.239>we 00:10:46.240 --> 00:10:47.790 align:start position:0% <00:10:46.240>Finally, <00:10:46.356>we <00:10:46.472>had <00:10:46.588>batch <00:10:46.705>evaluations, <00:10:46.821>we <00:10:46.937>had <00:10:47.053>the <00:10:47.170>judge, <00:10:47.286>and <00:10:47.402>we <00:10:47.518>started <00:10:47.635>prompt 00:10:47.790 --> 00:10:47.800 align:start position:0% <00:10:47.790>had <00:10:47.791>the <00:10:47.793>judge, <00:10:47.794>and <00:10:47.795>we <00:10:47.797>started <00:10:47.799>prompt 00:10:47.800 --> 00:10:49.990 align:start position:0% <00:10:47.800>had <00:10:47.907>the <00:10:48.015>judge, <00:10:48.123>and <00:10:48.230>we <00:10:48.338>started <00:10:48.446>prompt <00:10:48.553>engineering. <00:10:48.661>So <00:10:48.769>we <00:10:48.876>were <00:10:48.984>able <00:10:49.092>to <00:10:49.199>ground 00:10:49.990 --> 00:10:50.000 align:start position:0% <00:10:49.990>engineering. <00:10:49.991>So <00:10:49.993>we <00:10:49.994>were <00:10:49.996>able <00:10:49.997>to <00:10:49.999>ground 00:10:50.000 --> 00:10:51.510 align:start position:0% <00:10:50.000>engineering. <00:10:50.104>So <00:10:50.209>we <00:10:50.313>were <00:10:50.418>able <00:10:50.522>to <00:10:50.627>ground <00:10:50.731>the <00:10:50.836>comments <00:10:50.940>to <00:10:51.045>the <00:10:51.149>guidance <00:10:51.254>to <00:10:51.359>make 00:10:51.510 --> 00:10:51.520 align:start position:0% <00:10:51.510>the <00:10:51.511>comments <00:10:51.513>to <00:10:51.514>the <00:10:51.516>guidance <00:10:51.517>to <00:10:51.519>make 00:10:51.520 --> 00:10:52.710 align:start position:0% <00:10:51.520>the <00:10:51.602>comments <00:10:51.684>to <00:10:51.767>the <00:10:51.849>guidance <00:10:51.931>to <00:10:52.014>make <00:10:52.096>sure <00:10:52.179>that <00:10:52.261>only <00:10:52.343>the <00:10:52.426>things <00:10:52.508>that <00:10:52.591>are 00:10:52.710 --> 00:10:52.720 align:start position:0% <00:10:52.710>sure <00:10:52.711>that <00:10:52.713>only <00:10:52.714>the <00:10:52.716>things <00:10:52.717>that <00:10:52.719>are 00:10:52.720 --> 00:10:54.230 align:start position:0% <00:10:52.720>sure <00:10:52.824>that <00:10:52.929>only <00:10:53.033>the <00:10:53.138>things <00:10:53.242>that <00:10:53.347>are <00:10:53.451>important <00:10:53.556>to <00:10:53.660>us <00:10:53.765>to <00:10:53.869>our <00:10:53.974>stack <00:10:54.079>were 00:10:54.230 --> 00:10:54.240 align:start position:0% <00:10:54.230>important <00:10:54.231>to <00:10:54.233>us <00:10:54.234>to <00:10:54.236>our <00:10:54.237>stack <00:10:54.239>were 00:10:54.240 --> 00:10:56.190 align:start position:0% <00:10:54.240>important <00:10:54.395>to <00:10:54.551>us <00:10:54.706>to <00:10:54.862>our <00:10:55.017>stack <00:10:55.173>were <00:10:55.328>serviced <00:10:55.484>as <00:10:55.640>feedback. 00:10:56.190 --> 00:10:56.200 align:start position:0% <00:10:56.190>serviced <00:10:56.194>as <00:10:56.199>feedback. 00:10:56.200 --> 00:10:57.590 align:start position:0% <00:10:56.200>serviced <00:10:56.339>as <00:10:56.478>feedback. <00:10:56.617>And <00:10:56.756>the <00:10:56.895>number <00:10:57.034>of <00:10:57.173>comments <00:10:57.312>went <00:10:57.451>down. 00:10:57.590 --> 00:10:57.600 align:start position:0% <00:10:57.590>And <00:10:57.591>the <00:10:57.593>number <00:10:57.594>of <00:10:57.596>comments <00:10:57.597>went <00:10:57.599>down. 00:10:57.600 --> 00:10:59.630 align:start position:0% <00:10:57.600>And <00:10:57.707>the <00:10:57.815>number <00:10:57.923>of <00:10:58.030>comments <00:10:58.138>went <00:10:58.246>down. <00:10:58.353>Great. <00:10:58.461>So <00:10:58.569>we <00:10:58.676>made <00:10:58.784>the <00:10:58.892>comments <00:10:59.000>shorter 00:10:59.630 --> 00:10:59.640 align:start position:0% <00:10:59.630>Great. <00:10:59.631>So <00:10:59.633>we <00:10:59.634>made <00:10:59.636>the <00:10:59.637>comments <00:10:59.639>shorter 00:10:59.640 --> 00:11:01.150 align:start position:0% <00:10:59.640>Great. <00:10:59.753>So <00:10:59.866>we <00:10:59.979>made <00:11:00.093>the <00:11:00.206>comments <00:11:00.319>shorter <00:11:00.432>by <00:11:00.545>putting <00:11:00.659>something <00:11:00.772>in <00:11:00.885>the <00:11:00.999>system 00:11:01.150 --> 00:11:01.160 align:start position:0% <00:11:01.150>by <00:11:01.151>putting <00:11:01.153>something <00:11:01.155>in <00:11:01.157>the <00:11:01.159>system 00:11:01.160 --> 00:11:02.910 align:start position:0% <00:11:01.160>by <00:11:01.287>putting <00:11:01.414>something <00:11:01.541>in <00:11:01.669>the <00:11:01.796>system <00:11:01.923>prompt <00:11:02.050>and <00:11:02.178>really <00:11:02.305>like <00:11:02.432>instructing <00:11:02.560>the 00:11:02.910 --> 00:11:02.920 align:start position:0% <00:11:02.910>prompt <00:11:02.911>and <00:11:02.913>really <00:11:02.915>like <00:11:02.917>instructing <00:11:02.919>the 00:11:02.920 --> 00:11:04.350 align:start position:0% <00:11:02.920>prompt <00:11:03.027>and <00:11:03.134>really <00:11:03.241>like <00:11:03.348>instructing <00:11:03.456>the <00:11:03.563>model, <00:11:03.670>"Hey, <00:11:03.778>we <00:11:03.885>only <00:11:03.992>need <00:11:04.099>like <00:11:04.207>good 00:11:04.350 --> 00:11:04.360 align:start position:0% <00:11:04.350>model, <00:11:04.351>"Hey, <00:11:04.353>we <00:11:04.354>only <00:11:04.356>need <00:11:04.357>like <00:11:04.359>good 00:11:04.360 --> 00:11:06.510 align:start position:0% <00:11:04.360>model, <00:11:04.476>"Hey, <00:11:04.593>we <00:11:04.710>only <00:11:04.826>need <00:11:04.943>like <00:11:05.060>good <00:11:05.176>stuff. <00:11:05.293>Don't <00:11:05.410>post <00:11:05.526>those <00:11:05.643>massive <00:11:05.760>things." 00:11:06.510 --> 00:11:06.520 align:start position:0% <00:11:06.510>stuff. <00:11:06.511>Don't <00:11:06.513>post <00:11:06.515>those <00:11:06.517>massive <00:11:06.519>things." 00:11:06.520 --> 00:11:08.470 align:start position:0% <00:11:06.520>stuff. <00:11:06.620>Don't <00:11:06.720>post <00:11:06.819>those <00:11:06.920>massive <00:11:07.020>things." <00:11:07.120>And <00:11:07.220>we <00:11:07.319>were <00:11:07.420>able <00:11:07.520>down <00:11:07.620>to <00:11:07.720>drive <00:11:07.819>down <00:11:07.920>the 00:11:08.470 --> 00:11:08.480 align:start position:0% <00:11:08.470>And <00:11:08.471>we <00:11:08.472>were <00:11:08.473>able <00:11:08.474>down <00:11:08.475>to <00:11:08.476>drive <00:11:08.477>down <00:11:08.479>the 00:11:08.480 --> 00:11:11.230 align:start position:0% <00:11:08.480>And <00:11:08.580>we <00:11:08.680>were <00:11:08.780>able <00:11:08.880>down <00:11:08.980>to <00:11:09.080>drive <00:11:09.180>down <00:11:09.280>the <00:11:09.380>the <00:11:09.480>comment <00:11:09.580>length <00:11:09.680>down <00:11:09.780>as <00:11:09.880>well. 00:11:11.230 --> 00:11:11.240 align:start position:0% <00:11:11.230>the <00:11:11.231>comment <00:11:11.233>length <00:11:11.235>down <00:11:11.237>as <00:11:11.239>well. 00:11:11.240 --> 00:11:12.510 align:start position:0% <00:11:11.240>the <00:11:11.335>comment <00:11:11.430>length <00:11:11.525>down <00:11:11.621>as <00:11:11.716>well. <00:11:11.811>We <00:11:11.906>were <00:11:12.002>able <00:11:12.097>to <00:11:12.192>enforce <00:11:12.287>the <00:11:12.383>certain 00:11:12.510 --> 00:11:12.520 align:start position:0% <00:11:12.510>We <00:11:12.511>were <00:11:12.513>able <00:11:12.514>to <00:11:12.516>enforce <00:11:12.517>the <00:11:12.519>certain 00:11:12.520 --> 00:11:14.510 align:start position:0% <00:11:12.520>We <00:11:12.627>were <00:11:12.735>able <00:11:12.843>to <00:11:12.950>enforce <00:11:13.058>the <00:11:13.166>certain <00:11:13.273>output <00:11:13.381>format <00:11:13.489>and <00:11:13.596>many <00:11:13.704>more <00:11:13.812>more <00:11:13.920>things. 00:11:14.510 --> 00:11:14.520 align:start position:0% <00:11:14.510>output <00:11:14.511>format <00:11:14.513>and <00:11:14.514>many <00:11:14.516>more <00:11:14.517>more <00:11:14.519>things. 00:11:14.520 --> 00:11:16.710 align:start position:0% <00:11:14.520>output <00:11:14.620>format <00:11:14.720>and <00:11:14.819>many <00:11:14.920>more <00:11:15.020>more <00:11:15.120>things. <00:11:15.220>And <00:11:15.319>over <00:11:15.420>time <00:11:15.520>our <00:11:15.620>system <00:11:15.720>prompt <00:11:15.819>grew <00:11:15.920>to 00:11:16.710 --> 00:11:16.720 align:start position:0% <00:11:16.710>And <00:11:16.711>over <00:11:16.712>time <00:11:16.713>our <00:11:16.715>system <00:11:16.716>prompt <00:11:16.717>grew <00:11:16.719>to 00:11:16.720 --> 00:11:18.750 align:start position:0% <00:11:16.720>And <00:11:16.813>over <00:11:16.906>time <00:11:17.000>our <00:11:17.093>system <00:11:17.186>prompt <00:11:17.280>grew <00:11:17.373>to <00:11:17.466>be <00:11:17.560>this <00:11:17.653>monster, <00:11:17.746>but <00:11:17.840>we <00:11:17.933>were <00:11:18.026>able <00:11:18.120>to 00:11:18.750 --> 00:11:18.760 align:start position:0% <00:11:18.750>be <00:11:18.751>this <00:11:18.752>monster, <00:11:18.753>but <00:11:18.755>we <00:11:18.756>were <00:11:18.757>able <00:11:18.759>to 00:11:18.760 --> 00:11:21.310 align:start position:0% <00:11:18.760>be <00:11:18.860>this <00:11:18.960>monster, <00:11:19.060>but <00:11:19.160>we <00:11:19.260>were <00:11:19.360>able <00:11:19.460>to <00:11:19.560>strangle <00:11:19.660>the <00:11:19.760>LLM <00:11:19.860>to <00:11:19.960>really <00:11:20.060>force <00:11:20.160>the 00:11:21.310 --> 00:11:21.320 align:start position:0% <00:11:21.310>strangle <00:11:21.311>the <00:11:21.313>LLM <00:11:21.314>to <00:11:21.316>really <00:11:21.317>force <00:11:21.319>the 00:11:21.320 --> 00:11:23.310 align:start position:0% <00:11:21.320>strangle <00:11:21.447>the <00:11:21.574>LLM <00:11:21.701>to <00:11:21.829>really <00:11:21.956>force <00:11:22.083>the <00:11:22.210>behavior <00:11:22.338>that <00:11:22.465>we <00:11:22.592>wanted <00:11:22.720>to 00:11:23.310 --> 00:11:23.320 align:start position:0% <00:11:23.310>behavior <00:11:23.312>that <00:11:23.314>we <00:11:23.316>wanted <00:11:23.319>to 00:11:23.320 --> 00:11:25.230 align:start position:0% <00:11:23.320>behavior <00:11:23.475>that <00:11:23.631>we <00:11:23.786>wanted <00:11:23.942>to <00:11:24.097>uh <00:11:24.253>to <00:11:24.408>kind <00:11:24.564>of <00:11:24.720>show. 00:11:25.230 --> 00:11:25.240 align:start position:0% <00:11:25.230>uh <00:11:25.232>to <00:11:25.234>kind <00:11:25.236>of <00:11:25.239>show. 00:11:25.240 --> 00:11:26.950 align:start position:0% <00:11:25.240>uh <00:11:25.367>to <00:11:25.494>kind <00:11:25.621>of <00:11:25.749>show. <00:11:25.876>Now <00:11:26.003>that <00:11:26.130>we <00:11:26.258>have <00:11:26.385>the <00:11:26.512>batch <00:11:26.640>evaluations, 00:11:26.950 --> 00:11:26.960 align:start position:0% <00:11:26.950>Now <00:11:26.951>that <00:11:26.953>we <00:11:26.954>have <00:11:26.956>the <00:11:26.957>batch <00:11:26.959>evaluations, 00:11:26.960 --> 00:11:29.430 align:start position:0% <00:11:26.960>Now <00:11:27.067>that <00:11:27.175>we <00:11:27.283>have <00:11:27.390>the <00:11:27.498>batch <00:11:27.606>evaluations, <00:11:27.713>we <00:11:27.821>could <00:11:27.929>do <00:11:28.036>offline <00:11:28.144>A/B <00:11:28.252>tests <00:11:28.360>before 00:11:29.430 --> 00:11:29.440 align:start position:0% <00:11:29.430>we <00:11:29.431>could <00:11:29.433>do <00:11:29.434>offline <00:11:29.436>A/B <00:11:29.437>tests <00:11:29.439>before 00:11:29.440 --> 00:11:30.910 align:start position:0% <00:11:29.440>we <00:11:29.550>could <00:11:29.660>do <00:11:29.770>offline <00:11:29.881>A/B <00:11:29.991>tests <00:11:30.101>before <00:11:30.211>rolling <00:11:30.322>changes <00:11:30.432>to <00:11:30.542>the <00:11:30.652>agent <00:11:30.762>in 00:11:30.910 --> 00:11:30.920 align:start position:0% <00:11:30.910>rolling <00:11:30.911>changes <00:11:30.913>to <00:11:30.915>the <00:11:30.917>agent <00:11:30.919>in 00:11:30.920 --> 00:11:32.430 align:start position:0% <00:11:30.920>rolling <00:11:31.033>changes <00:11:31.146>to <00:11:31.259>the <00:11:31.372>agent <00:11:31.486>in <00:11:31.599>production. <00:11:31.712>We <00:11:31.825>were <00:11:31.939>able <00:11:32.052>to <00:11:32.165>compare <00:11:32.279>the 00:11:32.430 --> 00:11:32.440 align:start position:0% <00:11:32.430>production. <00:11:32.431>We <00:11:32.433>were <00:11:32.434>able <00:11:32.436>to <00:11:32.437>compare <00:11:32.439>the 00:11:32.440 --> 00:11:34.030 align:start position:0% <00:11:32.440>production. <00:11:32.556>We <00:11:32.673>were <00:11:32.790>able <00:11:32.906>to <00:11:33.023>compare <00:11:33.140>the <00:11:33.256>baseline <00:11:33.373>and <00:11:33.490>a <00:11:33.606>treatment <00:11:33.723>and <00:11:33.840>detect 00:11:34.030 --> 00:11:34.040 align:start position:0% <00:11:34.030>baseline <00:11:34.031>and <00:11:34.033>a <00:11:34.035>treatment <00:11:34.037>and <00:11:34.039>detect 00:11:34.040 --> 00:11:36.270 align:start position:0% <00:11:34.040>baseline <00:11:34.180>and <00:11:34.319>a <00:11:34.459>treatment <00:11:34.599>and <00:11:34.740>detect <00:11:34.880>improvement <00:11:35.020>and <00:11:35.160>validate <00:11:35.300>our <00:11:35.439>hypothesis, 00:11:36.270 --> 00:11:36.280 align:start position:0% <00:11:36.270>improvement <00:11:36.272>and <00:11:36.274>validate <00:11:36.276>our <00:11:36.279>hypothesis, 00:11:36.280 --> 00:11:38.830 align:start position:0% <00:11:36.280>improvement <00:11:36.420>and <00:11:36.560>validate <00:11:36.699>our <00:11:36.839>hypothesis, <00:11:36.980>right? <00:11:37.120>Instead <00:11:37.260>of <00:11:37.400>just <00:11:37.540>yellowing <00:11:37.680>stuff 00:11:38.830 --> 00:11:38.840 align:start position:0% <00:11:38.830>right? <00:11:38.831>Instead <00:11:38.833>of <00:11:38.835>just <00:11:38.837>yellowing <00:11:38.839>stuff 00:11:38.840 --> 00:11:40.310 align:start position:0% <00:11:38.840>right? <00:11:38.950>Instead <00:11:39.060>of <00:11:39.170>just <00:11:39.281>yellowing <00:11:39.391>stuff <00:11:39.501>uh <00:11:39.611>you <00:11:39.722>know, <00:11:39.832>like <00:11:39.942>just <00:11:40.052>without <00:11:40.163>any 00:11:40.310 --> 00:11:40.320 align:start position:0% <00:11:40.310>uh <00:11:40.311>you <00:11:40.313>know, <00:11:40.314>like <00:11:40.316>just <00:11:40.317>without <00:11:40.319>any 00:11:40.320 --> 00:11:41.630 align:start position:0% <00:11:40.320>uh <00:11:40.488>you <00:11:40.656>know, <00:11:40.825>like <00:11:40.993>just <00:11:41.162>without <00:11:41.330>any <00:11:41.499>validation. 00:11:41.630 --> 00:11:41.640 align:start position:0% validation. 00:11:41.640 --> 00:11:43.390 align:start position:0% <00:11:41.640>validation. <00:11:41.795>So, <00:11:41.951>let's <00:11:42.106>do <00:11:42.262>a <00:11:42.417>quick <00:11:42.573>time <00:11:42.728>check. <00:11:42.884>We <00:11:43.040>are 00:11:43.390 --> 00:11:43.400 align:start position:0% <00:11:43.390>So, <00:11:43.391>let's <00:11:43.392>do <00:11:43.393>a <00:11:43.394>quick <00:11:43.395>time <00:11:43.396>check. <00:11:43.397>We <00:11:43.399>are 00:11:43.400 --> 00:11:45.070 align:start position:0% <00:11:43.400>So, <00:11:43.487>let's <00:11:43.574>do <00:11:43.662>a <00:11:43.750>quick <00:11:43.837>time <00:11:43.925>check. <00:11:44.012>We <00:11:44.100>are <00:11:44.187>at <00:11:44.275>20 <00:11:44.362>minutes <00:11:44.449>left. <00:11:44.537>Great, <00:11:44.625>I <00:11:44.712>have <00:11:44.800>time 00:11:45.070 --> 00:11:45.080 align:start position:0% <00:11:45.070>at <00:11:45.071>20 <00:11:45.072>minutes <00:11:45.073>left. <00:11:45.075>Great, <00:11:45.076>I <00:11:45.077>have <00:11:45.079>time 00:11:45.080 --> 00:11:47.190 align:start position:0% <00:11:45.080>at <00:11:45.167>20 <00:11:45.255>minutes <00:11:45.342>left. <00:11:45.430>Great, <00:11:45.517>I <00:11:45.605>have <00:11:45.692>time <00:11:45.780>for <00:11:45.867>a <00:11:45.955>real <00:11:46.042>example. <00:11:46.130>Why <00:11:46.217>all <00:11:46.305>of <00:11:46.392>this <00:11:46.480>is 00:11:47.190 --> 00:11:47.200 align:start position:0% <00:11:47.190>for <00:11:47.191>a <00:11:47.192>real <00:11:47.193>example. <00:11:47.194>Why <00:11:47.195>all <00:11:47.196>of <00:11:47.197>this <00:11:47.199>is 00:11:47.200 --> 00:11:48.590 align:start position:0% <00:11:47.200>for <00:11:47.325>a <00:11:47.450>real <00:11:47.575>example. <00:11:47.700>Why <00:11:47.825>all <00:11:47.950>of <00:11:48.075>this <00:11:48.200>is <00:11:48.325>so <00:11:48.451>important? 00:11:48.590 --> 00:11:48.600 align:start position:0% <00:11:48.590>so <00:11:48.599>important? 00:11:48.600 --> 00:11:49.630 align:start position:0% <00:11:48.600>so <00:11:49.063>important? <00:11:49.527>Well, 00:11:49.630 --> 00:11:49.640 align:start position:0% Well, 00:11:49.640 --> 00:11:51.390 align:start position:0% <00:11:49.640>Well, <00:11:49.814>here's <00:11:49.990>an <00:11:50.165>example. <00:11:50.340>I <00:11:50.515>was <00:11:50.689>setting <00:11:50.865>up <00:11:51.040>this 00:11:51.390 --> 00:11:51.400 align:start position:0% <00:11:51.390>here's <00:11:51.391>an <00:11:51.392>example. <00:11:51.393>I <00:11:51.395>was <00:11:51.396>setting <00:11:51.397>up <00:11:51.399>this 00:11:51.400 --> 00:11:52.790 align:start position:0% <00:11:51.400>here's <00:11:51.496>an <00:11:51.592>example. <00:11:51.688>I <00:11:51.784>was <00:11:51.881>setting <00:11:51.977>up <00:11:52.073>this <00:11:52.169>code <00:11:52.266>review <00:11:52.362>agent <00:11:52.458>for <00:11:52.554>a <00:11:52.651>different 00:11:52.790 --> 00:11:52.800 align:start position:0% <00:11:52.790>code <00:11:52.791>review <00:11:52.793>agent <00:11:52.795>for <00:11:52.797>a <00:11:52.799>different 00:11:52.800 --> 00:11:54.030 align:start position:0% <00:11:52.800>code <00:11:52.938>review <00:11:53.076>agent <00:11:53.215>for <00:11:53.353>a <00:11:53.491>different <00:11:53.630>repository, <00:11:53.768>building <00:11:53.906>repository, 00:11:54.030 --> 00:11:54.040 align:start position:0% <00:11:54.030>repository, <00:11:54.034>building <00:11:54.039>repository, 00:11:54.040 --> 00:11:55.430 align:start position:0% <00:11:54.040>repository, <00:11:54.165>building <00:11:54.290>repository, <00:11:54.415>different <00:11:54.540>code <00:11:54.665>base. <00:11:54.790>We <00:11:54.915>had <00:11:55.040>to <00:11:55.165>come <00:11:55.290>up 00:11:55.430 --> 00:11:55.440 align:start position:0% <00:11:55.430>different <00:11:55.431>code <00:11:55.432>base. <00:11:55.433>We <00:11:55.435>had <00:11:55.436>to <00:11:55.437>come <00:11:55.439>up 00:11:55.440 --> 00:11:56.590 align:start position:0% <00:11:55.440>different <00:11:55.519>code <00:11:55.599>base. <00:11:55.678>We <00:11:55.758>had <00:11:55.838>to <00:11:55.917>come <00:11:55.997>up <00:11:56.076>with <00:11:56.156>a <00:11:56.236>different <00:11:56.315>code <00:11:56.395>review <00:11:56.475>scale. 00:11:56.590 --> 00:11:56.600 align:start position:0% <00:11:56.590>with <00:11:56.591>a <00:11:56.593>different <00:11:56.595>code <00:11:56.597>review <00:11:56.599>scale. 00:11:56.600 --> 00:11:57.990 align:start position:0% <00:11:56.600>with <00:11:56.704>a <00:11:56.808>different <00:11:56.912>code <00:11:57.017>review <00:11:57.121>scale. <00:11:57.225>Again, <00:11:57.329>we <00:11:57.434>spoke <00:11:57.538>with <00:11:57.642>the <00:11:57.746>experts. <00:11:57.851>We 00:11:57.990 --> 00:11:58.000 align:start position:0% <00:11:57.990>Again, <00:11:57.991>we <00:11:57.993>spoke <00:11:57.994>with <00:11:57.996>the <00:11:57.997>experts. <00:11:57.999>We 00:11:58.000 --> 00:11:59.750 align:start position:0% <00:11:58.000>Again, <00:11:58.107>we <00:11:58.215>spoke <00:11:58.323>with <00:11:58.430>the <00:11:58.538>experts. <00:11:58.646>We <00:11:58.753>encoded <00:11:58.861>all <00:11:58.969>of <00:11:59.076>the <00:11:59.184>expertise <00:11:59.292>into <00:11:59.400>the 00:11:59.750 --> 00:11:59.760 align:start position:0% <00:11:59.750>encoded <00:11:59.751>all <00:11:59.753>of <00:11:59.754>the <00:11:59.756>expertise <00:11:59.757>into <00:11:59.759>the 00:11:59.760 --> 00:12:02.350 align:start position:0% <00:11:59.760>encoded <00:11:59.876>all <00:11:59.993>of <00:12:00.110>the <00:12:00.226>expertise <00:12:00.343>into <00:12:00.460>the <00:12:00.576>markdown <00:12:00.693>files, <00:12:00.810>created <00:12:00.926>a <00:12:01.043>skill. <00:12:01.160>Great. 00:12:02.350 --> 00:12:02.360 align:start position:0% <00:12:02.350>markdown <00:12:02.351>files, <00:12:02.353>created <00:12:02.355>a <00:12:02.357>skill. <00:12:02.359>Great. 00:12:02.360 --> 00:12:04.350 align:start position:0% <00:12:02.360>markdown <00:12:02.487>files, <00:12:02.614>created <00:12:02.741>a <00:12:02.869>skill. <00:12:02.996>Great. <00:12:03.123>We <00:12:03.250>ran <00:12:03.378>batch <00:12:03.505>evaluations <00:12:03.632>because <00:12:03.760>we 00:12:04.350 --> 00:12:04.360 align:start position:0% <00:12:04.350>We <00:12:04.351>ran <00:12:04.353>batch <00:12:04.355>evaluations <00:12:04.357>because <00:12:04.359>we 00:12:04.360 --> 00:12:05.550 align:start position:0% <00:12:04.360>We <00:12:04.457>ran <00:12:04.554>batch <00:12:04.652>evaluations <00:12:04.749>because <00:12:04.846>we <00:12:04.944>learned <00:12:05.041>something, <00:12:05.138>right? <00:12:05.236>We <00:12:05.333>didn't <00:12:05.430>put 00:12:05.550 --> 00:12:05.560 align:start position:0% <00:12:05.550>learned <00:12:05.551>something, <00:12:05.553>right? <00:12:05.555>We <00:12:05.557>didn't <00:12:05.559>put 00:12:05.560 --> 00:12:07.510 align:start position:0% <00:12:05.560>learned <00:12:05.676>something, <00:12:05.793>right? <00:12:05.910>We <00:12:06.026>didn't <00:12:06.143>put <00:12:06.260>it <00:12:06.376>in <00:12:06.493>production <00:12:06.609>right <00:12:06.726>away. <00:12:06.843>And <00:12:06.959>turns 00:12:07.510 --> 00:12:07.520 align:start position:0% <00:12:07.510>it <00:12:07.511>in <00:12:07.513>production <00:12:07.514>right <00:12:07.516>away. <00:12:07.517>And <00:12:07.519>turns 00:12:07.520 --> 00:12:09.910 align:start position:0% <00:12:07.520>it <00:12:07.620>in <00:12:07.720>production <00:12:07.819>right <00:12:07.920>away. <00:12:08.020>And <00:12:08.120>turns <00:12:08.220>out <00:12:08.319>um <00:12:08.420>for <00:12:08.520>because <00:12:08.620>of <00:12:08.720>that <00:12:08.819>skill, <00:12:08.920>for 00:12:09.910 --> 00:12:09.920 align:start position:0% <00:12:09.910>out <00:12:09.911>um <00:12:09.912>for <00:12:09.913>because <00:12:09.915>of <00:12:09.916>that <00:12:09.917>skill, <00:12:09.919>for 00:12:09.920 --> 00:12:11.190 align:start position:0% <00:12:09.920>out <00:12:09.996>um <00:12:10.072>for <00:12:10.148>because <00:12:10.224>of <00:12:10.300>that <00:12:10.377>skill, <00:12:10.453>for <00:12:10.529>some <00:12:10.605>reason, <00:12:10.682>we <00:12:10.758>were <00:12:10.834>getting <00:12:10.910>a <00:12:10.986>lot <00:12:11.063>of 00:12:11.190 --> 00:12:11.200 align:start position:0% <00:12:11.190>some <00:12:11.191>reason, <00:12:11.192>we <00:12:11.193>were <00:12:11.195>getting <00:12:11.196>a <00:12:11.197>lot <00:12:11.199>of 00:12:11.200 --> 00:12:13.630 align:start position:0% <00:12:11.200>some <00:12:11.307>reason, <00:12:11.415>we <00:12:11.523>were <00:12:11.630>getting <00:12:11.738>a <00:12:11.846>lot <00:12:11.953>of <00:12:12.061>low <00:12:12.169>severity <00:12:12.276>comments. <00:12:12.384>Like <00:12:12.492>70% <00:12:12.600>were 00:12:13.630 --> 00:12:13.640 align:start position:0% <00:12:13.630>low <00:12:13.631>severity <00:12:13.633>comments. <00:12:13.635>Like <00:12:13.637>70% <00:12:13.639>were 00:12:13.640 --> 00:12:15.350 align:start position:0% <00:12:13.640>low <00:12:13.756>severity <00:12:13.873>comments. <00:12:13.990>Like <00:12:14.106>70% <00:12:14.223>were <00:12:14.340>attributed <00:12:14.456>to <00:12:14.573>one <00:12:14.689>single <00:12:14.806>file <00:12:14.923>in <00:12:15.040>that 00:12:15.350 --> 00:12:15.360 align:start position:0% <00:12:15.350>attributed <00:12:15.351>to <00:12:15.353>one <00:12:15.354>single <00:12:15.356>file <00:12:15.357>in <00:12:15.359>that 00:12:15.360 --> 00:12:17.390 align:start position:0% <00:12:15.360>attributed <00:12:15.535>to <00:12:15.710>one <00:12:15.885>single <00:12:16.060>file <00:12:16.235>in <00:12:16.410>that <00:12:16.585>skill, <00:12:16.760>architecture.md. 00:12:17.390 --> 00:12:17.400 align:start position:0% <00:12:17.390>skill, <00:12:17.399>architecture.md. 00:12:17.400 --> 00:12:18.910 align:start position:0% <00:12:17.400>skill, <00:12:17.569>architecture.md. <00:12:17.739>Not <00:12:17.909>only <00:12:18.079>one <00:12:18.249>single <00:12:18.419>file, <00:12:18.589>it <00:12:18.759>was 00:12:18.910 --> 00:12:18.920 align:start position:0% <00:12:18.910>Not <00:12:18.911>only <00:12:18.913>one <00:12:18.914>single <00:12:18.915>file, <00:12:18.917>it <00:12:18.919>was 00:12:18.920 --> 00:12:21.190 align:start position:0% <00:12:18.920>Not <00:12:19.036>only <00:12:19.153>one <00:12:19.270>single <00:12:19.386>file, <00:12:19.503>it <00:12:19.620>was <00:12:19.736>actually <00:12:19.853>attributed <00:12:19.969>to <00:12:20.086>one <00:12:20.203>single <00:12:20.319>line. 00:12:21.190 --> 00:12:21.200 align:start position:0% <00:12:21.190>actually <00:12:21.191>attributed <00:12:21.193>to <00:12:21.195>one <00:12:21.197>single <00:12:21.199>line. 00:12:21.200 --> 00:12:23.310 align:start position:0% <00:12:21.200>actually <00:12:21.316>attributed <00:12:21.433>to <00:12:21.550>one <00:12:21.666>single <00:12:21.783>line. <00:12:21.900>Not <00:12:22.016>only <00:12:22.133>one <00:12:22.250>single <00:12:22.366>line, <00:12:22.483>it <00:12:22.600>was 00:12:23.310 --> 00:12:23.320 align:start position:0% <00:12:23.310>Not <00:12:23.311>only <00:12:23.313>one <00:12:23.314>single <00:12:23.316>line, <00:12:23.317>it <00:12:23.319>was 00:12:23.320 --> 00:12:25.270 align:start position:0% <00:12:23.320>Not <00:12:23.427>only <00:12:23.535>one <00:12:23.643>single <00:12:23.750>line, <00:12:23.858>it <00:12:23.966>was <00:12:24.073>attributed <00:12:24.181>to <00:12:24.289>one <00:12:24.396>single <00:12:24.504>word. <00:12:24.612>So, <00:12:24.720>when 00:12:25.270 --> 00:12:25.280 align:start position:0% <00:12:25.270>attributed <00:12:25.271>to <00:12:25.273>one <00:12:25.274>single <00:12:25.276>word. <00:12:25.277>So, <00:12:25.279>when 00:12:25.280 --> 00:12:27.310 align:start position:0% <00:12:25.280>attributed <00:12:25.367>to <00:12:25.454>one <00:12:25.542>single <00:12:25.630>word. <00:12:25.717>So, <00:12:25.805>when <00:12:25.892>we <00:12:25.980>got <00:12:26.067>rid <00:12:26.155>of <00:12:26.242>this <00:12:26.329>always, <00:12:26.417>so <00:12:26.505>we <00:12:26.592>we <00:12:26.680>we 00:12:27.310 --> 00:12:27.320 align:start position:0% <00:12:27.310>we <00:12:27.310>got <00:12:27.312>rid <00:12:27.313>of <00:12:27.314>this <00:12:27.315>always, <00:12:27.316>so <00:12:27.317>we <00:12:27.318>we <00:12:27.319>we 00:12:27.320 --> 00:12:29.270 align:start position:0% <00:12:27.320>we <00:12:27.407>got <00:12:27.495>rid <00:12:27.582>of <00:12:27.670>this <00:12:27.757>always, <00:12:27.845>so <00:12:27.932>we <00:12:28.020>we <00:12:28.107>we <00:12:28.195>we <00:12:28.282>had <00:12:28.370>this <00:12:28.457>line, <00:12:28.545>"Always <00:12:28.632>use <00:12:28.720>verifying 00:12:29.270 --> 00:12:29.280 align:start position:0% <00:12:29.270>we <00:12:29.271>had <00:12:29.273>this <00:12:29.274>line, <00:12:29.276>"Always <00:12:29.277>use <00:12:29.279>verifying 00:12:29.280 --> 00:12:30.590 align:start position:0% <00:12:29.280>we <00:12:29.364>had <00:12:29.448>this <00:12:29.532>line, <00:12:29.616>"Always <00:12:29.701>use <00:12:29.785>verifying <00:12:29.869>doubles." <00:12:29.953>But <00:12:30.037>if <00:12:30.122>you <00:12:30.206>get <00:12:30.290>rid <00:12:30.374>of <00:12:30.459>that 00:12:30.590 --> 00:12:30.600 align:start position:0% <00:12:30.590>doubles." <00:12:30.591>But <00:12:30.592>if <00:12:30.593>you <00:12:30.595>get <00:12:30.596>rid <00:12:30.597>of <00:12:30.599>that 00:12:30.600 --> 00:12:32.590 align:start position:0% <00:12:30.600>doubles." <00:12:30.707>But <00:12:30.815>if <00:12:30.923>you <00:12:31.030>get <00:12:31.138>rid <00:12:31.246>of <00:12:31.353>that <00:12:31.461>always <00:12:31.569>and <00:12:31.676>just <00:12:31.784>say, <00:12:31.892>"Use <00:12:32.000>verifying 00:12:32.590 --> 00:12:32.600 align:start position:0% <00:12:32.590>always <00:12:32.591>and <00:12:32.593>just <00:12:32.595>say, <00:12:32.597>"Use <00:12:32.599>verifying 00:12:32.600 --> 00:12:34.950 align:start position:0% <00:12:32.600>always <00:12:32.716>and <00:12:32.833>just <00:12:32.950>say, <00:12:33.066>"Use <00:12:33.183>verifying <00:12:33.300>doubles." <00:12:33.416>we <00:12:33.533>were <00:12:33.650>able <00:12:33.766>to <00:12:33.883>eliminate <00:12:34.000>20 00:12:34.950 --> 00:12:34.960 align:start position:0% <00:12:34.950>doubles." <00:12:34.951>we <00:12:34.953>were <00:12:34.954>able <00:12:34.956>to <00:12:34.957>eliminate <00:12:34.959>20 00:12:34.960 --> 00:12:38.110 align:start position:0% <00:12:34.960>doubles." <00:12:35.067>we <00:12:35.175>were <00:12:35.283>able <00:12:35.390>to <00:12:35.498>eliminate <00:12:35.606>20 <00:12:35.713>like <00:12:35.821>eliminate <00:12:35.929>all <00:12:36.036>the <00:12:36.144>comments <00:12:36.252>from <00:12:36.360>28 00:12:38.110 --> 00:12:38.120 align:start position:0% <00:12:38.110>like <00:12:38.111>eliminate <00:12:38.113>all <00:12:38.114>the <00:12:38.116>comments <00:12:38.117>from <00:12:38.119>28 00:12:38.120 --> 00:12:40.350 align:start position:0% <00:12:38.120>like <00:12:38.227>eliminate <00:12:38.335>all <00:12:38.443>the <00:12:38.550>comments <00:12:38.658>from <00:12:38.766>28 <00:12:38.873>PRs <00:12:38.981>in <00:12:39.089>the <00:12:39.196>test <00:12:39.304>data <00:12:39.412>set. <00:12:39.520>Massive 00:12:40.350 --> 00:12:40.360 align:start position:0% <00:12:40.350>PRs <00:12:40.351>in <00:12:40.353>the <00:12:40.354>test <00:12:40.356>data <00:12:40.357>set. <00:12:40.359>Massive 00:12:40.360 --> 00:12:41.829 align:start position:0% <00:12:40.360>PRs <00:12:40.461>in <00:12:40.563>the <00:12:40.665>test <00:12:40.766>data <00:12:40.868>set. <00:12:40.970>Massive <00:12:41.071>result. <00:12:41.173>Like <00:12:41.275>we <00:12:41.377>we <00:12:41.478>were <00:12:41.580>able <00:12:41.682>to 00:12:41.829 --> 00:12:41.839 align:start position:0% <00:12:41.829>result. <00:12:41.830>Like <00:12:41.832>we <00:12:41.833>we <00:12:41.834>were <00:12:41.836>able <00:12:41.838>to 00:12:41.839 --> 00:12:43.590 align:start position:0% <00:12:41.839>result. <00:12:41.978>Like <00:12:42.118>we <00:12:42.258>we <00:12:42.398>were <00:12:42.539>able <00:12:42.679>to <00:12:42.819>eliminate <00:12:42.959>lots <00:12:43.098>of <00:12:43.238>noise. 00:12:43.590 --> 00:12:43.600 align:start position:0% <00:12:43.590>eliminate <00:12:43.593>lots <00:12:43.596>of <00:12:43.599>noise. 00:12:43.600 --> 00:12:45.550 align:start position:0% <00:12:43.600>eliminate <00:12:43.740>lots <00:12:43.880>of <00:12:44.020>noise. <00:12:44.160>So, <00:12:44.300>every <00:12:44.440>single <00:12:44.580>word <00:12:44.720>matters, <00:12:44.860>but <00:12:45.000>not 00:12:45.550 --> 00:12:45.560 align:start position:0% <00:12:45.550>So, <00:12:45.551>every <00:12:45.553>single <00:12:45.554>word <00:12:45.555>matters, <00:12:45.557>but <00:12:45.559>not 00:12:45.560 --> 00:12:47.150 align:start position:0% <00:12:45.560>So, <00:12:45.667>every <00:12:45.775>single <00:12:45.883>word <00:12:45.990>matters, <00:12:46.098>but <00:12:46.206>not <00:12:46.313>even <00:12:46.421>single <00:12:46.529>word, <00:12:46.636>the <00:12:46.744>position <00:12:46.852>of <00:12:46.959>the 00:12:47.150 --> 00:12:47.160 align:start position:0% <00:12:47.150>even <00:12:47.151>single <00:12:47.153>word, <00:12:47.154>the <00:12:47.156>position <00:12:47.157>of <00:12:47.159>the 00:12:47.160 --> 00:12:48.550 align:start position:0% <00:12:47.160>even <00:12:47.256>single <00:12:47.352>word, <00:12:47.448>the <00:12:47.544>position <00:12:47.641>of <00:12:47.737>the <00:12:47.833>word <00:12:47.929>matters <00:12:48.026>because <00:12:48.122>they <00:12:48.218>all <00:12:48.314>have <00:12:48.411>like 00:12:48.550 --> 00:12:48.560 align:start position:0% <00:12:48.550>word <00:12:48.551>matters <00:12:48.553>because <00:12:48.554>they <00:12:48.555>all <00:12:48.557>have <00:12:48.559>like 00:12:48.560 --> 00:12:50.630 align:start position:0% <00:12:48.560>word <00:12:48.667>matters <00:12:48.775>because <00:12:48.883>they <00:12:48.990>all <00:12:49.098>have <00:12:49.206>like <00:12:49.313>focal <00:12:49.421>points <00:12:49.529>of <00:12:49.636>attention. <00:12:49.744>So, <00:12:49.852>it <00:12:49.959>really 00:12:50.630 --> 00:12:50.640 align:start position:0% <00:12:50.630>focal <00:12:50.631>points <00:12:50.633>of <00:12:50.634>attention. <00:12:50.636>So, <00:12:50.637>it <00:12:50.639>really 00:12:50.640 --> 00:12:52.230 align:start position:0% <00:12:50.640>focal <00:12:50.756>points <00:12:50.873>of <00:12:50.990>attention. <00:12:51.106>So, <00:12:51.223>it <00:12:51.340>really <00:12:51.456>matters <00:12:51.573>where <00:12:51.689>you <00:12:51.806>place <00:12:51.923>those <00:12:52.040>words, 00:12:52.230 --> 00:12:52.240 align:start position:0% <00:12:52.230>matters <00:12:52.231>where <00:12:52.233>you <00:12:52.235>place <00:12:52.237>those <00:12:52.239>words, 00:12:52.240 --> 00:12:53.710 align:start position:0% <00:12:52.240>matters <00:12:52.360>where <00:12:52.480>you <00:12:52.600>place <00:12:52.721>those <00:12:52.841>words, <00:12:52.961>where <00:12:53.081>the <00:12:53.202>accents <00:12:53.322>are. <00:12:53.442>And <00:12:53.563>there's 00:12:53.710 --> 00:12:53.720 align:start position:0% <00:12:53.710>where <00:12:53.711>the <00:12:53.713>accents <00:12:53.715>are. <00:12:53.717>And <00:12:53.719>there's 00:12:53.720 --> 00:12:55.270 align:start position:0% <00:12:53.720>where <00:12:53.827>the <00:12:53.934>accents <00:12:54.041>are. <00:12:54.149>And <00:12:54.256>there's <00:12:54.363>really <00:12:54.471>no <00:12:54.578>way <00:12:54.685>to <00:12:54.793>figure <00:12:54.900>this <00:12:55.007>out <00:12:55.115>unless 00:12:55.270 --> 00:12:55.280 align:start position:0% <00:12:55.270>really <00:12:55.271>no <00:12:55.272>way <00:12:55.273>to <00:12:55.275>figure <00:12:55.276>this <00:12:55.277>out <00:12:55.279>unless 00:12:55.280 --> 00:12:56.710 align:start position:0% <00:12:55.280>really <00:12:55.379>no <00:12:55.478>way <00:12:55.577>to <00:12:55.676>figure <00:12:55.775>this <00:12:55.874>out <00:12:55.973>unless <00:12:56.072>you <00:12:56.171>have <00:12:56.270>batch <00:12:56.369>evaluations <00:12:56.468>and <00:12:56.567>you're 00:12:56.710 --> 00:12:56.720 align:start position:0% <00:12:56.710>you <00:12:56.711>have <00:12:56.713>batch <00:12:56.715>evaluations <00:12:56.717>and <00:12:56.719>you're 00:12:56.720 --> 00:12:58.750 align:start position:0% <00:12:56.720>you <00:12:56.836>have <00:12:56.953>batch <00:12:57.070>evaluations <00:12:57.186>and <00:12:57.303>you're <00:12:57.420>able <00:12:57.536>to <00:12:57.653>test <00:12:57.770>this <00:12:57.886>out <00:12:58.003>and <00:12:58.120>see 00:12:58.750 --> 00:12:58.760 align:start position:0% <00:12:58.750>able <00:12:58.751>to <00:12:58.753>test <00:12:58.754>this <00:12:58.756>out <00:12:58.757>and <00:12:58.759>see 00:12:58.760 --> 00:13:00.950 align:start position:0% <00:12:58.760>able <00:12:58.860>to <00:12:58.960>test <00:12:59.060>this <00:12:59.160>out <00:12:59.260>and <00:12:59.360>see <00:12:59.460>all <00:12:59.560>of <00:12:59.660>your <00:12:59.760>quality <00:12:59.860>metrics <00:12:59.960>as <00:13:00.060>you <00:13:00.160>do 00:13:00.950 --> 00:13:00.960 align:start position:0% <00:13:00.950>all <00:13:00.951>of <00:13:00.952>your <00:13:00.953>quality <00:13:00.955>metrics <00:13:00.956>as <00:13:00.957>you <00:13:00.959>do 00:13:00.960 --> 00:13:02.390 align:start position:0% <00:13:00.960>all <00:13:01.120>of <00:13:01.281>your <00:13:01.442>quality <00:13:01.603>metrics <00:13:01.764>as <00:13:01.925>you <00:13:02.086>do <00:13:02.247>this. 00:13:02.390 --> 00:13:02.400 align:start position:0% this. 00:13:02.400 --> 00:13:04.110 align:start position:0% <00:13:02.400>this. <00:13:02.600>Okay, <00:13:02.800>so <00:13:03.000>we <00:13:03.199>are <00:13:03.400>so <00:13:03.600>technically <00:13:03.800>focused, 00:13:04.110 --> 00:13:04.120 align:start position:0% <00:13:04.110>Okay, <00:13:04.111>so <00:13:04.113>we <00:13:04.114>are <00:13:04.116>so <00:13:04.117>technically <00:13:04.119>focused, 00:13:04.120 --> 00:13:05.390 align:start position:0% <00:13:04.120>Okay, <00:13:04.207>so <00:13:04.295>we <00:13:04.383>are <00:13:04.471>so <00:13:04.559>technically <00:13:04.647>focused, <00:13:04.735>but <00:13:04.823>what <00:13:04.911>about <00:13:04.999>humans, <00:13:05.087>right? <00:13:05.175>Like <00:13:05.263>we're 00:13:05.390 --> 00:13:05.400 align:start position:0% <00:13:05.390>but <00:13:05.391>what <00:13:05.393>about <00:13:05.394>humans, <00:13:05.396>right? <00:13:05.397>Like <00:13:05.399>we're 00:13:05.400 --> 00:13:06.590 align:start position:0% <00:13:05.400>but <00:13:05.497>what <00:13:05.594>about <00:13:05.692>humans, <00:13:05.789>right? <00:13:05.886>Like <00:13:05.984>we're <00:13:06.081>still <00:13:06.178>building <00:13:06.276>this <00:13:06.373>for <00:13:06.471>humans, 00:13:06.590 --> 00:13:06.600 align:start position:0% <00:13:06.590>still <00:13:06.592>building <00:13:06.594>this <00:13:06.596>for <00:13:06.599>humans, 00:13:06.600 --> 00:13:07.790 align:start position:0% <00:13:06.600>still <00:13:06.814>building <00:13:07.028>this <00:13:07.242>for <00:13:07.456>humans, <00:13:07.670>hopefully. 00:13:07.790 --> 00:13:07.800 align:start position:0% hopefully. 00:13:07.800 --> 00:13:09.190 align:start position:0% <00:13:07.800>hopefully. <00:13:08.008>Of <00:13:08.217>course, <00:13:08.425>we <00:13:08.634>were <00:13:08.842>collecting <00:13:09.051>feedback 00:13:09.190 --> 00:13:09.200 align:start position:0% <00:13:09.190>Of <00:13:09.191>course, <00:13:09.193>we <00:13:09.195>were <00:13:09.197>collecting <00:13:09.199>feedback 00:13:09.200 --> 00:13:10.990 align:start position:0% <00:13:09.200>Of <00:13:09.355>course, <00:13:09.511>we <00:13:09.666>were <00:13:09.822>collecting <00:13:09.977>feedback <00:13:10.133>from <00:13:10.288>humans. <00:13:10.444>On <00:13:10.600>the 00:13:10.990 --> 00:13:11.000 align:start position:0% <00:13:10.990>from <00:13:10.993>humans. <00:13:10.996>On <00:13:10.999>the 00:13:11.000 --> 00:13:12.790 align:start position:0% <00:13:11.000>from <00:13:11.155>humans. <00:13:11.311>On <00:13:11.466>the <00:13:11.622>uh <00:13:11.777>what <00:13:11.933>left-hand <00:13:12.088>side, <00:13:12.244>we <00:13:12.400>collect 00:13:12.790 --> 00:13:12.800 align:start position:0% <00:13:12.790>uh <00:13:12.791>what <00:13:12.793>left-hand <00:13:12.795>side, <00:13:12.797>we <00:13:12.799>collect 00:13:12.800 --> 00:13:14.829 align:start position:0% <00:13:12.800>uh <00:13:12.916>what <00:13:13.033>left-hand <00:13:13.150>side, <00:13:13.266>we <00:13:13.383>collect <00:13:13.500>direct <00:13:13.616>feedback, <00:13:13.733>so <00:13:13.849>you <00:13:13.966>can <00:13:14.083>put <00:13:14.199>thumbs 00:13:14.829 --> 00:13:14.839 align:start position:0% <00:13:14.829>direct <00:13:14.830>feedback, <00:13:14.832>so <00:13:14.833>you <00:13:14.835>can <00:13:14.836>put <00:13:14.838>thumbs 00:13:14.839 --> 00:13:16.310 align:start position:0% <00:13:14.839>direct <00:13:14.927>feedback, <00:13:15.015>so <00:13:15.103>you <00:13:15.192>can <00:13:15.280>put <00:13:15.368>thumbs <00:13:15.456>up <00:13:15.545>or <00:13:15.633>thumbs <00:13:15.721>down <00:13:15.809>on <00:13:15.898>the <00:13:15.986>comment <00:13:16.074>and <00:13:16.162>let 00:13:16.310 --> 00:13:16.320 align:start position:0% <00:13:16.310>up <00:13:16.311>or <00:13:16.312>thumbs <00:13:16.313>down <00:13:16.314>on <00:13:16.315>the <00:13:16.316>comment <00:13:16.317>and <00:13:16.319>let 00:13:16.320 --> 00:13:17.670 align:start position:0% <00:13:16.320>up <00:13:16.395>or <00:13:16.471>thumbs <00:13:16.547>down <00:13:16.623>on <00:13:16.699>the <00:13:16.775>comment <00:13:16.851>and <00:13:16.927>let <00:13:17.003>us <00:13:17.079>know <00:13:17.155>whether <00:13:17.231>the <00:13:17.307>comment <00:13:17.383>was <00:13:17.459>good <00:13:17.535>or 00:13:17.670 --> 00:13:17.680 align:start position:0% <00:13:17.670>us <00:13:17.671>know <00:13:17.672>whether <00:13:17.673>the <00:13:17.675>comment <00:13:17.676>was <00:13:17.677>good <00:13:17.679>or 00:13:17.680 --> 00:13:20.470 align:start position:0% <00:13:17.680>us <00:13:17.773>know <00:13:17.866>whether <00:13:17.959>the <00:13:18.053>comment <00:13:18.146>was <00:13:18.239>good <00:13:18.333>or <00:13:18.426>bad. <00:13:18.520>But <00:13:18.613>humans <00:13:18.706>are <00:13:18.800>so <00:13:18.893>lazy. <00:13:18.986>They <00:13:19.079>they 00:13:20.470 --> 00:13:20.480 align:start position:0% <00:13:20.470>bad. <00:13:20.471>But <00:13:20.472>humans <00:13:20.473>are <00:13:20.475>so <00:13:20.476>lazy. <00:13:20.477>They <00:13:20.479>they 00:13:20.480 --> 00:13:21.990 align:start position:0% <00:13:20.480>bad. <00:13:20.570>But <00:13:20.661>humans <00:13:20.751>are <00:13:20.842>so <00:13:20.933>lazy. <00:13:21.023>They <00:13:21.114>they <00:13:21.204>never <00:13:21.295>click <00:13:21.386>those <00:13:21.476>thing <00:13:21.567>and <00:13:21.657>I <00:13:21.748>had <00:13:21.839>to 00:13:21.990 --> 00:13:22.000 align:start position:0% <00:13:21.990>never <00:13:21.991>click <00:13:21.992>those <00:13:21.993>thing <00:13:21.995>and <00:13:21.996>I <00:13:21.997>had <00:13:21.999>to 00:13:22.000 --> 00:13:23.070 align:start position:0% <00:13:22.000>never <00:13:22.068>click <00:13:22.137>those <00:13:22.206>thing <00:13:22.275>and <00:13:22.343>I <00:13:22.412>had <00:13:22.481>to <00:13:22.550>reach <00:13:22.619>out <00:13:22.687>and <00:13:22.756>say, <00:13:22.825>"Hey, <00:13:22.894>could <00:13:22.963>you 00:13:23.070 --> 00:13:23.080 align:start position:0% <00:13:23.070>reach <00:13:23.071>out <00:13:23.073>and <00:13:23.074>say, <00:13:23.076>"Hey, <00:13:23.077>could <00:13:23.079>you 00:13:23.080 --> 00:13:24.270 align:start position:0% <00:13:23.080>reach <00:13:23.162>out <00:13:23.244>and <00:13:23.327>say, <00:13:23.409>"Hey, <00:13:23.491>could <00:13:23.574>you <00:13:23.656>please <00:13:23.739>look <00:13:23.821>at <00:13:23.903>this <00:13:23.986>comment? <00:13:24.068>Could <00:13:24.151>you 00:13:24.270 --> 00:13:24.280 align:start position:0% <00:13:24.270>please <00:13:24.271>look <00:13:24.273>at <00:13:24.274>this <00:13:24.276>comment? <00:13:24.277>Could <00:13:24.279>you 00:13:24.280 --> 00:13:26.350 align:start position:0% <00:13:24.280>please <00:13:24.367>look <00:13:24.454>at <00:13:24.542>this <00:13:24.630>comment? <00:13:24.717>Could <00:13:24.805>you <00:13:24.892>like <00:13:24.980>tell <00:13:25.067>me <00:13:25.155>is <00:13:25.242>it <00:13:25.329>good <00:13:25.417>or <00:13:25.505>bad?" <00:13:25.592>So, <00:13:25.680>we 00:13:26.350 --> 00:13:26.360 align:start position:0% <00:13:26.350>like <00:13:26.351>tell <00:13:26.352>me <00:13:26.353>is <00:13:26.354>it <00:13:26.355>good <00:13:26.356>or <00:13:26.357>bad?" <00:13:26.358>So, <00:13:26.359>we 00:13:26.360 --> 00:13:28.030 align:start position:0% <00:13:26.360>like <00:13:26.447>tell <00:13:26.535>me <00:13:26.622>is <00:13:26.710>it <00:13:26.797>good <00:13:26.885>or <00:13:26.972>bad?" <00:13:27.060>So, <00:13:27.147>we <00:13:27.235>collect <00:13:27.322>another <00:13:27.410>signal, <00:13:27.497>which <00:13:27.585>is <00:13:27.672>like <00:13:27.760>an 00:13:28.030 --> 00:13:28.040 align:start position:0% <00:13:28.030>collect <00:13:28.031>another <00:13:28.033>signal, <00:13:28.034>which <00:13:28.036>is <00:13:28.037>like <00:13:28.039>an 00:13:28.040 --> 00:13:30.510 align:start position:0% <00:13:28.040>collect <00:13:28.167>another <00:13:28.294>signal, <00:13:28.421>which <00:13:28.549>is <00:13:28.676>like <00:13:28.803>an <00:13:28.930>indirect <00:13:29.058>feedback. <00:13:29.185>So, <00:13:29.312>when <00:13:29.439>whenever 00:13:30.510 --> 00:13:30.520 align:start position:0% <00:13:30.510>indirect <00:13:30.512>feedback. <00:13:30.514>So, <00:13:30.516>when <00:13:30.519>whenever 00:13:30.520 --> 00:13:32.070 align:start position:0% <00:13:30.520>indirect <00:13:30.659>feedback. <00:13:30.799>So, <00:13:30.938>when <00:13:31.078>whenever <00:13:31.217>there's <00:13:31.357>a <00:13:31.496>comment <00:13:31.636>and <00:13:31.775>there's <00:13:31.915>no 00:13:32.070 --> 00:13:32.080 align:start position:0% <00:13:32.070>there's <00:13:32.071>a <00:13:32.073>comment <00:13:32.075>and <00:13:32.077>there's <00:13:32.079>no 00:13:32.080 --> 00:13:33.750 align:start position:0% <00:13:32.080>there's <00:13:32.187>a <00:13:32.295>comment <00:13:32.403>and <00:13:32.510>there's <00:13:32.618>no <00:13:32.726>reaction <00:13:32.833>from <00:13:32.941>a <00:13:33.049>human, <00:13:33.156>but <00:13:33.264>there's <00:13:33.372>a <00:13:33.480>at 00:13:33.750 --> 00:13:33.760 align:start position:0% <00:13:33.750>reaction <00:13:33.751>from <00:13:33.752>a <00:13:33.753>human, <00:13:33.755>but <00:13:33.756>there's <00:13:33.757>a <00:13:33.759>at 00:13:33.760 --> 00:13:35.190 align:start position:0% <00:13:33.760>reaction <00:13:33.845>from <00:13:33.931>a <00:13:34.017>human, <00:13:34.103>but <00:13:34.189>there's <00:13:34.274>a <00:13:34.360>at <00:13:34.446>the <00:13:34.532>commit <00:13:34.618>in <00:13:34.703>the <00:13:34.789>pull <00:13:34.875>request <00:13:34.961>in <00:13:35.047>the 00:13:35.190 --> 00:13:35.200 align:start position:0% <00:13:35.190>the <00:13:35.191>commit <00:13:35.192>in <00:13:35.193>the <00:13:35.195>pull <00:13:35.196>request <00:13:35.197>in <00:13:35.199>the 00:13:35.200 --> 00:13:36.990 align:start position:0% <00:13:35.200>the <00:13:35.307>commit <00:13:35.415>in <00:13:35.523>the <00:13:35.630>pull <00:13:35.738>request <00:13:35.846>in <00:13:35.953>the <00:13:36.061>final <00:13:36.169>diff, <00:13:36.276>they <00:13:36.384>apply <00:13:36.492>that <00:13:36.600>feedback, 00:13:36.990 --> 00:13:37.000 align:start position:0% <00:13:36.990>final <00:13:36.991>diff, <00:13:36.993>they <00:13:36.995>apply <00:13:36.997>that <00:13:36.999>feedback, 00:13:37.000 --> 00:13:38.990 align:start position:0% <00:13:37.000>final <00:13:37.107>diff, <00:13:37.215>they <00:13:37.323>apply <00:13:37.430>that <00:13:37.538>feedback, <00:13:37.646>that <00:13:37.753>an <00:13:37.861>indirect <00:13:37.969>signal <00:13:38.076>to <00:13:38.184>us <00:13:38.292>that <00:13:38.400>that 00:13:38.990 --> 00:13:39.000 align:start position:0% <00:13:38.990>that <00:13:38.991>an <00:13:38.992>indirect <00:13:38.993>signal <00:13:38.995>to <00:13:38.996>us <00:13:38.997>that <00:13:38.999>that 00:13:39.000 --> 00:13:40.790 align:start position:0% <00:13:39.000>that <00:13:39.107>an <00:13:39.215>indirect <00:13:39.323>signal <00:13:39.430>to <00:13:39.538>us <00:13:39.646>that <00:13:39.753>that <00:13:39.861>comment <00:13:39.969>was <00:13:40.076>useful <00:13:40.184>because <00:13:40.292>they <00:13:40.400>took 00:13:40.790 --> 00:13:40.800 align:start position:0% <00:13:40.790>comment <00:13:40.791>was <00:13:40.793>useful <00:13:40.795>because <00:13:40.797>they <00:13:40.799>took 00:13:40.800 --> 00:13:42.430 align:start position:0% <00:13:40.800>comment <00:13:40.900>was <00:13:41.000>useful <00:13:41.099>because <00:13:41.199>they <00:13:41.300>took <00:13:41.400>note <00:13:41.500>of <00:13:41.599>it <00:13:41.699>and <00:13:41.800>then <00:13:41.900>applied <00:13:42.000>it <00:13:42.099>in <00:13:42.199>the 00:13:42.430 --> 00:13:42.440 align:start position:0% <00:13:42.430>note <00:13:42.431>of <00:13:42.432>it <00:13:42.433>and <00:13:42.434>then <00:13:42.435>applied <00:13:42.436>it <00:13:42.437>in <00:13:42.439>the 00:13:42.440 --> 00:13:44.470 align:start position:0% <00:13:42.440>note <00:13:42.567>of <00:13:42.694>it <00:13:42.821>and <00:13:42.949>then <00:13:43.076>applied <00:13:43.203>it <00:13:43.330>in <00:13:43.458>the <00:13:43.585>final <00:13:43.712>diff. <00:13:43.840>Great. 00:13:44.470 --> 00:13:44.480 align:start position:0% <00:13:44.470>final <00:13:44.474>diff. <00:13:44.479>Great. 00:13:44.480 --> 00:13:46.230 align:start position:0% <00:13:44.480>final <00:13:44.607>diff. <00:13:44.734>Great. <00:13:44.861>So, <00:13:44.989>we <00:13:45.116>took <00:13:45.243>a <00:13:45.370>month <00:13:45.498>of <00:13:45.625>iterating <00:13:45.752>on <00:13:45.880>the 00:13:46.230 --> 00:13:46.240 align:start position:0% <00:13:46.230>So, <00:13:46.231>we <00:13:46.232>took <00:13:46.233>a <00:13:46.234>month <00:13:46.235>of <00:13:46.236>iterating <00:13:46.237>on <00:13:46.239>the 00:13:46.240 --> 00:13:48.230 align:start position:0% <00:13:46.240>So, <00:13:46.340>we <00:13:46.440>took <00:13:46.540>a <00:13:46.640>month <00:13:46.740>of <00:13:46.840>iterating <00:13:46.940>on <00:13:47.040>the <00:13:47.140>prompt, <00:13:47.240>on <00:13:47.340>the <00:13:47.440>agent, <00:13:47.540>bugging <00:13:47.640>everyone 00:13:48.230 --> 00:13:48.240 align:start position:0% <00:13:48.230>prompt, <00:13:48.231>on <00:13:48.233>the <00:13:48.235>agent, <00:13:48.237>bugging <00:13:48.239>everyone 00:13:48.240 --> 00:13:49.750 align:start position:0% <00:13:48.240>prompt, <00:13:48.344>on <00:13:48.449>the <00:13:48.553>agent, <00:13:48.658>bugging <00:13:48.762>everyone <00:13:48.867>around <00:13:48.971>to <00:13:49.076>put <00:13:49.180>those <00:13:49.285>thumbs <00:13:49.389>up <00:13:49.494>and <00:13:49.599>some 00:13:49.750 --> 00:13:49.760 align:start position:0% <00:13:49.750>around <00:13:49.751>to <00:13:49.752>put <00:13:49.753>those <00:13:49.755>thumbs <00:13:49.756>up <00:13:49.757>and <00:13:49.759>some 00:13:49.760 --> 00:13:51.270 align:start position:0% <00:13:49.760>around <00:13:49.864>to <00:13:49.969>put <00:13:50.073>those <00:13:50.178>thumbs <00:13:50.282>up <00:13:50.387>and <00:13:50.491>some <00:13:50.596>down, <00:13:50.700>and <00:13:50.805>detecting <00:13:50.909>that <00:13:51.014>signal, <00:13:51.119>and 00:13:51.270 --> 00:13:51.280 align:start position:0% <00:13:51.270>down, <00:13:51.271>and <00:13:51.273>detecting <00:13:51.275>that <00:13:51.277>signal, <00:13:51.279>and 00:13:51.280 --> 00:13:52.550 align:start position:0% <00:13:51.280>down, <00:13:51.375>and <00:13:51.470>detecting <00:13:51.565>that <00:13:51.661>signal, <00:13:51.756>and <00:13:51.851>finally <00:13:51.946>we <00:13:52.041>were <00:13:52.137>able <00:13:52.232>to <00:13:52.327>cross <00:13:52.423>this 00:13:52.550 --> 00:13:52.560 align:start position:0% <00:13:52.550>finally <00:13:52.551>we <00:13:52.553>were <00:13:52.554>able <00:13:52.555>to <00:13:52.557>cross <00:13:52.559>this 00:13:52.560 --> 00:13:55.950 align:start position:0% <00:13:52.560>finally <00:13:52.667>we <00:13:52.775>were <00:13:52.883>able <00:13:52.990>to <00:13:53.098>cross <00:13:53.206>this <00:13:53.313>elusive <00:13:53.421>50% <00:13:53.529>threshold. <00:13:53.636>So, <00:13:53.744>we <00:13:53.852>either <00:13:53.959>the 00:13:55.950 --> 00:13:55.960 align:start position:0% <00:13:55.950>elusive <00:13:55.951>50% <00:13:55.953>threshold. <00:13:55.954>So, <00:13:55.956>we <00:13:55.957>either <00:13:55.959>the 00:13:55.960 --> 00:13:58.270 align:start position:0% <00:13:55.960>elusive <00:13:56.053>50% <00:13:56.146>threshold. <00:13:56.240>So, <00:13:56.333>we <00:13:56.426>either <00:13:56.520>the <00:13:56.613>comment <00:13:56.706>was <00:13:56.800>thumbed <00:13:56.893>up <00:13:56.986>by <00:13:57.080>a <00:13:57.173>human <00:13:57.266>or <00:13:57.360>was 00:13:58.270 --> 00:13:58.280 align:start position:0% <00:13:58.270>comment <00:13:58.271>was <00:13:58.272>thumbed <00:13:58.273>up <00:13:58.274>by <00:13:58.275>a <00:13:58.276>human <00:13:58.277>or <00:13:58.279>was 00:13:58.280 --> 00:13:59.830 align:start position:0% <00:13:58.280>comment <00:13:58.379>was <00:13:58.479>thumbed <00:13:58.578>up <00:13:58.678>by <00:13:58.778>a <00:13:58.877>human <00:13:58.977>or <00:13:59.077>was <00:13:59.176>indirectly <00:13:59.276>applied <00:13:59.376>to <00:13:59.475>the <00:13:59.575>final <00:13:59.675>diff. 00:13:59.830 --> 00:13:59.840 align:start position:0% <00:13:59.830>indirectly <00:13:59.831>applied <00:13:59.833>to <00:13:59.835>the <00:13:59.837>final <00:13:59.839>diff. 00:13:59.840 --> 00:14:01.430 align:start position:0% <00:13:59.840>indirectly <00:13:59.940>applied <00:14:00.040>to <00:14:00.140>the <00:14:00.240>final <00:14:00.340>diff. <00:14:00.440>So, <00:14:00.540>it <00:14:00.640>was <00:14:00.740>a <00:14:00.840>great <00:14:00.940>success, <00:14:01.040>but <00:14:01.140>it <00:14:01.240>took 00:14:01.430 --> 00:14:01.440 align:start position:0% <00:14:01.430>So, <00:14:01.431>it <00:14:01.432>was <00:14:01.433>a <00:14:01.434>great <00:14:01.435>success, <00:14:01.436>but <00:14:01.437>it <00:14:01.439>took 00:14:01.440 --> 00:14:02.790 align:start position:0% <00:14:01.440>So, <00:14:01.541>it <00:14:01.642>was <00:14:01.743>a <00:14:01.845>great <00:14:01.946>success, <00:14:02.047>but <00:14:02.148>it <00:14:02.250>took <00:14:02.351>a <00:14:02.452>lot <00:14:02.553>of <00:14:02.655>work. 00:14:02.790 --> 00:14:02.800 align:start position:0% <00:14:02.790>a <00:14:02.793>lot <00:14:02.795>of <00:14:02.799>work. 00:14:02.800 --> 00:14:04.390 align:start position:0% <00:14:02.800>a <00:14:02.927>lot <00:14:03.054>of <00:14:03.181>work. <00:14:03.309>And <00:14:03.436>now <00:14:03.563>it's <00:14:03.690>time <00:14:03.818>for <00:14:03.945>the <00:14:04.072>famous <00:14:04.199>quote, 00:14:04.390 --> 00:14:04.400 align:start position:0% <00:14:04.390>And <00:14:04.391>now <00:14:04.392>it's <00:14:04.393>time <00:14:04.395>for <00:14:04.396>the <00:14:04.397>famous <00:14:04.399>quote, 00:14:04.400 --> 00:14:05.630 align:start position:0% <00:14:04.400>And <00:14:04.473>now <00:14:04.547>it's <00:14:04.621>time <00:14:04.695>for <00:14:04.769>the <00:14:04.842>famous <00:14:04.916>quote, <00:14:04.990>which <00:14:05.064>you <00:14:05.138>might <00:14:05.211>want <00:14:05.285>to <00:14:05.359>write <00:14:05.433>it <00:14:05.507>down 00:14:05.630 --> 00:14:05.640 align:start position:0% <00:14:05.630>which <00:14:05.631>you <00:14:05.632>might <00:14:05.633>want <00:14:05.635>to <00:14:05.636>write <00:14:05.637>it <00:14:05.639>down 00:14:05.640 --> 00:14:07.590 align:start position:0% <00:14:05.640>which <00:14:05.740>you <00:14:05.840>might <00:14:05.939>want <00:14:06.040>to <00:14:06.140>write <00:14:06.240>it <00:14:06.340>down <00:14:06.439>from <00:14:06.540>one <00:14:06.640>famous <00:14:06.740>AI <00:14:06.840>[snorts] <00:14:06.939>expert. <00:14:07.040>You 00:14:07.590 --> 00:14:07.600 align:start position:0% <00:14:07.590>from <00:14:07.591>one <00:14:07.593>famous <00:14:07.594>AI <00:14:07.596>[snorts] <00:14:07.597>expert. <00:14:07.599>You 00:14:07.600 --> 00:14:08.990 align:start position:0% <00:14:07.600>from <00:14:07.696>one <00:14:07.792>famous <00:14:07.888>AI <00:14:07.984>[snorts] <00:14:08.081>expert. <00:14:08.177>You <00:14:08.273>might <00:14:08.369>have <00:14:08.466>seen <00:14:08.562>him <00:14:08.658>on <00:14:08.754>stage <00:14:08.851>somewhere 00:14:08.990 --> 00:14:09.000 align:start position:0% <00:14:08.990>might <00:14:08.991>have <00:14:08.993>seen <00:14:08.994>him <00:14:08.996>on <00:14:08.997>stage <00:14:08.999>somewhere 00:14:09.000 --> 00:14:11.150 align:start position:0% <00:14:09.000>might <00:14:09.093>have <00:14:09.186>seen <00:14:09.280>him <00:14:09.373>on <00:14:09.466>stage <00:14:09.560>somewhere <00:14:09.653>in <00:14:09.746>here. <00:14:09.840>So, <00:14:09.933>if <00:14:10.026>you <00:14:10.120>don't <00:14:10.213>back <00:14:10.306>test <00:14:10.400>your 00:14:11.150 --> 00:14:11.160 align:start position:0% <00:14:11.150>in <00:14:11.151>here. <00:14:11.152>So, <00:14:11.153>if <00:14:11.154>you <00:14:11.155>don't <00:14:11.156>back <00:14:11.157>test <00:14:11.159>your 00:14:11.160 --> 00:14:12.830 align:start position:0% <00:14:11.160>in <00:14:11.247>here. <00:14:11.334>So, <00:14:11.422>if <00:14:11.510>you <00:14:11.597>don't <00:14:11.685>back <00:14:11.772>test <00:14:11.860>your <00:14:11.947>agent <00:14:12.035>on <00:14:12.122>a <00:14:12.209>large <00:14:12.297>data <00:14:12.385>set, <00:14:12.472>pretty <00:14:12.560>much 00:14:12.830 --> 00:14:12.840 align:start position:0% <00:14:12.830>agent <00:14:12.831>on <00:14:12.832>a <00:14:12.833>large <00:14:12.835>data <00:14:12.836>set, <00:14:12.837>pretty <00:14:12.839>much 00:14:12.840 --> 00:14:14.190 align:start position:0% <00:14:12.840>agent <00:14:12.926>on <00:14:13.013>a <00:14:13.100>large <00:14:13.187>data <00:14:13.273>set, <00:14:13.360>pretty <00:14:13.447>much <00:14:13.534>you <00:14:13.621>don't <00:14:13.707>have <00:14:13.794>an <00:14:13.881>agent. <00:14:13.968>That's <00:14:14.055>as 00:14:14.190 --> 00:14:14.200 align:start position:0% <00:14:14.190>you <00:14:14.191>don't <00:14:14.193>have <00:14:14.194>an <00:14:14.196>agent. <00:14:14.197>That's <00:14:14.199>as 00:14:14.200 --> 00:14:16.110 align:start position:0% <00:14:14.200>you <00:14:14.355>don't <00:14:14.511>have <00:14:14.666>an <00:14:14.822>agent. <00:14:14.977>That's <00:14:15.133>as <00:14:15.288>simple <00:14:15.444>as <00:14:15.600>that. 00:14:16.110 --> 00:14:16.120 align:start position:0% <00:14:16.110>simple <00:14:16.114>as <00:14:16.119>that. 00:14:16.120 --> 00:14:17.310 align:start position:0% <00:14:16.120>simple <00:14:16.217>as <00:14:16.314>that. <00:14:16.412>But, <00:14:16.509>we <00:14:16.606>kind <00:14:16.704>of <00:14:16.801>knew <00:14:16.898>this, <00:14:16.996>right? <00:14:17.093>We <00:14:17.190>had 00:14:17.310 --> 00:14:17.320 align:start position:0% <00:14:17.310>But, <00:14:17.311>we <00:14:17.312>kind <00:14:17.313>of <00:14:17.314>knew <00:14:17.315>this, <00:14:17.316>right? <00:14:17.317>We <00:14:17.319>had 00:14:17.320 --> 00:14:19.350 align:start position:0% <00:14:17.320>But, <00:14:17.407>we <00:14:17.495>kind <00:14:17.582>of <00:14:17.670>knew <00:14:17.757>this, <00:14:17.845>right? <00:14:17.932>We <00:14:18.020>had <00:14:18.107>a <00:14:18.195>product. <00:14:18.282>We <00:14:18.370>put <00:14:18.457>business <00:14:18.545>on <00:14:18.632>the <00:14:18.720>line 00:14:19.350 --> 00:14:19.360 align:start position:0% <00:14:19.350>a <00:14:19.351>product. <00:14:19.352>We <00:14:19.353>put <00:14:19.355>business <00:14:19.356>on <00:14:19.357>the <00:14:19.359>line 00:14:19.360 --> 00:14:20.950 align:start position:0% <00:14:19.360>a <00:14:19.460>product. <00:14:19.560>We <00:14:19.660>put <00:14:19.760>business <00:14:19.860>on <00:14:19.960>the <00:14:20.060>line <00:14:20.160>with <00:14:20.260>a <00:14:20.360>value-based <00:14:20.460>pricing, <00:14:20.560>and <00:14:20.660>we <00:14:20.760>know 00:14:20.950 --> 00:14:20.960 align:start position:0% <00:14:20.950>with <00:14:20.951>a <00:14:20.953>value-based <00:14:20.954>pricing, <00:14:20.956>and <00:14:20.957>we <00:14:20.959>know 00:14:20.960 --> 00:14:22.670 align:start position:0% <00:14:20.960>with <00:14:21.067>a <00:14:21.175>value-based <00:14:21.283>pricing, <00:14:21.390>and <00:14:21.498>we <00:14:21.606>know <00:14:21.713>exactly <00:14:21.821>how <00:14:21.929>to <00:14:22.036>build <00:14:22.144>a <00:14:22.252>successful <00:14:22.360>agent. 00:14:22.670 --> 00:14:22.680 align:start position:0% <00:14:22.670>exactly <00:14:22.671>how <00:14:22.673>to <00:14:22.674>build <00:14:22.675>a <00:14:22.677>successful <00:14:22.679>agent. 00:14:22.680 --> 00:14:24.310 align:start position:0% <00:14:22.680>exactly <00:14:22.787>how <00:14:22.895>to <00:14:23.003>build <00:14:23.110>a <00:14:23.218>successful <00:14:23.326>agent. <00:14:23.433>There's <00:14:23.541>no <00:14:23.649>other <00:14:23.756>way <00:14:23.864>than <00:14:23.972>sweat <00:14:24.079>through 00:14:24.310 --> 00:14:24.320 align:start position:0% <00:14:24.310>There's <00:14:24.311>no <00:14:24.313>other <00:14:24.314>way <00:14:24.316>than <00:14:24.317>sweat <00:14:24.319>through 00:14:24.320 --> 00:14:27.150 align:start position:0% <00:14:24.320>There's <00:14:24.427>no <00:14:24.535>other <00:14:24.643>way <00:14:24.750>than <00:14:24.858>sweat <00:14:24.966>through <00:14:25.073>those <00:14:25.181>80 <00:14:25.289>tests, <00:14:25.396>uh <00:14:25.504>sweating <00:14:25.612>in <00:14:25.720>every 00:14:27.150 --> 00:14:27.160 align:start position:0% <00:14:27.150>those <00:14:27.151>80 <00:14:27.153>tests, <00:14:27.154>uh <00:14:27.156>sweating <00:14:27.157>in <00:14:27.159>every 00:14:27.160 --> 00:14:29.190 align:start position:0% <00:14:27.160>those <00:14:27.315>80 <00:14:27.471>tests, <00:14:27.626>uh <00:14:27.782>sweating <00:14:27.937>in <00:14:28.093>every <00:14:28.248>decimal <00:14:28.404>percentage <00:14:28.560>point. 00:14:29.190 --> 00:14:29.200 align:start position:0% <00:14:29.190>decimal <00:14:29.194>percentage <00:14:29.199>point. 00:14:29.200 --> 00:14:32.390 align:start position:0% <00:14:29.200>decimal <00:14:29.355>percentage <00:14:29.511>point. <00:14:29.666>So, <00:14:29.822>there's <00:14:29.977>no <00:14:30.133>really <00:14:30.288>real <00:14:30.444>easy <00:14:30.600>answer. 00:14:32.390 --> 00:14:32.400 align:start position:0% <00:14:32.390>So, <00:14:32.391>there's <00:14:32.393>no <00:14:32.394>really <00:14:32.396>real <00:14:32.397>easy <00:14:32.399>answer. 00:14:32.400 --> 00:14:34.030 align:start position:0% <00:14:32.400>So, <00:14:32.516>there's <00:14:32.633>no <00:14:32.750>really <00:14:32.866>real <00:14:32.983>easy <00:14:33.100>answer. <00:14:33.216>So, <00:14:33.333>building <00:14:33.449>agent <00:14:33.566>is <00:14:33.683>really <00:14:33.800>really 00:14:34.030 --> 00:14:34.040 align:start position:0% <00:14:34.030>So, <00:14:34.031>building <00:14:34.033>agent <00:14:34.035>is <00:14:34.037>really <00:14:34.039>really 00:14:34.040 --> 00:14:37.030 align:start position:0% <00:14:34.040>So, <00:14:34.167>building <00:14:34.294>agent <00:14:34.421>is <00:14:34.549>really <00:14:34.676>really <00:14:34.803>hard, <00:14:34.930>but <00:14:35.058>it <00:14:35.185>is <00:14:35.312>possible, <00:14:35.439>right? 00:14:37.030 --> 00:14:37.040 align:start position:0% <00:14:37.030>hard, <00:14:37.031>but <00:14:37.033>it <00:14:37.035>is <00:14:37.037>possible, <00:14:37.039>right? 00:14:37.040 --> 00:14:38.310 align:start position:0% <00:14:37.040>hard, <00:14:37.135>but <00:14:37.230>it <00:14:37.325>is <00:14:37.420>possible, <00:14:37.516>right? <00:14:37.611>So, <00:14:37.706>we <00:14:37.801>have <00:14:37.897>now <00:14:37.992>Claude <00:14:38.087>code <00:14:38.183>reviewing 00:14:38.310 --> 00:14:38.320 align:start position:0% <00:14:38.310>So, <00:14:38.311>we <00:14:38.313>have <00:14:38.314>now <00:14:38.316>Claude <00:14:38.317>code <00:14:38.319>reviewing 00:14:38.320 --> 00:14:40.950 align:start position:0% <00:14:38.320>So, <00:14:38.413>we <00:14:38.506>have <00:14:38.600>now <00:14:38.693>Claude <00:14:38.786>code <00:14:38.880>reviewing <00:14:38.973>our <00:14:39.066>PRs <00:14:39.160>a <00:14:39.253>bit <00:14:39.346>more <00:14:39.440>as <00:14:39.533>a <00:14:39.626>senior <00:14:39.720>engineer. 00:14:40.950 --> 00:14:40.960 align:start position:0% <00:14:40.950>our <00:14:40.951>PRs <00:14:40.952>a <00:14:40.953>bit <00:14:40.954>more <00:14:40.955>as <00:14:40.956>a <00:14:40.957>senior <00:14:40.959>engineer. 00:14:40.960 --> 00:14:42.870 align:start position:0% <00:14:40.960>our <00:14:41.047>PRs <00:14:41.135>a <00:14:41.222>bit <00:14:41.310>more <00:14:41.397>as <00:14:41.485>a <00:14:41.572>senior <00:14:41.660>engineer. <00:14:41.747>But, <00:14:41.835>what <00:14:41.922>if <00:14:42.010>we <00:14:42.097>want <00:14:42.185>to <00:14:42.272>approve <00:14:42.360>those 00:14:42.870 --> 00:14:42.880 align:start position:0% <00:14:42.870>But, <00:14:42.871>what <00:14:42.872>if <00:14:42.873>we <00:14:42.875>want <00:14:42.876>to <00:14:42.877>approve <00:14:42.879>those 00:14:42.880 --> 00:14:44.590 align:start position:0% <00:14:42.880>But, <00:14:42.967>what <00:14:43.055>if <00:14:43.142>we <00:14:43.230>want <00:14:43.317>to <00:14:43.405>approve <00:14:43.492>those <00:14:43.580>PRs <00:14:43.667>as <00:14:43.755>a <00:14:43.842>senior <00:14:43.930>engineer? <00:14:44.017>Oh, <00:14:44.105>this <00:14:44.192>is <00:14:44.280>a 00:14:44.590 --> 00:14:44.600 align:start position:0% <00:14:44.590>PRs <00:14:44.591>as <00:14:44.592>a <00:14:44.593>senior <00:14:44.594>engineer? <00:14:44.595>Oh, <00:14:44.596>this <00:14:44.597>is <00:14:44.599>a 00:14:44.600 --> 00:14:46.110 align:start position:0% <00:14:44.600>PRs <00:14:44.735>as <00:14:44.871>a <00:14:45.007>senior <00:14:45.143>engineer? <00:14:45.279>Oh, <00:14:45.415>this <00:14:45.551>is <00:14:45.687>a <00:14:45.823>different <00:14:45.959>ballgame. 00:14:46.110 --> 00:14:46.120 align:start position:0% <00:14:46.110>different <00:14:46.119>ballgame. 00:14:46.120 --> 00:14:47.630 align:start position:0% <00:14:46.120>different <00:14:46.255>ballgame. <00:14:46.391>What <00:14:46.527>if <00:14:46.663>I <00:14:46.799>tell <00:14:46.935>you <00:14:47.071>that <00:14:47.207>our <00:14:47.343>goal <00:14:47.479>was 00:14:47.630 --> 00:14:47.640 align:start position:0% <00:14:47.630>What <00:14:47.631>if <00:14:47.632>I <00:14:47.633>tell <00:14:47.634>you <00:14:47.635>that <00:14:47.636>our <00:14:47.637>goal <00:14:47.639>was 00:14:47.640 --> 00:14:49.870 align:start position:0% <00:14:47.640>What <00:14:47.733>if <00:14:47.826>I <00:14:47.920>tell <00:14:48.013>you <00:14:48.106>that <00:14:48.199>our <00:14:48.293>goal <00:14:48.386>was <00:14:48.480>actually <00:14:48.573>to <00:14:48.666>approve <00:14:48.760>more <00:14:48.853>than <00:14:48.946>half <00:14:49.040>of 00:14:49.870 --> 00:14:49.880 align:start position:0% <00:14:49.870>actually <00:14:49.871>to <00:14:49.873>approve <00:14:49.874>more <00:14:49.876>than <00:14:49.877>half <00:14:49.879>of 00:14:49.880 --> 00:14:51.950 align:start position:0% <00:14:49.880>actually <00:14:49.980>to <00:14:50.080>approve <00:14:50.180>more <00:14:50.280>than <00:14:50.380>half <00:14:50.480>of <00:14:50.580>all <00:14:50.680>of <00:14:50.780>our <00:14:50.880>pull <00:14:50.980>requests? <00:14:51.080>And <00:14:51.180>you <00:14:51.280>might 00:14:51.950 --> 00:14:51.960 align:start position:0% <00:14:51.950>all <00:14:51.951>of <00:14:51.952>our <00:14:51.953>pull <00:14:51.955>requests? <00:14:51.956>And <00:14:51.957>you <00:14:51.959>might 00:14:51.960 --> 00:14:53.230 align:start position:0% <00:14:51.960>all <00:14:52.047>of <00:14:52.135>our <00:14:52.223>pull <00:14:52.311>requests? <00:14:52.399>And <00:14:52.487>you <00:14:52.575>might <00:14:52.663>think, <00:14:52.751>"Oh, <00:14:52.839>are <00:14:52.927>they <00:14:53.015>delusional? <00:14:53.103>Like, 00:14:53.230 --> 00:14:53.240 align:start position:0% <00:14:53.230>think, <00:14:53.231>"Oh, <00:14:53.233>are <00:14:53.235>they <00:14:53.237>delusional? <00:14:53.239>Like, 00:14:53.240 --> 00:14:54.590 align:start position:0% <00:14:53.240>think, <00:14:53.333>"Oh, <00:14:53.426>are <00:14:53.520>they <00:14:53.613>delusional? <00:14:53.707>Like, <00:14:53.800>this <00:14:53.894>is <00:14:53.987>ridiculous. <00:14:54.081>It's <00:14:54.174>not <00:14:54.268>It's <00:14:54.361>not <00:14:54.455>be 00:14:54.590 --> 00:14:54.600 align:start position:0% <00:14:54.590>this <00:14:54.591>is <00:14:54.592>ridiculous. <00:14:54.593>It's <00:14:54.595>not <00:14:54.596>It's <00:14:54.597>not <00:14:54.599>be 00:14:54.600 --> 00:14:55.829 align:start position:0% <00:14:54.600>this <00:14:54.738>is <00:14:54.876>ridiculous. <00:14:55.014>It's <00:14:55.153>not <00:14:55.291>It's <00:14:55.429>not <00:14:55.567>be <00:14:55.706>possible." 00:14:55.829 --> 00:14:55.839 align:start position:0% possible." 00:14:55.839 --> 00:14:56.790 align:start position:0% <00:14:55.839>possible." <00:14:56.694>Well, 00:14:56.790 --> 00:14:56.800 align:start position:0% Well, 00:14:56.800 --> 00:14:58.590 align:start position:0% <00:14:56.800>Well, <00:14:56.939>let's <00:14:57.079>see <00:14:57.219>if <00:14:57.359>we <00:14:57.500>were <00:14:57.640>able <00:14:57.780>to <00:14:57.920>do <00:14:58.060>this <00:14:58.199>or 00:14:58.590 --> 00:14:58.600 align:start position:0% <00:14:58.590>let's <00:14:58.591>see <00:14:58.592>if <00:14:58.593>we <00:14:58.594>were <00:14:58.595>able <00:14:58.596>to <00:14:58.597>do <00:14:58.598>this <00:14:58.599>or 00:14:58.600 --> 00:15:00.190 align:start position:0% <00:14:58.600>let's <00:14:58.682>see <00:14:58.764>if <00:14:58.847>we <00:14:58.929>were <00:14:59.011>able <00:14:59.094>to <00:14:59.176>do <00:14:59.258>this <00:14:59.341>or <00:14:59.423>not. <00:14:59.505>So, <00:14:59.588>but <00:14:59.670>first <00:14:59.752>we <00:14:59.835>need <00:14:59.917>to <00:15:00.000>really 00:15:00.190 --> 00:15:00.200 align:start position:0% <00:15:00.190>not. <00:15:00.191>So, <00:15:00.192>but <00:15:00.193>first <00:15:00.195>we <00:15:00.196>need <00:15:00.197>to <00:15:00.199>really 00:15:00.200 --> 00:15:02.990 align:start position:0% <00:15:00.200>not. <00:15:00.300>So, <00:15:00.400>but <00:15:00.500>first <00:15:00.600>we <00:15:00.700>need <00:15:00.800>to <00:15:00.900>really <00:15:01.000>dissect <00:15:01.100>what <00:15:01.200>is <00:15:01.300>it <00:15:01.400>actually <00:15:01.500>means <00:15:01.600>to 00:15:02.990 --> 00:15:03.000 align:start position:0% <00:15:02.990>dissect <00:15:02.991>what <00:15:02.993>is <00:15:02.994>it <00:15:02.996>actually <00:15:02.997>means <00:15:02.999>to 00:15:03.000 --> 00:15:04.590 align:start position:0% <00:15:03.000>dissect <00:15:03.100>what <00:15:03.200>is <00:15:03.300>it <00:15:03.400>actually <00:15:03.500>means <00:15:03.600>to <00:15:03.700>review <00:15:03.800>a <00:15:03.900>PR, <00:15:04.000>right? <00:15:04.100>The <00:15:04.200>thing <00:15:04.300>that <00:15:04.400>we 00:15:04.590 --> 00:15:04.600 align:start position:0% <00:15:04.590>review <00:15:04.591>a <00:15:04.592>PR, <00:15:04.593>right? <00:15:04.595>The <00:15:04.596>thing <00:15:04.597>that <00:15:04.599>we 00:15:04.600 --> 00:15:05.829 align:start position:0% <00:15:04.600>review <00:15:04.685>a <00:15:04.770>PR, <00:15:04.855>right? <00:15:04.940>The <00:15:05.025>thing <00:15:05.110>that <00:15:05.195>we <00:15:05.280>had <00:15:05.365>in <00:15:05.450>the <00:15:05.535>beginning, <00:15:05.621>this <00:15:05.706>first 00:15:05.829 --> 00:15:05.839 align:start position:0% <00:15:05.829>had <00:15:05.830>in <00:15:05.832>the <00:15:05.834>beginning, <00:15:05.836>this <00:15:05.838>first 00:15:05.839 --> 00:15:08.110 align:start position:0% <00:15:05.839>had <00:15:05.966>in <00:15:06.093>the <00:15:06.220>beginning, <00:15:06.348>this <00:15:06.475>first <00:15:06.602>iteration, <00:15:06.729>is <00:15:06.857>just <00:15:06.984>a <00:15:07.111>tiny <00:15:07.239>slice. 00:15:08.110 --> 00:15:08.120 align:start position:0% <00:15:08.110>iteration, <00:15:08.111>is <00:15:08.113>just <00:15:08.115>a <00:15:08.117>tiny <00:15:08.119>slice. 00:15:08.120 --> 00:15:09.470 align:start position:0% <00:15:08.120>iteration, <00:15:08.221>is <00:15:08.322>just <00:15:08.423>a <00:15:08.525>tiny <00:15:08.626>slice. <00:15:08.727>But, <00:15:08.828>what <00:15:08.930>are <00:15:09.031>those <00:15:09.132>questions <00:15:09.233>that <00:15:09.335>you 00:15:09.470 --> 00:15:09.480 align:start position:0% <00:15:09.470>But, <00:15:09.471>what <00:15:09.473>are <00:15:09.474>those <00:15:09.476>questions <00:15:09.477>that <00:15:09.479>you 00:15:09.480 --> 00:15:10.590 align:start position:0% <00:15:09.480>But, <00:15:09.556>what <00:15:09.633>are <00:15:09.710>those <00:15:09.787>questions <00:15:09.864>that <00:15:09.941>you <00:15:10.017>ask <00:15:10.094>yourself <00:15:10.171>when <00:15:10.248>you <00:15:10.325>review <00:15:10.402>a <00:15:10.479>pull 00:15:10.590 --> 00:15:10.600 align:start position:0% <00:15:10.590>ask <00:15:10.591>yourself <00:15:10.593>when <00:15:10.594>you <00:15:10.596>review <00:15:10.597>a <00:15:10.599>pull 00:15:10.600 --> 00:15:12.310 align:start position:0% <00:15:10.600>ask <00:15:10.716>yourself <00:15:10.833>when <00:15:10.950>you <00:15:11.066>review <00:15:11.183>a <00:15:11.300>pull <00:15:11.416>request? <00:15:11.533>You <00:15:11.650>look <00:15:11.766>at <00:15:11.883>the <00:15:12.000>problem 00:15:12.310 --> 00:15:12.320 align:start position:0% <00:15:12.310>request? <00:15:12.311>You <00:15:12.313>look <00:15:12.315>at <00:15:12.317>the <00:15:12.319>problem 00:15:12.320 --> 00:15:13.710 align:start position:0% <00:15:12.320>request? <00:15:12.445>You <00:15:12.570>look <00:15:12.695>at <00:15:12.820>the <00:15:12.945>problem <00:15:13.070>statement, <00:15:13.195>right? <00:15:13.320>Does <00:15:13.445>the <00:15:13.571>PR 00:15:13.710 --> 00:15:13.720 align:start position:0% <00:15:13.710>statement, <00:15:13.712>right? <00:15:13.714>Does <00:15:13.716>the <00:15:13.719>PR 00:15:13.720 --> 00:15:15.270 align:start position:0% <00:15:13.720>statement, <00:15:13.894>right? <00:15:14.068>Does <00:15:14.243>the <00:15:14.417>PR <00:15:14.591>description <00:15:14.766>communicate <00:15:14.940>the <00:15:15.115>intent 00:15:15.270 --> 00:15:15.280 align:start position:0% <00:15:15.270>description <00:15:15.273>communicate <00:15:15.276>the <00:15:15.279>intent 00:15:15.280 --> 00:15:16.910 align:start position:0% <00:15:15.280>description <00:15:15.513>communicate <00:15:15.746>the <00:15:15.980>intent <00:15:16.213>behind <00:15:16.446>the <00:15:16.680>change? 00:15:16.910 --> 00:15:16.920 align:start position:0% <00:15:16.910>behind <00:15:16.914>the <00:15:16.919>change? 00:15:16.920 --> 00:15:18.590 align:start position:0% <00:15:16.920>behind <00:15:17.075>the <00:15:17.231>change? <00:15:17.386>Well, <00:15:17.542>even <00:15:17.697>if <00:15:17.853>you <00:15:18.008>have <00:15:18.164>a <00:15:18.319>problem 00:15:18.590 --> 00:15:18.600 align:start position:0% <00:15:18.590>Well, <00:15:18.591>even <00:15:18.593>if <00:15:18.594>you <00:15:18.596>have <00:15:18.597>a <00:15:18.599>problem 00:15:18.600 --> 00:15:20.190 align:start position:0% <00:15:18.600>Well, <00:15:18.716>even <00:15:18.833>if <00:15:18.950>you <00:15:19.066>have <00:15:19.183>a <00:15:19.300>problem <00:15:19.416>statement, <00:15:19.533>but <00:15:19.650>what <00:15:19.766>is <00:15:19.883>the <00:15:20.000>bottom 00:15:20.190 --> 00:15:20.200 align:start position:0% <00:15:20.190>statement, <00:15:20.191>but <00:15:20.193>what <00:15:20.195>is <00:15:20.197>the <00:15:20.199>bottom 00:15:20.200 --> 00:15:21.790 align:start position:0% <00:15:20.200>statement, <00:15:20.327>but <00:15:20.454>what <00:15:20.581>is <00:15:20.709>the <00:15:20.836>bottom <00:15:20.963>alignment? <00:15:21.090>Are <00:15:21.218>you <00:15:21.345>actually <00:15:21.472>fixing <00:15:21.600>the 00:15:21.790 --> 00:15:21.800 align:start position:0% <00:15:21.790>alignment? <00:15:21.791>Are <00:15:21.793>you <00:15:21.795>actually <00:15:21.797>fixing <00:15:21.799>the 00:15:21.800 --> 00:15:23.550 align:start position:0% <00:15:21.800>alignment? <00:15:21.907>Are <00:15:22.015>you <00:15:22.123>actually <00:15:22.230>fixing <00:15:22.338>the <00:15:22.446>thing <00:15:22.553>that <00:15:22.661>you <00:15:22.769>said <00:15:22.876>you're <00:15:22.984>going <00:15:23.092>to <00:15:23.199>fix, 00:15:23.550 --> 00:15:23.560 align:start position:0% <00:15:23.550>thing <00:15:23.551>that <00:15:23.552>you <00:15:23.553>said <00:15:23.555>you're <00:15:23.556>going <00:15:23.557>to <00:15:23.559>fix, 00:15:23.560 --> 00:15:24.950 align:start position:0% <00:15:23.560>thing <00:15:23.638>that <00:15:23.716>you <00:15:23.794>said <00:15:23.872>you're <00:15:23.950>going <00:15:24.029>to <00:15:24.107>fix, <00:15:24.185>right? <00:15:24.263>Do <00:15:24.341>you <00:15:24.420>have <00:15:24.498>any <00:15:24.576>bugs <00:15:24.654>in <00:15:24.732>there? <00:15:24.811>Is 00:15:24.950 --> 00:15:24.960 align:start position:0% <00:15:24.950>right? <00:15:24.951>Do <00:15:24.952>you <00:15:24.953>have <00:15:24.954>any <00:15:24.955>bugs <00:15:24.956>in <00:15:24.957>there? <00:15:24.959>Is 00:15:24.960 --> 00:15:26.710 align:start position:0% <00:15:24.960>right? <00:15:25.042>Do <00:15:25.124>you <00:15:25.207>have <00:15:25.289>any <00:15:25.371>bugs <00:15:25.454>in <00:15:25.536>there? <00:15:25.618>Is <00:15:25.701>it <00:15:25.783>safe <00:15:25.865>to <00:15:25.948>ship? <00:15:26.030>Do <00:15:26.112>you <00:15:26.195>adhere <00:15:26.277>to <00:15:26.360>all 00:15:26.710 --> 00:15:26.720 align:start position:0% <00:15:26.710>it <00:15:26.711>safe <00:15:26.712>to <00:15:26.713>ship? <00:15:26.714>Do <00:15:26.715>you <00:15:26.716>adhere <00:15:26.717>to <00:15:26.719>all 00:15:26.720 --> 00:15:28.070 align:start position:0% <00:15:26.720>it <00:15:26.801>safe <00:15:26.882>to <00:15:26.963>ship? <00:15:27.044>Do <00:15:27.125>you <00:15:27.206>adhere <00:15:27.287>to <00:15:27.368>all <00:15:27.449>the <00:15:27.530>best <00:15:27.611>practices? <00:15:27.692>Do <00:15:27.773>you <00:15:27.854>have <00:15:27.935>any 00:15:28.070 --> 00:15:28.080 align:start position:0% <00:15:28.070>the <00:15:28.071>best <00:15:28.073>practices? <00:15:28.074>Do <00:15:28.076>you <00:15:28.077>have <00:15:28.079>any 00:15:28.080 --> 00:15:29.550 align:start position:0% <00:15:28.080>the <00:15:28.212>best <00:15:28.344>practices? <00:15:28.476>Do <00:15:28.609>you <00:15:28.741>have <00:15:28.873>any <00:15:29.006>anti-patterns? <00:15:29.138>What <00:15:29.270>about <00:15:29.403>performance, 00:15:29.550 --> 00:15:29.560 align:start position:0% <00:15:29.550>anti-patterns? <00:15:29.553>What <00:15:29.555>about <00:15:29.559>performance, 00:15:29.560 --> 00:15:31.350 align:start position:0% <00:15:29.560>anti-patterns? <00:15:29.715>What <00:15:29.871>about <00:15:30.026>performance, <00:15:30.182>security? <00:15:30.337>There's <00:15:30.493>dozens <00:15:30.648>and <00:15:30.804>dozens <00:15:30.959>of 00:15:31.350 --> 00:15:31.360 align:start position:0% <00:15:31.350>security? <00:15:31.351>There's <00:15:31.353>dozens <00:15:31.355>and <00:15:31.357>dozens <00:15:31.359>of 00:15:31.360 --> 00:15:33.270 align:start position:0% <00:15:31.360>security? <00:15:31.593>There's <00:15:31.826>dozens <00:15:32.060>and <00:15:32.293>dozens <00:15:32.526>of <00:15:32.760>questions. 00:15:33.270 --> 00:15:33.280 align:start position:0% questions. 00:15:33.280 --> 00:15:35.630 align:start position:0% <00:15:33.280>questions. <00:15:33.435>Okay, <00:15:33.591>so <00:15:33.746>let's <00:15:33.902>see. <00:15:34.057>Let's <00:15:34.213>go <00:15:34.368>back <00:15:34.524>to <00:15:34.680>our 00:15:35.630 --> 00:15:35.640 align:start position:0% <00:15:35.630>Okay, <00:15:35.631>so <00:15:35.632>let's <00:15:35.633>see. <00:15:35.634>Let's <00:15:35.635>go <00:15:35.636>back <00:15:35.637>to <00:15:35.639>our 00:15:35.640 --> 00:15:37.150 align:start position:0% <00:15:35.640>Okay, <00:15:35.724>so <00:15:35.809>let's <00:15:35.894>see. <00:15:35.979>Let's <00:15:36.064>go <00:15:36.149>back <00:15:36.234>to <00:15:36.319>our <00:15:36.404>live <00:15:36.489>demo. <00:15:36.574>Let's <00:15:36.659>take <00:15:36.744>a <00:15:36.829>look <00:15:36.914>of <00:15:36.999>what 00:15:37.150 --> 00:15:37.160 align:start position:0% <00:15:37.150>live <00:15:37.151>demo. <00:15:37.152>Let's <00:15:37.153>take <00:15:37.155>a <00:15:37.156>look <00:15:37.157>of <00:15:37.159>what 00:15:37.160 --> 00:15:38.270 align:start position:0% <00:15:37.160>live <00:15:37.284>demo. <00:15:37.409>Let's <00:15:37.534>take <00:15:37.659>a <00:15:37.784>look <00:15:37.909>of <00:15:38.034>what <00:15:38.159>agent 00:15:38.270 --> 00:15:38.280 align:start position:0% agent 00:15:38.280 --> 00:15:40.030 align:start position:0% <00:15:38.280>agent <00:15:38.480>uh <00:15:38.680>has <00:15:38.880>produced. <00:15:39.079>You <00:15:39.280>ready? <00:15:39.480>Yeah? <00:15:39.680>Should 00:15:40.030 --> 00:15:40.040 align:start position:0% <00:15:40.030>uh <00:15:40.031>has <00:15:40.033>produced. <00:15:40.034>You <00:15:40.036>ready? <00:15:40.037>Yeah? <00:15:40.039>Should 00:15:40.040 --> 00:15:42.990 align:start position:0% <00:15:40.040>uh <00:15:40.140>has <00:15:40.240>produced. <00:15:40.339>You <00:15:40.439>ready? <00:15:40.540>Yeah? <00:15:40.640>Should <00:15:40.740>I <00:15:40.839>go <00:15:40.939>there? <00:15:41.040>Oh <00:15:41.140>my <00:15:41.240>goodness. <00:15:41.339>Let's <00:15:41.439>see. 00:15:42.990 --> 00:15:43.000 align:start position:0% <00:15:42.990>I <00:15:42.991>go <00:15:42.992>there? <00:15:42.993>Oh <00:15:42.995>my <00:15:42.996>goodness. <00:15:42.997>Let's <00:15:42.999>see. 00:15:43.000 --> 00:15:45.590 align:start position:0% <00:15:43.000>I <00:15:43.100>go <00:15:43.200>there? <00:15:43.300>Oh <00:15:43.400>my <00:15:43.500>goodness. <00:15:43.600>Let's <00:15:43.700>see. <00:15:43.800>Okay, <00:15:43.900>there <00:15:44.000>are <00:15:44.100>some <00:15:44.200>some <00:15:44.300>comments. <00:15:44.400>Oh, 00:15:45.590 --> 00:15:45.600 align:start position:0% <00:15:45.590>Okay, <00:15:45.591>there <00:15:45.593>are <00:15:45.594>some <00:15:45.596>some <00:15:45.597>comments. <00:15:45.599>Oh, 00:15:45.600 --> 00:15:48.510 align:start position:0% <00:15:45.600>Okay, <00:15:45.693>there <00:15:45.786>are <00:15:45.880>some <00:15:45.973>some <00:15:46.066>comments. <00:15:46.160>Oh, <00:15:46.253>no. <00:15:46.346>Take <00:15:46.440>a <00:15:46.533>look <00:15:46.626>at <00:15:46.720>this. <00:15:46.813>My <00:15:46.906>god, <00:15:47.000>it's 00:15:48.510 --> 00:15:48.520 align:start position:0% <00:15:48.510>no. <00:15:48.511>Take <00:15:48.512>a <00:15:48.513>look <00:15:48.514>at <00:15:48.515>this. <00:15:48.516>My <00:15:48.517>god, <00:15:48.519>it's 00:15:48.520 --> 00:15:52.070 align:start position:0% <00:15:48.520>no. <00:15:48.607>Take <00:15:48.694>a <00:15:48.782>look <00:15:48.870>at <00:15:48.957>this. <00:15:49.045>My <00:15:49.132>god, <00:15:49.220>it's <00:15:49.307>all <00:15:49.395>red. <00:15:49.482>Let <00:15:49.569>me <00:15:49.657>make <00:15:49.745>it <00:15:49.832>slightly <00:15:49.920>larger. 00:15:52.070 --> 00:15:52.080 align:start position:0% <00:15:52.070>all <00:15:52.071>red. <00:15:52.072>Let <00:15:52.073>me <00:15:52.075>make <00:15:52.076>it <00:15:52.077>slightly <00:15:52.079>larger. 00:15:52.080 --> 00:15:53.670 align:start position:0% <00:15:52.080>all <00:15:52.196>red. <00:15:52.313>Let <00:15:52.430>me <00:15:52.546>make <00:15:52.663>it <00:15:52.780>slightly <00:15:52.896>larger. <00:15:53.013>The <00:15:53.130>problem <00:15:53.246>description <00:15:53.363>was <00:15:53.480>horrible 00:15:53.670 --> 00:15:53.680 align:start position:0% <00:15:53.670>The <00:15:53.672>problem <00:15:53.674>description <00:15:53.676>was <00:15:53.679>horrible 00:15:53.680 --> 00:15:54.830 align:start position:0% <00:15:53.680>The <00:15:53.795>problem <00:15:53.910>description <00:15:54.025>was <00:15:54.140>horrible <00:15:54.255>because <00:15:54.370>we <00:15:54.485>didn't <00:15:54.600>communicate <00:15:54.715>the 00:15:54.830 --> 00:15:54.840 align:start position:0% <00:15:54.830>because <00:15:54.832>we <00:15:54.834>didn't <00:15:54.836>communicate <00:15:54.839>the 00:15:54.840 --> 00:15:55.950 align:start position:0% <00:15:54.840>because <00:15:54.930>we <00:15:55.021>didn't <00:15:55.112>communicate <00:15:55.203>the <00:15:55.294>intent. <00:15:55.384>We <00:15:55.475>just <00:15:55.566>said, <00:15:55.657>"Oh, <00:15:55.748>we're <00:15:55.839>going 00:15:55.950 --> 00:15:55.960 align:start position:0% <00:15:55.950>intent. <00:15:55.951>We <00:15:55.953>just <00:15:55.954>said, <00:15:55.956>"Oh, <00:15:55.957>we're <00:15:55.959>going 00:15:55.960 --> 00:15:57.230 align:start position:0% <00:15:55.960>intent. <00:15:56.041>We <00:15:56.123>just <00:15:56.204>said, <00:15:56.286>"Oh, <00:15:56.368>we're <00:15:56.449>going <00:15:56.531>to <00:15:56.613>do <00:15:56.694>minor <00:15:56.776>changes <00:15:56.858>here <00:15:56.939>and <00:15:57.021>there." <00:15:57.103>But 00:15:57.230 --> 00:15:57.240 align:start position:0% <00:15:57.230>to <00:15:57.231>do <00:15:57.232>minor <00:15:57.233>changes <00:15:57.235>here <00:15:57.236>and <00:15:57.237>there." <00:15:57.239>But 00:15:57.240 --> 00:15:58.670 align:start position:0% <00:15:57.240>to <00:15:57.331>do <00:15:57.423>minor <00:15:57.515>changes <00:15:57.607>here <00:15:57.699>and <00:15:57.791>there." <00:15:57.883>But <00:15:57.975>what <00:15:58.067>what <00:15:58.159>is <00:15:58.251>the <00:15:58.343>customer <00:15:58.435>problem <00:15:58.526>we're 00:15:58.670 --> 00:15:58.680 align:start position:0% <00:15:58.670>what <00:15:58.671>what <00:15:58.673>is <00:15:58.674>the <00:15:58.675>customer <00:15:58.677>problem <00:15:58.679>we're 00:15:58.680 --> 00:16:00.310 align:start position:0% <00:15:58.680>what <00:15:58.796>what <00:15:58.913>is <00:15:59.030>the <00:15:59.146>customer <00:15:59.263>problem <00:15:59.380>we're <00:15:59.496>solving <00:15:59.613>here? <00:15:59.729>It's <00:15:59.846>horrible. <00:15:59.963>So, <00:16:00.079>the 00:16:00.310 --> 00:16:00.320 align:start position:0% <00:16:00.310>solving <00:16:00.311>here? <00:16:00.313>It's <00:16:00.315>horrible. <00:16:00.317>So, <00:16:00.319>the 00:16:00.320 --> 00:16:01.470 align:start position:0% <00:16:00.320>solving <00:16:00.492>here? <00:16:00.665>It's <00:16:00.837>horrible. <00:16:01.010>So, <00:16:01.182>the <00:16:01.355>agent 00:16:01.470 --> 00:16:01.480 align:start position:0% agent 00:16:01.480 --> 00:16:04.070 align:start position:0% <00:16:01.480>agent <00:16:01.713>uh <00:16:01.946>the <00:16:02.180>sub-agent <00:16:02.413>rejected <00:16:02.646>that <00:16:02.880>problem 00:16:04.070 --> 00:16:04.080 align:start position:0% <00:16:04.070>uh <00:16:04.071>the <00:16:04.073>sub-agent <00:16:04.075>rejected <00:16:04.077>that <00:16:04.079>problem 00:16:04.080 --> 00:16:05.510 align:start position:0% <00:16:04.080>uh <00:16:04.187>the <00:16:04.294>sub-agent <00:16:04.401>rejected <00:16:04.509>that <00:16:04.616>problem <00:16:04.723>description. <00:16:04.830>So, <00:16:04.938>we <00:16:05.045>have <00:16:05.152>a <00:16:05.259>sub-agent <00:16:05.367>for 00:16:05.510 --> 00:16:05.520 align:start position:0% <00:16:05.510>description. <00:16:05.511>So, <00:16:05.513>we <00:16:05.514>have <00:16:05.516>a <00:16:05.517>sub-agent <00:16:05.519>for 00:16:05.520 --> 00:16:07.230 align:start position:0% <00:16:05.520>description. <00:16:05.636>So, <00:16:05.753>we <00:16:05.870>have <00:16:05.986>a <00:16:06.103>sub-agent <00:16:06.220>for <00:16:06.336>every <00:16:06.453>little <00:16:06.569>sub-job <00:16:06.686>that <00:16:06.803>goes <00:16:06.920>into 00:16:07.230 --> 00:16:07.240 align:start position:0% <00:16:07.230>every <00:16:07.231>little <00:16:07.233>sub-job <00:16:07.235>that <00:16:07.237>goes <00:16:07.239>into 00:16:07.240 --> 00:16:08.230 align:start position:0% <00:16:07.240>every <00:16:07.308>little <00:16:07.377>sub-job <00:16:07.445>that <00:16:07.514>goes <00:16:07.582>into <00:16:07.651>review <00:16:07.719>in <00:16:07.788>a <00:16:07.856>pull <00:16:07.925>request. <00:16:07.993>And <00:16:08.062>by <00:16:08.131>the 00:16:08.230 --> 00:16:08.240 align:start position:0% <00:16:08.230>review <00:16:08.231>in <00:16:08.232>a <00:16:08.233>pull <00:16:08.235>request. <00:16:08.236>And <00:16:08.237>by <00:16:08.239>the 00:16:08.240 --> 00:16:10.110 align:start position:0% <00:16:08.240>review <00:16:08.347>in <00:16:08.455>a <00:16:08.563>pull <00:16:08.670>request. <00:16:08.778>And <00:16:08.886>by <00:16:08.993>the <00:16:09.101>way, <00:16:09.209>sometimes <00:16:09.316>you <00:16:09.424>need <00:16:09.532>different <00:16:09.640>humans 00:16:10.110 --> 00:16:10.120 align:start position:0% <00:16:10.110>way, <00:16:10.111>sometimes <00:16:10.113>you <00:16:10.115>need <00:16:10.117>different <00:16:10.119>humans 00:16:10.120 --> 00:16:11.950 align:start position:0% <00:16:10.120>way, <00:16:10.227>sometimes <00:16:10.335>you <00:16:10.443>need <00:16:10.550>different <00:16:10.658>humans <00:16:10.766>to <00:16:10.873>assess <00:16:10.981>a <00:16:11.089>PR <00:16:11.196>from <00:16:11.304>a <00:16:11.412>different <00:16:11.520>angle. 00:16:11.950 --> 00:16:11.960 align:start position:0% <00:16:11.950>to <00:16:11.951>assess <00:16:11.952>a <00:16:11.953>PR <00:16:11.955>from <00:16:11.956>a <00:16:11.957>different <00:16:11.959>angle. 00:16:11.960 --> 00:16:13.230 align:start position:0% <00:16:11.960>to <00:16:12.047>assess <00:16:12.135>a <00:16:12.223>PR <00:16:12.311>from <00:16:12.399>a <00:16:12.487>different <00:16:12.575>angle. <00:16:12.663>That's <00:16:12.751>why <00:16:12.839>we <00:16:12.927>have <00:16:13.015>different <00:16:13.103>sub-agents 00:16:13.230 --> 00:16:13.240 align:start position:0% <00:16:13.230>That's <00:16:13.231>why <00:16:13.233>we <00:16:13.235>have <00:16:13.237>different <00:16:13.239>sub-agents 00:16:13.240 --> 00:16:15.110 align:start position:0% <00:16:13.240>That's <00:16:13.367>why <00:16:13.494>we <00:16:13.621>have <00:16:13.749>different <00:16:13.876>sub-agents <00:16:14.003>with <00:16:14.130>different <00:16:14.258>context <00:16:14.385>to <00:16:14.512>do <00:16:14.640>that. 00:16:15.110 --> 00:16:15.120 align:start position:0% <00:16:15.110>with <00:16:15.111>different <00:16:15.113>context <00:16:15.115>to <00:16:15.117>do <00:16:15.119>that. 00:16:15.120 --> 00:16:16.590 align:start position:0% <00:16:15.120>with <00:16:15.230>different <00:16:15.340>context <00:16:15.450>to <00:16:15.561>do <00:16:15.671>that. <00:16:15.781>Alignment <00:16:15.891>was <00:16:16.002>bad <00:16:16.112>because <00:16:16.222>we <00:16:16.332>said, <00:16:16.443>"Oh, 00:16:16.590 --> 00:16:16.600 align:start position:0% <00:16:16.590>Alignment <00:16:16.591>was <00:16:16.593>bad <00:16:16.594>because <00:16:16.596>we <00:16:16.597>said, <00:16:16.599>"Oh, 00:16:16.600 --> 00:16:17.750 align:start position:0% <00:16:16.600>Alignment <00:16:16.673>was <00:16:16.747>bad <00:16:16.821>because <00:16:16.895>we <00:16:16.969>said, <00:16:17.043>"Oh, <00:16:17.117>we're <00:16:17.191>doing <00:16:17.265>a <00:16:17.339>few <00:16:17.413>fixes <00:16:17.487>here <00:16:17.561>and <00:16:17.635>there." 00:16:17.750 --> 00:16:17.760 align:start position:0% <00:16:17.750>we're <00:16:17.751>doing <00:16:17.752>a <00:16:17.753>few <00:16:17.755>fixes <00:16:17.756>here <00:16:17.757>and <00:16:17.759>there." 00:16:17.760 --> 00:16:19.230 align:start position:0% <00:16:17.760>we're <00:16:17.848>doing <00:16:17.936>a <00:16:18.024>few <00:16:18.112>fixes <00:16:18.201>here <00:16:18.289>and <00:16:18.377>there." <00:16:18.465>But <00:16:18.553>we <00:16:18.642>forgot <00:16:18.730>to <00:16:18.818>mention <00:16:18.906>one <00:16:18.994>thing <00:16:19.083>that 00:16:19.230 --> 00:16:19.240 align:start position:0% <00:16:19.230>But <00:16:19.231>we <00:16:19.232>forgot <00:16:19.233>to <00:16:19.235>mention <00:16:19.236>one <00:16:19.237>thing <00:16:19.239>that 00:16:19.240 --> 00:16:21.550 align:start position:0% <00:16:19.240>But <00:16:19.340>we <00:16:19.440>forgot <00:16:19.540>to <00:16:19.640>mention <00:16:19.740>one <00:16:19.840>thing <00:16:19.940>that <00:16:20.040>we <00:16:20.140>did <00:16:20.240>as <00:16:20.340>well. <00:16:20.440>So, <00:16:20.540>another <00:16:20.640>sub-agent 00:16:21.550 --> 00:16:21.560 align:start position:0% <00:16:21.550>we <00:16:21.551>did <00:16:21.553>as <00:16:21.554>well. <00:16:21.555>So, <00:16:21.557>another <00:16:21.559>sub-agent 00:16:21.560 --> 00:16:23.470 align:start position:0% <00:16:21.560>we <00:16:21.660>did <00:16:21.760>as <00:16:21.859>well. <00:16:21.959>So, <00:16:22.060>another <00:16:22.160>sub-agent <00:16:22.260>flagged <00:16:22.359>that <00:16:22.459>problem <00:16:22.560>and <00:16:22.660>it <00:16:22.760>put <00:16:22.859>a <00:16:22.959>thumbs 00:16:23.470 --> 00:16:23.480 align:start position:0% <00:16:23.470>flagged <00:16:23.471>that <00:16:23.472>problem <00:16:23.473>and <00:16:23.475>it <00:16:23.476>put <00:16:23.477>a <00:16:23.479>thumbs 00:16:23.480 --> 00:16:24.910 align:start position:0% <00:16:23.480>flagged <00:16:23.560>that <00:16:23.640>problem <00:16:23.721>and <00:16:23.801>it <00:16:23.882>put <00:16:23.962>a <00:16:24.043>thumbs <00:16:24.123>down. <00:16:24.203>Like, <00:16:24.284>this <00:16:24.364>PR <00:16:24.445>is <00:16:24.525>not <00:16:24.606>going <00:16:24.686>to <00:16:24.766>get 00:16:24.910 --> 00:16:24.920 align:start position:0% <00:16:24.910>down. <00:16:24.911>Like, <00:16:24.912>this <00:16:24.913>PR <00:16:24.914>is <00:16:24.915>not <00:16:24.916>going <00:16:24.917>to <00:16:24.919>get 00:16:24.920 --> 00:16:26.750 align:start position:0% <00:16:24.920>down. <00:16:25.036>Like, <00:16:25.153>this <00:16:25.270>PR <00:16:25.386>is <00:16:25.503>not <00:16:25.620>going <00:16:25.736>to <00:16:25.853>get <00:16:25.969>approved. <00:16:26.086>Correctness <00:16:26.203>issues. <00:16:26.319>We 00:16:26.750 --> 00:16:26.760 align:start position:0% <00:16:26.750>approved. <00:16:26.753>Correctness <00:16:26.756>issues. <00:16:26.759>We 00:16:26.760 --> 00:16:28.510 align:start position:0% <00:16:26.760>approved. <00:16:26.900>Correctness <00:16:27.040>issues. <00:16:27.180>We <00:16:27.319>surfaced <00:16:27.460>some <00:16:27.600>bugs <00:16:27.740>in <00:16:27.880>there, <00:16:28.020>some <00:16:28.160>SQL 00:16:28.510 --> 00:16:28.520 align:start position:0% <00:16:28.510>surfaced <00:16:28.511>some <00:16:28.513>bugs <00:16:28.514>in <00:16:28.516>there, <00:16:28.517>some <00:16:28.519>SQL 00:16:28.520 --> 00:16:29.990 align:start position:0% <00:16:28.520>surfaced <00:16:28.630>some <00:16:28.740>bugs <00:16:28.850>in <00:16:28.961>there, <00:16:29.071>some <00:16:29.181>SQL <00:16:29.291>injection <00:16:29.402>and <00:16:29.512>what <00:16:29.622>not, <00:16:29.732>some <00:16:29.843>wrong 00:16:29.990 --> 00:16:30.000 align:start position:0% <00:16:29.990>injection <00:16:29.991>and <00:16:29.993>what <00:16:29.995>not, <00:16:29.997>some <00:16:29.999>wrong 00:16:30.000 --> 00:16:32.230 align:start position:0% <00:16:30.000>injection <00:16:30.140>and <00:16:30.280>what <00:16:30.420>not, <00:16:30.560>some <00:16:30.700>wrong <00:16:30.840>denominator. <00:16:30.980>Like, <00:16:31.120>it's <00:16:31.260>horrible. <00:16:31.400>We 00:16:32.230 --> 00:16:32.240 align:start position:0% <00:16:32.230>denominator. <00:16:32.232>Like, <00:16:32.234>it's <00:16:32.236>horrible. <00:16:32.239>We 00:16:32.240 --> 00:16:33.870 align:start position:0% <00:16:32.240>denominator. <00:16:32.395>Like, <00:16:32.551>it's <00:16:32.706>horrible. <00:16:32.862>We <00:16:33.017>violated <00:16:33.173>some <00:16:33.328>code <00:16:33.484>reuse <00:16:33.640>standards 00:16:33.870 --> 00:16:33.880 align:start position:0% <00:16:33.870>violated <00:16:33.872>some <00:16:33.874>code <00:16:33.876>reuse <00:16:33.879>standards 00:16:33.880 --> 00:16:35.990 align:start position:0% <00:16:33.880>violated <00:16:33.987>some <00:16:34.095>code <00:16:34.203>reuse <00:16:34.310>standards <00:16:34.418>because <00:16:34.526>we <00:16:34.633>we <00:16:34.741>put <00:16:34.849>some <00:16:34.956>logic <00:16:35.064>in <00:16:35.172>in <00:16:35.280>in 00:16:35.990 --> 00:16:36.000 align:start position:0% <00:16:35.990>because <00:16:35.991>we <00:16:35.992>we <00:16:35.993>put <00:16:35.994>some <00:16:35.995>logic <00:16:35.996>in <00:16:35.997>in <00:16:35.999>in 00:16:36.000 --> 00:16:37.270 align:start position:0% <00:16:36.000>because <00:16:36.087>we <00:16:36.175>we <00:16:36.263>put <00:16:36.351>some <00:16:36.439>logic <00:16:36.527>in <00:16:36.615>in <00:16:36.703>in <00:16:36.791>the <00:16:36.879>presentation <00:16:36.967>layer, <00:16:37.055>which <00:16:37.143>we 00:16:37.270 --> 00:16:37.280 align:start position:0% <00:16:37.270>the <00:16:37.272>presentation <00:16:37.274>layer, <00:16:37.276>which <00:16:37.279>we 00:16:37.280 --> 00:16:39.030 align:start position:0% <00:16:37.280>the <00:16:37.407>presentation <00:16:37.534>layer, <00:16:37.661>which <00:16:37.789>we <00:16:37.916>shouldn't <00:16:38.043>be <00:16:38.170>doing. <00:16:38.298>That <00:16:38.425>was <00:16:38.552>a <00:16:38.680>problem. 00:16:39.030 --> 00:16:39.040 align:start position:0% <00:16:39.030>shouldn't <00:16:39.031>be <00:16:39.033>doing. <00:16:39.034>That <00:16:39.036>was <00:16:39.037>a <00:16:39.039>problem. 00:16:39.040 --> 00:16:41.350 align:start position:0% <00:16:39.040>shouldn't <00:16:39.167>be <00:16:39.294>doing. <00:16:39.421>That <00:16:39.549>was <00:16:39.676>a <00:16:39.803>problem. <00:16:39.930>It <00:16:40.058>wasn't <00:16:40.185>safe <00:16:40.312>to <00:16:40.439>ship. 00:16:41.350 --> 00:16:41.360 align:start position:0% <00:16:41.350>It <00:16:41.352>wasn't <00:16:41.354>safe <00:16:41.356>to <00:16:41.359>ship. 00:16:41.360 --> 00:16:43.350 align:start position:0% <00:16:41.360>It <00:16:41.487>wasn't <00:16:41.614>safe <00:16:41.741>to <00:16:41.869>ship. <00:16:41.996>This <00:16:42.123>is <00:16:42.250>such <00:16:42.378>like <00:16:42.505>a <00:16:42.632>horrible <00:16:42.760>disaster, 00:16:43.350 --> 00:16:43.360 align:start position:0% <00:16:43.350>This <00:16:43.351>is <00:16:43.353>such <00:16:43.354>like <00:16:43.356>a <00:16:43.357>horrible <00:16:43.359>disaster, 00:16:43.360 --> 00:16:44.790 align:start position:0% <00:16:43.360>This <00:16:43.543>is <00:16:43.727>such <00:16:43.911>like <00:16:44.095>a <00:16:44.279>horrible <00:16:44.463>disaster, <00:16:44.646>right? 00:16:44.790 --> 00:16:44.800 align:start position:0% right? 00:16:44.800 --> 00:16:48.150 align:start position:0% <00:16:44.800>right? <00:16:45.000>Okay, <00:16:45.199>let's <00:16:45.400>get <00:16:45.599>back <00:16:45.800>to <00:16:46.000>the <00:16:46.199>slides. 00:16:48.150 --> 00:16:48.160 align:start position:0% <00:16:48.150>Okay, <00:16:48.151>let's <00:16:48.153>get <00:16:48.154>back <00:16:48.156>to <00:16:48.157>the <00:16:48.159>slides. 00:16:48.160 --> 00:16:50.510 align:start position:0% <00:16:48.160>Okay, <00:16:48.260>let's <00:16:48.360>get <00:16:48.459>back <00:16:48.560>to <00:16:48.660>the <00:16:48.760>slides. <00:16:48.860>Now <00:16:48.959>that <00:16:49.060>we <00:16:49.160>have <00:16:49.260>a <00:16:49.360>much <00:16:49.459>more <00:16:49.560>complicated 00:16:50.510 --> 00:16:50.520 align:start position:0% <00:16:50.510>Now <00:16:50.511>that <00:16:50.512>we <00:16:50.513>have <00:16:50.515>a <00:16:50.516>much <00:16:50.517>more <00:16:50.519>complicated 00:16:50.520 --> 00:16:52.270 align:start position:0% <00:16:50.520>Now <00:16:50.636>that <00:16:50.753>we <00:16:50.870>have <00:16:50.986>a <00:16:51.103>much <00:16:51.220>more <00:16:51.336>complicated <00:16:51.453>agent, <00:16:51.569>what <00:16:51.686>about <00:16:51.803>evaluations, <00:16:51.920>right? 00:16:52.270 --> 00:16:52.280 align:start position:0% <00:16:52.270>agent, <00:16:52.272>what <00:16:52.274>about <00:16:52.276>evaluations, <00:16:52.279>right? 00:16:52.280 --> 00:16:53.110 align:start position:0% <00:16:52.280>agent, <00:16:52.354>what <00:16:52.429>about <00:16:52.504>evaluations, <00:16:52.578>right? <00:16:52.653>I've <00:16:52.728>been <00:16:52.802>preaching <00:16:52.877>that <00:16:52.952>it's <00:16:53.027>so 00:16:53.110 --> 00:16:53.120 align:start position:0% <00:16:53.110>I've <00:16:53.111>been <00:16:53.113>preaching <00:16:53.115>that <00:16:53.117>it's <00:16:53.119>so 00:16:53.120 --> 00:16:54.990 align:start position:0% <00:16:53.120>I've <00:16:53.247>been <00:16:53.374>preaching <00:16:53.501>that <00:16:53.629>it's <00:16:53.756>so <00:16:53.883>important. <00:16:54.010>So, <00:16:54.138>what <00:16:54.265>about <00:16:54.392>those <00:16:54.520>evals? 00:16:54.990 --> 00:16:55.000 align:start position:0% <00:16:54.990>important. <00:16:54.991>So, <00:16:54.993>what <00:16:54.995>about <00:16:54.997>those <00:16:54.999>evals? 00:16:55.000 --> 00:16:57.110 align:start position:0% <00:16:55.000>important. <00:16:55.107>So, <00:16:55.215>what <00:16:55.323>about <00:16:55.430>those <00:16:55.538>evals? <00:16:55.646>Well, <00:16:55.753>we <00:16:55.861>had <00:16:55.969>to <00:16:56.076>build <00:16:56.184>a <00:16:56.292>curation <00:16:56.400>app, 00:16:57.110 --> 00:16:57.120 align:start position:0% <00:16:57.110>Well, <00:16:57.111>we <00:16:57.112>had <00:16:57.113>to <00:16:57.115>build <00:16:57.116>a <00:16:57.117>curation <00:16:57.119>app, 00:16:57.120 --> 00:16:59.430 align:start position:0% <00:16:57.120>Well, <00:16:57.213>we <00:16:57.306>had <00:16:57.400>to <00:16:57.493>build <00:16:57.586>a <00:16:57.680>curation <00:16:57.773>app, <00:16:57.866>right? <00:16:57.960>So, <00:16:58.053>what <00:16:58.146>is <00:16:58.240>curation <00:16:58.333>app? <00:16:58.426>You <00:16:58.520>can 00:16:59.430 --> 00:16:59.440 align:start position:0% <00:16:59.430>right? <00:16:59.431>So, <00:16:59.432>what <00:16:59.433>is <00:16:59.435>curation <00:16:59.436>app? <00:16:59.437>You <00:16:59.439>can 00:16:59.440 --> 00:17:00.550 align:start position:0% <00:16:59.440>right? <00:16:59.511>So, <00:16:59.582>what <00:16:59.654>is <00:16:59.725>curation <00:16:59.796>app? <00:16:59.868>You <00:16:59.939>can <00:17:00.010>look <00:17:00.082>at <00:17:00.153>the <00:17:00.224>pull <00:17:00.296>request <00:17:00.367>at <00:17:00.439>its 00:17:00.550 --> 00:17:00.560 align:start position:0% <00:17:00.550>look <00:17:00.551>at <00:17:00.553>the <00:17:00.554>pull <00:17:00.555>request <00:17:00.557>at <00:17:00.559>its 00:17:00.560 --> 00:17:02.230 align:start position:0% <00:17:00.560>look <00:17:00.676>at <00:17:00.793>the <00:17:00.910>pull <00:17:01.026>request <00:17:01.143>at <00:17:01.260>its <00:17:01.376>historical <00:17:01.493>state, <00:17:01.609>like <00:17:01.726>what <00:17:01.843>was <00:17:01.959>the 00:17:02.230 --> 00:17:02.240 align:start position:0% <00:17:02.230>historical <00:17:02.231>state, <00:17:02.233>like <00:17:02.235>what <00:17:02.237>was <00:17:02.239>the 00:17:02.240 --> 00:17:03.230 align:start position:0% <00:17:02.240>historical <00:17:02.388>state, <00:17:02.537>like <00:17:02.685>what <00:17:02.834>was <00:17:02.982>the <00:17:03.131>diff. 00:17:03.230 --> 00:17:03.240 align:start position:0% diff. 00:17:03.240 --> 00:17:04.750 align:start position:0% <00:17:03.240>diff. <00:17:03.409>And <00:17:03.579>then <00:17:03.749>you <00:17:03.919>go <00:17:04.089>and <00:17:04.259>establish <00:17:04.429>the <00:17:04.598>ground 00:17:04.750 --> 00:17:04.760 align:start position:0% <00:17:04.750>And <00:17:04.751>then <00:17:04.752>you <00:17:04.753>go <00:17:04.755>and <00:17:04.756>establish <00:17:04.757>the <00:17:04.759>ground 00:17:04.760 --> 00:17:06.829 align:start position:0% <00:17:04.760>And <00:17:04.859>then <00:17:04.960>you <00:17:05.060>go <00:17:05.160>and <00:17:05.260>establish <00:17:05.359>the <00:17:05.460>ground <00:17:05.560>truth, <00:17:05.660>which <00:17:05.760>is <00:17:05.859>what <00:17:05.960>is <00:17:06.060>that <00:17:06.160>expected 00:17:06.829 --> 00:17:06.839 align:start position:0% <00:17:06.829>truth, <00:17:06.830>which <00:17:06.831>is <00:17:06.833>what <00:17:06.835>is <00:17:06.836>that <00:17:06.838>expected 00:17:06.839 --> 00:17:08.590 align:start position:0% <00:17:06.839>truth, <00:17:06.946>which <00:17:07.054>is <00:17:07.162>what <00:17:07.269>is <00:17:07.377>that <00:17:07.485>expected <00:17:07.592>outcome <00:17:07.700>that <00:17:07.808>you <00:17:07.915>expect <00:17:08.023>from <00:17:08.131>the <00:17:08.239>agent? 00:17:08.590 --> 00:17:08.600 align:start position:0% <00:17:08.589>outcome <00:17:08.591>that <00:17:08.592>you <00:17:08.594>expect <00:17:08.596>from <00:17:08.597>the <00:17:08.598>agent? 00:17:08.600 --> 00:17:09.910 align:start position:0% <00:17:08.599>outcome <00:17:08.684>that <00:17:08.768>you <00:17:08.852>expect <00:17:08.936>from <00:17:09.021>the <00:17:09.105>agent? <00:17:09.189>What <00:17:09.273>is <00:17:09.357>the <00:17:09.442>assessment <00:17:09.526>that <00:17:09.610>you <00:17:09.694>want <00:17:09.779>to 00:17:09.910 --> 00:17:09.920 align:start position:0% <00:17:09.910>What <00:17:09.911>is <00:17:09.912>the <00:17:09.913>assessment <00:17:09.915>that <00:17:09.916>you <00:17:09.917>want <00:17:09.919>to 00:17:09.920 --> 00:17:11.590 align:start position:0% <00:17:09.920>What <00:17:10.013>is <00:17:10.106>the <00:17:10.200>assessment <00:17:10.293>that <00:17:10.386>you <00:17:10.480>want <00:17:10.573>to <00:17:10.666>get? <00:17:10.760>What <00:17:10.853>are <00:17:10.946>those <00:17:11.040>issues <00:17:11.133>that <00:17:11.226>are <00:17:11.320>in 00:17:11.590 --> 00:17:11.600 align:start position:0% <00:17:11.589>get? <00:17:11.591>What <00:17:11.592>are <00:17:11.593>those <00:17:11.595>issues <00:17:11.596>that <00:17:11.597>are <00:17:11.598>in 00:17:11.600 --> 00:17:12.790 align:start position:0% <00:17:11.599>get? <00:17:11.676>What <00:17:11.752>are <00:17:11.829>those <00:17:11.906>issues <00:17:11.982>that <00:17:12.059>are <00:17:12.135>in <00:17:12.212>this <00:17:12.288>pull <00:17:12.365>request <00:17:12.441>that <00:17:12.518>you <00:17:12.594>want <00:17:12.671>your 00:17:12.790 --> 00:17:12.800 align:start position:0% <00:17:12.790>this <00:17:12.791>pull <00:17:12.792>request <00:17:12.794>that <00:17:12.796>you <00:17:12.797>want <00:17:12.799>your 00:17:12.800 --> 00:17:14.710 align:start position:0% <00:17:12.800>this <00:17:12.899>pull <00:17:13.000>request <00:17:13.099>that <00:17:13.200>you <00:17:13.300>want <00:17:13.399>your <00:17:13.500>agent <00:17:13.599>to <00:17:13.700>surface? <00:17:13.800>So, <00:17:13.899>you <00:17:14.000>have <00:17:14.099>to <00:17:14.200>curate 00:17:14.710 --> 00:17:14.720 align:start position:0% <00:17:14.710>agent <00:17:14.711>to <00:17:14.712>surface? <00:17:14.713>So, <00:17:14.715>you <00:17:14.716>have <00:17:14.717>to <00:17:14.719>curate 00:17:14.720 --> 00:17:16.470 align:start position:0% <00:17:14.720>agent <00:17:14.836>to <00:17:14.953>surface? <00:17:15.069>So, <00:17:15.186>you <00:17:15.303>have <00:17:15.420>to <00:17:15.536>curate <00:17:15.653>all <00:17:15.770>of <00:17:15.886>that <00:17:16.003>ground <00:17:16.120>truth. 00:17:16.470 --> 00:17:16.480 align:start position:0% <00:17:16.470>all <00:17:16.472>of <00:17:16.474>that <00:17:16.476>ground <00:17:16.479>truth. 00:17:16.480 --> 00:17:17.829 align:start position:0% <00:17:16.480>all <00:17:16.581>of <00:17:16.682>that <00:17:16.783>ground <00:17:16.884>truth. <00:17:16.985>And <00:17:17.087>then <00:17:17.188>you <00:17:17.289>can <00:17:17.390>see <00:17:17.491>the <00:17:17.592>ground <00:17:17.694>truth 00:17:17.829 --> 00:17:17.839 align:start position:0% <00:17:17.829>And <00:17:17.830>then <00:17:17.831>you <00:17:17.832>can <00:17:17.834>see <00:17:17.835>the <00:17:17.836>ground <00:17:17.838>truth 00:17:17.839 --> 00:17:20.230 align:start position:0% <00:17:17.839>And <00:17:17.938>then <00:17:18.039>you <00:17:18.138>can <00:17:18.239>see <00:17:18.339>the <00:17:18.438>ground <00:17:18.539>truth <00:17:18.638>side <00:17:18.739>by <00:17:18.839>side <00:17:18.938>with <00:17:19.039>your <00:17:19.138>assessment, <00:17:19.239>and 00:17:20.230 --> 00:17:20.240 align:start position:0% <00:17:20.230>side <00:17:20.231>by <00:17:20.233>side <00:17:20.234>with <00:17:20.236>your <00:17:20.237>assessment, <00:17:20.239>and 00:17:20.240 --> 00:17:21.949 align:start position:0% <00:17:20.240>side <00:17:20.347>by <00:17:20.455>side <00:17:20.563>with <00:17:20.670>your <00:17:20.778>assessment, <00:17:20.886>and <00:17:20.993>you <00:17:21.101>can <00:17:21.209>see <00:17:21.316>where <00:17:21.424>the <00:17:21.532>agent <00:17:21.640>crosses 00:17:21.949 --> 00:17:21.959 align:start position:0% <00:17:21.949>you <00:17:21.950>can <00:17:21.952>see <00:17:21.953>where <00:17:21.955>the <00:17:21.956>agent <00:17:21.958>crosses 00:17:21.959 --> 00:17:23.429 align:start position:0% <00:17:21.959>you <00:17:22.053>can <00:17:22.148>see <00:17:22.242>where <00:17:22.337>the <00:17:22.431>agent <00:17:22.526>crosses <00:17:22.620>wires <00:17:22.715>and <00:17:22.809>where <00:17:22.904>it <00:17:22.998>got <00:17:23.093>things <00:17:23.187>wrong. <00:17:23.282>And 00:17:23.429 --> 00:17:23.439 align:start position:0% <00:17:23.429>wires <00:17:23.430>and <00:17:23.431>where <00:17:23.432>it <00:17:23.434>got <00:17:23.435>things <00:17:23.436>wrong. <00:17:23.438>And 00:17:23.439 --> 00:17:26.150 align:start position:0% <00:17:23.439>wires <00:17:23.526>and <00:17:23.614>where <00:17:23.701>it <00:17:23.789>got <00:17:23.876>things <00:17:23.964>wrong. <00:17:24.051>And <00:17:24.139>then <00:17:24.226>you <00:17:24.314>can <00:17:24.401>run <00:17:24.489>AB <00:17:24.576>AB <00:17:24.664>tests, <00:17:24.751>offline <00:17:24.839>AB 00:17:26.150 --> 00:17:26.160 align:start position:0% <00:17:26.150>then <00:17:26.151>you <00:17:26.152>can <00:17:26.153>run <00:17:26.154>AB <00:17:26.155>AB <00:17:26.156>tests, <00:17:26.157>offline <00:17:26.159>AB 00:17:26.160 --> 00:17:28.069 align:start position:0% <00:17:26.160>then <00:17:26.253>you <00:17:26.346>can <00:17:26.440>run <00:17:26.533>AB <00:17:26.626>AB <00:17:26.720>tests, <00:17:26.813>offline <00:17:26.906>AB <00:17:27.000>tests, <00:17:27.093>and <00:17:27.186>validate <00:17:27.280>your <00:17:27.373>changes <00:17:27.466>to <00:17:27.560>the 00:17:28.069 --> 00:17:28.079 align:start position:0% <00:17:28.069>tests, <00:17:28.070>and <00:17:28.071>validate <00:17:28.073>your <00:17:28.075>changes <00:17:28.076>to <00:17:28.078>the 00:17:28.079 --> 00:17:29.710 align:start position:0% <00:17:28.079>tests, <00:17:28.178>and <00:17:28.279>validate <00:17:28.378>your <00:17:28.479>changes <00:17:28.579>to <00:17:28.678>the <00:17:28.779>agent <00:17:28.879>and <00:17:28.979>assess <00:17:29.079>the <00:17:29.178>quality <00:17:29.279>and <00:17:29.379>stay <00:17:29.479>on 00:17:29.710 --> 00:17:29.720 align:start position:0% <00:17:29.710>agent <00:17:29.711>and <00:17:29.712>assess <00:17:29.713>the <00:17:29.715>quality <00:17:29.716>and <00:17:29.717>stay <00:17:29.719>on 00:17:29.720 --> 00:17:31.070 align:start position:0% <00:17:29.720>agent <00:17:29.841>and <00:17:29.963>assess <00:17:30.084>the <00:17:30.206>quality <00:17:30.327>and <00:17:30.449>stay <00:17:30.570>on <00:17:30.692>top <00:17:30.813>of <00:17:30.935>it. 00:17:31.070 --> 00:17:31.080 align:start position:0% <00:17:31.070>top <00:17:31.074>of <00:17:31.079>it. 00:17:31.080 --> 00:17:33.230 align:start position:0% <00:17:31.080>top <00:17:31.235>of <00:17:31.391>it. <00:17:31.546>And <00:17:31.702>this <00:17:31.857>was <00:17:32.013>a <00:17:32.168>massive <00:17:32.324>massive <00:17:32.480>mistake. 00:17:33.230 --> 00:17:33.240 align:start position:0% <00:17:33.230>And <00:17:33.231>this <00:17:33.233>was <00:17:33.234>a <00:17:33.236>massive <00:17:33.237>massive <00:17:33.239>mistake. 00:17:33.240 --> 00:17:35.870 align:start position:0% <00:17:33.240>And <00:17:33.340>this <00:17:33.440>was <00:17:33.540>a <00:17:33.640>massive <00:17:33.740>massive <00:17:33.840>mistake. <00:17:33.940>Like, <00:17:34.040>no <00:17:34.140>one <00:17:34.240>used <00:17:34.340>this. <00:17:34.440>You <00:17:34.540>know <00:17:34.640>why? 00:17:35.870 --> 00:17:35.880 align:start position:0% <00:17:35.870>Like, <00:17:35.871>no <00:17:35.872>one <00:17:35.873>used <00:17:35.875>this. <00:17:35.876>You <00:17:35.877>know <00:17:35.879>why? 00:17:35.880 --> 00:17:37.310 align:start position:0% <00:17:35.880>Like, <00:17:35.987>no <00:17:36.094>one <00:17:36.201>used <00:17:36.309>this. <00:17:36.416>You <00:17:36.523>know <00:17:36.630>why? <00:17:36.738>Well, <00:17:36.845>because <00:17:36.952>it <00:17:37.059>wasn't <00:17:37.167>agentic 00:17:37.310 --> 00:17:37.320 align:start position:0% <00:17:37.310>Well, <00:17:37.312>because <00:17:37.314>it <00:17:37.316>wasn't <00:17:37.319>agentic 00:17:37.320 --> 00:17:39.150 align:start position:0% <00:17:37.320>Well, <00:17:37.427>because <00:17:37.535>it <00:17:37.643>wasn't <00:17:37.750>agentic <00:17:37.858>friendly. <00:17:37.966>No <00:17:38.073>one <00:17:38.181>has <00:17:38.289>time <00:17:38.396>to <00:17:38.504>go <00:17:38.612>to <00:17:38.720>that 00:17:39.150 --> 00:17:39.160 align:start position:0% <00:17:39.150>friendly. <00:17:39.151>No <00:17:39.152>one <00:17:39.153>has <00:17:39.154>time <00:17:39.155>to <00:17:39.156>go <00:17:39.157>to <00:17:39.159>that 00:17:39.160 --> 00:17:40.710 align:start position:0% <00:17:39.160>friendly. <00:17:39.253>No <00:17:39.346>one <00:17:39.439>has <00:17:39.532>time <00:17:39.625>to <00:17:39.718>go <00:17:39.811>to <00:17:39.904>that <00:17:39.997>UI <00:17:40.090>and <00:17:40.183>click <00:17:40.276>those <00:17:40.369>buttons <00:17:40.462>and <00:17:40.555>figure 00:17:40.710 --> 00:17:40.720 align:start position:0% <00:17:40.710>UI <00:17:40.711>and <00:17:40.713>click <00:17:40.714>those <00:17:40.716>buttons <00:17:40.717>and <00:17:40.719>figure 00:17:40.720 --> 00:17:41.910 align:start position:0% <00:17:40.720>UI <00:17:40.802>and <00:17:40.884>click <00:17:40.967>those <00:17:41.049>buttons <00:17:41.131>and <00:17:41.214>figure <00:17:41.296>out, <00:17:41.379>"Oh <00:17:41.461>my <00:17:41.543>god, <00:17:41.626>batch <00:17:41.708>of <00:17:41.791>else 00:17:41.910 --> 00:17:41.920 align:start position:0% <00:17:41.910>out, <00:17:41.911>"Oh <00:17:41.913>my <00:17:41.914>god, <00:17:41.916>batch <00:17:41.917>of <00:17:41.919>else 00:17:41.920 --> 00:17:43.510 align:start position:0% <00:17:41.920>out, <00:17:42.036>"Oh <00:17:42.153>my <00:17:42.270>god, <00:17:42.386>batch <00:17:42.503>of <00:17:42.620>else <00:17:42.736>creation." <00:17:42.853>Like, <00:17:42.970>I'm <00:17:43.086>just <00:17:43.203>building <00:17:43.320>a 00:17:43.510 --> 00:17:43.520 align:start position:0% <00:17:43.510>creation." <00:17:43.511>Like, <00:17:43.513>I'm <00:17:43.515>just <00:17:43.517>building <00:17:43.519>a 00:17:43.520 --> 00:17:46.390 align:start position:0% <00:17:43.520>creation." <00:17:43.695>Like, <00:17:43.870>I'm <00:17:44.045>just <00:17:44.220>building <00:17:44.395>a <00:17:44.570>product <00:17:44.745>here. <00:17:44.920>Like, 00:17:46.390 --> 00:17:46.400 align:start position:0% <00:17:46.390>product <00:17:46.394>here. <00:17:46.399>Like, 00:17:46.400 --> 00:17:47.750 align:start position:0% <00:17:46.400>product <00:17:46.510>here. <00:17:46.620>Like, <00:17:46.731>don't <00:17:46.841>bother <00:17:46.952>me. <00:17:47.062>So, <00:17:47.173>we <00:17:47.283>had <00:17:47.394>to <00:17:47.504>build <00:17:47.615>an 00:17:47.750 --> 00:17:47.760 align:start position:0% <00:17:47.750>don't <00:17:47.751>bother <00:17:47.752>me. <00:17:47.753>So, <00:17:47.754>we <00:17:47.755>had <00:17:47.756>to <00:17:47.757>build <00:17:47.759>an 00:17:47.760 --> 00:17:49.470 align:start position:0% <00:17:47.760>don't <00:17:47.847>bother <00:17:47.935>me. <00:17:48.022>So, <00:17:48.110>we <00:17:48.197>had <00:17:48.285>to <00:17:48.372>build <00:17:48.460>an <00:17:48.547>MCP <00:17:48.635>to <00:17:48.722>make <00:17:48.810>it <00:17:48.897>agentic <00:17:48.985>first <00:17:49.072>so <00:17:49.160>that 00:17:49.470 --> 00:17:49.480 align:start position:0% <00:17:49.470>MCP <00:17:49.471>to <00:17:49.472>make <00:17:49.473>it <00:17:49.475>agentic <00:17:49.476>first <00:17:49.477>so <00:17:49.479>that 00:17:49.480 --> 00:17:50.950 align:start position:0% <00:17:49.480>MCP <00:17:49.574>to <00:17:49.669>make <00:17:49.763>it <00:17:49.858>agentic <00:17:49.952>first <00:17:50.047>so <00:17:50.141>that <00:17:50.236>folks <00:17:50.330>who <00:17:50.425>are <00:17:50.519>live <00:17:50.614>coding <00:17:50.708>their <00:17:50.803>code 00:17:50.950 --> 00:17:50.960 align:start position:0% <00:17:50.950>folks <00:17:50.951>who <00:17:50.953>are <00:17:50.954>live <00:17:50.956>coding <00:17:50.957>their <00:17:50.959>code 00:17:50.960 --> 00:17:53.070 align:start position:0% <00:17:50.960>folks <00:17:51.067>who <00:17:51.175>are <00:17:51.283>live <00:17:51.390>coding <00:17:51.498>their <00:17:51.606>code <00:17:51.713>session <00:17:51.821>are <00:17:51.929>still <00:17:52.036>able <00:17:52.144>to <00:17:52.252>interact <00:17:52.360>with 00:17:53.070 --> 00:17:53.080 align:start position:0% <00:17:53.070>session <00:17:53.071>are <00:17:53.072>still <00:17:53.074>able <00:17:53.076>to <00:17:53.077>interact <00:17:53.079>with 00:17:53.080 --> 00:17:54.990 align:start position:0% <00:17:53.080>session <00:17:53.187>are <00:17:53.295>still <00:17:53.403>able <00:17:53.510>to <00:17:53.618>interact <00:17:53.726>with <00:17:53.833>that <00:17:53.941>system. <00:17:54.049>Or <00:17:54.156>even <00:17:54.264>the <00:17:54.372>agent <00:17:54.480>interacts 00:17:54.990 --> 00:17:55.000 align:start position:0% <00:17:54.990>that <00:17:54.991>system. <00:17:54.993>Or <00:17:54.994>even <00:17:54.996>the <00:17:54.997>agent <00:17:54.999>interacts 00:17:55.000 --> 00:17:56.630 align:start position:0% <00:17:55.000>that <00:17:55.107>system. <00:17:55.215>Or <00:17:55.323>even <00:17:55.430>the <00:17:55.538>agent <00:17:55.646>interacts <00:17:55.753>with <00:17:55.861>that <00:17:55.969>system <00:17:56.076>on <00:17:56.184>their <00:17:56.292>behalf <00:17:56.400>and 00:17:56.630 --> 00:17:56.640 align:start position:0% <00:17:56.630>with <00:17:56.631>that <00:17:56.633>system <00:17:56.634>on <00:17:56.636>their <00:17:56.637>behalf <00:17:56.639>and 00:17:56.640 --> 00:17:57.790 align:start position:0% <00:17:56.640>with <00:17:56.719>that <00:17:56.799>system <00:17:56.878>on <00:17:56.958>their <00:17:57.038>behalf <00:17:57.117>and <00:17:57.197>doing <00:17:57.276>all <00:17:57.356>the <00:17:57.436>work. <00:17:57.515>This <00:17:57.595>is <00:17:57.675>really 00:17:57.790 --> 00:17:57.800 align:start position:0% <00:17:57.790>doing <00:17:57.791>all <00:17:57.793>the <00:17:57.794>work. <00:17:57.796>This <00:17:57.797>is <00:17:57.799>really 00:17:57.800 --> 00:17:59.670 align:start position:0% <00:17:57.800>doing <00:17:58.000>all <00:17:58.200>the <00:17:58.399>work. <00:17:58.600>This <00:17:58.800>is <00:17:59.000>really <00:17:59.200>important. 00:17:59.670 --> 00:17:59.680 align:start position:0% important. 00:17:59.680 --> 00:18:01.030 align:start position:0% <00:17:59.680>important. <00:17:59.815>Great. <00:17:59.950>So, <00:18:00.085>now <00:18:00.220>we <00:18:00.355>have <00:18:00.490>the <00:18:00.625>agent. <00:18:00.760>It <00:18:00.895>was 00:18:01.030 --> 00:18:01.040 align:start position:0% <00:18:01.030>Great. <00:18:01.031>So, <00:18:01.032>now <00:18:01.033>we <00:18:01.034>have <00:18:01.035>the <00:18:01.036>agent. <00:18:01.037>It <00:18:01.039>was 00:18:01.040 --> 00:18:02.350 align:start position:0% <00:18:01.040>Great. <00:18:01.171>So, <00:18:01.302>now <00:18:01.433>we <00:18:01.563>have <00:18:01.695>the <00:18:01.826>agent. <00:18:01.956>It <00:18:02.088>was <00:18:02.218>evaluating 00:18:02.350 --> 00:18:02.360 align:start position:0% evaluating 00:18:02.360 --> 00:18:03.310 align:start position:0% <00:18:02.360>evaluating <00:18:03.215>uh 00:18:03.310 --> 00:18:03.320 align:start position:0% uh 00:18:03.320 --> 00:18:04.630 align:start position:0% <00:18:03.320>uh <00:18:03.516>pull <00:18:03.713>requests, <00:18:03.909>using <00:18:04.106>all <00:18:04.302>of <00:18:04.499>those 00:18:04.630 --> 00:18:04.640 align:start position:0% <00:18:04.630>pull <00:18:04.631>requests, <00:18:04.633>using <00:18:04.635>all <00:18:04.637>of <00:18:04.639>those 00:18:04.640 --> 00:18:06.470 align:start position:0% <00:18:04.640>pull <00:18:04.780>requests, <00:18:04.920>using <00:18:05.060>all <00:18:05.200>of <00:18:05.340>those <00:18:05.480>different <00:18:05.620>subagents. <00:18:05.760>But, <00:18:05.900>my <00:18:06.040>favorite 00:18:06.470 --> 00:18:06.480 align:start position:0% <00:18:06.470>different <00:18:06.472>subagents. <00:18:06.474>But, <00:18:06.476>my <00:18:06.479>favorite 00:18:06.480 --> 00:18:08.110 align:start position:0% <00:18:06.480>different <00:18:06.596>subagents. <00:18:06.713>But, <00:18:06.830>my <00:18:06.946>favorite <00:18:07.063>part <00:18:07.180>has <00:18:07.296>nothing <00:18:07.413>to <00:18:07.530>do <00:18:07.646>with <00:18:07.763>AI. <00:18:07.880>This 00:18:08.110 --> 00:18:08.120 align:start position:0% <00:18:08.110>part <00:18:08.111>has <00:18:08.112>nothing <00:18:08.113>to <00:18:08.115>do <00:18:08.116>with <00:18:08.117>AI. <00:18:08.119>This 00:18:08.120 --> 00:18:09.710 align:start position:0% <00:18:08.120>part <00:18:08.236>has <00:18:08.353>nothing <00:18:08.469>to <00:18:08.586>do <00:18:08.703>with <00:18:08.820>AI. <00:18:08.936>This <00:18:09.053>little <00:18:09.169>thing <00:18:09.286>at <00:18:09.403>the <00:18:09.520>bottom, 00:18:09.710 --> 00:18:09.720 align:start position:0% <00:18:09.710>little <00:18:09.712>thing <00:18:09.714>at <00:18:09.716>the <00:18:09.719>bottom, 00:18:09.720 --> 00:18:11.990 align:start position:0% <00:18:09.720>little <00:18:09.847>thing <00:18:09.974>at <00:18:10.101>the <00:18:10.229>bottom, <00:18:10.356>which <00:18:10.483>is <00:18:10.610>the <00:18:10.738>deterministic <00:18:10.865>gate. <00:18:10.992>If <00:18:11.120>your 00:18:11.990 --> 00:18:12.000 align:start position:0% <00:18:11.990>which <00:18:11.991>is <00:18:11.993>the <00:18:11.994>deterministic <00:18:11.996>gate. <00:18:11.997>If <00:18:11.999>your 00:18:12.000 --> 00:18:13.830 align:start position:0% <00:18:12.000>which <00:18:12.100>is <00:18:12.200>the <00:18:12.300>deterministic <00:18:12.400>gate. <00:18:12.500>If <00:18:12.600>your <00:18:12.700>PR <00:18:12.800>is <00:18:12.900>too <00:18:13.000>big, <00:18:13.100>you're <00:18:13.200>not <00:18:13.300>you're <00:18:13.400>never 00:18:13.830 --> 00:18:13.840 align:start position:0% <00:18:13.830>PR <00:18:13.831>is <00:18:13.832>too <00:18:13.833>big, <00:18:13.835>you're <00:18:13.836>not <00:18:13.837>you're <00:18:13.839>never 00:18:13.840 --> 00:18:15.710 align:start position:0% <00:18:13.840>PR <00:18:13.927>is <00:18:14.014>too <00:18:14.102>big, <00:18:14.189>you're <00:18:14.277>not <00:18:14.365>you're <00:18:14.452>never <00:18:14.540>going <00:18:14.627>to <00:18:14.715>get <00:18:14.802>an <00:18:14.889>auto <00:18:14.977>approval. <00:18:15.064>So, <00:18:15.152>if <00:18:15.240>it 00:18:15.710 --> 00:18:15.720 align:start position:0% <00:18:15.710>going <00:18:15.711>to <00:18:15.712>get <00:18:15.713>an <00:18:15.714>auto <00:18:15.715>approval. <00:18:15.716>So, <00:18:15.717>if <00:18:15.719>it 00:18:15.720 --> 00:18:18.030 align:start position:0% <00:18:15.720>going <00:18:15.813>to <00:18:15.906>get <00:18:16.000>an <00:18:16.093>auto <00:18:16.186>approval. <00:18:16.280>So, <00:18:16.373>if <00:18:16.466>it <00:18:16.560>exceeds <00:18:16.653>a <00:18:16.746>certain <00:18:16.840>uh <00:18:16.933>threshold <00:18:17.026>of <00:18:17.120>lines 00:18:18.030 --> 00:18:18.040 align:start position:0% <00:18:18.030>exceeds <00:18:18.031>a <00:18:18.033>certain <00:18:18.034>uh <00:18:18.036>threshold <00:18:18.037>of <00:18:18.039>lines 00:18:18.040 --> 00:18:19.150 align:start position:0% <00:18:18.040>exceeds <00:18:18.116>a <00:18:18.193>certain <00:18:18.270>uh <00:18:18.347>threshold <00:18:18.424>of <00:18:18.501>lines <00:18:18.577>of <00:18:18.654>code, <00:18:18.731>you're <00:18:18.808>not <00:18:18.885>going <00:18:18.962>to <00:18:19.039>get 00:18:19.150 --> 00:18:19.160 align:start position:0% <00:18:19.150>of <00:18:19.151>code, <00:18:19.153>you're <00:18:19.154>not <00:18:19.156>going <00:18:19.157>to <00:18:19.159>get 00:18:19.160 --> 00:18:21.110 align:start position:0% <00:18:19.160>of <00:18:19.267>code, <00:18:19.375>you're <00:18:19.483>not <00:18:19.590>going <00:18:19.698>to <00:18:19.806>get <00:18:19.913>approval <00:18:20.021>from <00:18:20.129>our <00:18:20.236>system. <00:18:20.344>Why <00:18:20.452>is <00:18:20.560>that 00:18:21.110 --> 00:18:21.120 align:start position:0% <00:18:21.110>approval <00:18:21.111>from <00:18:21.112>our <00:18:21.114>system. <00:18:21.116>Why <00:18:21.117>is <00:18:21.119>that 00:18:21.120 --> 00:18:23.350 align:start position:0% <00:18:21.120>approval <00:18:21.219>from <00:18:21.320>our <00:18:21.419>system. <00:18:21.520>Why <00:18:21.620>is <00:18:21.719>that <00:18:21.820>the <00:18:21.919>case? <00:18:22.020>Well, <00:18:22.120>on <00:18:22.219>the <00:18:22.320>surface, <00:18:22.419>tiny <00:18:22.520>PRs 00:18:23.350 --> 00:18:23.360 align:start position:0% <00:18:23.350>the <00:18:23.351>case? <00:18:23.352>Well, <00:18:23.353>on <00:18:23.355>the <00:18:23.356>surface, <00:18:23.357>tiny <00:18:23.359>PRs 00:18:23.360 --> 00:18:24.710 align:start position:0% <00:18:23.360>the <00:18:23.446>case? <00:18:23.533>Well, <00:18:23.620>on <00:18:23.707>the <00:18:23.793>surface, <00:18:23.880>tiny <00:18:23.967>PRs <00:18:24.054>are <00:18:24.141>kind <00:18:24.227>of <00:18:24.314>easier <00:18:24.401>to <00:18:24.488>review, <00:18:24.575>whether 00:18:24.710 --> 00:18:24.720 align:start position:0% <00:18:24.710>are <00:18:24.711>kind <00:18:24.713>of <00:18:24.714>easier <00:18:24.716>to <00:18:24.717>review, <00:18:24.719>whether 00:18:24.720 --> 00:18:26.990 align:start position:0% <00:18:24.720>are <00:18:24.847>kind <00:18:24.974>of <00:18:25.101>easier <00:18:25.229>to <00:18:25.356>review, <00:18:25.483>whether <00:18:25.610>human <00:18:25.738>or <00:18:25.865>bot. <00:18:25.992>Kind <00:18:26.120>of 00:18:26.990 --> 00:18:27.000 align:start position:0% <00:18:26.990>human <00:18:26.992>or <00:18:26.994>bot. <00:18:26.996>Kind <00:18:26.999>of 00:18:27.000 --> 00:18:28.470 align:start position:0% <00:18:27.000>human <00:18:27.189>or <00:18:27.378>bot. <00:18:27.567>Kind <00:18:27.756>of <00:18:27.945>makes <00:18:28.134>sense, <00:18:28.323>right? 00:18:28.470 --> 00:18:28.480 align:start position:0% <00:18:28.470>makes <00:18:28.474>sense, <00:18:28.479>right? 00:18:28.480 --> 00:18:30.190 align:start position:0% <00:18:28.480>makes <00:18:28.655>sense, <00:18:28.830>right? <00:18:29.005>So, <00:18:29.180>what <00:18:29.355>was <00:18:29.530>this <00:18:29.705>threshold? <00:18:29.880>Initially, 00:18:30.190 --> 00:18:30.200 align:start position:0% <00:18:30.190>So, <00:18:30.191>what <00:18:30.193>was <00:18:30.195>this <00:18:30.197>threshold? <00:18:30.199>Initially, 00:18:30.200 --> 00:18:31.910 align:start position:0% <00:18:30.200>So, <00:18:30.316>what <00:18:30.433>was <00:18:30.550>this <00:18:30.666>threshold? <00:18:30.783>Initially, <00:18:30.900>when <00:18:31.016>we <00:18:31.133>started <00:18:31.250>with <00:18:31.366>this <00:18:31.483>agent, <00:18:31.600>we 00:18:31.910 --> 00:18:31.920 align:start position:0% <00:18:31.910>when <00:18:31.911>we <00:18:31.913>started <00:18:31.914>with <00:18:31.916>this <00:18:31.917>agent, <00:18:31.919>we 00:18:31.920 --> 00:18:33.630 align:start position:0% <00:18:31.920>when <00:18:32.027>we <00:18:32.135>started <00:18:32.243>with <00:18:32.350>this <00:18:32.458>agent, <00:18:32.566>we <00:18:32.673>established <00:18:32.781>a <00:18:32.889>threshold <00:18:32.996>of <00:18:33.104>40 <00:18:33.212>lines <00:18:33.320>of 00:18:33.630 --> 00:18:33.640 align:start position:0% <00:18:33.630>established <00:18:33.631>a <00:18:33.633>threshold <00:18:33.634>of <00:18:33.636>40 <00:18:33.637>lines <00:18:33.639>of 00:18:33.640 --> 00:18:35.550 align:start position:0% <00:18:33.640>established <00:18:33.747>a <00:18:33.855>threshold <00:18:33.963>of <00:18:34.070>40 <00:18:34.178>lines <00:18:34.286>of <00:18:34.393>code. <00:18:34.501>Then, <00:18:34.609>as <00:18:34.716>we <00:18:34.824>built <00:18:34.932>confidence <00:18:35.040>and 00:18:35.550 --> 00:18:35.560 align:start position:0% <00:18:35.550>code. <00:18:35.551>Then, <00:18:35.553>as <00:18:35.554>we <00:18:35.556>built <00:18:35.557>confidence <00:18:35.559>and 00:18:35.560 --> 00:18:37.550 align:start position:0% <00:18:35.560>code. <00:18:35.667>Then, <00:18:35.775>as <00:18:35.883>we <00:18:35.990>built <00:18:36.098>confidence <00:18:36.206>and <00:18:36.313>made <00:18:36.421>the <00:18:36.529>agent <00:18:36.636>smarter, <00:18:36.744>we <00:18:36.852>increased <00:18:36.960>it 00:18:37.550 --> 00:18:37.560 align:start position:0% <00:18:37.550>made <00:18:37.551>the <00:18:37.553>agent <00:18:37.554>smarter, <00:18:37.556>we <00:18:37.557>increased <00:18:37.559>it 00:18:37.560 --> 00:18:40.070 align:start position:0% <00:18:37.560>made <00:18:37.687>the <00:18:37.814>agent <00:18:37.941>smarter, <00:18:38.069>we <00:18:38.196>increased <00:18:38.323>it <00:18:38.450>to <00:18:38.578>150 <00:18:38.705>lines <00:18:38.832>of <00:18:38.960>code. 00:18:40.070 --> 00:18:40.080 align:start position:0% <00:18:40.070>to <00:18:40.072>150 <00:18:40.074>lines <00:18:40.076>of <00:18:40.079>code. 00:18:40.080 --> 00:18:42.150 align:start position:0% <00:18:40.080>to <00:18:40.207>150 <00:18:40.334>lines <00:18:40.461>of <00:18:40.589>code. <00:18:40.716>But, <00:18:40.843>it's <00:18:40.970>still <00:18:41.098>small, <00:18:41.225>right? <00:18:41.352>150 <00:18:41.480>lines 00:18:42.150 --> 00:18:42.160 align:start position:0% <00:18:42.150>But, <00:18:42.151>it's <00:18:42.153>still <00:18:42.154>small, <00:18:42.156>right? <00:18:42.157>150 <00:18:42.159>lines 00:18:42.160 --> 00:18:44.030 align:start position:0% <00:18:42.160>But, <00:18:42.260>it's <00:18:42.360>still <00:18:42.460>small, <00:18:42.560>right? <00:18:42.660>150 <00:18:42.760>lines <00:18:42.860>of <00:18:42.960>code <00:18:43.060>like <00:18:43.160>we <00:18:43.260>don't <00:18:43.360>create <00:18:43.460>this <00:18:43.560>these 00:18:44.030 --> 00:18:44.040 align:start position:0% <00:18:44.030>of <00:18:44.031>code <00:18:44.032>like <00:18:44.033>we <00:18:44.035>don't <00:18:44.036>create <00:18:44.037>this <00:18:44.039>these 00:18:44.040 --> 00:18:45.230 align:start position:0% <00:18:44.040>of <00:18:44.129>code <00:18:44.218>like <00:18:44.307>we <00:18:44.397>don't <00:18:44.486>create <00:18:44.575>this <00:18:44.664>these <00:18:44.754>pull <00:18:44.843>requests <00:18:44.932>these <00:18:45.021>days <00:18:45.111>anymore. 00:18:45.230 --> 00:18:45.240 align:start position:0% <00:18:45.230>pull <00:18:45.232>requests <00:18:45.234>these <00:18:45.236>days <00:18:45.239>anymore. 00:18:45.240 --> 00:18:47.190 align:start position:0% <00:18:45.240>pull <00:18:45.395>requests <00:18:45.551>these <00:18:45.706>days <00:18:45.862>anymore. <00:18:46.017>They're <00:18:46.173>all <00:18:46.328>bigger <00:18:46.484>than <00:18:46.640>that. 00:18:47.190 --> 00:18:47.200 align:start position:0% <00:18:47.190>They're <00:18:47.192>all <00:18:47.194>bigger <00:18:47.196>than <00:18:47.199>that. 00:18:47.200 --> 00:18:48.470 align:start position:0% <00:18:47.200>They're <00:18:47.314>all <00:18:47.428>bigger <00:18:47.542>than <00:18:47.657>that. <00:18:47.771>And <00:18:47.885>this <00:18:48.000>brings <00:18:48.114>the <00:18:48.228>most <00:18:48.343>important 00:18:48.470 --> 00:18:48.480 align:start position:0% <00:18:48.470>And <00:18:48.471>this <00:18:48.473>brings <00:18:48.475>the <00:18:48.477>most <00:18:48.479>important 00:18:48.480 --> 00:18:50.510 align:start position:0% <00:18:48.480>And <00:18:48.607>this <00:18:48.734>brings <00:18:48.861>the <00:18:48.989>most <00:18:49.116>important <00:18:49.243>question, <00:18:49.370>the <00:18:49.498>most <00:18:49.625>important <00:18:49.752>point <00:18:49.880>of 00:18:50.510 --> 00:18:50.520 align:start position:0% <00:18:50.510>question, <00:18:50.511>the <00:18:50.513>most <00:18:50.515>important <00:18:50.517>point <00:18:50.519>of 00:18:50.520 --> 00:18:51.910 align:start position:0% <00:18:50.520>question, <00:18:50.616>the <00:18:50.712>most <00:18:50.808>important <00:18:50.904>point <00:18:51.001>of <00:18:51.097>this <00:18:51.193>whole <00:18:51.289>talk <00:18:51.386>is <00:18:51.482>that <00:18:51.578>why <00:18:51.674>are <00:18:51.771>we 00:18:51.910 --> 00:18:51.920 align:start position:0% <00:18:51.910>this <00:18:51.911>whole <00:18:51.912>talk <00:18:51.913>is <00:18:51.915>that <00:18:51.916>why <00:18:51.917>are <00:18:51.919>we 00:18:51.920 --> 00:18:53.470 align:start position:0% <00:18:51.920>this <00:18:52.027>whole <00:18:52.134>talk <00:18:52.241>is <00:18:52.349>that <00:18:52.456>why <00:18:52.563>are <00:18:52.671>we <00:18:52.778>building <00:18:52.885>this <00:18:52.993>PR <00:18:53.100>review <00:18:53.207>and <00:18:53.315>approval 00:18:53.470 --> 00:18:53.480 align:start position:0% <00:18:53.470>building <00:18:53.471>this <00:18:53.473>PR <00:18:53.475>review <00:18:53.477>and <00:18:53.479>approval 00:18:53.480 --> 00:18:54.830 align:start position:0% <00:18:53.480>building <00:18:53.581>this <00:18:53.682>PR <00:18:53.783>review <00:18:53.885>and <00:18:53.986>approval <00:18:54.087>agent <00:18:54.188>in <00:18:54.290>the <00:18:54.391>first <00:18:54.492>place, <00:18:54.593>right? <00:18:54.695>What's 00:18:54.830 --> 00:18:54.840 align:start position:0% <00:18:54.830>agent <00:18:54.831>in <00:18:54.832>the <00:18:54.834>first <00:18:54.836>place, <00:18:54.837>right? <00:18:54.839>What's 00:18:54.840 --> 00:18:56.990 align:start position:0% <00:18:54.840>agent <00:18:54.939>in <00:18:55.040>the <00:18:55.139>first <00:18:55.240>place, <00:18:55.340>right? <00:18:55.439>What's <00:18:55.540>the <00:18:55.639>point? <00:18:55.740>Well, <00:18:55.840>do <00:18:55.939>we <00:18:56.040>want <00:18:56.139>to <00:18:56.240>preserve 00:18:56.990 --> 00:18:57.000 align:start position:0% <00:18:56.990>the <00:18:56.991>point? <00:18:56.992>Well, <00:18:56.993>do <00:18:56.995>we <00:18:56.996>want <00:18:56.997>to <00:18:56.999>preserve 00:18:57.000 --> 00:18:59.030 align:start position:0% <00:18:57.000>the <00:18:57.100>point? <00:18:57.200>Well, <00:18:57.300>do <00:18:57.400>we <00:18:57.500>want <00:18:57.600>to <00:18:57.700>preserve <00:18:57.800>problem <00:18:57.900>statement <00:18:58.000>and <00:18:58.100>intent <00:18:58.200>on <00:18:58.300>the <00:18:58.400>pull 00:18:59.030 --> 00:18:59.040 align:start position:0% <00:18:59.030>problem <00:18:59.031>statement <00:18:59.033>and <00:18:59.034>intent <00:18:59.036>on <00:18:59.037>the <00:18:59.039>pull 00:18:59.040 --> 00:19:00.950 align:start position:0% <00:18:59.040>problem <00:18:59.156>statement <00:18:59.273>and <00:18:59.389>intent <00:18:59.506>on <00:18:59.623>the <00:18:59.740>pull <00:18:59.856>request <00:18:59.973>description? <00:19:00.090>Yes, <00:19:00.206>of <00:19:00.323>course <00:19:00.440>we 00:19:00.950 --> 00:19:00.960 align:start position:0% <00:19:00.950>request <00:19:00.951>description? <00:19:00.953>Yes, <00:19:00.955>of <00:19:00.957>course <00:19:00.959>we 00:19:00.960 --> 00:19:02.830 align:start position:0% <00:19:00.960>request <00:19:01.076>description? <00:19:01.193>Yes, <00:19:01.310>of <00:19:01.426>course <00:19:01.543>we <00:19:01.660>want <00:19:01.776>that. <00:19:01.893>This <00:19:02.010>is <00:19:02.126>great. <00:19:02.243>Like, <00:19:02.360>this 00:19:02.830 --> 00:19:02.840 align:start position:0% <00:19:02.830>want <00:19:02.831>that. <00:19:02.832>This <00:19:02.834>is <00:19:02.836>great. <00:19:02.837>Like, <00:19:02.839>this 00:19:02.840 --> 00:19:05.310 align:start position:0% <00:19:02.840>want <00:19:02.956>that. <00:19:03.073>This <00:19:03.189>is <00:19:03.306>great. <00:19:03.423>Like, <00:19:03.540>this <00:19:03.656>crap <00:19:03.773>generated <00:19:03.889>in <00:19:04.006>2025, <00:19:04.123>those <00:19:04.240>PR 00:19:05.310 --> 00:19:05.320 align:start position:0% <00:19:05.310>crap <00:19:05.311>generated <00:19:05.313>in <00:19:05.315>2025, <00:19:05.317>those <00:19:05.319>PR 00:19:05.320 --> 00:19:06.470 align:start position:0% <00:19:05.320>crap <00:19:05.449>generated <00:19:05.578>in <00:19:05.708>2025, <00:19:05.837>those <00:19:05.966>PR <00:19:06.096>descriptions, <00:19:06.225>they're <00:19:06.355>completely 00:19:06.470 --> 00:19:06.480 align:start position:0% <00:19:06.470>descriptions, <00:19:06.474>they're <00:19:06.479>completely 00:19:06.480 --> 00:19:08.630 align:start position:0% <00:19:06.480>descriptions, <00:19:06.655>they're <00:19:06.830>completely <00:19:07.005>useless. <00:19:07.180>They're <00:19:07.355>just <00:19:07.530>a <00:19:07.705>human <00:19:07.880>language 00:19:08.630 --> 00:19:08.640 align:start position:0% <00:19:08.630>useless. <00:19:08.631>They're <00:19:08.633>just <00:19:08.635>a <00:19:08.637>human <00:19:08.639>language 00:19:08.640 --> 00:19:10.190 align:start position:0% <00:19:08.640>useless. <00:19:08.756>They're <00:19:08.872>just <00:19:08.988>a <00:19:09.105>human <00:19:09.221>language <00:19:09.337>retelling <00:19:09.453>of <00:19:09.570>the <00:19:09.686>changes, <00:19:09.802>but <00:19:09.918>they <00:19:10.035>don't 00:19:10.190 --> 00:19:10.200 align:start position:0% <00:19:10.190>retelling <00:19:10.191>of <00:19:10.193>the <00:19:10.194>changes, <00:19:10.196>but <00:19:10.197>they <00:19:10.199>don't 00:19:10.200 --> 00:19:12.350 align:start position:0% <00:19:10.200>retelling <00:19:10.307>of <00:19:10.415>the <00:19:10.523>changes, <00:19:10.630>but <00:19:10.738>they <00:19:10.846>don't <00:19:10.953>tell <00:19:11.061>you <00:19:11.169>the <00:19:11.276>problem, <00:19:11.384>the <00:19:11.492>intent. <00:19:11.600>This 00:19:12.350 --> 00:19:12.360 align:start position:0% <00:19:12.350>tell <00:19:12.351>you <00:19:12.352>the <00:19:12.354>problem, <00:19:12.356>the <00:19:12.357>intent. <00:19:12.359>This 00:19:12.360 --> 00:19:14.470 align:start position:0% <00:19:12.360>tell <00:19:12.476>you <00:19:12.593>the <00:19:12.709>problem, <00:19:12.826>the <00:19:12.943>intent. <00:19:13.060>This <00:19:13.176>should <00:19:13.293>This <00:19:13.409>should <00:19:13.526>never <00:19:13.643>happen <00:19:13.760>again. 00:19:14.470 --> 00:19:14.480 align:start position:0% <00:19:14.470>should <00:19:14.471>This <00:19:14.473>should <00:19:14.475>never <00:19:14.477>happen <00:19:14.479>again. 00:19:14.480 --> 00:19:16.390 align:start position:0% <00:19:14.480>should <00:19:14.580>This <00:19:14.680>should <00:19:14.780>never <00:19:14.880>happen <00:19:14.980>again. <00:19:15.080>Do <00:19:15.180>we <00:19:15.280>want <00:19:15.380>to <00:19:15.480>cut <00:19:15.580>review <00:19:15.680>time? <00:19:15.780>Of <00:19:15.880>course 00:19:16.390 --> 00:19:16.400 align:start position:0% <00:19:16.390>Do <00:19:16.391>we <00:19:16.392>want <00:19:16.393>to <00:19:16.394>cut <00:19:16.395>review <00:19:16.396>time? <00:19:16.397>Of <00:19:16.399>course 00:19:16.400 --> 00:19:17.990 align:start position:0% <00:19:16.400>Do <00:19:16.493>we <00:19:16.586>want <00:19:16.680>to <00:19:16.773>cut <00:19:16.866>review <00:19:16.960>time? <00:19:17.053>Of <00:19:17.146>course <00:19:17.240>we <00:19:17.333>do. <00:19:17.426>We <00:19:17.520>want <00:19:17.613>our <00:19:17.706>experts <00:19:17.800>do 00:19:17.990 --> 00:19:18.000 align:start position:0% <00:19:17.990>we <00:19:17.991>do. <00:19:17.993>We <00:19:17.994>want <00:19:17.996>our <00:19:17.997>experts <00:19:17.999>do 00:19:18.000 --> 00:19:19.630 align:start position:0% <00:19:18.000>we <00:19:18.127>do. <00:19:18.254>We <00:19:18.381>want <00:19:18.509>our <00:19:18.636>experts <00:19:18.763>do <00:19:18.890>interesting <00:19:19.018>things <00:19:19.145>instead <00:19:19.272>of <00:19:19.400>spending 00:19:19.630 --> 00:19:19.640 align:start position:0% <00:19:19.630>interesting <00:19:19.632>things <00:19:19.634>instead <00:19:19.636>of <00:19:19.639>spending 00:19:19.640 --> 00:19:21.830 align:start position:0% <00:19:19.640>interesting <00:19:19.767>things <00:19:19.894>instead <00:19:20.021>of <00:19:20.149>spending <00:19:20.276>hours <00:19:20.403>of <00:19:20.530>their <00:19:20.658>time <00:19:20.785>like <00:19:20.912>posting <00:19:21.040>those 00:19:21.830 --> 00:19:21.840 align:start position:0% <00:19:21.830>hours <00:19:21.831>of <00:19:21.832>their <00:19:21.834>time <00:19:21.836>like <00:19:21.837>posting <00:19:21.839>those 00:19:21.840 --> 00:19:23.510 align:start position:0% <00:19:21.840>hours <00:19:21.947>of <00:19:22.055>their <00:19:22.163>time <00:19:22.270>like <00:19:22.378>posting <00:19:22.486>those <00:19:22.593>comments <00:19:22.701>over <00:19:22.809>and <00:19:22.916>over <00:19:23.024>again <00:19:23.132>trying <00:19:23.240>to 00:19:23.510 --> 00:19:23.520 align:start position:0% <00:19:23.510>comments <00:19:23.511>over <00:19:23.513>and <00:19:23.514>over <00:19:23.516>again <00:19:23.517>trying <00:19:23.519>to 00:19:23.520 --> 00:19:25.510 align:start position:0% <00:19:23.520>comments <00:19:23.636>over <00:19:23.753>and <00:19:23.870>over <00:19:23.986>again <00:19:24.103>trying <00:19:24.220>to <00:19:24.336>educate <00:19:24.453>folks <00:19:24.570>about <00:19:24.686>best <00:19:24.803>practices <00:19:24.920>and 00:19:25.510 --> 00:19:25.520 align:start position:0% <00:19:25.510>educate <00:19:25.511>folks <00:19:25.513>about <00:19:25.515>best <00:19:25.517>practices <00:19:25.519>and 00:19:25.520 --> 00:19:26.950 align:start position:0% <00:19:25.520>educate <00:19:25.627>folks <00:19:25.734>about <00:19:25.841>best <00:19:25.949>practices <00:19:26.056>and <00:19:26.163>type <00:19:26.270>parents. <00:19:26.378>This <00:19:26.485>is <00:19:26.592>boring. <00:19:26.699>This <00:19:26.807>is 00:19:26.950 --> 00:19:26.960 align:start position:0% <00:19:26.950>type <00:19:26.951>parents. <00:19:26.953>This <00:19:26.954>is <00:19:26.956>boring. <00:19:26.957>This <00:19:26.959>is 00:19:26.960 --> 00:19:28.950 align:start position:0% <00:19:26.960>type <00:19:27.135>parents. <00:19:27.310>This <00:19:27.485>is <00:19:27.660>boring. <00:19:27.835>This <00:19:28.010>is <00:19:28.185>not <00:19:28.360>interesting. 00:19:28.950 --> 00:19:28.960 align:start position:0% <00:19:28.950>not <00:19:28.959>interesting. 00:19:28.960 --> 00:19:30.510 align:start position:0% <00:19:28.960>not <00:19:29.115>interesting. <00:19:29.270>Do <00:19:29.425>we <00:19:29.580>want <00:19:29.735>to <00:19:29.890>review <00:19:30.045>better <00:19:30.200>than <00:19:30.355>a 00:19:30.510 --> 00:19:30.520 align:start position:0% <00:19:30.510>Do <00:19:30.511>we <00:19:30.512>want <00:19:30.513>to <00:19:30.515>review <00:19:30.516>better <00:19:30.517>than <00:19:30.519>a 00:19:30.520 --> 00:19:32.870 align:start position:0% <00:19:30.520>Do <00:19:30.607>we <00:19:30.695>want <00:19:30.782>to <00:19:30.870>review <00:19:30.957>better <00:19:31.045>than <00:19:31.132>a <00:19:31.220>human? <00:19:31.307>Of <00:19:31.395>course <00:19:31.482>we <00:19:31.570>want <00:19:31.657>to <00:19:31.745>do <00:19:31.832>that. <00:19:31.920>And 00:19:32.870 --> 00:19:32.880 align:start position:0% <00:19:32.870>human? <00:19:32.871>Of <00:19:32.872>course <00:19:32.873>we <00:19:32.874>want <00:19:32.875>to <00:19:32.876>do <00:19:32.877>that. <00:19:32.879>And 00:19:32.880 --> 00:19:34.670 align:start position:0% <00:19:32.880>human? <00:19:32.967>Of <00:19:33.055>course <00:19:33.142>we <00:19:33.230>want <00:19:33.317>to <00:19:33.405>do <00:19:33.492>that. <00:19:33.580>And <00:19:33.667>in <00:19:33.755>fact, <00:19:33.842>I <00:19:33.930>have <00:19:34.017>lots <00:19:34.105>of <00:19:34.192>examples <00:19:34.280>where 00:19:34.670 --> 00:19:34.680 align:start position:0% <00:19:34.670>in <00:19:34.671>fact, <00:19:34.672>I <00:19:34.673>have <00:19:34.675>lots <00:19:34.676>of <00:19:34.677>examples <00:19:34.679>where 00:19:34.680 --> 00:19:36.630 align:start position:0% <00:19:34.680>in <00:19:34.762>fact, <00:19:34.844>I <00:19:34.927>have <00:19:35.009>lots <00:19:35.091>of <00:19:35.174>examples <00:19:35.256>where <00:19:35.338>our <00:19:35.421>AI <00:19:35.503>agent <00:19:35.585>does <00:19:35.668>a <00:19:35.750>much <00:19:35.832>better <00:19:35.915>job <00:19:35.997>on <00:19:36.080>a 00:19:36.630 --> 00:19:36.640 align:start position:0% <00:19:36.630>our <00:19:36.631>AI <00:19:36.632>agent <00:19:36.633>does <00:19:36.634>a <00:19:36.635>much <00:19:36.636>better <00:19:36.637>job <00:19:36.638>on <00:19:36.639>a 00:19:36.640 --> 00:19:38.430 align:start position:0% <00:19:36.640>our <00:19:36.727>AI <00:19:36.815>agent <00:19:36.902>does <00:19:36.990>a <00:19:37.077>much <00:19:37.165>better <00:19:37.252>job <00:19:37.340>on <00:19:37.427>a <00:19:37.515>pull <00:19:37.602>request <00:19:37.690>than <00:19:37.777>a <00:19:37.865>human <00:19:37.952>reviewer. <00:19:38.040>Talk 00:19:38.430 --> 00:19:38.440 align:start position:0% <00:19:38.430>pull <00:19:38.431>request <00:19:38.433>than <00:19:38.434>a <00:19:38.436>human <00:19:38.437>reviewer. <00:19:38.439>Talk 00:19:38.440 --> 00:19:39.590 align:start position:0% <00:19:38.440>pull <00:19:38.519>request <00:19:38.599>than <00:19:38.678>a <00:19:38.758>human <00:19:38.838>reviewer. <00:19:38.917>Talk <00:19:38.997>to <00:19:39.076>me <00:19:39.156>later. <00:19:39.236>I'll <00:19:39.315>show <00:19:39.395>you <00:19:39.475>some 00:19:39.590 --> 00:19:39.600 align:start position:0% <00:19:39.590>to <00:19:39.591>me <00:19:39.592>later. <00:19:39.594>I'll <00:19:39.596>show <00:19:39.597>you <00:19:39.599>some 00:19:39.600 --> 00:19:42.150 align:start position:0% <00:19:39.600>to <00:19:39.800>me <00:19:40.000>later. <00:19:40.199>I'll <00:19:40.399>show <00:19:40.600>you <00:19:40.800>some <00:19:41.000>examples. 00:19:42.150 --> 00:19:42.160 align:start position:0% examples. 00:19:42.160 --> 00:19:43.630 align:start position:0% <00:19:42.160>examples. <00:19:42.325>But <00:19:42.490>what <00:19:42.656>is <00:19:42.821>the <00:19:42.986>main <00:19:43.152>problem, <00:19:43.317>right? <00:19:43.483>All 00:19:43.630 --> 00:19:43.640 align:start position:0% <00:19:43.630>But <00:19:43.631>what <00:19:43.632>is <00:19:43.633>the <00:19:43.635>main <00:19:43.636>problem, <00:19:43.637>right? <00:19:43.639>All 00:19:43.640 --> 00:19:45.150 align:start position:0% <00:19:43.640>But <00:19:43.730>what <00:19:43.821>is <00:19:43.911>the <00:19:44.002>main <00:19:44.093>problem, <00:19:44.183>right? <00:19:44.274>All <00:19:44.364>of <00:19:44.455>those <00:19:44.546>are <00:19:44.636>kind <00:19:44.727>of <00:19:44.817>on <00:19:44.908>the <00:19:44.999>surface. 00:19:45.150 --> 00:19:45.160 align:start position:0% <00:19:45.150>of <00:19:45.151>those <00:19:45.152>are <00:19:45.153>kind <00:19:45.155>of <00:19:45.156>on <00:19:45.157>the <00:19:45.159>surface. 00:19:45.160 --> 00:19:46.270 align:start position:0% <00:19:45.160>of <00:19:45.226>those <00:19:45.293>are <00:19:45.359>kind <00:19:45.426>of <00:19:45.493>on <00:19:45.559>the <00:19:45.626>surface. <00:19:45.692>What <00:19:45.759>is <00:19:45.826>the <00:19:45.892>main <00:19:45.959>problem? <00:19:46.025>Well, <00:19:46.092>the <00:19:46.159>main 00:19:46.270 --> 00:19:46.280 align:start position:0% <00:19:46.270>What <00:19:46.271>is <00:19:46.272>the <00:19:46.273>main <00:19:46.275>problem? <00:19:46.276>Well, <00:19:46.277>the <00:19:46.279>main 00:19:46.280 --> 00:19:48.350 align:start position:0% <00:19:46.280>What <00:19:46.379>is <00:19:46.480>the <00:19:46.580>main <00:19:46.680>problem? <00:19:46.780>Well, <00:19:46.879>the <00:19:46.980>main <00:19:47.080>problem <00:19:47.180>is <00:19:47.280>still <00:19:47.379>this, <00:19:47.480>right? <00:19:47.580>We <00:19:47.680>still 00:19:48.350 --> 00:19:48.360 align:start position:0% <00:19:48.350>problem <00:19:48.351>is <00:19:48.352>still <00:19:48.354>this, <00:19:48.356>right? <00:19:48.357>We <00:19:48.359>still 00:19:48.360 --> 00:19:50.470 align:start position:0% <00:19:48.360>problem <00:19:48.476>is <00:19:48.593>still <00:19:48.709>this, <00:19:48.826>right? <00:19:48.943>We <00:19:49.060>still <00:19:49.176>are <00:19:49.293>getting <00:19:49.409>those <00:19:49.526>massive <00:19:49.643>AI <00:19:49.760>generated 00:19:50.470 --> 00:19:50.480 align:start position:0% <00:19:50.470>are <00:19:50.471>getting <00:19:50.473>those <00:19:50.475>massive <00:19:50.477>AI <00:19:50.479>generated 00:19:50.480 --> 00:19:52.230 align:start position:0% <00:19:50.480>are <00:19:50.596>getting <00:19:50.713>those <00:19:50.830>massive <00:19:50.946>AI <00:19:51.063>generated <00:19:51.180>pull <00:19:51.296>requests, <00:19:51.413>but <00:19:51.530>they <00:19:51.646>are <00:19:51.763>not <00:19:51.880>safe. 00:19:52.230 --> 00:19:52.240 align:start position:0% <00:19:52.230>pull <00:19:52.231>requests, <00:19:52.233>but <00:19:52.234>they <00:19:52.236>are <00:19:52.237>not <00:19:52.239>safe. 00:19:52.240 --> 00:19:54.190 align:start position:0% <00:19:52.240>pull <00:19:52.347>requests, <00:19:52.455>but <00:19:52.563>they <00:19:52.670>are <00:19:52.778>not <00:19:52.886>safe. <00:19:52.993>They <00:19:53.101>were <00:19:53.209>never <00:19:53.316>safe <00:19:53.424>before <00:19:53.532>and <00:19:53.640>they're 00:19:54.190 --> 00:19:54.200 align:start position:0% <00:19:54.190>They <00:19:54.191>were <00:19:54.193>never <00:19:54.194>safe <00:19:54.196>before <00:19:54.197>and <00:19:54.199>they're 00:19:54.200 --> 00:19:57.790 align:start position:0% <00:19:54.200>They <00:19:54.300>were <00:19:54.400>never <00:19:54.500>safe <00:19:54.600>before <00:19:54.700>and <00:19:54.800>they're <00:19:54.900>not <00:19:55.000>safe <00:19:55.100>now. <00:19:55.200>Why <00:19:55.300>are <00:19:55.400>not <00:19:55.500>they <00:19:55.600>safe? 00:19:57.790 --> 00:19:57.800 align:start position:0% <00:19:57.790>not <00:19:57.791>safe <00:19:57.792>now. <00:19:57.793>Why <00:19:57.795>are <00:19:57.796>not <00:19:57.797>they <00:19:57.799>safe? 00:19:57.800 --> 00:19:59.070 align:start position:0% <00:19:57.800>not <00:19:57.887>safe <00:19:57.975>now. <00:19:58.063>Why <00:19:58.151>are <00:19:58.239>not <00:19:58.327>they <00:19:58.415>safe? <00:19:58.503>Time <00:19:58.591>for <00:19:58.679>another <00:19:58.767>famous <00:19:58.855>quote <00:19:58.943>from 00:19:59.070 --> 00:19:59.080 align:start position:0% <00:19:59.070>Time <00:19:59.071>for <00:19:59.073>another <00:19:59.075>famous <00:19:59.077>quote <00:19:59.079>from 00:19:59.080 --> 00:20:00.630 align:start position:0% <00:19:59.080>Time <00:19:59.312>for <00:19:59.545>another <00:19:59.777>famous <00:20:00.010>quote <00:20:00.242>from <00:20:00.475>another 00:20:00.630 --> 00:20:00.640 align:start position:0% another 00:20:00.640 --> 00:20:01.830 align:start position:0% <00:20:00.640>another <00:20:00.854>famous <00:20:01.068>leader <00:20:01.282>in <00:20:01.496>the <00:20:01.711>industry, 00:20:01.830 --> 00:20:01.840 align:start position:0% <00:20:01.830>famous <00:20:01.832>leader <00:20:01.834>in <00:20:01.836>the <00:20:01.839>industry, 00:20:01.840 --> 00:20:03.470 align:start position:0% <00:20:01.840>famous <00:20:01.995>leader <00:20:02.151>in <00:20:02.306>the <00:20:02.462>industry, <00:20:02.617>production <00:20:02.773>is <00:20:02.928>your <00:20:03.084>only <00:20:03.240>objective 00:20:03.470 --> 00:20:03.480 align:start position:0% <00:20:03.470>production <00:20:03.472>is <00:20:03.474>your <00:20:03.476>only <00:20:03.479>objective 00:20:03.480 --> 00:20:05.670 align:start position:0% <00:20:03.480>production <00:20:03.596>is <00:20:03.713>your <00:20:03.830>only <00:20:03.946>objective <00:20:04.063>reality. <00:20:04.180>So, <00:20:04.296>if <00:20:04.413>you <00:20:04.530>ship <00:20:04.646>a <00:20:04.763>diff <00:20:04.880>like 00:20:05.670 --> 00:20:05.680 align:start position:0% <00:20:05.670>reality. <00:20:05.671>So, <00:20:05.672>if <00:20:05.673>you <00:20:05.675>ship <00:20:05.676>a <00:20:05.677>diff <00:20:05.679>like 00:20:05.680 --> 00:20:07.310 align:start position:0% <00:20:05.680>reality. <00:20:05.767>So, <00:20:05.855>if <00:20:05.942>you <00:20:06.030>ship <00:20:06.117>a <00:20:06.205>diff <00:20:06.292>like <00:20:06.380>that <00:20:06.467>and <00:20:06.555>you <00:20:06.642>see <00:20:06.730>it <00:20:06.817>changes <00:20:06.905>a <00:20:06.992>lot <00:20:07.080>of 00:20:07.310 --> 00:20:07.320 align:start position:0% <00:20:07.310>that <00:20:07.311>and <00:20:07.312>you <00:20:07.313>see <00:20:07.314>it <00:20:07.315>changes <00:20:07.316>a <00:20:07.317>lot <00:20:07.319>of 00:20:07.320 --> 00:20:09.030 align:start position:0% <00:20:07.320>that <00:20:07.419>and <00:20:07.520>you <00:20:07.620>see <00:20:07.720>it <00:20:07.820>changes <00:20:07.919>a <00:20:08.020>lot <00:20:08.120>of <00:20:08.220>things, <00:20:08.320>existing <00:20:08.419>things <00:20:08.520>in <00:20:08.620>the <00:20:08.720>system. 00:20:09.030 --> 00:20:09.040 align:start position:0% <00:20:09.030>things, <00:20:09.031>existing <00:20:09.033>things <00:20:09.035>in <00:20:09.037>the <00:20:09.039>system. 00:20:09.040 --> 00:20:10.390 align:start position:0% <00:20:09.040>things, <00:20:09.133>existing <00:20:09.226>things <00:20:09.320>in <00:20:09.413>the <00:20:09.507>system. <00:20:09.600>And <00:20:09.694>assuming <00:20:09.787>you <00:20:09.881>have <00:20:09.974>a <00:20:10.068>product <00:20:10.161>that <00:20:10.255>you 00:20:10.390 --> 00:20:10.400 align:start position:0% <00:20:10.390>And <00:20:10.391>assuming <00:20:10.392>you <00:20:10.393>have <00:20:10.395>a <00:20:10.396>product <00:20:10.397>that <00:20:10.399>you 00:20:10.400 --> 00:20:12.070 align:start position:0% <00:20:10.400>And <00:20:10.507>assuming <00:20:10.615>you <00:20:10.723>have <00:20:10.830>a <00:20:10.938>product <00:20:11.046>that <00:20:11.153>you <00:20:11.261>have <00:20:11.369>some <00:20:11.476>paying <00:20:11.584>customers, <00:20:11.692>then <00:20:11.800>it's 00:20:12.070 --> 00:20:12.080 align:start position:0% <00:20:12.070>have <00:20:12.071>some <00:20:12.073>paying <00:20:12.075>customers, <00:20:12.077>then <00:20:12.079>it's 00:20:12.080 --> 00:20:13.990 align:start position:0% <00:20:12.080>have <00:20:12.207>some <00:20:12.334>paying <00:20:12.461>customers, <00:20:12.589>then <00:20:12.716>it's <00:20:12.843>intrinsically <00:20:12.970>unsafe <00:20:13.098>to <00:20:13.225>ship <00:20:13.352>this. <00:20:13.480>There 00:20:13.990 --> 00:20:14.000 align:start position:0% <00:20:13.990>intrinsically <00:20:13.991>unsafe <00:20:13.993>to <00:20:13.995>ship <00:20:13.997>this. <00:20:13.999>There 00:20:14.000 --> 00:20:16.110 align:start position:0% <00:20:14.000>intrinsically <00:20:14.116>unsafe <00:20:14.233>to <00:20:14.350>ship <00:20:14.466>this. <00:20:14.583>There <00:20:14.700>could <00:20:14.816>be <00:20:14.933>so <00:20:15.050>many <00:20:15.166>unknown <00:20:15.283>unknowns <00:20:15.400>hidden 00:20:16.110 --> 00:20:16.120 align:start position:0% <00:20:16.110>could <00:20:16.111>be <00:20:16.112>so <00:20:16.114>many <00:20:16.116>unknown <00:20:16.117>unknowns <00:20:16.119>hidden 00:20:16.120 --> 00:20:17.790 align:start position:0% <00:20:16.120>could <00:20:16.227>be <00:20:16.335>so <00:20:16.443>many <00:20:16.550>unknown <00:20:16.658>unknowns <00:20:16.766>hidden <00:20:16.873>in <00:20:16.981>that <00:20:17.089>diff <00:20:17.196>that <00:20:17.304>when <00:20:17.412>it <00:20:17.520>hits 00:20:17.790 --> 00:20:17.800 align:start position:0% <00:20:17.790>in <00:20:17.791>that <00:20:17.793>diff <00:20:17.794>that <00:20:17.796>when <00:20:17.797>it <00:20:17.799>hits 00:20:17.800 --> 00:20:20.030 align:start position:0% <00:20:17.800>in <00:20:17.916>that <00:20:18.033>diff <00:20:18.149>that <00:20:18.266>when <00:20:18.383>it <00:20:18.500>hits <00:20:18.616>production <00:20:18.733>and <00:20:18.850>only <00:20:18.966>there <00:20:19.083>those <00:20:19.200>unknown 00:20:20.030 --> 00:20:20.040 align:start position:0% <00:20:20.030>production <00:20:20.031>and <00:20:20.033>only <00:20:20.035>there <00:20:20.037>those <00:20:20.039>unknown 00:20:20.040 --> 00:20:21.750 align:start position:0% <00:20:20.040>production <00:20:20.167>and <00:20:20.294>only <00:20:20.421>there <00:20:20.549>those <00:20:20.676>unknown <00:20:20.803>unknowns <00:20:20.930>will <00:20:21.058>reveal <00:20:21.185>itself, <00:20:21.312>right? <00:20:21.440>That 00:20:21.750 --> 00:20:21.760 align:start position:0% <00:20:21.750>unknowns <00:20:21.751>will <00:20:21.753>reveal <00:20:21.755>itself, <00:20:21.757>right? <00:20:21.759>That 00:20:21.760 --> 00:20:22.910 align:start position:0% <00:20:21.760>unknowns <00:20:21.863>will <00:20:21.967>reveal <00:20:22.070>itself, <00:20:22.174>right? <00:20:22.277>That <00:20:22.381>production <00:20:22.484>is <00:20:22.588>the <00:20:22.691>only <00:20:22.795>objective 00:20:22.910 --> 00:20:22.920 align:start position:0% <00:20:22.910>production <00:20:22.912>is <00:20:22.914>the <00:20:22.916>only <00:20:22.919>objective 00:20:22.920 --> 00:20:24.270 align:start position:0% <00:20:22.920>production <00:20:23.055>is <00:20:23.190>the <00:20:23.325>only <00:20:23.460>objective <00:20:23.595>reality. <00:20:23.730>That's <00:20:23.865>where <00:20:24.000>your <00:20:24.135>customers 00:20:24.270 --> 00:20:24.280 align:start position:0% <00:20:24.270>reality. <00:20:24.272>That's <00:20:24.274>where <00:20:24.276>your <00:20:24.279>customers 00:20:24.280 --> 00:20:26.270 align:start position:0% <00:20:24.280>reality. <00:20:24.435>That's <00:20:24.591>where <00:20:24.746>your <00:20:24.902>customers <00:20:25.057>meet <00:20:25.213>your <00:20:25.368>infrastructure, <00:20:25.524>your <00:20:25.680>code, 00:20:26.270 --> 00:20:26.280 align:start position:0% <00:20:26.270>meet <00:20:26.272>your <00:20:26.274>infrastructure, <00:20:26.276>your <00:20:26.279>code, 00:20:26.280 --> 00:20:28.110 align:start position:0% <00:20:26.280>meet <00:20:26.420>your <00:20:26.560>infrastructure, <00:20:26.700>your <00:20:26.840>code, <00:20:26.980>your <00:20:27.120>data, <00:20:27.260>all <00:20:27.399>of <00:20:27.540>the <00:20:27.680>dependencies. 00:20:28.110 --> 00:20:28.120 align:start position:0% <00:20:28.110>your <00:20:28.111>data, <00:20:28.113>all <00:20:28.115>of <00:20:28.117>the <00:20:28.119>dependencies. 00:20:28.120 --> 00:20:29.430 align:start position:0% <00:20:28.120>your <00:20:28.218>data, <00:20:28.316>all <00:20:28.414>of <00:20:28.513>the <00:20:28.611>dependencies. <00:20:28.709>That's <00:20:28.807>the <00:20:28.906>only <00:20:29.004>place <00:20:29.102>where <00:20:29.200>the <00:20:29.299>magic 00:20:29.430 --> 00:20:29.440 align:start position:0% <00:20:29.430>That's <00:20:29.431>the <00:20:29.433>only <00:20:29.434>place <00:20:29.436>where <00:20:29.437>the <00:20:29.439>magic 00:20:29.440 --> 00:20:30.590 align:start position:0% <00:20:29.440>That's <00:20:29.519>the <00:20:29.599>only <00:20:29.678>place <00:20:29.758>where <00:20:29.838>the <00:20:29.917>magic <00:20:29.997>happens. <00:20:30.076>That's <00:20:30.156>the <00:20:30.236>only <00:20:30.315>place <00:20:30.395>where <00:20:30.475>you 00:20:30.590 --> 00:20:30.600 align:start position:0% <00:20:30.590>happens. <00:20:30.591>That's <00:20:30.592>the <00:20:30.594>only <00:20:30.596>place <00:20:30.597>where <00:20:30.599>you 00:20:30.600 --> 00:20:32.990 align:start position:0% <00:20:30.600>happens. <00:20:30.727>That's <00:20:30.854>the <00:20:30.981>only <00:20:31.109>place <00:20:31.236>where <00:20:31.363>you <00:20:31.490>can <00:20:31.618>surface <00:20:31.745>those <00:20:31.872>unknown <00:20:32.000>unknowns. 00:20:32.990 --> 00:20:33.000 align:start position:0% <00:20:32.990>can <00:20:32.992>surface <00:20:32.994>those <00:20:32.996>unknown <00:20:32.999>unknowns. 00:20:33.000 --> 00:20:35.030 align:start position:0% <00:20:33.000>can <00:20:33.116>surface <00:20:33.233>those <00:20:33.350>unknown <00:20:33.466>unknowns. <00:20:33.583>We <00:20:33.700>as <00:20:33.816>a <00:20:33.933>company, <00:20:34.050>we <00:20:34.166>preached <00:20:34.283>that <00:20:34.400>about 00:20:35.030 --> 00:20:35.040 align:start position:0% <00:20:35.030>We <00:20:35.031>as <00:20:35.032>a <00:20:35.033>company, <00:20:35.035>we <00:20:35.036>preached <00:20:35.037>that <00:20:35.039>about 00:20:35.040 --> 00:20:37.230 align:start position:0% <00:20:35.040>We <00:20:35.133>as <00:20:35.226>a <00:20:35.320>company, <00:20:35.413>we <00:20:35.506>preached <00:20:35.600>that <00:20:35.693>about <00:20:35.786>this <00:20:35.879>for <00:20:35.973>15 <00:20:36.066>years. <00:20:36.159>Like <00:20:36.253>there's <00:20:36.346>only <00:20:36.440>way 00:20:37.230 --> 00:20:37.240 align:start position:0% <00:20:37.230>this <00:20:37.231>for <00:20:37.232>15 <00:20:37.233>years. <00:20:37.235>Like <00:20:37.236>there's <00:20:37.237>only <00:20:37.239>way 00:20:37.240 --> 00:20:39.270 align:start position:0% <00:20:37.240>this <00:20:37.333>for <00:20:37.426>15 <00:20:37.520>years. <00:20:37.613>Like <00:20:37.706>there's <00:20:37.800>only <00:20:37.893>way <00:20:37.986>to <00:20:38.080>ship <00:20:38.173>safely. <00:20:38.266>You <00:20:38.360>have <00:20:38.453>to <00:20:38.546>ship <00:20:38.640>small 00:20:39.270 --> 00:20:39.280 align:start position:0% <00:20:39.270>to <00:20:39.271>ship <00:20:39.272>safely. <00:20:39.273>You <00:20:39.275>have <00:20:39.276>to <00:20:39.277>ship <00:20:39.279>small 00:20:39.280 --> 00:20:40.790 align:start position:0% <00:20:39.280>to <00:20:39.364>ship <00:20:39.449>safely. <00:20:39.534>You <00:20:39.619>have <00:20:39.704>to <00:20:39.789>ship <00:20:39.874>small <00:20:39.959>and <00:20:40.044>you <00:20:40.129>have <00:20:40.214>to <00:20:40.299>ship <00:20:40.384>fast. <00:20:40.469>If <00:20:40.554>you <00:20:40.639>ship 00:20:40.790 --> 00:20:40.800 align:start position:0% <00:20:40.790>and <00:20:40.791>you <00:20:40.792>have <00:20:40.793>to <00:20:40.794>ship <00:20:40.795>fast. <00:20:40.796>If <00:20:40.797>you <00:20:40.799>ship 00:20:40.800 --> 00:20:42.670 align:start position:0% <00:20:40.800>and <00:20:40.899>you <00:20:41.000>have <00:20:41.100>to <00:20:41.200>ship <00:20:41.300>fast. <00:20:41.399>If <00:20:41.500>you <00:20:41.600>ship <00:20:41.700>in <00:20:41.800>small <00:20:41.899>increments, <00:20:42.000>then <00:20:42.100>every <00:20:42.200>change 00:20:42.670 --> 00:20:42.680 align:start position:0% <00:20:42.670>in <00:20:42.671>small <00:20:42.673>increments, <00:20:42.675>then <00:20:42.677>every <00:20:42.679>change 00:20:42.680 --> 00:20:44.790 align:start position:0% <00:20:42.680>in <00:20:42.787>small <00:20:42.895>increments, <00:20:43.003>then <00:20:43.110>every <00:20:43.218>change <00:20:43.326>is <00:20:43.433>small <00:20:43.541>and <00:20:43.649>kind <00:20:43.756>of <00:20:43.864>enclosed <00:20:43.972>and <00:20:44.080>you 00:20:44.790 --> 00:20:44.800 align:start position:0% <00:20:44.790>is <00:20:44.791>small <00:20:44.792>and <00:20:44.793>kind <00:20:44.795>of <00:20:44.796>enclosed <00:20:44.797>and <00:20:44.799>you 00:20:44.800 --> 00:20:46.590 align:start position:0% <00:20:44.800>is <00:20:44.899>small <00:20:45.000>and <00:20:45.100>kind <00:20:45.200>of <00:20:45.300>enclosed <00:20:45.399>and <00:20:45.500>you <00:20:45.600>de-risk <00:20:45.700>that <00:20:45.800>change <00:20:45.899>in <00:20:46.000>production <00:20:46.100>one <00:20:46.200>by 00:20:46.590 --> 00:20:46.600 align:start position:0% <00:20:46.590>de-risk <00:20:46.591>that <00:20:46.592>change <00:20:46.594>in <00:20:46.596>production <00:20:46.597>one <00:20:46.599>by 00:20:46.600 --> 00:20:48.830 align:start position:0% <00:20:46.600>de-risk <00:20:46.693>that <00:20:46.786>change <00:20:46.879>in <00:20:46.973>production <00:20:47.066>one <00:20:47.159>by <00:20:47.253>one. <00:20:47.346>And <00:20:47.439>if <00:20:47.533>you <00:20:47.626>ship <00:20:47.719>them <00:20:47.813>fast, <00:20:47.906>then <00:20:48.000>if 00:20:48.830 --> 00:20:48.840 align:start position:0% <00:20:48.830>one. <00:20:48.831>And <00:20:48.832>if <00:20:48.833>you <00:20:48.834>ship <00:20:48.835>them <00:20:48.836>fast, <00:20:48.837>then <00:20:48.839>if 00:20:48.840 --> 00:20:50.910 align:start position:0% <00:20:48.840>one. <00:20:48.933>And <00:20:49.026>if <00:20:49.120>you <00:20:49.213>ship <00:20:49.306>them <00:20:49.399>fast, <00:20:49.493>then <00:20:49.586>if <00:20:49.679>things <00:20:49.773>break, <00:20:49.866>you <00:20:49.959>still <00:20:50.053>kind <00:20:50.146>of <00:20:50.240>have 00:20:50.910 --> 00:20:50.920 align:start position:0% <00:20:50.910>things <00:20:50.911>break, <00:20:50.913>you <00:20:50.914>still <00:20:50.916>kind <00:20:50.917>of <00:20:50.919>have 00:20:50.920 --> 00:20:52.710 align:start position:0% <00:20:50.920>things <00:20:51.027>break, <00:20:51.135>you <00:20:51.243>still <00:20:51.350>kind <00:20:51.458>of <00:20:51.566>have <00:20:51.673>fresh <00:20:51.781>context <00:20:51.889>in <00:20:51.996>your <00:20:52.104>head <00:20:52.212>to <00:20:52.320>diagnose 00:20:52.710 --> 00:20:52.720 align:start position:0% <00:20:52.710>fresh <00:20:52.711>context <00:20:52.713>in <00:20:52.714>your <00:20:52.716>head <00:20:52.717>to <00:20:52.719>diagnose 00:20:52.720 --> 00:20:54.630 align:start position:0% <00:20:52.720>fresh <00:20:52.820>context <00:20:52.920>in <00:20:53.020>your <00:20:53.120>head <00:20:53.220>to <00:20:53.320>diagnose <00:20:53.420>that <00:20:53.520>problem <00:20:53.620>and <00:20:53.720>revert <00:20:53.820>or <00:20:53.920>fix <00:20:54.020>it <00:20:54.120>or 00:20:54.630 --> 00:20:54.640 align:start position:0% <00:20:54.630>that <00:20:54.631>problem <00:20:54.632>and <00:20:54.633>revert <00:20:54.635>or <00:20:54.636>fix <00:20:54.637>it <00:20:54.639>or 00:20:54.640 --> 00:20:55.790 align:start position:0% <00:20:54.640>that <00:20:54.719>problem <00:20:54.799>and <00:20:54.878>revert <00:20:54.958>or <00:20:55.038>fix <00:20:55.117>it <00:20:55.197>or <00:20:55.276>make <00:20:55.356>some <00:20:55.436>other <00:20:55.515>decisions. <00:20:55.595>So, <00:20:55.675>it's 00:20:55.790 --> 00:20:55.800 align:start position:0% <00:20:55.790>make <00:20:55.791>some <00:20:55.793>other <00:20:55.795>decisions. <00:20:55.797>So, <00:20:55.799>it's 00:20:55.800 --> 00:20:56.870 align:start position:0% <00:20:55.800>make <00:20:55.880>some <00:20:55.960>other <00:20:56.040>decisions. <00:20:56.120>So, <00:20:56.201>it's <00:20:56.281>really <00:20:56.361>important. <00:20:56.442>If <00:20:56.522>you <00:20:56.602>want <00:20:56.682>to <00:20:56.763>ship 00:20:56.870 --> 00:20:56.880 align:start position:0% <00:20:56.870>really <00:20:56.871>important. <00:20:56.873>If <00:20:56.874>you <00:20:56.876>want <00:20:56.877>to <00:20:56.879>ship 00:20:56.880 --> 00:20:58.230 align:start position:0% <00:20:56.880>really <00:20:56.966>important. <00:20:57.053>If <00:20:57.140>you <00:20:57.227>want <00:20:57.313>to <00:20:57.400>ship <00:20:57.487>safe, <00:20:57.574>you <00:20:57.661>want <00:20:57.747>to <00:20:57.834>ship <00:20:57.921>small <00:20:58.008>and <00:20:58.095>you 00:20:58.230 --> 00:20:58.240 align:start position:0% <00:20:58.230>safe, <00:20:58.231>you <00:20:58.232>want <00:20:58.233>to <00:20:58.235>ship <00:20:58.236>small <00:20:58.237>and <00:20:58.239>you 00:20:58.240 --> 00:21:00.070 align:start position:0% <00:20:58.240>safe, <00:20:58.367>you <00:20:58.494>want <00:20:58.621>to <00:20:58.749>ship <00:20:58.876>small <00:20:59.003>and <00:20:59.130>you <00:20:59.258>want <00:20:59.385>to <00:20:59.512>ship <00:20:59.640>fast. 00:21:00.070 --> 00:21:00.080 align:start position:0% <00:21:00.070>want <00:21:00.072>to <00:21:00.076>ship <00:21:00.079>fast. 00:21:00.080 --> 00:21:02.030 align:start position:0% <00:21:00.080>want <00:21:00.207>to <00:21:00.334>ship <00:21:00.461>fast. <00:21:00.589>And <00:21:00.716>that's <00:21:00.843>why <00:21:00.970>this <00:21:01.098>thing <00:21:01.225>is <00:21:01.352>like <00:21:01.480>it's 00:21:02.030 --> 00:21:02.040 align:start position:0% <00:21:02.030>And <00:21:02.031>that's <00:21:02.032>why <00:21:02.033>this <00:21:02.035>thing <00:21:02.036>is <00:21:02.037>like <00:21:02.039>it's 00:21:02.040 --> 00:21:04.030 align:start position:0% <00:21:02.040>And <00:21:02.133>that's <00:21:02.226>why <00:21:02.320>this <00:21:02.413>thing <00:21:02.506>is <00:21:02.600>like <00:21:02.693>it's <00:21:02.786>not <00:21:02.879>going <00:21:02.973>to <00:21:03.066>get <00:21:03.159>approved, <00:21:03.253>right? <00:21:03.346>By <00:21:03.440>our 00:21:04.030 --> 00:21:04.040 align:start position:0% <00:21:04.030>not <00:21:04.031>going <00:21:04.032>to <00:21:04.033>get <00:21:04.035>approved, <00:21:04.036>right? <00:21:04.037>By <00:21:04.039>our 00:21:04.040 --> 00:21:06.030 align:start position:0% <00:21:04.040>not <00:21:04.127>going <00:21:04.215>to <00:21:04.302>get <00:21:04.389>approved, <00:21:04.477>right? <00:21:04.565>By <00:21:04.652>our <00:21:04.740>our <00:21:04.827>bot <00:21:04.915>because <00:21:05.002>we <00:21:05.090>we <00:21:05.177>we <00:21:05.264>we <00:21:05.352>we <00:21:05.440>still 00:21:06.030 --> 00:21:06.040 align:start position:0% <00:21:06.030>our <00:21:06.031>bot <00:21:06.032>because <00:21:06.033>we <00:21:06.034>we <00:21:06.035>we <00:21:06.036>we <00:21:06.037>we <00:21:06.039>still 00:21:06.040 --> 00:21:07.750 align:start position:0% <00:21:06.040>our <00:21:06.133>bot <00:21:06.226>because <00:21:06.320>we <00:21:06.413>we <00:21:06.506>we <00:21:06.600>we <00:21:06.693>we <00:21:06.786>still <00:21:06.879>want <00:21:06.973>to <00:21:07.066>maintain <00:21:07.159>this <00:21:07.253>culture <00:21:07.346>of <00:21:07.440>safe 00:21:07.750 --> 00:21:07.760 align:start position:0% <00:21:07.750>want <00:21:07.751>to <00:21:07.753>maintain <00:21:07.754>this <00:21:07.756>culture <00:21:07.757>of <00:21:07.759>safe 00:21:07.760 --> 00:21:08.750 align:start position:0% <00:21:07.760>want <00:21:07.887>to <00:21:08.014>maintain <00:21:08.141>this <00:21:08.269>culture <00:21:08.396>of <00:21:08.523>safe <00:21:08.651>shipping. 00:21:08.750 --> 00:21:08.760 align:start position:0% shipping. 00:21:08.760 --> 00:21:10.590 align:start position:0% <00:21:08.760>shipping. <00:21:08.960>And <00:21:09.160>this <00:21:09.360>brings <00:21:09.560>the <00:21:09.760>point, <00:21:09.960>right? <00:21:10.160>What 00:21:10.590 --> 00:21:10.600 align:start position:0% <00:21:10.590>And <00:21:10.591>this <00:21:10.592>brings <00:21:10.594>the <00:21:10.596>point, <00:21:10.597>right? <00:21:10.599>What 00:21:10.600 --> 00:21:12.510 align:start position:0% <00:21:10.600>And <00:21:10.693>this <00:21:10.786>brings <00:21:10.879>the <00:21:10.973>point, <00:21:11.066>right? <00:21:11.159>What <00:21:11.253>is <00:21:11.346>that <00:21:11.439>bot <00:21:11.533>is? <00:21:11.626>Like, <00:21:11.719>what <00:21:11.813>is <00:21:11.906>that <00:21:12.000>thing 00:21:12.510 --> 00:21:12.520 align:start position:0% <00:21:12.510>is <00:21:12.511>that <00:21:12.512>bot <00:21:12.513>is? <00:21:12.514>Like, <00:21:12.515>what <00:21:12.516>is <00:21:12.517>that <00:21:12.519>thing 00:21:12.520 --> 00:21:13.710 align:start position:0% <00:21:12.520>is <00:21:12.639>that <00:21:12.758>bot <00:21:12.877>is? <00:21:12.996>Like, <00:21:13.115>what <00:21:13.234>is <00:21:13.353>that <00:21:13.472>thing <00:21:13.591>is? 00:21:13.710 --> 00:21:13.720 align:start position:0% is? 00:21:13.720 --> 00:21:15.750 align:start position:0% <00:21:13.720>is? <00:21:13.920>It's <00:21:14.120>actually <00:21:14.320>helps <00:21:14.520>us <00:21:14.720>to <00:21:14.920>shape <00:21:15.120>our 00:21:15.750 --> 00:21:15.760 align:start position:0% <00:21:15.750>It's <00:21:15.751>actually <00:21:15.753>helps <00:21:15.754>us <00:21:15.756>to <00:21:15.757>shape <00:21:15.759>our 00:21:15.760 --> 00:21:17.910 align:start position:0% <00:21:15.760>It's <00:21:15.887>actually <00:21:16.014>helps <00:21:16.141>us <00:21:16.269>to <00:21:16.396>shape <00:21:16.523>our <00:21:16.650>sociotechnical <00:21:16.778>system <00:21:16.905>by <00:21:17.032>creating <00:21:17.160>an 00:21:17.910 --> 00:21:17.920 align:start position:0% <00:21:17.910>sociotechnical <00:21:17.912>system <00:21:17.914>by <00:21:17.916>creating <00:21:17.919>an 00:21:17.920 --> 00:21:19.790 align:start position:0% <00:21:17.920>sociotechnical <00:21:18.047>system <00:21:18.174>by <00:21:18.301>creating <00:21:18.429>an <00:21:18.556>incentive. <00:21:18.683>Because <00:21:18.810>now <00:21:18.938>you <00:21:19.065>have <00:21:19.192>a <00:21:19.320>choice 00:21:19.790 --> 00:21:19.800 align:start position:0% <00:21:19.790>incentive. <00:21:19.791>Because <00:21:19.793>now <00:21:19.794>you <00:21:19.796>have <00:21:19.797>a <00:21:19.799>choice 00:21:19.800 --> 00:21:22.150 align:start position:0% <00:21:19.800>incentive. <00:21:19.899>Because <00:21:20.000>now <00:21:20.100>you <00:21:20.200>have <00:21:20.300>a <00:21:20.399>choice <00:21:20.500>at <00:21:20.600>Finn. <00:21:20.700>You <00:21:20.800>can <00:21:20.899>create <00:21:21.000>this <00:21:21.100>massive <00:21:21.200>AI 00:21:22.150 --> 00:21:22.160 align:start position:0% <00:21:22.150>at <00:21:22.151>Finn. <00:21:22.152>You <00:21:22.153>can <00:21:22.155>create <00:21:22.156>this <00:21:22.157>massive <00:21:22.159>AI 00:21:22.160 --> 00:21:24.230 align:start position:0% <00:21:22.160>at <00:21:22.260>Finn. <00:21:22.360>You <00:21:22.460>can <00:21:22.560>create <00:21:22.660>this <00:21:22.760>massive <00:21:22.860>AI <00:21:22.960>slop <00:21:23.060>PR <00:21:23.160>with <00:21:23.260>many <00:21:23.360>many <00:21:23.460>unknown <00:21:23.560>unknowns 00:21:24.230 --> 00:21:24.240 align:start position:0% <00:21:24.230>slop <00:21:24.231>PR <00:21:24.233>with <00:21:24.234>many <00:21:24.236>many <00:21:24.237>unknown <00:21:24.239>unknowns 00:21:24.240 --> 00:21:25.910 align:start position:0% <00:21:24.240>slop <00:21:24.347>PR <00:21:24.455>with <00:21:24.563>many <00:21:24.670>many <00:21:24.778>unknown <00:21:24.886>unknowns <00:21:24.993>in <00:21:25.101>their <00:21:25.209>massive <00:21:25.316>diff, <00:21:25.424>and <00:21:25.532>you'll <00:21:25.640>be 00:21:25.910 --> 00:21:25.920 align:start position:0% <00:21:25.910>in <00:21:25.911>their <00:21:25.913>massive <00:21:25.914>diff, <00:21:25.916>and <00:21:25.917>you'll <00:21:25.919>be 00:21:25.920 --> 00:21:27.710 align:start position:0% <00:21:25.920>in <00:21:26.027>their <00:21:26.135>massive <00:21:26.243>diff, <00:21:26.350>and <00:21:26.458>you'll <00:21:26.566>be <00:21:26.673>waiting <00:21:26.781>for <00:21:26.889>hours <00:21:26.996>for <00:21:27.104>human <00:21:27.212>to <00:21:27.320>review 00:21:27.710 --> 00:21:27.720 align:start position:0% <00:21:27.710>waiting <00:21:27.711>for <00:21:27.713>hours <00:21:27.714>for <00:21:27.716>human <00:21:27.717>to <00:21:27.719>review 00:21:27.720 --> 00:21:29.430 align:start position:0% <00:21:27.720>waiting <00:21:27.813>for <00:21:27.906>hours <00:21:28.000>for <00:21:28.093>human <00:21:28.186>to <00:21:28.280>review <00:21:28.373>it. <00:21:28.466>And <00:21:28.560>I <00:21:28.653>bet <00:21:28.746>the <00:21:28.840>human <00:21:28.933>will <00:21:29.026>come <00:21:29.120>and 00:21:29.430 --> 00:21:29.440 align:start position:0% <00:21:29.430>it. <00:21:29.431>And <00:21:29.432>I <00:21:29.433>bet <00:21:29.434>the <00:21:29.435>human <00:21:29.436>will <00:21:29.437>come <00:21:29.439>and 00:21:29.440 --> 00:21:30.470 align:start position:0% <00:21:29.440>it. <00:21:29.497>And <00:21:29.555>I <00:21:29.613>bet <00:21:29.671>the <00:21:29.729>human <00:21:29.787>will <00:21:29.845>come <00:21:29.903>and <00:21:29.961>say, <00:21:30.019>"You <00:21:30.077>know <00:21:30.135>what? <00:21:30.193>This <00:21:30.251>is <00:21:30.309>too <00:21:30.367>big. 00:21:30.470 --> 00:21:30.480 align:start position:0% <00:21:30.470>say, <00:21:30.471>"You <00:21:30.472>know <00:21:30.473>what? <00:21:30.475>This <00:21:30.476>is <00:21:30.477>too <00:21:30.479>big. 00:21:30.480 --> 00:21:33.590 align:start position:0% <00:21:30.480>say, <00:21:30.562>"You <00:21:30.644>know <00:21:30.727>what? <00:21:30.809>This <00:21:30.891>is <00:21:30.974>too <00:21:31.056>big. <00:21:31.138>Let's <00:21:31.221>split <00:21:31.303>it <00:21:31.385>out." <00:21:31.468>Or <00:21:31.550>or <00:21:31.632>you <00:21:31.715>can <00:21:31.797>get <00:21:31.880>a 00:21:33.590 --> 00:21:33.600 align:start position:0% <00:21:33.590>Let's <00:21:33.591>split <00:21:33.591>it <00:21:33.592>out." <00:21:33.593>Or <00:21:33.594>or <00:21:33.596>you <00:21:33.597>can <00:21:33.598>get <00:21:33.599>a 00:21:33.600 --> 00:21:35.270 align:start position:0% <00:21:33.600>Let's <00:21:33.687>split <00:21:33.774>it <00:21:33.862>out." <00:21:33.949>Or <00:21:34.037>or <00:21:34.125>you <00:21:34.212>can <00:21:34.300>get <00:21:34.387>a <00:21:34.475>carrot, <00:21:34.562>right? <00:21:34.649>You <00:21:34.737>can <00:21:34.824>split <00:21:34.912>your <00:21:35.000>pull 00:21:35.270 --> 00:21:35.280 align:start position:0% <00:21:35.270>carrot, <00:21:35.271>right? <00:21:35.273>You <00:21:35.274>can <00:21:35.276>split <00:21:35.277>your <00:21:35.279>pull 00:21:35.280 --> 00:21:36.590 align:start position:0% <00:21:35.280>carrot, <00:21:35.378>right? <00:21:35.476>You <00:21:35.574>can <00:21:35.673>split <00:21:35.771>your <00:21:35.869>pull <00:21:35.967>request, <00:21:36.066>and <00:21:36.164>then <00:21:36.262>you'll <00:21:36.360>benefit <00:21:36.458>from 00:21:36.590 --> 00:21:36.600 align:start position:0% <00:21:36.590>request, <00:21:36.591>and <00:21:36.593>then <00:21:36.595>you'll <00:21:36.597>benefit <00:21:36.599>from 00:21:36.600 --> 00:21:38.630 align:start position:0% <00:21:36.600>request, <00:21:36.716>and <00:21:36.833>then <00:21:36.949>you'll <00:21:37.066>benefit <00:21:37.183>from <00:21:37.300>our <00:21:37.416>system. <00:21:37.533>You'll <00:21:37.649>get <00:21:37.766>an <00:21:37.883>auto <00:21:38.000>approval. 00:21:38.630 --> 00:21:38.640 align:start position:0% <00:21:38.630>our <00:21:38.631>system. <00:21:38.633>You'll <00:21:38.634>get <00:21:38.636>an <00:21:38.637>auto <00:21:38.639>approval. 00:21:38.640 --> 00:21:40.990 align:start position:0% <00:21:38.640>our <00:21:38.747>system. <00:21:38.855>You'll <00:21:38.963>get <00:21:39.070>an <00:21:39.178>auto <00:21:39.286>approval. <00:21:39.393>You'll <00:21:39.501>be <00:21:39.609>unblocked <00:21:39.716>faster. <00:21:39.824>And <00:21:39.932>then, <00:21:40.040>by 00:21:40.990 --> 00:21:41.000 align:start position:0% <00:21:40.990>You'll <00:21:40.991>be <00:21:40.993>unblocked <00:21:40.994>faster. <00:21:40.996>And <00:21:40.997>then, <00:21:40.999>by 00:21:41.000 --> 00:21:42.630 align:start position:0% <00:21:41.000>You'll <00:21:41.107>be <00:21:41.215>unblocked <00:21:41.323>faster. <00:21:41.430>And <00:21:41.538>then, <00:21:41.646>by <00:21:41.753>doing <00:21:41.861>this, <00:21:41.969>you'll <00:21:42.076>help <00:21:42.184>us <00:21:42.292>to <00:21:42.400>maintain 00:21:42.630 --> 00:21:42.640 align:start position:0% <00:21:42.630>doing <00:21:42.631>this, <00:21:42.633>you'll <00:21:42.634>help <00:21:42.636>us <00:21:42.637>to <00:21:42.639>maintain 00:21:42.640 --> 00:21:45.790 align:start position:0% <00:21:42.640>doing <00:21:42.756>this, <00:21:42.873>you'll <00:21:42.990>help <00:21:43.106>us <00:21:43.223>to <00:21:43.340>maintain <00:21:43.456>that <00:21:43.573>culture <00:21:43.690>of <00:21:43.806>safe <00:21:43.923>shipping, <00:21:44.040>right? 00:21:45.790 --> 00:21:45.800 align:start position:0% <00:21:45.790>that <00:21:45.791>culture <00:21:45.793>of <00:21:45.795>safe <00:21:45.797>shipping, <00:21:45.799>right? 00:21:45.800 --> 00:21:48.030 align:start position:0% <00:21:45.800>that <00:21:45.907>culture <00:21:46.015>of <00:21:46.123>safe <00:21:46.230>shipping, <00:21:46.338>right? <00:21:46.446>Okay, <00:21:46.553>so <00:21:46.661>time <00:21:46.769>time <00:21:46.876>for <00:21:46.984>the <00:21:47.092>live <00:21:47.200>demo, 00:21:48.030 --> 00:21:48.040 align:start position:0% <00:21:48.030>Okay, <00:21:48.031>so <00:21:48.032>time <00:21:48.033>time <00:21:48.035>for <00:21:48.036>the <00:21:48.037>live <00:21:48.039>demo, 00:21:48.040 --> 00:21:49.270 align:start position:0% <00:21:48.040>Okay, <00:21:48.113>so <00:21:48.187>time <00:21:48.261>time <00:21:48.335>for <00:21:48.408>the <00:21:48.482>live <00:21:48.556>demo, <00:21:48.630>but <00:21:48.704>I <00:21:48.778>forgot <00:21:48.851>to <00:21:48.925>click <00:21:48.999>one <00:21:49.073>thing, <00:21:49.147>I 00:21:49.270 --> 00:21:49.280 align:start position:0% <00:21:49.270>but <00:21:49.271>I <00:21:49.272>forgot <00:21:49.273>to <00:21:49.275>click <00:21:49.276>one <00:21:49.277>thing, <00:21:49.279>I 00:21:49.280 --> 00:21:51.630 align:start position:0% <00:21:49.280>but <00:21:49.373>I <00:21:49.466>forgot <00:21:49.560>to <00:21:49.653>click <00:21:49.746>one <00:21:49.840>thing, <00:21:49.933>I <00:21:50.026>think. <00:21:50.120>Let's <00:21:50.213>see. <00:21:50.306>Let's <00:21:50.399>see <00:21:50.493>what <00:21:50.586>did <00:21:50.680>the 00:21:51.630 --> 00:21:51.640 align:start position:0% <00:21:51.630>think. <00:21:51.631>Let's <00:21:51.632>see. <00:21:51.633>Let's <00:21:51.635>see <00:21:51.636>what <00:21:51.637>did <00:21:51.639>the 00:21:51.640 --> 00:21:53.790 align:start position:0% <00:21:51.640>think. <00:21:51.767>Let's <00:21:51.894>see. <00:21:52.021>Let's <00:21:52.149>see <00:21:52.276>what <00:21:52.403>did <00:21:52.530>the <00:21:52.658>bot <00:21:52.785>show <00:21:52.912>us. <00:21:53.040>Okay. 00:21:53.790 --> 00:21:53.800 align:start position:0% <00:21:53.790>bot <00:21:53.793>show <00:21:53.796>us. <00:21:53.799>Okay. 00:21:53.800 --> 00:21:54.910 align:start position:0% <00:21:53.800>bot <00:21:54.049>show <00:21:54.299>us. <00:21:54.549>Okay. <00:21:54.799>So, 00:21:54.910 --> 00:21:54.920 align:start position:0% So, 00:21:54.920 --> 00:21:56.710 align:start position:0% <00:21:54.920>So, <00:21:55.060>I <00:21:55.200>was <00:21:55.340>I <00:21:55.480>was <00:21:55.620>planning <00:21:55.760>to <00:21:55.900>ask <00:21:56.040>Lot <00:21:56.180>to <00:21:56.320>fix 00:21:56.710 --> 00:21:56.720 align:start position:0% <00:21:56.710>I <00:21:56.711>was <00:21:56.712>I <00:21:56.713>was <00:21:56.714>planning <00:21:56.715>to <00:21:56.716>ask <00:21:56.717>Lot <00:21:56.718>to <00:21:56.719>fix 00:21:56.720 --> 00:21:58.270 align:start position:0% <00:21:56.720>I <00:21:56.797>was <00:21:56.875>I <00:21:56.952>was <00:21:57.030>planning <00:21:57.107>to <00:21:57.185>ask <00:21:57.262>Lot <00:21:57.340>to <00:21:57.417>fix <00:21:57.495>it, <00:21:57.572>but <00:21:57.650>I <00:21:57.727>forgot. <00:21:57.805>But <00:21:57.882>luckily, <00:21:57.960>I <00:21:58.037>have <00:21:58.115>a 00:21:58.270 --> 00:21:58.280 align:start position:0% <00:21:58.270>it, <00:21:58.271>but <00:21:58.272>I <00:21:58.273>forgot. <00:21:58.274>But <00:21:58.275>luckily, <00:21:58.276>I <00:21:58.277>have <00:21:58.279>a 00:21:58.280 --> 00:22:00.670 align:start position:0% <00:21:58.280>it, <00:21:58.367>but <00:21:58.455>I <00:21:58.542>forgot. <00:21:58.629>But <00:21:58.717>luckily, <00:21:58.805>I <00:21:58.892>have <00:21:58.980>a <00:21:59.067>backup. <00:21:59.155>So, <00:21:59.242>this <00:21:59.330>this <00:21:59.417>this <00:21:59.504>is <00:21:59.592>an <00:21:59.680>actual 00:22:00.670 --> 00:22:00.680 align:start position:0% <00:22:00.670>backup. <00:22:00.671>So, <00:22:00.672>this <00:22:00.673>this <00:22:00.675>this <00:22:00.676>is <00:22:00.677>an <00:22:00.679>actual 00:22:00.680 --> 00:22:02.270 align:start position:0% <00:22:00.680>backup. <00:22:00.780>So, <00:22:00.880>this <00:22:00.980>this <00:22:01.080>this <00:22:01.180>is <00:22:01.280>an <00:22:01.380>actual <00:22:01.480>approval. <00:22:01.580>So, <00:22:01.680>finally, <00:22:01.780>we <00:22:01.880>fixed <00:22:01.980>all <00:22:02.080>the 00:22:02.270 --> 00:22:02.280 align:start position:0% <00:22:02.270>approval. <00:22:02.271>So, <00:22:02.273>finally, <00:22:02.274>we <00:22:02.276>fixed <00:22:02.277>all <00:22:02.279>the 00:22:02.280 --> 00:22:04.150 align:start position:0% <00:22:02.280>approval. <00:22:02.387>So, <00:22:02.495>finally, <00:22:02.603>we <00:22:02.710>fixed <00:22:02.818>all <00:22:02.926>the <00:22:03.033>issues <00:22:03.141>in <00:22:03.249>that <00:22:03.356>PR. <00:22:03.464>The <00:22:03.572>problem <00:22:03.680>statement 00:22:04.150 --> 00:22:04.160 align:start position:0% <00:22:04.150>issues <00:22:04.151>in <00:22:04.153>that <00:22:04.154>PR. <00:22:04.156>The <00:22:04.157>problem <00:22:04.159>statement 00:22:04.160 --> 00:22:06.230 align:start position:0% <00:22:04.160>issues <00:22:04.260>in <00:22:04.360>that <00:22:04.460>PR. <00:22:04.560>The <00:22:04.660>problem <00:22:04.760>statement <00:22:04.860>is <00:22:04.960>on <00:22:05.060>point. <00:22:05.160>It's <00:22:05.260>aligned <00:22:05.360>with <00:22:05.460>the <00:22:05.560>diff. 00:22:06.230 --> 00:22:06.240 align:start position:0% <00:22:06.230>is <00:22:06.231>on <00:22:06.232>point. <00:22:06.233>It's <00:22:06.235>aligned <00:22:06.236>with <00:22:06.237>the <00:22:06.239>diff. 00:22:06.240 --> 00:22:07.670 align:start position:0% <00:22:06.240>is <00:22:06.331>on <00:22:06.423>point. <00:22:06.515>It's <00:22:06.607>aligned <00:22:06.699>with <00:22:06.791>the <00:22:06.883>diff. <00:22:06.975>Correctness <00:22:07.067>is <00:22:07.159>there. <00:22:07.251>All <00:22:07.343>the <00:22:07.435>bugs <00:22:07.527>are 00:22:07.670 --> 00:22:07.680 align:start position:0% <00:22:07.670>Correctness <00:22:07.671>is <00:22:07.673>there. <00:22:07.674>All <00:22:07.676>the <00:22:07.677>bugs <00:22:07.679>are 00:22:07.680 --> 00:22:10.310 align:start position:0% <00:22:07.680>Correctness <00:22:07.780>is <00:22:07.880>there. <00:22:07.980>All <00:22:08.080>the <00:22:08.180>bugs <00:22:08.280>are <00:22:08.380>fixed, <00:22:08.480>and <00:22:08.580>safety <00:22:08.680>is <00:22:08.780>okay, <00:22:08.880>and <00:22:08.980>PR <00:22:09.080>is 00:22:10.310 --> 00:22:10.320 align:start position:0% <00:22:10.310>fixed, <00:22:10.311>and <00:22:10.312>safety <00:22:10.313>is <00:22:10.315>okay, <00:22:10.316>and <00:22:10.317>PR <00:22:10.319>is 00:22:10.320 --> 00:22:12.230 align:start position:0% <00:22:10.320>fixed, <00:22:10.413>and <00:22:10.506>safety <00:22:10.600>is <00:22:10.693>okay, <00:22:10.786>and <00:22:10.879>PR <00:22:10.973>is <00:22:11.066>below <00:22:11.159>the <00:22:11.253>lock <00:22:11.346>limit <00:22:11.439>line. <00:22:11.533>Great. <00:22:11.626>So, <00:22:11.720>we 00:22:12.230 --> 00:22:12.240 align:start position:0% <00:22:12.230>below <00:22:12.231>the <00:22:12.232>lock <00:22:12.233>limit <00:22:12.235>line. <00:22:12.236>Great. <00:22:12.237>So, <00:22:12.239>we 00:22:12.240 --> 00:22:14.790 align:start position:0% <00:22:12.240>below <00:22:12.380>the <00:22:12.520>lock <00:22:12.660>limit <00:22:12.800>line. <00:22:12.940>Great. <00:22:13.080>So, <00:22:13.220>we <00:22:13.360>get <00:22:13.500>an <00:22:13.640>approval. 00:22:14.790 --> 00:22:14.800 align:start position:0% <00:22:14.790>get <00:22:14.794>an <00:22:14.799>approval. 00:22:14.800 --> 00:22:19.070 align:start position:0% <00:22:14.800>get <00:22:14.975>an <00:22:15.149>approval. <00:22:15.325>And <00:22:15.500>getting <00:22:15.675>back <00:22:15.850>to <00:22:16.024>the <00:22:16.200>slides. 00:22:19.080 --> 00:22:21.030 align:start position:0% Oops. 00:22:21.030 --> 00:22:21.040 align:start position:0% Oops. 00:22:21.040 --> 00:22:23.270 align:start position:0% <00:22:21.040>Oops. <00:22:21.215>So, <00:22:21.389>now <00:22:21.565>that <00:22:21.740>we <00:22:21.915>surfaced <00:22:22.090>the <00:22:22.264>main <00:22:22.440>crux 00:22:23.270 --> 00:22:23.280 align:start position:0% <00:22:23.270>So, <00:22:23.271>now <00:22:23.272>that <00:22:23.273>we <00:22:23.275>surfaced <00:22:23.276>the <00:22:23.277>main <00:22:23.279>crux 00:22:23.280 --> 00:22:24.910 align:start position:0% <00:22:23.280>So, <00:22:23.373>now <00:22:23.466>that <00:22:23.560>we <00:22:23.653>surfaced <00:22:23.746>the <00:22:23.840>main <00:22:23.933>crux <00:22:24.026>of <00:22:24.120>this <00:22:24.213>whole <00:22:24.306>thing, <00:22:24.399>we <00:22:24.493>are <00:22:24.586>dealing <00:22:24.680>with 00:22:24.910 --> 00:22:24.920 align:start position:0% <00:22:24.910>of <00:22:24.911>this <00:22:24.912>whole <00:22:24.913>thing, <00:22:24.915>we <00:22:24.916>are <00:22:24.917>dealing <00:22:24.919>with 00:22:24.920 --> 00:22:27.070 align:start position:0% <00:22:24.920>of <00:22:25.027>this <00:22:25.135>whole <00:22:25.243>thing, <00:22:25.350>we <00:22:25.458>are <00:22:25.566>dealing <00:22:25.673>with <00:22:25.781>a <00:22:25.889>sociotechnical <00:22:25.996>system. <00:22:26.104>In <00:22:26.212>any <00:22:26.320>complex 00:22:27.070 --> 00:22:27.080 align:start position:0% <00:22:27.070>a <00:22:27.071>sociotechnical <00:22:27.073>system. <00:22:27.075>In <00:22:27.077>any <00:22:27.079>complex 00:22:27.080 --> 00:22:28.710 align:start position:0% <00:22:27.080>a <00:22:27.220>sociotechnical <00:22:27.360>system. <00:22:27.500>In <00:22:27.639>any <00:22:27.780>complex <00:22:27.919>system, <00:22:28.060>you'll <00:22:28.199>get <00:22:28.340>the <00:22:28.480>first-order 00:22:28.710 --> 00:22:28.720 align:start position:0% <00:22:28.710>system, <00:22:28.712>you'll <00:22:28.714>get <00:22:28.716>the <00:22:28.719>first-order 00:22:28.720 --> 00:22:30.070 align:start position:0% <00:22:28.720>system, <00:22:28.841>you'll <00:22:28.963>get <00:22:29.084>the <00:22:29.206>first-order <00:22:29.327>effects. <00:22:29.449>Those <00:22:29.570>are <00:22:29.692>the <00:22:29.813>effects <00:22:29.935>that 00:22:30.070 --> 00:22:30.080 align:start position:0% <00:22:30.070>effects. <00:22:30.071>Those <00:22:30.073>are <00:22:30.075>the <00:22:30.077>effects <00:22:30.079>that 00:22:30.080 --> 00:22:31.590 align:start position:0% <00:22:30.080>effects. <00:22:30.184>Those <00:22:30.289>are <00:22:30.393>the <00:22:30.498>effects <00:22:30.602>that <00:22:30.707>you're <00:22:30.811>hoping <00:22:30.916>for. <00:22:31.020>So, <00:22:31.125>when <00:22:31.229>you <00:22:31.334>roll <00:22:31.438>out 00:22:31.590 --> 00:22:31.600 align:start position:0% <00:22:31.590>you're <00:22:31.591>hoping <00:22:31.592>for. <00:22:31.593>So, <00:22:31.595>when <00:22:31.596>you <00:22:31.597>roll <00:22:31.599>out 00:22:31.600 --> 00:22:33.070 align:start position:0% <00:22:31.600>you're <00:22:31.694>hoping <00:22:31.789>for. <00:22:31.883>So, <00:22:31.977>when <00:22:32.072>you <00:22:32.167>roll <00:22:32.261>out <00:22:32.356>that <00:22:32.450>AI <00:22:32.544>agent, <00:22:32.639>whatever <00:22:32.734>that <00:22:32.828>is, <00:22:32.923>you 00:22:33.070 --> 00:22:33.080 align:start position:0% <00:22:33.070>that <00:22:33.071>AI <00:22:33.072>agent, <00:22:33.074>whatever <00:22:33.076>that <00:22:33.077>is, <00:22:33.079>you 00:22:33.080 --> 00:22:34.390 align:start position:0% <00:22:33.080>that <00:22:33.170>AI <00:22:33.261>agent, <00:22:33.352>whatever <00:22:33.442>that <00:22:33.533>is, <00:22:33.624>you <00:22:33.714>pick <00:22:33.805>something <00:22:33.896>off <00:22:33.986>the <00:22:34.077>shelf, <00:22:34.168>you <00:22:34.259>build 00:22:34.390 --> 00:22:34.400 align:start position:0% <00:22:34.390>pick <00:22:34.391>something <00:22:34.393>off <00:22:34.394>the <00:22:34.396>shelf, <00:22:34.397>you <00:22:34.399>build 00:22:34.400 --> 00:22:35.950 align:start position:0% <00:22:34.400>pick <00:22:34.574>something <00:22:34.748>off <00:22:34.923>the <00:22:35.097>shelf, <00:22:35.271>you <00:22:35.446>build <00:22:35.620>something <00:22:35.795>yourself. 00:22:35.950 --> 00:22:35.960 align:start position:0% <00:22:35.950>something <00:22:35.959>yourself. 00:22:35.960 --> 00:22:37.430 align:start position:0% <00:22:35.960>something <00:22:36.149>yourself. <00:22:36.338>You're <00:22:36.527>hoping <00:22:36.716>for <00:22:36.905>something <00:22:37.094>to <00:22:37.283>happen, 00:22:37.430 --> 00:22:37.440 align:start position:0% <00:22:37.430>You're <00:22:37.431>hoping <00:22:37.433>for <00:22:37.435>something <00:22:37.437>to <00:22:37.439>happen, 00:22:37.440 --> 00:22:38.470 align:start position:0% <00:22:37.440>You're <00:22:37.594>hoping <00:22:37.749>for <00:22:37.903>something <00:22:38.058>to <00:22:38.212>happen, <00:22:38.367>right? 00:22:38.470 --> 00:22:38.480 align:start position:0% right? 00:22:38.480 --> 00:22:40.110 align:start position:0% <00:22:38.480>right? <00:22:38.655>So, <00:22:38.830>now <00:22:39.005>the <00:22:39.180>big <00:22:39.355>reveal. <00:22:39.530>You <00:22:39.705>ready? <00:22:39.880>Drum 00:22:40.110 --> 00:22:40.120 align:start position:0% <00:22:40.110>So, <00:22:40.111>now <00:22:40.112>the <00:22:40.113>big <00:22:40.115>reveal. <00:22:40.116>You <00:22:40.117>ready? <00:22:40.119>Drum 00:22:40.120 --> 00:22:41.350 align:start position:0% <00:22:40.120>So, <00:22:40.258>now <00:22:40.396>the <00:22:40.535>big <00:22:40.673>reveal. <00:22:40.811>You <00:22:40.950>ready? <00:22:41.088>Drum <00:22:41.226>roll. 00:22:41.350 --> 00:22:41.360 align:start position:0% roll. 00:22:41.360 --> 00:22:43.270 align:start position:0% <00:22:41.360>roll. <00:22:41.534>Auto <00:22:41.709>approval <00:22:41.885>rates. <00:22:42.060>Did <00:22:42.235>we <00:22:42.409>get <00:22:42.584>to <00:22:42.760>50% 00:22:43.270 --> 00:22:43.280 align:start position:0% <00:22:43.270>Auto <00:22:43.271>approval <00:22:43.272>rates. <00:22:43.273>Did <00:22:43.275>we <00:22:43.276>get <00:22:43.277>to <00:22:43.279>50% 00:22:43.280 --> 00:22:45.750 align:start position:0% <00:22:43.280>Auto <00:22:43.387>approval <00:22:43.495>rates. <00:22:43.603>Did <00:22:43.710>we <00:22:43.818>get <00:22:43.926>to <00:22:44.033>50% <00:22:44.141>or <00:22:44.249>not? <00:22:44.356>What <00:22:44.464>do <00:22:44.572>you <00:22:44.680>think? 00:22:45.750 --> 00:22:45.760 align:start position:0% <00:22:45.750>or <00:22:45.751>not? <00:22:45.753>What <00:22:45.755>do <00:22:45.757>you <00:22:45.759>think? 00:22:45.760 --> 00:22:48.230 align:start position:0% <00:22:45.760>or <00:22:45.960>not? <00:22:46.160>What <00:22:46.360>do <00:22:46.560>you <00:22:46.760>think? <00:22:46.960>No? <00:22:47.160>No? 00:22:48.230 --> 00:22:48.240 align:start position:0% <00:22:48.230>No? <00:22:48.239>No? 00:22:48.240 --> 00:22:52.390 align:start position:0% <00:22:48.240>No? <00:22:48.415>No? <00:22:48.590>Okay, <00:22:48.765>we <00:22:48.940>did <00:22:49.115>get <00:22:49.290>to <00:22:49.465>50%. <00:22:49.640>Woohoo! 00:22:52.390 --> 00:22:52.400 align:start position:0% <00:22:52.390>Okay, <00:22:52.391>we <00:22:52.393>did <00:22:52.394>get <00:22:52.396>to <00:22:52.397>50%. <00:22:52.399>Woohoo! 00:22:52.400 --> 00:22:53.590 align:start position:0% <00:22:52.400>Okay, <00:22:52.553>we <00:22:52.706>did <00:22:52.859>get <00:22:53.012>to <00:22:53.165>50%. <00:22:53.318>Woohoo! <00:22:53.471>Great. 00:22:53.590 --> 00:22:53.600 align:start position:0% Great. 00:22:53.600 --> 00:22:56.230 align:start position:0% <00:22:53.600>Great. <00:22:53.755>Uh <00:22:53.911>then, <00:22:54.066>the <00:22:54.222>other <00:22:54.377>big <00:22:54.533>reveal. <00:22:54.688>Uh <00:22:54.844>if <00:22:55.000>you 00:22:56.230 --> 00:22:56.240 align:start position:0% <00:22:56.230>Uh <00:22:56.231>then, <00:22:56.232>the <00:22:56.233>other <00:22:56.234>big <00:22:56.235>reveal. <00:22:56.236>Uh <00:22:56.237>if <00:22:56.239>you 00:22:56.240 --> 00:22:58.430 align:start position:0% <00:22:56.240>Uh <00:22:56.327>then, <00:22:56.415>the <00:22:56.502>other <00:22:56.590>big <00:22:56.677>reveal. <00:22:56.765>Uh <00:22:56.852>if <00:22:56.940>you <00:22:57.027>were <00:22:57.115>um <00:22:57.202>if <00:22:57.290>you <00:22:57.377>were <00:22:57.465>paying <00:22:57.552>attention, <00:22:57.640>do 00:22:58.430 --> 00:22:58.440 align:start position:0% <00:22:58.430>were <00:22:58.431>um <00:22:58.432>if <00:22:58.433>you <00:22:58.435>were <00:22:58.436>paying <00:22:58.437>attention, <00:22:58.439>do 00:22:58.440 --> 00:23:00.790 align:start position:0% <00:22:58.440>were <00:22:58.527>um <00:22:58.615>if <00:22:58.702>you <00:22:58.790>were <00:22:58.877>paying <00:22:58.965>attention, <00:22:59.052>do <00:22:59.140>you <00:22:59.227>know <00:22:59.315>what <00:22:59.402>the <00:22:59.490>name <00:22:59.577>of <00:22:59.665>the <00:22:59.752>agent? <00:22:59.840>Can 00:23:00.790 --> 00:23:00.800 align:start position:0% <00:23:00.790>you <00:23:00.791>know <00:23:00.792>what <00:23:00.793>the <00:23:00.794>name <00:23:00.795>of <00:23:00.796>the <00:23:00.797>agent? <00:23:00.799>Can 00:23:00.800 --> 00:23:02.110 align:start position:0% <00:23:00.800>you <00:23:00.878>know <00:23:00.957>what <00:23:01.035>the <00:23:01.114>name <00:23:01.193>of <00:23:01.271>the <00:23:01.350>agent? <00:23:01.428>Can <00:23:01.507>someone <00:23:01.586>Yeah? <00:23:01.664>What's <00:23:01.743>the <00:23:01.821>name <00:23:01.900>of <00:23:01.978>the 00:23:02.110 --> 00:23:02.120 align:start position:0% <00:23:02.110>someone <00:23:02.111>Yeah? <00:23:02.112>What's <00:23:02.114>the <00:23:02.116>name <00:23:02.117>of <00:23:02.119>the 00:23:02.120 --> 00:23:04.390 align:start position:0% <00:23:02.120>someone <00:23:02.320>Yeah? <00:23:02.520>What's <00:23:02.719>the <00:23:02.919>name <00:23:03.120>of <00:23:03.320>the <00:23:03.520>agent? 00:23:04.390 --> 00:23:04.400 align:start position:0% agent? 00:23:04.400 --> 00:23:06.710 align:start position:0% <00:23:04.400>agent? <00:23:04.600>Bam, <00:23:04.800>it's <00:23:05.000>Shrek. <00:23:05.200>And <00:23:05.400>you <00:23:05.600>might <00:23:05.800>think, 00:23:06.710 --> 00:23:06.720 align:start position:0% <00:23:06.710>Bam, <00:23:06.711>it's <00:23:06.713>Shrek. <00:23:06.714>And <00:23:06.716>you <00:23:06.717>might <00:23:06.719>think, 00:23:06.720 --> 00:23:08.350 align:start position:0% <00:23:06.720>Bam, <00:23:06.827>it's <00:23:06.935>Shrek. <00:23:07.043>And <00:23:07.150>you <00:23:07.258>might <00:23:07.366>think, <00:23:07.473>"Oh <00:23:07.581>my <00:23:07.689>god, <00:23:07.796>it's <00:23:07.904>foolish. <00:23:08.012>Like, <00:23:08.120>they're 00:23:08.350 --> 00:23:08.360 align:start position:0% <00:23:08.350>"Oh <00:23:08.351>my <00:23:08.352>god, <00:23:08.354>it's <00:23:08.356>foolish. <00:23:08.357>Like, <00:23:08.359>they're 00:23:08.360 --> 00:23:09.790 align:start position:0% <00:23:08.360>"Oh <00:23:08.476>my <00:23:08.593>god, <00:23:08.711>it's <00:23:08.828>foolish. <00:23:08.945>Like, <00:23:09.062>they're <00:23:09.178>not <00:23:09.296>serious, <00:23:09.413>not <00:23:09.530>professional. <00:23:09.647>Like, 00:23:09.790 --> 00:23:09.800 align:start position:0% <00:23:09.790>not <00:23:09.792>serious, <00:23:09.794>not <00:23:09.796>professional. <00:23:09.799>Like, 00:23:09.800 --> 00:23:11.030 align:start position:0% <00:23:09.800>not <00:23:09.900>serious, <00:23:10.001>not <00:23:10.101>professional. <00:23:10.202>Like, <00:23:10.303>what <00:23:10.403>the <00:23:10.504>hell <00:23:10.605>is <00:23:10.705>this? <00:23:10.806>Shrek? <00:23:10.907>You're 00:23:11.030 --> 00:23:11.040 align:start position:0% <00:23:11.030>what <00:23:11.031>the <00:23:11.033>hell <00:23:11.034>is <00:23:11.036>this? <00:23:11.037>Shrek? <00:23:11.039>You're 00:23:11.040 --> 00:23:12.910 align:start position:0% <00:23:11.040>what <00:23:11.167>the <00:23:11.294>hell <00:23:11.421>is <00:23:11.549>this? <00:23:11.676>Shrek? <00:23:11.803>You're <00:23:11.930>kidding <00:23:12.058>me." <00:23:12.185>It's <00:23:12.312>actually <00:23:12.440>super 00:23:12.910 --> 00:23:12.920 align:start position:0% <00:23:12.910>kidding <00:23:12.912>me." <00:23:12.914>It's <00:23:12.916>actually <00:23:12.919>super 00:23:12.920 --> 00:23:14.830 align:start position:0% <00:23:12.920>kidding <00:23:13.060>me." <00:23:13.200>It's <00:23:13.340>actually <00:23:13.480>super <00:23:13.620>intentional. <00:23:13.760>We <00:23:13.900>are <00:23:14.040>dealing <00:23:14.180>with <00:23:14.320>a 00:23:14.830 --> 00:23:14.840 align:start position:0% <00:23:14.830>intentional. <00:23:14.831>We <00:23:14.833>are <00:23:14.835>dealing <00:23:14.837>with <00:23:14.839>a 00:23:14.840 --> 00:23:16.910 align:start position:0% <00:23:14.840>intentional. <00:23:14.967>We <00:23:15.094>are <00:23:15.221>dealing <00:23:15.349>with <00:23:15.476>a <00:23:15.603>socio-technical <00:23:15.730>system. <00:23:15.858>We <00:23:15.985>had <00:23:16.112>a <00:23:16.240>history 00:23:16.910 --> 00:23:16.920 align:start position:0% <00:23:16.910>socio-technical <00:23:16.911>system. <00:23:16.913>We <00:23:16.915>had <00:23:16.917>a <00:23:16.919>history 00:23:16.920 --> 00:23:20.110 align:start position:0% <00:23:16.920>socio-technical <00:23:17.047>system. <00:23:17.174>We <00:23:17.301>had <00:23:17.429>a <00:23:17.556>history <00:23:17.683>of <00:23:17.810>tons <00:23:17.938>of <00:23:18.065>low-quality <00:23:18.192>AI <00:23:18.320>automation. 00:23:20.110 --> 00:23:20.120 align:start position:0% <00:23:20.110>of <00:23:20.111>tons <00:23:20.113>of <00:23:20.115>low-quality <00:23:20.117>AI <00:23:20.119>automation. 00:23:20.120 --> 00:23:21.950 align:start position:0% <00:23:20.120>of <00:23:20.236>tons <00:23:20.353>of <00:23:20.469>low-quality <00:23:20.586>AI <00:23:20.703>automation. <00:23:20.820>All <00:23:20.936>of <00:23:21.053>those <00:23:21.169>comments <00:23:21.286>on <00:23:21.403>pull <00:23:21.520>requests, 00:23:21.950 --> 00:23:21.960 align:start position:0% <00:23:21.950>All <00:23:21.951>of <00:23:21.953>those <00:23:21.954>comments <00:23:21.956>on <00:23:21.957>pull <00:23:21.959>requests, 00:23:21.960 --> 00:23:23.870 align:start position:0% <00:23:21.960>All <00:23:22.076>of <00:23:22.193>those <00:23:22.310>comments <00:23:22.426>on <00:23:22.543>pull <00:23:22.660>requests, <00:23:22.776>it <00:23:22.893>creates <00:23:23.010>fatigue. <00:23:23.126>Folks <00:23:23.243>are <00:23:23.360>getting 00:23:23.870 --> 00:23:23.880 align:start position:0% <00:23:23.870>it <00:23:23.871>creates <00:23:23.873>fatigue. <00:23:23.875>Folks <00:23:23.877>are <00:23:23.879>getting 00:23:23.880 --> 00:23:25.870 align:start position:0% <00:23:23.880>it <00:23:23.996>creates <00:23:24.113>fatigue. <00:23:24.230>Folks <00:23:24.346>are <00:23:24.463>getting <00:23:24.580>tired. <00:23:24.696>Like, <00:23:24.813>they <00:23:24.930>they <00:23:25.046>have <00:23:25.163>bias <00:23:25.280>now. 00:23:25.870 --> 00:23:25.880 align:start position:0% <00:23:25.870>tired. <00:23:25.871>Like, <00:23:25.873>they <00:23:25.874>they <00:23:25.876>have <00:23:25.877>bias <00:23:25.879>now. 00:23:25.880 --> 00:23:27.790 align:start position:0% <00:23:25.880>tired. <00:23:25.996>Like, <00:23:26.113>they <00:23:26.230>they <00:23:26.346>have <00:23:26.463>bias <00:23:26.580>now. <00:23:26.696>Whenever <00:23:26.813>they <00:23:26.930>see <00:23:27.046>some <00:23:27.163>AI <00:23:27.280>automation, 00:23:27.790 --> 00:23:27.800 align:start position:0% <00:23:27.790>Whenever <00:23:27.791>they <00:23:27.793>see <00:23:27.795>some <00:23:27.797>AI <00:23:27.799>automation, 00:23:27.800 --> 00:23:29.110 align:start position:0% <00:23:27.800>Whenever <00:23:27.917>they <00:23:28.035>see <00:23:28.153>some <00:23:28.271>AI <00:23:28.389>automation, <00:23:28.507>they <00:23:28.625>automatically <00:23:28.743>assume <00:23:28.861>it's <00:23:28.978>probably 00:23:29.110 --> 00:23:29.120 align:start position:0% <00:23:29.110>they <00:23:29.112>automatically <00:23:29.114>assume <00:23:29.116>it's <00:23:29.119>probably 00:23:29.120 --> 00:23:30.430 align:start position:0% <00:23:29.120>they <00:23:29.218>automatically <00:23:29.316>assume <00:23:29.414>it's <00:23:29.513>probably <00:23:29.611>a <00:23:29.709>low <00:23:29.807>quality. <00:23:29.906>So, <00:23:30.004>we <00:23:30.102>have <00:23:30.200>to <00:23:30.299>cut 00:23:30.430 --> 00:23:30.440 align:start position:0% <00:23:30.430>a <00:23:30.431>low <00:23:30.432>quality. <00:23:30.433>So, <00:23:30.435>we <00:23:30.436>have <00:23:30.437>to <00:23:30.439>cut 00:23:30.440 --> 00:23:31.630 align:start position:0% <00:23:30.440>a <00:23:30.516>low <00:23:30.593>quality. <00:23:30.669>So, <00:23:30.746>we <00:23:30.822>have <00:23:30.899>to <00:23:30.975>cut <00:23:31.052>through <00:23:31.128>the <00:23:31.205>noise. <00:23:31.281>We <00:23:31.358>have <00:23:31.434>to <00:23:31.511>create 00:23:31.630 --> 00:23:31.640 align:start position:0% <00:23:31.630>through <00:23:31.631>the <00:23:31.633>noise. <00:23:31.634>We <00:23:31.636>have <00:23:31.637>to <00:23:31.639>create 00:23:31.640 --> 00:23:33.590 align:start position:0% <00:23:31.640>through <00:23:31.756>the <00:23:31.873>noise. <00:23:31.990>We <00:23:32.106>have <00:23:32.223>to <00:23:32.340>create <00:23:32.456>something <00:23:32.573>that <00:23:32.690>is <00:23:32.806>eye-catchy, <00:23:32.923>that <00:23:33.040>pops, 00:23:33.590 --> 00:23:33.600 align:start position:0% <00:23:33.590>something <00:23:33.591>that <00:23:33.593>is <00:23:33.595>eye-catchy, <00:23:33.597>that <00:23:33.599>pops, 00:23:33.600 --> 00:23:35.110 align:start position:0% <00:23:33.600>something <00:23:33.704>that <00:23:33.809>is <00:23:33.913>eye-catchy, <00:23:34.018>that <00:23:34.122>pops, <00:23:34.227>that <00:23:34.331>you <00:23:34.436>remember. <00:23:34.540>You <00:23:34.645>treat <00:23:34.749>it <00:23:34.854>as <00:23:34.958>a 00:23:35.110 --> 00:23:35.120 align:start position:0% <00:23:35.110>that <00:23:35.111>you <00:23:35.112>remember. <00:23:35.113>You <00:23:35.115>treat <00:23:35.116>it <00:23:35.117>as <00:23:35.119>a 00:23:35.120 --> 00:23:37.510 align:start position:0% <00:23:35.120>that <00:23:35.227>you <00:23:35.335>remember. <00:23:35.443>You <00:23:35.550>treat <00:23:35.658>it <00:23:35.766>as <00:23:35.873>a <00:23:35.981>real-life <00:23:36.089>character. <00:23:36.196>So, <00:23:36.304>that's <00:23:36.412>why <00:23:36.520>we 00:23:37.510 --> 00:23:37.520 align:start position:0% <00:23:37.510>real-life <00:23:37.511>character. <00:23:37.513>So, <00:23:37.515>that's <00:23:37.517>why <00:23:37.519>we 00:23:37.520 --> 00:23:39.630 align:start position:0% <00:23:37.520>real-life <00:23:37.636>character. <00:23:37.753>So, <00:23:37.870>that's <00:23:37.986>why <00:23:38.103>we <00:23:38.220>named <00:23:38.336>him <00:23:38.453>Shrek, <00:23:38.570>right? <00:23:38.686>And <00:23:38.803>it <00:23:38.920>worked 00:23:39.630 --> 00:23:39.640 align:start position:0% <00:23:39.630>named <00:23:39.631>him <00:23:39.633>Shrek, <00:23:39.634>right? <00:23:39.636>And <00:23:39.637>it <00:23:39.639>worked 00:23:39.640 --> 00:23:41.550 align:start position:0% <00:23:39.640>named <00:23:39.756>him <00:23:39.873>Shrek, <00:23:39.990>right? <00:23:40.106>And <00:23:40.223>it <00:23:40.340>worked <00:23:40.456>because <00:23:40.573>folks <00:23:40.690>now <00:23:40.806>talking <00:23:40.923>about <00:23:41.040>him, 00:23:41.550 --> 00:23:41.560 align:start position:0% <00:23:41.550>because <00:23:41.551>folks <00:23:41.553>now <00:23:41.555>talking <00:23:41.557>about <00:23:41.559>him, 00:23:41.560 --> 00:23:43.590 align:start position:0% <00:23:41.560>because <00:23:41.676>folks <00:23:41.793>now <00:23:41.909>talking <00:23:42.026>about <00:23:42.143>him, <00:23:42.260>right? <00:23:42.376>It's <00:23:42.493>a <00:23:42.610>living <00:23:42.726>creature. <00:23:42.843>They <00:23:42.960>make 00:23:43.590 --> 00:23:43.600 align:start position:0% <00:23:43.590>right? <00:23:43.591>It's <00:23:43.592>a <00:23:43.594>living <00:23:43.596>creature. <00:23:43.597>They <00:23:43.599>make 00:23:43.600 --> 00:23:46.070 align:start position:0% <00:23:43.600>right? <00:23:43.707>It's <00:23:43.815>a <00:23:43.923>living <00:23:44.030>creature. <00:23:44.138>They <00:23:44.246>make <00:23:44.353>jokes <00:23:44.461>about <00:23:44.569>him. <00:23:44.676>They <00:23:44.784>like <00:23:44.892>They <00:23:45.000>They 00:23:46.070 --> 00:23:46.080 align:start position:0% <00:23:46.070>jokes <00:23:46.071>about <00:23:46.072>him. <00:23:46.074>They <00:23:46.076>like <00:23:46.077>They <00:23:46.079>They 00:23:46.080 --> 00:23:47.830 align:start position:0% <00:23:46.080>jokes <00:23:46.196>about <00:23:46.313>him. <00:23:46.429>They <00:23:46.546>like <00:23:46.663>They <00:23:46.780>They <00:23:46.896>recognize <00:23:47.013>the <00:23:47.129>personality. <00:23:47.246>It <00:23:47.363>has <00:23:47.480>some 00:23:47.830 --> 00:23:47.840 align:start position:0% <00:23:47.830>recognize <00:23:47.831>the <00:23:47.833>personality. <00:23:47.835>It <00:23:47.837>has <00:23:47.839>some 00:23:47.840 --> 00:23:50.390 align:start position:0% <00:23:47.840>recognize <00:23:47.956>the <00:23:48.073>personality. <00:23:48.189>It <00:23:48.306>has <00:23:48.423>some <00:23:48.540>traits. <00:23:48.656>They <00:23:48.773>talk <00:23:48.889>about <00:23:49.006>Shrek <00:23:49.123>on <00:23:49.240>Slack. 00:23:50.390 --> 00:23:50.400 align:start position:0% <00:23:50.390>traits. <00:23:50.391>They <00:23:50.393>talk <00:23:50.394>about <00:23:50.396>Shrek <00:23:50.397>on <00:23:50.399>Slack. 00:23:50.400 --> 00:23:52.230 align:start position:0% <00:23:50.400>traits. <00:23:50.500>They <00:23:50.600>talk <00:23:50.700>about <00:23:50.800>Shrek <00:23:50.900>on <00:23:51.000>Slack. <00:23:51.100>Great. <00:23:51.200>So, <00:23:51.300>we <00:23:51.400>we <00:23:51.500>we <00:23:51.600>hit <00:23:51.700>that <00:23:51.800>first-order 00:23:52.230 --> 00:23:52.240 align:start position:0% <00:23:52.230>Great. <00:23:52.231>So, <00:23:52.232>we <00:23:52.233>we <00:23:52.235>we <00:23:52.236>hit <00:23:52.237>that <00:23:52.239>first-order 00:23:52.240 --> 00:23:53.510 align:start position:0% <00:23:52.240>Great. <00:23:52.327>So, <00:23:52.415>we <00:23:52.503>we <00:23:52.591>we <00:23:52.679>hit <00:23:52.767>that <00:23:52.855>first-order <00:23:52.943>effect <00:23:53.031>because <00:23:53.119>they <00:23:53.207>pay <00:23:53.295>attention. <00:23:53.383>We 00:23:53.510 --> 00:23:53.520 align:start position:0% <00:23:53.510>effect <00:23:53.511>because <00:23:53.513>they <00:23:53.515>pay <00:23:53.517>attention. <00:23:53.519>We 00:23:53.520 --> 00:23:55.910 align:start position:0% <00:23:53.520>effect <00:23:53.675>because <00:23:53.831>they <00:23:53.986>pay <00:23:54.142>attention. <00:23:54.297>We <00:23:54.453>cut <00:23:54.608>through <00:23:54.764>the <00:23:54.920>noise. 00:23:55.910 --> 00:23:55.920 align:start position:0% <00:23:55.910>cut <00:23:55.913>through <00:23:55.916>the <00:23:55.919>noise. 00:23:55.920 --> 00:23:57.830 align:start position:0% <00:23:55.920>cut <00:23:56.047>through <00:23:56.174>the <00:23:56.301>noise. <00:23:56.429>Um <00:23:56.556>not <00:23:56.683>only <00:23:56.810>we <00:23:56.938>cut <00:23:57.065>through <00:23:57.192>the <00:23:57.320>noise, 00:23:57.830 --> 00:23:57.840 align:start position:0% <00:23:57.830>Um <00:23:57.831>not <00:23:57.832>only <00:23:57.833>we <00:23:57.835>cut <00:23:57.836>through <00:23:57.837>the <00:23:57.839>noise, 00:23:57.840 --> 00:24:00.150 align:start position:0% <00:23:57.840>Um <00:23:57.933>not <00:23:58.026>only <00:23:58.120>we <00:23:58.213>cut <00:23:58.306>through <00:23:58.399>the <00:23:58.493>noise, <00:23:58.586>but <00:23:58.679>not <00:23:58.773>only <00:23:58.866>they <00:23:58.959>talk <00:23:59.053>about <00:23:59.146>it <00:23:59.240>They 00:24:00.150 --> 00:24:00.160 align:start position:0% <00:24:00.150>but <00:24:00.151>not <00:24:00.152>only <00:24:00.153>they <00:24:00.155>talk <00:24:00.156>about <00:24:00.157>it <00:24:00.159>They 00:24:00.160 --> 00:24:02.510 align:start position:0% <00:24:00.160>but <00:24:00.260>not <00:24:00.360>only <00:24:00.460>they <00:24:00.560>talk <00:24:00.660>about <00:24:00.760>it <00:24:00.860>They <00:24:00.960>They <00:24:01.060>started <00:24:01.160>to <00:24:01.260>building <00:24:01.360>skills <00:24:01.460>to <00:24:01.560>help 00:24:02.510 --> 00:24:02.520 align:start position:0% <00:24:02.510>They <00:24:02.511>started <00:24:02.513>to <00:24:02.514>building <00:24:02.516>skills <00:24:02.517>to <00:24:02.519>help 00:24:02.520 --> 00:24:04.190 align:start position:0% <00:24:02.520>They <00:24:02.627>started <00:24:02.735>to <00:24:02.843>building <00:24:02.950>skills <00:24:03.058>to <00:24:03.166>help <00:24:03.273>them <00:24:03.381>to <00:24:03.489>interact <00:24:03.596>with <00:24:03.704>Shrek. <00:24:03.812>So, <00:24:03.920>our 00:24:04.190 --> 00:24:04.200 align:start position:0% <00:24:04.190>them <00:24:04.191>to <00:24:04.193>interact <00:24:04.194>with <00:24:04.196>Shrek. <00:24:04.197>So, <00:24:04.199>our 00:24:04.200 --> 00:24:06.070 align:start position:0% <00:24:04.200>them <00:24:04.316>to <00:24:04.433>interact <00:24:04.550>with <00:24:04.666>Shrek. <00:24:04.783>So, <00:24:04.900>our <00:24:05.016>cloud <00:24:05.133>marketplace, <00:24:05.250>with <00:24:05.366>all <00:24:05.483>the <00:24:05.600>skills 00:24:06.070 --> 00:24:06.080 align:start position:0% <00:24:06.070>cloud <00:24:06.071>marketplace, <00:24:06.073>with <00:24:06.075>all <00:24:06.077>the <00:24:06.079>skills 00:24:06.080 --> 00:24:07.070 align:start position:0% <00:24:06.080>cloud <00:24:06.154>marketplace, <00:24:06.228>with <00:24:06.302>all <00:24:06.377>the <00:24:06.451>skills <00:24:06.525>that <00:24:06.599>we <00:24:06.674>have <00:24:06.748>and <00:24:06.822>share <00:24:06.896>across <00:24:06.971>the 00:24:07.070 --> 00:24:07.080 align:start position:0% <00:24:07.070>that <00:24:07.071>we <00:24:07.072>have <00:24:07.074>and <00:24:07.076>share <00:24:07.077>across <00:24:07.079>the 00:24:07.080 --> 00:24:09.070 align:start position:0% <00:24:07.080>that <00:24:07.196>we <00:24:07.313>have <00:24:07.429>and <00:24:07.546>share <00:24:07.663>across <00:24:07.780>the <00:24:07.896>company, <00:24:08.013>there's <00:24:08.129>this <00:24:08.246>chart <00:24:08.363>that <00:24:08.480>shows 00:24:09.070 --> 00:24:09.080 align:start position:0% <00:24:09.070>company, <00:24:09.071>there's <00:24:09.073>this <00:24:09.075>chart <00:24:09.077>that <00:24:09.079>shows 00:24:09.080 --> 00:24:11.270 align:start position:0% <00:24:09.080>company, <00:24:09.187>there's <00:24:09.295>this <00:24:09.403>chart <00:24:09.510>that <00:24:09.618>shows <00:24:09.726>the <00:24:09.833>number <00:24:09.941>of <00:24:10.049>mentions <00:24:10.156>of <00:24:10.264>Shrek <00:24:10.372>in <00:24:10.480>that 00:24:11.270 --> 00:24:11.280 align:start position:0% <00:24:11.270>the <00:24:11.271>number <00:24:11.272>of <00:24:11.273>mentions <00:24:11.275>of <00:24:11.276>Shrek <00:24:11.277>in <00:24:11.279>that 00:24:11.280 --> 00:24:12.950 align:start position:0% <00:24:11.280>the <00:24:11.396>number <00:24:11.513>of <00:24:11.629>mentions <00:24:11.746>of <00:24:11.863>Shrek <00:24:11.980>in <00:24:12.096>that <00:24:12.213>marketplace. <00:24:12.330>That <00:24:12.446>they <00:24:12.563>started <00:24:12.680>building 00:24:12.950 --> 00:24:12.960 align:start position:0% <00:24:12.950>marketplace. <00:24:12.952>That <00:24:12.954>they <00:24:12.956>started <00:24:12.959>building 00:24:12.960 --> 00:24:15.310 align:start position:0% <00:24:12.960>marketplace. <00:24:13.087>That <00:24:13.214>they <00:24:13.341>started <00:24:13.469>building <00:24:13.596>skills. <00:24:13.723>In <00:24:13.850>particular, <00:24:13.978>the <00:24:14.105>thing <00:24:14.232>that <00:24:14.360>we 00:24:15.310 --> 00:24:15.320 align:start position:0% <00:24:15.310>skills. <00:24:15.311>In <00:24:15.312>particular, <00:24:15.314>the <00:24:15.316>thing <00:24:15.317>that <00:24:15.319>we 00:24:15.320 --> 00:24:17.070 align:start position:0% <00:24:15.320>skills. <00:24:15.436>In <00:24:15.553>particular, <00:24:15.669>the <00:24:15.786>thing <00:24:15.903>that <00:24:16.020>we <00:24:16.136>were <00:24:16.253>really <00:24:16.370>hoping <00:24:16.486>to <00:24:16.603>happen, <00:24:16.720>they 00:24:17.070 --> 00:24:17.080 align:start position:0% <00:24:17.070>were <00:24:17.071>really <00:24:17.073>hoping <00:24:17.075>to <00:24:17.077>happen, <00:24:17.079>they 00:24:17.080 --> 00:24:19.270 align:start position:0% <00:24:17.080>were <00:24:17.207>really <00:24:17.334>hoping <00:24:17.461>to <00:24:17.589>happen, <00:24:17.716>they <00:24:17.843>started <00:24:17.970>to <00:24:18.098>building <00:24:18.225>skills <00:24:18.352>to <00:24:18.480>slice 00:24:19.270 --> 00:24:19.280 align:start position:0% <00:24:19.270>started <00:24:19.271>to <00:24:19.273>building <00:24:19.275>skills <00:24:19.277>to <00:24:19.279>slice 00:24:19.280 --> 00:24:21.550 align:start position:0% <00:24:19.280>started <00:24:19.396>to <00:24:19.513>building <00:24:19.629>skills <00:24:19.746>to <00:24:19.863>slice <00:24:19.980>their <00:24:20.096>work <00:24:20.213>into <00:24:20.330>smaller <00:24:20.446>pieces <00:24:20.563>and <00:24:20.680>help 00:24:21.550 --> 00:24:21.560 align:start position:0% <00:24:21.550>their <00:24:21.551>work <00:24:21.553>into <00:24:21.554>smaller <00:24:21.556>pieces <00:24:21.557>and <00:24:21.559>help 00:24:21.560 --> 00:24:23.870 align:start position:0% <00:24:21.560>their <00:24:21.653>work <00:24:21.746>into <00:24:21.840>smaller <00:24:21.933>pieces <00:24:22.026>and <00:24:22.120>help <00:24:22.213>us <00:24:22.306>to <00:24:22.399>to <00:24:22.493>to <00:24:22.586>maintain <00:24:22.679>the <00:24:22.773>culture <00:24:22.866>of <00:24:22.960>safe 00:24:23.870 --> 00:24:23.880 align:start position:0% <00:24:23.870>us <00:24:23.871>to <00:24:23.872>to <00:24:23.873>to <00:24:23.874>maintain <00:24:23.875>the <00:24:23.876>culture <00:24:23.877>of <00:24:23.879>safe 00:24:23.880 --> 00:24:25.390 align:start position:0% <00:24:23.880>us <00:24:23.984>to <00:24:24.089>to <00:24:24.193>to <00:24:24.298>maintain <00:24:24.402>the <00:24:24.507>culture <00:24:24.611>of <00:24:24.716>safe <00:24:24.820>shipping. <00:24:24.925>This <00:24:25.029>is <00:24:25.134>exactly <00:24:25.239>that 00:24:25.390 --> 00:24:25.400 align:start position:0% <00:24:25.390>shipping. <00:24:25.392>This <00:24:25.394>is <00:24:25.396>exactly <00:24:25.399>that 00:24:25.400 --> 00:24:26.950 align:start position:0% <00:24:25.400>shipping. <00:24:25.539>This <00:24:25.679>is <00:24:25.818>exactly <00:24:25.958>that <00:24:26.097>first-order <00:24:26.237>effect <00:24:26.376>that <00:24:26.516>we <00:24:26.655>were <00:24:26.795>hoping 00:24:26.950 --> 00:24:26.960 align:start position:0% <00:24:26.950>first-order <00:24:26.951>effect <00:24:26.953>that <00:24:26.955>we <00:24:26.957>were <00:24:26.959>hoping 00:24:26.960 --> 00:24:29.110 align:start position:0% <00:24:26.960>first-order <00:24:27.076>effect <00:24:27.193>that <00:24:27.310>we <00:24:27.426>were <00:24:27.543>hoping <00:24:27.660>for <00:24:27.776>by <00:24:27.893>creating <00:24:28.010>an <00:24:28.126>incentive <00:24:28.243>in <00:24:28.360>our 00:24:29.110 --> 00:24:29.120 align:start position:0% <00:24:29.110>for <00:24:29.111>by <00:24:29.112>creating <00:24:29.114>an <00:24:29.116>incentive <00:24:29.117>in <00:24:29.119>our 00:24:29.120 --> 00:24:31.030 align:start position:0% <00:24:29.120>for <00:24:29.260>by <00:24:29.399>creating <00:24:29.540>an <00:24:29.679>incentive <00:24:29.820>in <00:24:29.959>our <00:24:30.100>socio-technical <00:24:30.239>system <00:24:30.379>by <00:24:30.520>never 00:24:31.030 --> 00:24:31.040 align:start position:0% <00:24:31.030>socio-technical <00:24:31.033>system <00:24:31.036>by <00:24:31.039>never 00:24:31.040 --> 00:24:33.270 align:start position:0% <00:24:31.040>socio-technical <00:24:31.195>system <00:24:31.351>by <00:24:31.506>never <00:24:31.662>approving <00:24:31.817>large <00:24:31.973>PRs <00:24:32.128>over <00:24:32.284>a <00:24:32.440>certain 00:24:33.270 --> 00:24:33.280 align:start position:0% <00:24:33.270>approving <00:24:33.271>large <00:24:33.273>PRs <00:24:33.275>over <00:24:33.277>a <00:24:33.279>certain 00:24:33.280 --> 00:24:35.430 align:start position:0% <00:24:33.280>approving <00:24:33.435>large <00:24:33.591>PRs <00:24:33.746>over <00:24:33.902>a <00:24:34.057>certain <00:24:34.213>threshold. <00:24:34.368>This <00:24:34.524>is <00:24:34.680>great. 00:24:35.430 --> 00:24:35.440 align:start position:0% <00:24:35.430>threshold. <00:24:35.433>This <00:24:35.436>is <00:24:35.439>great. 00:24:35.440 --> 00:24:38.110 align:start position:0% <00:24:35.440>threshold. <00:24:35.595>This <00:24:35.751>is <00:24:35.906>great. <00:24:36.062>But, <00:24:36.217>socio-technical <00:24:36.373>system <00:24:36.528>is <00:24:36.684>a <00:24:36.840>complex 00:24:38.110 --> 00:24:38.120 align:start position:0% <00:24:38.110>But, <00:24:38.111>socio-technical <00:24:38.113>system <00:24:38.115>is <00:24:38.117>a <00:24:38.119>complex 00:24:38.120 --> 00:24:39.510 align:start position:0% <00:24:38.120>But, <00:24:38.245>socio-technical <00:24:38.370>system <00:24:38.495>is <00:24:38.620>a <00:24:38.745>complex <00:24:38.870>system, <00:24:38.995>right? <00:24:39.120>And <00:24:39.245>there's <00:24:39.371>always 00:24:39.510 --> 00:24:39.520 align:start position:0% <00:24:39.510>system, <00:24:39.512>right? <00:24:39.514>And <00:24:39.516>there's <00:24:39.519>always 00:24:39.520 --> 00:24:41.390 align:start position:0% <00:24:39.520>system, <00:24:39.660>right? <00:24:39.800>And <00:24:39.940>there's <00:24:40.080>always <00:24:40.220>second-order <00:24:40.360>effects <00:24:40.500>in <00:24:40.639>there. <00:24:40.780>So, <00:24:40.920>what 00:24:41.390 --> 00:24:41.400 align:start position:0% <00:24:41.390>second-order <00:24:41.391>effects <00:24:41.393>in <00:24:41.395>there. <00:24:41.397>So, <00:24:41.399>what 00:24:41.400 --> 00:24:43.550 align:start position:0% <00:24:41.400>second-order <00:24:41.555>effects <00:24:41.711>in <00:24:41.866>there. <00:24:42.022>So, <00:24:42.177>what <00:24:42.333>are <00:24:42.488>those <00:24:42.644>second-order <00:24:42.800>effects? 00:24:43.550 --> 00:24:43.560 align:start position:0% <00:24:43.550>are <00:24:43.553>those <00:24:43.556>second-order <00:24:43.559>effects? 00:24:43.560 --> 00:24:45.510 align:start position:0% <00:24:43.560>are <00:24:43.687>those <00:24:43.814>second-order <00:24:43.941>effects? <00:24:44.069>Well, <00:24:44.196>turns <00:24:44.323>out <00:24:44.450>Shrek <00:24:44.578>is <00:24:44.705>so <00:24:44.832>good <00:24:44.960>that 00:24:45.510 --> 00:24:45.520 align:start position:0% <00:24:45.510>Well, <00:24:45.511>turns <00:24:45.512>out <00:24:45.513>Shrek <00:24:45.515>is <00:24:45.516>so <00:24:45.517>good <00:24:45.519>that 00:24:45.520 --> 00:24:48.110 align:start position:0% <00:24:45.520>Well, <00:24:45.627>turns <00:24:45.735>out <00:24:45.843>Shrek <00:24:45.950>is <00:24:46.058>so <00:24:46.166>good <00:24:46.273>that <00:24:46.381>there's <00:24:46.489>a <00:24:46.596>certain <00:24:46.704>expectation <00:24:46.812>now. <00:24:46.920>Like, 00:24:48.110 --> 00:24:48.120 align:start position:0% <00:24:48.110>there's <00:24:48.111>a <00:24:48.113>certain <00:24:48.115>expectation <00:24:48.117>now. <00:24:48.119>Like, 00:24:48.120 --> 00:24:49.790 align:start position:0% <00:24:48.120>there's <00:24:48.227>a <00:24:48.335>certain <00:24:48.443>expectation <00:24:48.550>now. <00:24:48.658>Like, <00:24:48.766>you <00:24:48.873>can't <00:24:48.981>just <00:24:49.089>ask <00:24:49.196>someone <00:24:49.304>to <00:24:49.412>review <00:24:49.520>a 00:24:49.790 --> 00:24:49.800 align:start position:0% <00:24:49.790>you <00:24:49.791>can't <00:24:49.792>just <00:24:49.793>ask <00:24:49.795>someone <00:24:49.796>to <00:24:49.797>review <00:24:49.799>a 00:24:49.800 --> 00:24:51.870 align:start position:0% <00:24:49.800>you <00:24:49.887>can't <00:24:49.975>just <00:24:50.062>ask <00:24:50.149>someone <00:24:50.237>to <00:24:50.325>review <00:24:50.412>a <00:24:50.500>PR. <00:24:50.587>No, <00:24:50.675>you <00:24:50.762>have <00:24:50.850>to <00:24:50.937>get <00:24:51.024>to <00:24:51.112>a <00:24:51.200>terminal 00:24:51.870 --> 00:24:51.880 align:start position:0% <00:24:51.870>PR. <00:24:51.871>No, <00:24:51.872>you <00:24:51.873>have <00:24:51.874>to <00:24:51.875>get <00:24:51.876>to <00:24:51.877>a <00:24:51.879>terminal 00:24:51.880 --> 00:24:53.430 align:start position:0% <00:24:51.880>PR. <00:24:51.967>No, <00:24:52.054>you <00:24:52.141>have <00:24:52.228>to <00:24:52.315>get <00:24:52.403>to <00:24:52.490>a <00:24:52.577>terminal <00:24:52.664>state <00:24:52.751>with <00:24:52.839>Shrek. <00:24:52.926>You <00:24:53.013>have <00:24:53.100>to <00:24:53.187>make <00:24:53.275>Shrek 00:24:53.430 --> 00:24:53.440 align:start position:0% <00:24:53.430>state <00:24:53.431>with <00:24:53.432>Shrek. <00:24:53.433>You <00:24:53.435>have <00:24:53.436>to <00:24:53.437>make <00:24:53.439>Shrek 00:24:53.440 --> 00:24:55.870 align:start position:0% <00:24:53.440>state <00:24:53.540>with <00:24:53.640>Shrek. <00:24:53.740>You <00:24:53.840>have <00:24:53.940>to <00:24:54.040>make <00:24:54.140>Shrek <00:24:54.240>happy <00:24:54.340>first <00:24:54.440>because <00:24:54.540>if <00:24:54.640>you <00:24:54.740>wouldn't, <00:24:54.840>the 00:24:55.870 --> 00:24:55.880 align:start position:0% <00:24:55.870>happy <00:24:55.871>first <00:24:55.873>because <00:24:55.874>if <00:24:55.876>you <00:24:55.877>wouldn't, <00:24:55.879>the 00:24:55.880 --> 00:24:57.190 align:start position:0% <00:24:55.880>happy <00:24:55.970>first <00:24:56.061>because <00:24:56.152>if <00:24:56.242>you <00:24:56.333>wouldn't, <00:24:56.424>the <00:24:56.514>human <00:24:56.605>will <00:24:56.696>tell <00:24:56.786>you, <00:24:56.877>"Why <00:24:56.968>you <00:24:57.059>presenting 00:24:57.190 --> 00:24:57.200 align:start position:0% <00:24:57.190>human <00:24:57.191>will <00:24:57.193>tell <00:24:57.194>you, <00:24:57.196>"Why <00:24:57.197>you <00:24:57.199>presenting 00:24:57.200 --> 00:24:59.190 align:start position:0% <00:24:57.200>human <00:24:57.293>will <00:24:57.386>tell <00:24:57.480>you, <00:24:57.573>"Why <00:24:57.666>you <00:24:57.760>presenting <00:24:57.853>me <00:24:57.946>this <00:24:58.040>PR? <00:24:58.133>Like <00:24:58.226>did <00:24:58.320>you <00:24:58.413>even <00:24:58.506>make <00:24:58.600>Shrek 00:24:59.190 --> 00:24:59.200 align:start position:0% <00:24:59.190>me <00:24:59.191>this <00:24:59.192>PR? <00:24:59.193>Like <00:24:59.194>did <00:24:59.195>you <00:24:59.196>even <00:24:59.197>make <00:24:59.199>Shrek 00:24:59.200 --> 00:25:00.470 align:start position:0% <00:24:59.200>me <00:24:59.276>this <00:24:59.352>PR? <00:24:59.428>Like <00:24:59.504>did <00:24:59.581>you <00:24:59.657>even <00:24:59.733>make <00:24:59.809>Shrek <00:24:59.885>happy? <00:24:59.962>Like <00:25:00.038>what <00:25:00.114>the <00:25:00.190>hell? <00:25:00.266>Look, <00:25:00.343>I 00:25:00.470 --> 00:25:00.480 align:start position:0% <00:25:00.470>happy? <00:25:00.471>Like <00:25:00.473>what <00:25:00.474>the <00:25:00.476>hell? <00:25:00.477>Look, <00:25:00.479>I 00:25:00.480 --> 00:25:02.870 align:start position:0% <00:25:00.480>happy? <00:25:00.580>Like <00:25:00.680>what <00:25:00.780>the <00:25:00.880>hell? <00:25:00.980>Look, <00:25:01.080>I <00:25:01.180>rejected <00:25:01.280>your <00:25:01.380>thing. <00:25:01.480>Go <00:25:01.580>and <00:25:01.680>and <00:25:01.780>and <00:25:01.880>do 00:25:02.870 --> 00:25:02.880 align:start position:0% <00:25:02.870>rejected <00:25:02.871>your <00:25:02.872>thing. <00:25:02.873>Go <00:25:02.875>and <00:25:02.876>and <00:25:02.877>and <00:25:02.879>do 00:25:02.880 --> 00:25:04.030 align:start position:0% <00:25:02.880>rejected <00:25:02.949>your <00:25:03.018>thing. <00:25:03.087>Go <00:25:03.156>and <00:25:03.225>and <00:25:03.294>and <00:25:03.363>do <00:25:03.432>better. <00:25:03.501>Like <00:25:03.570>I'm <00:25:03.639>not <00:25:03.708>going <00:25:03.777>to <00:25:03.846>review <00:25:03.915>it 00:25:04.030 --> 00:25:04.040 align:start position:0% <00:25:04.030>better. <00:25:04.031>Like <00:25:04.032>I'm <00:25:04.033>not <00:25:04.035>going <00:25:04.036>to <00:25:04.037>review <00:25:04.039>it 00:25:04.040 --> 00:25:07.030 align:start position:0% <00:25:04.040>better. <00:25:04.147>Like <00:25:04.255>I'm <00:25:04.363>not <00:25:04.470>going <00:25:04.578>to <00:25:04.686>review <00:25:04.793>it <00:25:04.901>until <00:25:05.009>Shrek <00:25:05.116>put <00:25:05.224>this <00:25:05.332>thumb <00:25:05.440>up." 00:25:07.030 --> 00:25:07.040 align:start position:0% <00:25:07.030>until <00:25:07.031>Shrek <00:25:07.033>put <00:25:07.035>this <00:25:07.037>thumb <00:25:07.039>up." 00:25:07.040 --> 00:25:09.710 align:start position:0% <00:25:07.040>until <00:25:07.156>Shrek <00:25:07.273>put <00:25:07.389>this <00:25:07.506>thumb <00:25:07.623>up." <00:25:07.740>Which <00:25:07.856>means <00:25:07.973>that <00:25:08.090>uh <00:25:08.206>folks <00:25:08.323>are <00:25:08.440>like 00:25:09.710 --> 00:25:09.720 align:start position:0% <00:25:09.710>Which <00:25:09.711>means <00:25:09.713>that <00:25:09.714>uh <00:25:09.716>folks <00:25:09.717>are <00:25:09.719>like 00:25:09.720 --> 00:25:11.470 align:start position:0% <00:25:09.720>Which <00:25:09.836>means <00:25:09.953>that <00:25:10.070>uh <00:25:10.186>folks <00:25:10.303>are <00:25:10.420>like <00:25:10.536>really <00:25:10.653>invested <00:25:10.770>into <00:25:10.886>making <00:25:11.003>Shrek <00:25:11.120>happy 00:25:11.470 --> 00:25:11.480 align:start position:0% <00:25:11.470>really <00:25:11.471>invested <00:25:11.473>into <00:25:11.475>making <00:25:11.477>Shrek <00:25:11.479>happy 00:25:11.480 --> 00:25:12.830 align:start position:0% <00:25:11.480>really <00:25:11.590>invested <00:25:11.700>into <00:25:11.811>making <00:25:11.921>Shrek <00:25:12.032>happy <00:25:12.142>and <00:25:12.253>sometimes <00:25:12.363>it's <00:25:12.474>a <00:25:12.584>full-time <00:25:12.695>job. 00:25:12.830 --> 00:25:12.840 align:start position:0% <00:25:12.830>and <00:25:12.831>sometimes <00:25:12.833>it's <00:25:12.835>a <00:25:12.837>full-time <00:25:12.839>job. 00:25:12.840 --> 00:25:14.910 align:start position:0% <00:25:12.840>and <00:25:12.956>sometimes <00:25:13.073>it's <00:25:13.189>a <00:25:13.306>full-time <00:25:13.423>job. <00:25:13.540>Sometimes <00:25:13.656>it <00:25:13.773>takes <00:25:13.889>many <00:25:14.006>commits <00:25:14.123>to <00:25:14.240>fix 00:25:14.910 --> 00:25:14.920 align:start position:0% <00:25:14.910>Sometimes <00:25:14.911>it <00:25:14.913>takes <00:25:14.914>many <00:25:14.916>commits <00:25:14.917>to <00:25:14.919>fix 00:25:14.920 --> 00:25:16.910 align:start position:0% <00:25:14.920>Sometimes <00:25:15.020>it <00:25:15.120>takes <00:25:15.220>many <00:25:15.320>commits <00:25:15.420>to <00:25:15.520>fix <00:25:15.620>all <00:25:15.720>the <00:25:15.820>knits <00:25:15.920>that <00:25:16.020>it <00:25:16.120>surfaces. <00:25:16.220>And <00:25:16.320>it's 00:25:16.910 --> 00:25:16.920 align:start position:0% <00:25:16.910>all <00:25:16.911>the <00:25:16.912>knits <00:25:16.913>that <00:25:16.915>it <00:25:16.916>surfaces. <00:25:16.917>And <00:25:16.919>it's 00:25:16.920 --> 00:25:18.590 align:start position:0% <00:25:16.920>all <00:25:17.013>the <00:25:17.106>knits <00:25:17.200>that <00:25:17.293>it <00:25:17.386>surfaces. <00:25:17.480>And <00:25:17.573>it's <00:25:17.666>a <00:25:17.760>bit <00:25:17.853>tiresome. <00:25:17.946>And <00:25:18.040>on <00:25:18.133>the <00:25:18.226>surface <00:25:18.320>it's 00:25:18.590 --> 00:25:18.600 align:start position:0% <00:25:18.590>a <00:25:18.591>bit <00:25:18.592>tiresome. <00:25:18.593>And <00:25:18.595>on <00:25:18.596>the <00:25:18.597>surface <00:25:18.599>it's 00:25:18.600 --> 00:25:20.070 align:start position:0% <00:25:18.600>a <00:25:18.694>bit <00:25:18.789>tiresome. <00:25:18.883>And <00:25:18.977>on <00:25:19.072>the <00:25:19.167>surface <00:25:19.261>it's <00:25:19.356>also <00:25:19.450>cost <00:25:19.544>problem <00:25:19.639>because <00:25:19.734>we <00:25:19.828>spend <00:25:19.923>a 00:25:20.070 --> 00:25:20.080 align:start position:0% <00:25:20.070>also <00:25:20.071>cost <00:25:20.072>problem <00:25:20.074>because <00:25:20.076>we <00:25:20.077>spend <00:25:20.079>a 00:25:20.080 --> 00:25:22.150 align:start position:0% <00:25:20.080>also <00:25:20.179>cost <00:25:20.280>problem <00:25:20.379>because <00:25:20.480>we <00:25:20.580>spend <00:25:20.679>a <00:25:20.780>lot <00:25:20.879>of <00:25:20.980>money <00:25:21.080>to <00:25:21.179>run <00:25:21.280>all <00:25:21.379>of <00:25:21.480>those 00:25:22.150 --> 00:25:22.160 align:start position:0% <00:25:22.150>lot <00:25:22.151>of <00:25:22.152>money <00:25:22.153>to <00:25:22.155>run <00:25:22.156>all <00:25:22.157>of <00:25:22.159>those 00:25:22.160 --> 00:25:24.430 align:start position:0% <00:25:22.160>lot <00:25:22.267>of <00:25:22.375>money <00:25:22.483>to <00:25:22.590>run <00:25:22.698>all <00:25:22.806>of <00:25:22.913>those <00:25:23.021>reviews. <00:25:23.129>But <00:25:23.236>also <00:25:23.344>folks <00:25:23.452>are <00:25:23.560>getting 00:25:24.430 --> 00:25:24.440 align:start position:0% <00:25:24.430>reviews. <00:25:24.431>But <00:25:24.433>also <00:25:24.435>folks <00:25:24.437>are <00:25:24.439>getting 00:25:24.440 --> 00:25:25.910 align:start position:0% <00:25:24.440>reviews. <00:25:24.550>But <00:25:24.660>also <00:25:24.770>folks <00:25:24.881>are <00:25:24.991>getting <00:25:25.101>frustrated. <00:25:25.211>Like <00:25:25.322>if <00:25:25.432>you <00:25:25.542>sit <00:25:25.652>in <00:25:25.763>your 00:25:25.910 --> 00:25:25.920 align:start position:0% <00:25:25.910>frustrated. <00:25:25.911>Like <00:25:25.913>if <00:25:25.914>you <00:25:25.916>sit <00:25:25.917>in <00:25:25.919>your 00:25:25.920 --> 00:25:27.710 align:start position:0% <00:25:25.920>frustrated. <00:25:26.027>Like <00:25:26.135>if <00:25:26.243>you <00:25:26.350>sit <00:25:26.458>in <00:25:26.566>your <00:25:26.673>coding <00:25:26.781>agent <00:25:26.889>and <00:25:26.996>try <00:25:27.104>and <00:25:27.212>make <00:25:27.320>Shrek 00:25:27.710 --> 00:25:27.720 align:start position:0% <00:25:27.710>coding <00:25:27.711>agent <00:25:27.713>and <00:25:27.714>try <00:25:27.716>and <00:25:27.717>make <00:25:27.719>Shrek 00:25:27.720 --> 00:25:29.630 align:start position:0% <00:25:27.720>coding <00:25:27.827>agent <00:25:27.935>and <00:25:28.043>try <00:25:28.150>and <00:25:28.258>make <00:25:28.366>Shrek <00:25:28.473>happy <00:25:28.581>and <00:25:28.689>you're <00:25:28.796>like <00:25:28.904>not <00:25:29.012>getting <00:25:29.120>there 00:25:29.630 --> 00:25:29.640 align:start position:0% <00:25:29.630>happy <00:25:29.631>and <00:25:29.633>you're <00:25:29.634>like <00:25:29.636>not <00:25:29.637>getting <00:25:29.639>there 00:25:29.640 --> 00:25:31.270 align:start position:0% <00:25:29.640>happy <00:25:29.747>and <00:25:29.855>you're <00:25:29.963>like <00:25:30.070>not <00:25:30.178>getting <00:25:30.286>there <00:25:30.393>within <00:25:30.501>30 <00:25:30.609>minutes <00:25:30.716>or <00:25:30.824>whatever, <00:25:30.932>you <00:25:31.040>like 00:25:31.270 --> 00:25:31.280 align:start position:0% <00:25:31.270>within <00:25:31.271>30 <00:25:31.273>minutes <00:25:31.274>or <00:25:31.276>whatever, <00:25:31.277>you <00:25:31.279>like 00:25:31.280 --> 00:25:32.550 align:start position:0% <00:25:31.280>within <00:25:31.375>30 <00:25:31.470>minutes <00:25:31.565>or <00:25:31.661>whatever, <00:25:31.756>you <00:25:31.851>like <00:25:31.946>you're <00:25:32.042>getting <00:25:32.137>frustrated. <00:25:32.232>You <00:25:32.327>feel <00:25:32.423>the 00:25:32.550 --> 00:25:32.560 align:start position:0% <00:25:32.550>you're <00:25:32.551>getting <00:25:32.553>frustrated. <00:25:32.555>You <00:25:32.557>feel <00:25:32.559>the 00:25:32.560 --> 00:25:33.710 align:start position:0% <00:25:32.560>you're <00:25:32.732>getting <00:25:32.905>frustrated. <00:25:33.077>You <00:25:33.250>feel <00:25:33.422>the <00:25:33.595>pain. 00:25:33.710 --> 00:25:33.720 align:start position:0% pain. 00:25:33.720 --> 00:25:35.590 align:start position:0% <00:25:33.720>pain. <00:25:33.920>Right? <00:25:34.120>So <00:25:34.320>we <00:25:34.520>really <00:25:34.720>have <00:25:34.920>to <00:25:35.120>pay 00:25:35.590 --> 00:25:35.600 align:start position:0% <00:25:35.590>Right? <00:25:35.591>So <00:25:35.592>we <00:25:35.594>really <00:25:35.596>have <00:25:35.597>to <00:25:35.599>pay 00:25:35.600 --> 00:25:37.110 align:start position:0% <00:25:35.600>Right? <00:25:35.723>So <00:25:35.847>we <00:25:35.970>really <00:25:36.094>have <00:25:36.217>to <00:25:36.341>pay <00:25:36.464>attention <00:25:36.588>now <00:25:36.711>to <00:25:36.835>false <00:25:36.958>positive 00:25:37.110 --> 00:25:37.120 align:start position:0% <00:25:37.110>attention <00:25:37.112>now <00:25:37.114>to <00:25:37.116>false <00:25:37.119>positive 00:25:37.120 --> 00:25:38.630 align:start position:0% <00:25:37.120>attention <00:25:37.255>now <00:25:37.391>to <00:25:37.527>false <00:25:37.663>positive <00:25:37.799>suppression. <00:25:37.935>This <00:25:38.071>become <00:25:38.207>a <00:25:38.343>real <00:25:38.479>thing. 00:25:38.630 --> 00:25:38.640 align:start position:0% <00:25:38.630>suppression. <00:25:38.631>This <00:25:38.633>become <00:25:38.635>a <00:25:38.637>real <00:25:38.639>thing. 00:25:38.640 --> 00:25:40.110 align:start position:0% <00:25:38.640>suppression. <00:25:38.734>This <00:25:38.829>become <00:25:38.923>a <00:25:39.018>real <00:25:39.112>thing. <00:25:39.207>Like <00:25:39.301>we <00:25:39.396>not <00:25:39.490>only <00:25:39.585>have <00:25:39.679>to <00:25:39.774>make <00:25:39.868>sure <00:25:39.963>that 00:25:40.110 --> 00:25:40.120 align:start position:0% <00:25:40.110>Like <00:25:40.111>we <00:25:40.112>not <00:25:40.113>only <00:25:40.114>have <00:25:40.115>to <00:25:40.116>make <00:25:40.117>sure <00:25:40.119>that 00:25:40.120 --> 00:25:41.870 align:start position:0% <00:25:40.120>Like <00:25:40.219>we <00:25:40.320>not <00:25:40.419>only <00:25:40.520>have <00:25:40.620>to <00:25:40.719>make <00:25:40.820>sure <00:25:40.919>that <00:25:41.020>Shrek <00:25:41.120>surfaces <00:25:41.219>all <00:25:41.320>the <00:25:41.419>issues. <00:25:41.520>Like 00:25:41.870 --> 00:25:41.880 align:start position:0% <00:25:41.870>Shrek <00:25:41.871>surfaces <00:25:41.873>all <00:25:41.875>the <00:25:41.877>issues. <00:25:41.879>Like 00:25:41.880 --> 00:25:43.870 align:start position:0% <00:25:41.880>Shrek <00:25:41.996>surfaces <00:25:42.113>all <00:25:42.230>the <00:25:42.346>issues. <00:25:42.463>Like <00:25:42.580>recall <00:25:42.696>is <00:25:42.813>great. <00:25:42.930>But <00:25:43.046>the <00:25:43.163>false <00:25:43.280>positive 00:25:43.870 --> 00:25:43.880 align:start position:0% <00:25:43.870>recall <00:25:43.871>is <00:25:43.873>great. <00:25:43.874>But <00:25:43.876>the <00:25:43.877>false <00:25:43.879>positive 00:25:43.880 --> 00:25:45.590 align:start position:0% <00:25:43.880>recall <00:25:43.987>is <00:25:44.095>great. <00:25:44.203>But <00:25:44.310>the <00:25:44.418>false <00:25:44.526>positive <00:25:44.633>has <00:25:44.741>to <00:25:44.849>go <00:25:44.956>away. <00:25:45.064>Otherwise <00:25:45.172>humans <00:25:45.280>are 00:25:45.590 --> 00:25:45.600 align:start position:0% <00:25:45.590>has <00:25:45.591>to <00:25:45.592>go <00:25:45.594>away. <00:25:45.596>Otherwise <00:25:45.597>humans <00:25:45.599>are 00:25:45.600 --> 00:25:48.670 align:start position:0% <00:25:45.600>has <00:25:45.727>to <00:25:45.854>go <00:25:45.981>away. <00:25:46.109>Otherwise <00:25:46.236>humans <00:25:46.363>are <00:25:46.490>getting <00:25:46.618>frustrated <00:25:46.745>and <00:25:46.872>and <00:25:47.000>like 00:25:48.670 --> 00:25:48.680 align:start position:0% <00:25:48.670>getting <00:25:48.672>frustrated <00:25:48.674>and <00:25:48.676>and <00:25:48.679>like 00:25:48.680 --> 00:25:51.750 align:start position:0% <00:25:48.680>getting <00:25:48.855>frustrated <00:25:49.030>and <00:25:49.205>and <00:25:49.380>like <00:25:49.555>really <00:25:49.730>feeling <00:25:49.905>the <00:25:50.080>pain. 00:25:51.760 --> 00:25:53.630 align:start position:0% <00:25:51.760>Uh <00:25:51.993>the <00:25:52.226>other <00:25:52.460>thing <00:25:52.693>the <00:25:52.926>other <00:25:53.160>interesting 00:25:53.630 --> 00:25:53.640 align:start position:0% <00:25:53.630>Uh <00:25:53.631>the <00:25:53.633>other <00:25:53.634>thing <00:25:53.636>the <00:25:53.637>other <00:25:53.639>interesting 00:25:53.640 --> 00:25:55.670 align:start position:0% <00:25:53.640>Uh <00:25:53.756>the <00:25:53.873>other <00:25:53.990>thing <00:25:54.106>the <00:25:54.223>other <00:25:54.340>interesting <00:25:54.456>second <00:25:54.573>order <00:25:54.690>effect <00:25:54.806>that <00:25:54.923>happens, <00:25:55.040>folks 00:25:55.670 --> 00:25:55.680 align:start position:0% <00:25:55.670>second <00:25:55.671>order <00:25:55.673>effect <00:25:55.675>that <00:25:55.677>happens, <00:25:55.679>folks 00:25:55.680 --> 00:25:56.910 align:start position:0% <00:25:55.680>second <00:25:55.790>order <00:25:55.901>effect <00:25:56.012>that <00:25:56.122>happens, <00:25:56.233>folks <00:25:56.344>somehow <00:25:56.454>accidentally <00:25:56.565>figured <00:25:56.676>that <00:25:56.787>they 00:25:56.910 --> 00:25:56.920 align:start position:0% <00:25:56.910>somehow <00:25:56.912>accidentally <00:25:56.914>figured <00:25:56.916>that <00:25:56.919>they 00:25:56.920 --> 00:25:58.510 align:start position:0% <00:25:56.920>somehow <00:25:57.036>accidentally <00:25:57.153>figured <00:25:57.270>that <00:25:57.386>they <00:25:57.503>can <00:25:57.620>push <00:25:57.736>back <00:25:57.853>on <00:25:57.970>the <00:25:58.086>findings <00:25:58.203>by <00:25:58.320>putting 00:25:58.510 --> 00:25:58.520 align:start position:0% <00:25:58.510>can <00:25:58.511>push <00:25:58.512>back <00:25:58.513>on <00:25:58.515>the <00:25:58.516>findings <00:25:58.517>by <00:25:58.519>putting 00:25:58.520 --> 00:26:00.390 align:start position:0% <00:25:58.520>can <00:25:58.620>push <00:25:58.720>back <00:25:58.820>on <00:25:58.920>the <00:25:59.020>findings <00:25:59.120>by <00:25:59.220>putting <00:25:59.320>something <00:25:59.420>in <00:25:59.520>PR <00:25:59.620>description. <00:25:59.720>And <00:25:59.820>on <00:25:59.920>one 00:26:00.390 --> 00:26:00.400 align:start position:0% <00:26:00.390>something <00:26:00.391>in <00:26:00.393>PR <00:26:00.394>description. <00:26:00.396>And <00:26:00.397>on <00:26:00.399>one 00:26:00.400 --> 00:26:01.830 align:start position:0% <00:26:00.400>something <00:26:00.491>in <00:26:00.583>PR <00:26:00.675>description. <00:26:00.767>And <00:26:00.859>on <00:26:00.951>one <00:26:01.043>hand <00:26:01.135>you <00:26:01.227>might <00:26:01.319>say, <00:26:01.411>"Ah, <00:26:01.503>they <00:26:01.595>gaming <00:26:01.687>the 00:26:01.830 --> 00:26:01.840 align:start position:0% <00:26:01.830>hand <00:26:01.831>you <00:26:01.832>might <00:26:01.833>say, <00:26:01.835>"Ah, <00:26:01.836>they <00:26:01.837>gaming <00:26:01.839>the 00:26:01.840 --> 00:26:03.750 align:start position:0% <00:26:01.840>hand <00:26:01.933>you <00:26:02.026>might <00:26:02.120>say, <00:26:02.213>"Ah, <00:26:02.306>they <00:26:02.399>gaming <00:26:02.493>the <00:26:02.586>system." <00:26:02.679>Like <00:26:02.773>like <00:26:02.866>this <00:26:02.959>has <00:26:03.053>to <00:26:03.146>go <00:26:03.240>away. 00:26:03.750 --> 00:26:03.760 align:start position:0% <00:26:03.750>system." <00:26:03.751>Like <00:26:03.752>like <00:26:03.753>this <00:26:03.755>has <00:26:03.756>to <00:26:03.757>go <00:26:03.759>away. 00:26:03.760 --> 00:26:05.670 align:start position:0% <00:26:03.760>system." <00:26:03.860>Like <00:26:03.960>like <00:26:04.060>this <00:26:04.160>has <00:26:04.260>to <00:26:04.360>go <00:26:04.460>away. <00:26:04.560>But <00:26:04.660>actually <00:26:04.760>this <00:26:04.860>is <00:26:04.960>the <00:26:05.060>system <00:26:05.160>working 00:26:05.670 --> 00:26:05.680 align:start position:0% <00:26:05.670>But <00:26:05.671>actually <00:26:05.673>this <00:26:05.674>is <00:26:05.676>the <00:26:05.677>system <00:26:05.679>working 00:26:05.680 --> 00:26:07.150 align:start position:0% <00:26:05.680>But <00:26:05.790>actually <00:26:05.900>this <00:26:06.010>is <00:26:06.121>the <00:26:06.231>system <00:26:06.341>working <00:26:06.451>as <00:26:06.562>intended <00:26:06.672>because <00:26:06.782>they <00:26:06.892>started <00:26:07.003>to 00:26:07.150 --> 00:26:07.160 align:start position:0% <00:26:07.150>as <00:26:07.151>intended <00:26:07.153>because <00:26:07.155>they <00:26:07.157>started <00:26:07.159>to 00:26:07.160 --> 00:26:09.470 align:start position:0% <00:26:07.160>as <00:26:07.287>intended <00:26:07.414>because <00:26:07.541>they <00:26:07.669>started <00:26:07.796>to <00:26:07.923>record <00:26:08.050>in <00:26:08.178>their <00:26:08.305>decisions <00:26:08.432>and <00:26:08.560>preserving 00:26:09.470 --> 00:26:09.480 align:start position:0% <00:26:09.470>record <00:26:09.471>in <00:26:09.473>their <00:26:09.475>decisions <00:26:09.477>and <00:26:09.479>preserving 00:26:09.480 --> 00:26:10.150 align:start position:0% <00:26:09.480>record <00:26:09.580>in <00:26:09.681>their <00:26:09.781>decisions <00:26:09.882>and <00:26:09.982>preserving <00:26:10.083>that 00:26:10.150 --> 00:26:10.160 align:start position:0% that 00:26:10.160 --> 00:26:11.710 align:start position:0% <00:26:10.160>that <00:26:10.392>like <00:26:10.625>really <00:26:10.857>important <00:26:11.090>context <00:26:11.322>on <00:26:11.555>the 00:26:11.710 --> 00:26:11.720 align:start position:0% <00:26:11.710>like <00:26:11.711>really <00:26:11.713>important <00:26:11.715>context <00:26:11.717>on <00:26:11.719>the 00:26:11.720 --> 00:26:13.550 align:start position:0% <00:26:11.720>like <00:26:11.860>really <00:26:12.000>important <00:26:12.140>context <00:26:12.280>on <00:26:12.420>the <00:26:12.560>pull <00:26:12.700>request <00:26:12.840>descriptions <00:26:12.980>for <00:26:13.120>posterity, 00:26:13.550 --> 00:26:13.560 align:start position:0% <00:26:13.550>pull <00:26:13.552>request <00:26:13.554>descriptions <00:26:13.556>for <00:26:13.559>posterity, 00:26:13.560 --> 00:26:15.070 align:start position:0% <00:26:13.560>pull <00:26:13.683>request <00:26:13.807>descriptions <00:26:13.930>for <00:26:14.054>posterity, <00:26:14.177>right? <00:26:14.301>So <00:26:14.424>this <00:26:14.548>is <00:26:14.671>great. <00:26:14.795>We <00:26:14.918>actually 00:26:15.070 --> 00:26:15.080 align:start position:0% <00:26:15.070>right? <00:26:15.071>So <00:26:15.072>this <00:26:15.074>is <00:26:15.076>great. <00:26:15.077>We <00:26:15.079>actually 00:26:15.080 --> 00:26:17.190 align:start position:0% <00:26:15.080>right? <00:26:15.207>So <00:26:15.334>this <00:26:15.461>is <00:26:15.589>great. <00:26:15.716>We <00:26:15.843>actually <00:26:15.970>love <00:26:16.098>the <00:26:16.225>second <00:26:16.352>order <00:26:16.480>effect. 00:26:17.190 --> 00:26:17.200 align:start position:0% <00:26:17.190>love <00:26:17.192>the <00:26:17.194>second <00:26:17.196>order <00:26:17.199>effect. 00:26:17.200 --> 00:26:19.390 align:start position:0% <00:26:17.200>love <00:26:17.340>the <00:26:17.480>second <00:26:17.620>order <00:26:17.760>effect. <00:26:17.900>Okay, <00:26:18.040>we're <00:26:18.180>coming <00:26:18.320>to <00:26:18.460>an <00:26:18.600>end. 00:26:19.390 --> 00:26:19.400 align:start position:0% <00:26:19.390>Okay, <00:26:19.391>we're <00:26:19.393>coming <00:26:19.395>to <00:26:19.397>an <00:26:19.399>end. 00:26:19.400 --> 00:26:21.070 align:start position:0% <00:26:19.400>Okay, <00:26:19.507>we're <00:26:19.615>coming <00:26:19.723>to <00:26:19.830>an <00:26:19.938>end. <00:26:20.046>What <00:26:20.153>did <00:26:20.261>we <00:26:20.369>learn <00:26:20.476>from <00:26:20.584>this, <00:26:20.692>right? <00:26:20.800>What 00:26:21.070 --> 00:26:21.080 align:start position:0% <00:26:21.070>What <00:26:21.071>did <00:26:21.072>we <00:26:21.073>learn <00:26:21.075>from <00:26:21.076>this, <00:26:21.077>right? <00:26:21.079>What 00:26:21.080 --> 00:26:22.270 align:start position:0% <00:26:21.080>What <00:26:21.162>did <00:26:21.244>we <00:26:21.327>learn <00:26:21.409>from <00:26:21.491>this, <00:26:21.574>right? <00:26:21.656>What <00:26:21.739>what <00:26:21.821>what <00:26:21.903>what's <00:26:21.986>what <00:26:22.068>what's <00:26:22.151>the 00:26:22.270 --> 00:26:22.280 align:start position:0% <00:26:22.270>what <00:26:22.271>what <00:26:22.273>what's <00:26:22.275>what <00:26:22.277>what's <00:26:22.279>the 00:26:22.280 --> 00:26:24.510 align:start position:0% <00:26:22.280>what <00:26:22.396>what <00:26:22.513>what's <00:26:22.629>what <00:26:22.746>what's <00:26:22.863>the <00:26:22.980>summary? <00:26:23.096>What <00:26:23.213>is <00:26:23.330>the <00:26:23.446>takeaway <00:26:23.563>for <00:26:23.680>you? 00:26:24.510 --> 00:26:24.520 align:start position:0% <00:26:24.510>summary? <00:26:24.511>What <00:26:24.513>is <00:26:24.514>the <00:26:24.516>takeaway <00:26:24.517>for <00:26:24.519>you? 00:26:24.520 --> 00:26:26.950 align:start position:0% <00:26:24.520>summary? <00:26:24.620>What <00:26:24.720>is <00:26:24.820>the <00:26:24.920>takeaway <00:26:25.020>for <00:26:25.120>you? <00:26:25.220>Well, <00:26:25.320>the <00:26:25.420>first <00:26:25.520>thing <00:26:25.620>to <00:26:25.720>kind <00:26:25.820>of <00:26:25.920>get 00:26:26.950 --> 00:26:26.960 align:start position:0% <00:26:26.950>Well, <00:26:26.951>the <00:26:26.952>first <00:26:26.953>thing <00:26:26.955>to <00:26:26.956>kind <00:26:26.957>of <00:26:26.959>get 00:26:26.960 --> 00:26:28.230 align:start position:0% <00:26:26.960>Well, <00:26:27.036>the <00:26:27.112>first <00:26:27.188>thing <00:26:27.264>to <00:26:27.341>kind <00:26:27.417>of <00:26:27.493>get <00:26:27.569>used <00:26:27.645>to <00:26:27.722>is <00:26:27.798>that <00:26:27.874>if <00:26:27.950>you're <00:26:28.026>not <00:26:28.103>doing 00:26:28.230 --> 00:26:28.240 align:start position:0% <00:26:28.230>used <00:26:28.231>to <00:26:28.232>is <00:26:28.233>that <00:26:28.235>if <00:26:28.236>you're <00:26:28.237>not <00:26:28.239>doing 00:26:28.240 --> 00:26:29.990 align:start position:0% <00:26:28.240>used <00:26:28.333>to <00:26:28.426>is <00:26:28.520>that <00:26:28.613>if <00:26:28.706>you're <00:26:28.800>not <00:26:28.893>doing <00:26:28.986>anything, <00:26:29.080>this <00:26:29.173>is <00:26:29.266>the <00:26:29.360>thing <00:26:29.453>to <00:26:29.546>do. <00:26:29.640>This 00:26:29.990 --> 00:26:30.000 align:start position:0% <00:26:29.990>anything, <00:26:29.991>this <00:26:29.992>is <00:26:29.993>the <00:26:29.995>thing <00:26:29.996>to <00:26:29.997>do. <00:26:29.999>This 00:26:30.000 --> 00:26:31.750 align:start position:0% <00:26:30.000>anything, <00:26:30.087>this <00:26:30.175>is <00:26:30.262>the <00:26:30.350>thing <00:26:30.437>to <00:26:30.525>do. <00:26:30.612>This <00:26:30.700>is <00:26:30.787>the <00:26:30.875>thing <00:26:30.962>to <00:26:31.050>start <00:26:31.137>with. <00:26:31.225>Take <00:26:31.312>all <00:26:31.400>of 00:26:31.750 --> 00:26:31.760 align:start position:0% <00:26:31.750>is <00:26:31.751>the <00:26:31.752>thing <00:26:31.753>to <00:26:31.754>start <00:26:31.755>with. <00:26:31.756>Take <00:26:31.757>all <00:26:31.759>of 00:26:31.760 --> 00:26:33.790 align:start position:0% <00:26:31.760>is <00:26:31.853>the <00:26:31.946>thing <00:26:32.040>to <00:26:32.133>start <00:26:32.226>with. <00:26:32.320>Take <00:26:32.413>all <00:26:32.506>of <00:26:32.600>your <00:26:32.693>experts, <00:26:32.786>close <00:26:32.879>them <00:26:32.973>in <00:26:33.066>the <00:26:33.160>rooms 00:26:33.790 --> 00:26:33.800 align:start position:0% <00:26:33.790>your <00:26:33.791>experts, <00:26:33.793>close <00:26:33.794>them <00:26:33.796>in <00:26:33.797>the <00:26:33.799>rooms 00:26:33.800 --> 00:26:35.710 align:start position:0% <00:26:33.800>your <00:26:33.907>experts, <00:26:34.015>close <00:26:34.123>them <00:26:34.230>in <00:26:34.338>the <00:26:34.446>rooms <00:26:34.553>and <00:26:34.661>tell <00:26:34.769>them, <00:26:34.876>"Hey, <00:26:34.984>take <00:26:35.092>your <00:26:35.200>expert 00:26:35.710 --> 00:26:35.720 align:start position:0% <00:26:35.710>and <00:26:35.711>tell <00:26:35.713>them, <00:26:35.714>"Hey, <00:26:35.716>take <00:26:35.717>your <00:26:35.719>expert 00:26:35.720 --> 00:26:37.430 align:start position:0% <00:26:35.720>and <00:26:35.836>tell <00:26:35.953>them, <00:26:36.070>"Hey, <00:26:36.186>take <00:26:36.303>your <00:26:36.420>expert <00:26:36.536>knowledge, <00:26:36.653>all <00:26:36.770>of <00:26:36.886>your <00:26:37.003>domain <00:26:37.120>expertise, 00:26:37.430 --> 00:26:37.440 align:start position:0% <00:26:37.430>knowledge, <00:26:37.431>all <00:26:37.433>of <00:26:37.435>your <00:26:37.437>domain <00:26:37.439>expertise, 00:26:37.440 --> 00:26:39.070 align:start position:0% <00:26:37.440>knowledge, <00:26:37.547>all <00:26:37.655>of <00:26:37.763>your <00:26:37.870>domain <00:26:37.978>expertise, <00:26:38.086>and <00:26:38.193>encode <00:26:38.301>this <00:26:38.409>in <00:26:38.516>the <00:26:38.624>prompts, <00:26:38.732>in <00:26:38.840>the 00:26:39.070 --> 00:26:39.080 align:start position:0% <00:26:39.070>and <00:26:39.071>encode <00:26:39.072>this <00:26:39.073>in <00:26:39.075>the <00:26:39.076>prompts, <00:26:39.077>in <00:26:39.079>the 00:26:39.080 --> 00:26:40.550 align:start position:0% <00:26:39.080>and <00:26:39.174>encode <00:26:39.269>this <00:26:39.363>in <00:26:39.457>the <00:26:39.552>prompts, <00:26:39.647>in <00:26:39.741>the <00:26:39.836>skills. <00:26:39.930>You <00:26:40.024>want <00:26:40.119>to <00:26:40.214>preserve <00:26:40.308>this. <00:26:40.403>This 00:26:40.550 --> 00:26:40.560 align:start position:0% <00:26:40.550>skills. <00:26:40.551>You <00:26:40.553>want <00:26:40.554>to <00:26:40.556>preserve <00:26:40.557>this. <00:26:40.559>This 00:26:40.560 --> 00:26:42.470 align:start position:0% <00:26:40.560>skills. <00:26:40.659>You <00:26:40.760>want <00:26:40.860>to <00:26:40.960>preserve <00:26:41.060>this. <00:26:41.159>This <00:26:41.260>is <00:26:41.360>the <00:26:41.460>the <00:26:41.560>mode. <00:26:41.659>This <00:26:41.760>is <00:26:41.860>those <00:26:41.960>golden 00:26:42.470 --> 00:26:42.480 align:start position:0% <00:26:42.470>is <00:26:42.471>the <00:26:42.472>the <00:26:42.473>mode. <00:26:42.475>This <00:26:42.476>is <00:26:42.477>those <00:26:42.479>golden 00:26:42.480 --> 00:26:44.310 align:start position:0% <00:26:42.480>is <00:26:42.580>the <00:26:42.680>the <00:26:42.780>mode. <00:26:42.880>This <00:26:42.980>is <00:26:43.080>those <00:26:43.180>golden <00:26:43.280>nuggets <00:26:43.380>of <00:26:43.480>information <00:26:43.580>that <00:26:43.680>you <00:26:43.780>have <00:26:43.880>in 00:26:44.310 --> 00:26:44.320 align:start position:0% <00:26:44.310>nuggets <00:26:44.311>of <00:26:44.312>information <00:26:44.314>that <00:26:44.316>you <00:26:44.317>have <00:26:44.319>in 00:26:44.320 --> 00:26:46.470 align:start position:0% <00:26:44.320>nuggets <00:26:44.427>of <00:26:44.535>information <00:26:44.643>that <00:26:44.750>you <00:26:44.858>have <00:26:44.966>in <00:26:45.073>your <00:26:45.181>companies, <00:26:45.289>but <00:26:45.396>you <00:26:45.504>have <00:26:45.612>to <00:26:45.720>codify 00:26:46.470 --> 00:26:46.480 align:start position:0% <00:26:46.470>your <00:26:46.471>companies, <00:26:46.473>but <00:26:46.474>you <00:26:46.476>have <00:26:46.477>to <00:26:46.479>codify 00:26:46.480 --> 00:26:48.750 align:start position:0% <00:26:46.480>your <00:26:46.580>companies, <00:26:46.680>but <00:26:46.780>you <00:26:46.880>have <00:26:46.980>to <00:26:47.080>codify <00:26:47.180>them <00:26:47.280>and <00:26:47.380>expose <00:26:47.480>to <00:26:47.580>your <00:26:47.680>AI <00:26:47.780>agents." <00:26:47.880>This 00:26:48.750 --> 00:26:48.760 align:start position:0% <00:26:48.750>them <00:26:48.751>and <00:26:48.752>expose <00:26:48.753>to <00:26:48.755>your <00:26:48.756>AI <00:26:48.757>agents." <00:26:48.759>This 00:26:48.760 --> 00:26:50.670 align:start position:0% <00:26:48.760>them <00:26:48.860>and <00:26:48.960>expose <00:26:49.060>to <00:26:49.160>your <00:26:49.260>AI <00:26:49.360>agents." <00:26:49.460>This <00:26:49.560>is <00:26:49.660>the <00:26:49.760>thing <00:26:49.860>to <00:26:49.960>to <00:26:50.060>start <00:26:50.160>with. 00:26:50.670 --> 00:26:50.680 align:start position:0% <00:26:50.670>is <00:26:50.671>the <00:26:50.673>thing <00:26:50.674>to <00:26:50.676>to <00:26:50.677>start <00:26:50.679>with. 00:26:50.680 --> 00:26:52.230 align:start position:0% <00:26:50.680>is <00:26:50.787>the <00:26:50.894>thing <00:26:51.001>to <00:26:51.109>to <00:26:51.216>start <00:26:51.323>with. <00:26:51.431>Then <00:26:51.538>what? <00:26:51.645>Well, <00:26:51.753>probably <00:26:51.860>you <00:26:51.967>want <00:26:52.075>to 00:26:52.230 --> 00:26:52.240 align:start position:0% <00:26:52.230>Then <00:26:52.231>what? <00:26:52.233>Well, <00:26:52.234>probably <00:26:52.236>you <00:26:52.237>want <00:26:52.239>to 00:26:52.240 --> 00:26:53.430 align:start position:0% <00:26:52.240>Then <00:26:52.322>what? <00:26:52.404>Well, <00:26:52.487>probably <00:26:52.569>you <00:26:52.651>want <00:26:52.734>to <00:26:52.816>you're <00:26:52.899>going <00:26:52.981>to <00:26:53.063>build <00:26:53.146>an <00:26:53.228>agent, <00:26:53.311>right? 00:26:53.430 --> 00:26:53.440 align:start position:0% <00:26:53.430>you're <00:26:53.431>going <00:26:53.433>to <00:26:53.434>build <00:26:53.436>an <00:26:53.437>agent, <00:26:53.439>right? 00:26:53.440 --> 00:26:54.990 align:start position:0% <00:26:53.440>you're <00:26:53.579>going <00:26:53.719>to <00:26:53.858>build <00:26:53.998>an <00:26:54.137>agent, <00:26:54.277>right? <00:26:54.416>Whatever <00:26:54.556>that <00:26:54.695>agent <00:26:54.835>is. 00:26:54.990 --> 00:26:55.000 align:start position:0% <00:26:54.990>Whatever <00:26:54.993>that <00:26:54.996>agent <00:26:54.999>is. 00:26:55.000 --> 00:26:56.710 align:start position:0% <00:26:55.000>Whatever <00:26:55.127>that <00:26:55.254>agent <00:26:55.381>is. <00:26:55.509>So, <00:26:55.636>how <00:26:55.763>do <00:26:55.890>you <00:26:56.018>build <00:26:56.145>an <00:26:56.272>agent? <00:26:56.400>Like, 00:26:56.710 --> 00:26:56.720 align:start position:0% <00:26:56.710>So, <00:26:56.711>how <00:26:56.712>do <00:26:56.713>you <00:26:56.715>build <00:26:56.716>an <00:26:56.717>agent? <00:26:56.719>Like, 00:26:56.720 --> 00:26:58.390 align:start position:0% <00:26:56.720>So, <00:26:56.807>how <00:26:56.895>do <00:26:56.982>you <00:26:57.070>build <00:26:57.157>an <00:26:57.245>agent? <00:26:57.332>Like, <00:26:57.420>what <00:26:57.507>do <00:26:57.595>we <00:26:57.682>put <00:26:57.770>on <00:26:57.857>the <00:26:57.945>board? <00:26:58.032>We <00:26:58.120>put 00:26:58.390 --> 00:26:58.400 align:start position:0% <00:26:58.390>what <00:26:58.391>do <00:26:58.392>we <00:26:58.393>put <00:26:58.394>on <00:26:58.395>the <00:26:58.396>board? <00:26:58.397>We <00:26:58.399>put 00:26:58.400 --> 00:27:00.190 align:start position:0% <00:26:58.400>what <00:26:58.500>do <00:26:58.600>we <00:26:58.700>put <00:26:58.800>on <00:26:58.900>the <00:26:59.000>board? <00:26:59.100>We <00:26:59.200>put <00:26:59.300>eval, <00:26:59.400>backtest, <00:26:59.500>and <00:26:59.600>AB <00:26:59.700>test. <00:26:59.800>There's 00:27:00.190 --> 00:27:00.200 align:start position:0% <00:27:00.190>eval, <00:27:00.191>backtest, <00:27:00.193>and <00:27:00.195>AB <00:27:00.197>test. <00:27:00.199>There's 00:27:00.200 --> 00:27:01.670 align:start position:0% <00:27:00.200>eval, <00:27:00.320>backtest, <00:27:00.440>and <00:27:00.560>AB <00:27:00.681>test. <00:27:00.801>There's <00:27:00.921>nothing <00:27:01.041>else. <00:27:01.162>Like, <00:27:01.282>there's <00:27:01.402>no <00:27:01.523>secret 00:27:01.670 --> 00:27:01.680 align:start position:0% <00:27:01.670>nothing <00:27:01.671>else. <00:27:01.673>Like, <00:27:01.675>there's <00:27:01.677>no <00:27:01.679>secret 00:27:01.680 --> 00:27:02.990 align:start position:0% <00:27:01.680>nothing <00:27:01.764>else. <00:27:01.848>Like, <00:27:01.932>there's <00:27:02.016>no <00:27:02.101>secret <00:27:02.185>sauce. <00:27:02.269>This <00:27:02.353>is <00:27:02.437>the <00:27:02.522>only <00:27:02.606>way <00:27:02.690>to <00:27:02.774>build <00:27:02.859>an 00:27:02.990 --> 00:27:03.000 align:start position:0% <00:27:02.990>sauce. <00:27:02.991>This <00:27:02.992>is <00:27:02.993>the <00:27:02.994>only <00:27:02.995>way <00:27:02.996>to <00:27:02.997>build <00:27:02.999>an 00:27:03.000 --> 00:27:04.630 align:start position:0% <00:27:03.000>sauce. <00:27:03.087>This <00:27:03.175>is <00:27:03.262>the <00:27:03.350>only <00:27:03.437>way <00:27:03.525>to <00:27:03.612>build <00:27:03.700>an <00:27:03.787>agent. <00:27:03.875>In <00:27:03.962>fact, <00:27:04.050>you <00:27:04.137>can <00:27:04.225>write <00:27:04.312>code <00:27:04.400>an 00:27:04.630 --> 00:27:04.640 align:start position:0% <00:27:04.630>agent. <00:27:04.631>In <00:27:04.632>fact, <00:27:04.633>you <00:27:04.635>can <00:27:04.636>write <00:27:04.637>code <00:27:04.639>an 00:27:04.640 --> 00:27:06.670 align:start position:0% <00:27:04.640>agent. <00:27:04.733>In <00:27:04.826>fact, <00:27:04.920>you <00:27:05.013>can <00:27:05.106>write <00:27:05.200>code <00:27:05.293>an <00:27:05.386>agent <00:27:05.480>in <00:27:05.573>an <00:27:05.666>hour <00:27:05.760>right <00:27:05.853>here. <00:27:05.946>But, <00:27:06.040>this 00:27:06.670 --> 00:27:06.680 align:start position:0% <00:27:06.670>agent <00:27:06.671>in <00:27:06.672>an <00:27:06.673>hour <00:27:06.675>right <00:27:06.676>here. <00:27:06.677>But, <00:27:06.679>this 00:27:06.680 --> 00:27:08.550 align:start position:0% <00:27:06.680>agent <00:27:06.767>in <00:27:06.855>an <00:27:06.942>hour <00:27:07.030>right <00:27:07.117>here. <00:27:07.205>But, <00:27:07.292>this <00:27:07.380>takes <00:27:07.467>a <00:27:07.555>lot <00:27:07.642>of <00:27:07.730>time, <00:27:07.817>and <00:27:07.905>this <00:27:07.992>is <00:27:08.080>the 00:27:08.550 --> 00:27:08.560 align:start position:0% <00:27:08.550>takes <00:27:08.551>a <00:27:08.552>lot <00:27:08.553>of <00:27:08.554>time, <00:27:08.555>and <00:27:08.556>this <00:27:08.557>is <00:27:08.559>the 00:27:08.560 --> 00:27:10.110 align:start position:0% <00:27:08.560>takes <00:27:08.653>a <00:27:08.745>lot <00:27:08.839>of <00:27:08.932>time, <00:27:09.024>and <00:27:09.118>this <00:27:09.211>is <00:27:09.303>the <00:27:09.397>this <00:27:09.490>is <00:27:09.582>the <00:27:09.676>real <00:27:09.769>value. <00:27:09.861>Because <00:27:09.955>without 00:27:10.110 --> 00:27:10.120 align:start position:0% <00:27:10.110>this <00:27:10.111>is <00:27:10.112>the <00:27:10.114>real <00:27:10.116>value. <00:27:10.117>Because <00:27:10.119>without 00:27:10.120 --> 00:27:11.110 align:start position:0% <00:27:10.120>this <00:27:10.183>is <00:27:10.247>the <00:27:10.310>real <00:27:10.374>value. <00:27:10.438>Because <00:27:10.501>without <00:27:10.565>this, <00:27:10.629>you're <00:27:10.692>not <00:27:10.756>going <00:27:10.820>to <00:27:10.883>be <00:27:10.947>able <00:27:11.011>to 00:27:11.110 --> 00:27:11.120 align:start position:0% <00:27:11.110>this, <00:27:11.111>you're <00:27:11.112>not <00:27:11.113>going <00:27:11.115>to <00:27:11.116>be <00:27:11.117>able <00:27:11.119>to 00:27:11.120 --> 00:27:12.350 align:start position:0% <00:27:11.120>this, <00:27:11.199>you're <00:27:11.278>not <00:27:11.357>going <00:27:11.436>to <00:27:11.515>be <00:27:11.594>able <00:27:11.673>to <00:27:11.752>iterate <00:27:11.831>on <00:27:11.910>the <00:27:11.989>quality. <00:27:12.068>You're <00:27:12.147>going <00:27:12.226>to 00:27:12.350 --> 00:27:12.360 align:start position:0% <00:27:12.350>iterate <00:27:12.351>on <00:27:12.352>the <00:27:12.354>quality. <00:27:12.356>You're <00:27:12.357>going <00:27:12.359>to 00:27:12.360 --> 00:27:13.950 align:start position:0% <00:27:12.360>iterate <00:27:12.467>on <00:27:12.575>the <00:27:12.683>quality. <00:27:12.790>You're <00:27:12.898>going <00:27:13.006>to <00:27:13.113>YOLO <00:27:13.221>some <00:27:13.329>stuff <00:27:13.436>in <00:27:13.544>production. <00:27:13.652>It's <00:27:13.760>not 00:27:13.950 --> 00:27:13.960 align:start position:0% <00:27:13.950>YOLO <00:27:13.951>some <00:27:13.953>stuff <00:27:13.954>in <00:27:13.956>production. <00:27:13.957>It's <00:27:13.959>not 00:27:13.960 --> 00:27:15.510 align:start position:0% <00:27:13.960>YOLO <00:27:14.067>some <00:27:14.174>stuff <00:27:14.281>in <00:27:14.389>production. <00:27:14.496>It's <00:27:14.603>not <00:27:14.711>going <00:27:14.818>to <00:27:14.925>work. <00:27:15.033>You <00:27:15.140>get <00:27:15.247>your <00:27:15.355>users 00:27:15.510 --> 00:27:15.520 align:start position:0% <00:27:15.510>going <00:27:15.511>to <00:27:15.513>work. <00:27:15.514>You <00:27:15.516>get <00:27:15.517>your <00:27:15.519>users 00:27:15.520 --> 00:27:17.430 align:start position:0% <00:27:15.520>going <00:27:15.627>to <00:27:15.735>work. <00:27:15.843>You <00:27:15.950>get <00:27:16.058>your <00:27:16.166>users <00:27:16.273>confused, <00:27:16.381>and <00:27:16.489>that <00:27:16.596>agent <00:27:16.704>will <00:27:16.812>become <00:27:16.920>a 00:27:17.430 --> 00:27:17.440 align:start position:0% <00:27:17.430>confused, <00:27:17.431>and <00:27:17.433>that <00:27:17.434>agent <00:27:17.436>will <00:27:17.437>become <00:27:17.439>a 00:27:17.440 --> 00:27:19.590 align:start position:0% <00:27:17.440>confused, <00:27:17.640>and <00:27:17.840>that <00:27:18.040>agent <00:27:18.240>will <00:27:18.440>become <00:27:18.640>a <00:27:18.840>fossil. 00:27:19.590 --> 00:27:19.600 align:start position:0% fossil. 00:27:19.600 --> 00:27:21.150 align:start position:0% <00:27:19.600>fossil. <00:27:19.754>So, <00:27:19.909>you <00:27:20.065>really <00:27:20.220>need <00:27:20.375>to <00:27:20.530>figure <00:27:20.685>out <00:27:20.840>how <00:27:20.995>to 00:27:21.150 --> 00:27:21.160 align:start position:0% <00:27:21.150>So, <00:27:21.151>you <00:27:21.152>really <00:27:21.153>need <00:27:21.154>to <00:27:21.155>figure <00:27:21.156>out <00:27:21.157>how <00:27:21.159>to 00:27:21.160 --> 00:27:22.670 align:start position:0% <00:27:21.160>So, <00:27:21.250>you <00:27:21.341>really <00:27:21.431>need <00:27:21.522>to <00:27:21.613>figure <00:27:21.703>out <00:27:21.794>how <00:27:21.884>to <00:27:21.975>build <00:27:22.066>that <00:27:22.156>flywheel. <00:27:22.247>How <00:27:22.337>to <00:27:22.428>create <00:27:22.519>this 00:27:22.670 --> 00:27:22.680 align:start position:0% <00:27:22.670>build <00:27:22.671>that <00:27:22.673>flywheel. <00:27:22.674>How <00:27:22.676>to <00:27:22.677>create <00:27:22.679>this 00:27:22.680 --> 00:27:24.670 align:start position:0% <00:27:22.680>build <00:27:22.796>that <00:27:22.913>flywheel. <00:27:23.030>How <00:27:23.146>to <00:27:23.263>create <00:27:23.380>this <00:27:23.496>evaluation <00:27:23.613>framework, <00:27:23.730>how <00:27:23.846>to <00:27:23.963>create <00:27:24.080>the 00:27:24.670 --> 00:27:24.680 align:start position:0% <00:27:24.670>evaluation <00:27:24.671>framework, <00:27:24.673>how <00:27:24.675>to <00:27:24.677>create <00:27:24.679>the 00:27:24.680 --> 00:27:26.510 align:start position:0% <00:27:24.680>evaluation <00:27:24.796>framework, <00:27:24.913>how <00:27:25.030>to <00:27:25.146>create <00:27:25.263>the <00:27:25.380>ground <00:27:25.496>truth, <00:27:25.613>how <00:27:25.730>to <00:27:25.846>iterate <00:27:25.963>on <00:27:26.080>your 00:27:26.510 --> 00:27:26.520 align:start position:0% <00:27:26.510>ground <00:27:26.511>truth, <00:27:26.513>how <00:27:26.514>to <00:27:26.516>iterate <00:27:26.517>on <00:27:26.519>your 00:27:26.520 --> 00:27:28.630 align:start position:0% <00:27:26.520>ground <00:27:26.627>truth, <00:27:26.735>how <00:27:26.843>to <00:27:26.950>iterate <00:27:27.058>on <00:27:27.166>your <00:27:27.273>prompts, <00:27:27.381>and <00:27:27.489>iterate <00:27:27.596>on <00:27:27.704>those <00:27:27.812>data <00:27:27.920>sets, 00:27:28.630 --> 00:27:28.640 align:start position:0% <00:27:28.630>prompts, <00:27:28.631>and <00:27:28.633>iterate <00:27:28.634>on <00:27:28.636>those <00:27:28.637>data <00:27:28.639>sets, 00:27:28.640 --> 00:27:29.630 align:start position:0% <00:27:28.640>prompts, <00:27:28.767>and <00:27:28.894>iterate <00:27:29.021>on <00:27:29.149>those <00:27:29.276>data <00:27:29.403>sets, <00:27:29.531>and 00:27:29.630 --> 00:27:29.640 align:start position:0% and 00:27:29.640 --> 00:27:31.590 align:start position:0% <00:27:29.640>and <00:27:29.815>data <00:27:29.990>to <00:27:30.165>it, <00:27:30.340>and <00:27:30.515>more <00:27:30.690>pull <00:27:30.865>requests, <00:27:31.040>and 00:27:31.590 --> 00:27:31.600 align:start position:0% <00:27:31.590>data <00:27:31.591>to <00:27:31.592>it, <00:27:31.593>and <00:27:31.595>more <00:27:31.596>pull <00:27:31.597>requests, <00:27:31.599>and 00:27:31.600 --> 00:27:33.750 align:start position:0% <00:27:31.600>data <00:27:31.699>to <00:27:31.800>it, <00:27:31.899>and <00:27:32.000>more <00:27:32.100>pull <00:27:32.199>requests, <00:27:32.300>and <00:27:32.399>more <00:27:32.500>more <00:27:32.600>ground <00:27:32.699>truth, <00:27:32.800>and <00:27:32.899>keep <00:27:33.000>this 00:27:33.750 --> 00:27:33.760 align:start position:0% <00:27:33.750>more <00:27:33.751>more <00:27:33.753>ground <00:27:33.754>truth, <00:27:33.756>and <00:27:33.757>keep <00:27:33.759>this 00:27:33.760 --> 00:27:35.110 align:start position:0% <00:27:33.760>more <00:27:33.846>more <00:27:33.933>ground <00:27:34.020>truth, <00:27:34.107>and <00:27:34.193>keep <00:27:34.280>this <00:27:34.367>going. <00:27:34.454>It's <00:27:34.541>not <00:27:34.627>an <00:27:34.714>end <00:27:34.801>state. <00:27:34.888>It's <00:27:34.975>a 00:27:35.110 --> 00:27:35.120 align:start position:0% <00:27:35.110>going. <00:27:35.111>It's <00:27:35.112>not <00:27:35.113>an <00:27:35.115>end <00:27:35.116>state. <00:27:35.117>It's <00:27:35.119>a 00:27:35.120 --> 00:27:38.030 align:start position:0% <00:27:35.120>going. <00:27:35.227>It's <00:27:35.335>not <00:27:35.443>an <00:27:35.550>end <00:27:35.658>state. <00:27:35.766>It's <00:27:35.873>a <00:27:35.981>process, <00:27:36.089>right? <00:27:36.196>So, <00:27:36.304>you <00:27:36.412>have <00:27:36.520>to 00:27:38.030 --> 00:27:38.040 align:start position:0% <00:27:38.030>process, <00:27:38.031>right? <00:27:38.033>So, <00:27:38.035>you <00:27:38.037>have <00:27:38.039>to 00:27:38.040 --> 00:27:39.550 align:start position:0% <00:27:38.040>process, <00:27:38.175>right? <00:27:38.311>So, <00:27:38.447>you <00:27:38.583>have <00:27:38.719>to <00:27:38.855>establish <00:27:38.991>this <00:27:39.127>flywheel <00:27:39.263>process. <00:27:39.399>In 00:27:39.550 --> 00:27:39.560 align:start position:0% <00:27:39.550>establish <00:27:39.552>this <00:27:39.554>flywheel <00:27:39.556>process. <00:27:39.559>In 00:27:39.560 --> 00:27:41.470 align:start position:0% <00:27:39.560>establish <00:27:39.676>this <00:27:39.793>flywheel <00:27:39.909>process. <00:27:40.026>In <00:27:40.143>fact, <00:27:40.260>if <00:27:40.376>you're <00:27:40.493>buying <00:27:40.610>an <00:27:40.726>agent <00:27:40.843>off <00:27:40.960>the 00:27:41.470 --> 00:27:41.480 align:start position:0% <00:27:41.470>fact, <00:27:41.471>if <00:27:41.472>you're <00:27:41.473>buying <00:27:41.475>an <00:27:41.476>agent <00:27:41.477>off <00:27:41.479>the 00:27:41.480 --> 00:27:42.870 align:start position:0% <00:27:41.480>fact, <00:27:41.569>if <00:27:41.658>you're <00:27:41.748>buying <00:27:41.837>an <00:27:41.926>agent <00:27:42.016>off <00:27:42.105>the <00:27:42.194>shelf, <00:27:42.284>this <00:27:42.373>is <00:27:42.462>the <00:27:42.552>first <00:27:42.641>question <00:27:42.731>you 00:27:42.870 --> 00:27:42.880 align:start position:0% <00:27:42.870>shelf, <00:27:42.871>this <00:27:42.873>is <00:27:42.874>the <00:27:42.876>first <00:27:42.877>question <00:27:42.879>you 00:27:42.880 --> 00:27:44.470 align:start position:0% <00:27:42.880>shelf, <00:27:42.980>this <00:27:43.080>is <00:27:43.180>the <00:27:43.280>first <00:27:43.380>question <00:27:43.480>you <00:27:43.580>have <00:27:43.680>to <00:27:43.780>ask <00:27:43.880>the <00:27:43.980>vendor. <00:27:44.080>Don't <00:27:44.180>show <00:27:44.280>me 00:27:44.470 --> 00:27:44.480 align:start position:0% <00:27:44.470>have <00:27:44.471>to <00:27:44.472>ask <00:27:44.473>the <00:27:44.475>vendor. <00:27:44.476>Don't <00:27:44.477>show <00:27:44.479>me 00:27:44.480 --> 00:27:45.710 align:start position:0% <00:27:44.480>have <00:27:44.565>to <00:27:44.650>ask <00:27:44.735>the <00:27:44.820>vendor. <00:27:44.905>Don't <00:27:44.990>show <00:27:45.076>me <00:27:45.161>your <00:27:45.246>agent. <00:27:45.331>Show <00:27:45.416>me <00:27:45.501>your <00:27:45.587>evaluation 00:27:45.710 --> 00:27:45.720 align:start position:0% <00:27:45.710>your <00:27:45.711>agent. <00:27:45.713>Show <00:27:45.715>me <00:27:45.717>your <00:27:45.719>evaluation 00:27:45.720 --> 00:27:46.710 align:start position:0% <00:27:45.720>your <00:27:45.801>agent. <00:27:45.882>Show <00:27:45.963>me <00:27:46.044>your <00:27:46.125>evaluation <00:27:46.206>framework. <00:27:46.287>How <00:27:46.368>do <00:27:46.449>you <00:27:46.530>control <00:27:46.611>the 00:27:46.710 --> 00:27:46.720 align:start position:0% <00:27:46.710>framework. <00:27:46.711>How <00:27:46.713>do <00:27:46.715>you <00:27:46.717>control <00:27:46.719>the 00:27:46.720 --> 00:27:48.670 align:start position:0% <00:27:46.720>framework. <00:27:46.827>How <00:27:46.935>do <00:27:47.043>you <00:27:47.150>control <00:27:47.258>the <00:27:47.366>quality, <00:27:47.473>right? <00:27:47.581>How <00:27:47.689>can <00:27:47.796>I <00:27:47.904>rely <00:27:48.012>on <00:27:48.120>your 00:27:48.670 --> 00:27:48.680 align:start position:0% <00:27:48.670>quality, <00:27:48.671>right? <00:27:48.672>How <00:27:48.673>can <00:27:48.675>I <00:27:48.676>rely <00:27:48.677>on <00:27:48.679>your 00:27:48.680 --> 00:27:51.569 align:start position:0% <00:27:48.680>quality, <00:27:48.780>right? <00:27:48.880>How <00:27:48.980>can <00:27:49.080>I <00:27:49.180>rely <00:27:49.280>on <00:27:49.380>your <00:27:49.480>agent <00:27:49.580>to <00:27:49.680>do <00:27:49.780>a <00:27:49.880>consistently <00:27:49.980>good <00:27:50.080>job? 00:27:51.569 --> 00:27:51.579 align:start position:0% <00:27:51.569>agent <00:27:51.570>to <00:27:51.572>do <00:27:51.573>a <00:27:51.575>consistently <00:27:51.576>good <00:27:51.578>job? 00:27:51.579 --> 00:27:53.310 align:start position:0% <00:27:51.579>agent <00:27:51.754>to <00:27:51.928>do <00:27:52.104>a <00:27:52.279>consistently <00:27:52.454>good <00:27:52.629>job? <00:27:52.803>>> <00:27:52.979>[snorts] 00:27:53.310 --> 00:27:53.320 align:start position:0% <00:27:53.310>>> <00:27:53.319>[snorts] 00:27:53.320 --> 00:27:55.670 align:start position:0% <00:27:53.320>>> <00:27:53.460>[snorts] <00:27:53.600>>> <00:27:53.740>The <00:27:53.879>next <00:27:54.020>thing <00:27:54.159>is <00:27:54.300>the <00:27:54.439>whatever <00:27:54.580>you <00:27:54.720>do, 00:27:55.670 --> 00:27:55.680 align:start position:0% <00:27:55.670>>> <00:27:55.671>The <00:27:55.672>next <00:27:55.673>thing <00:27:55.674>is <00:27:55.675>the <00:27:55.676>whatever <00:27:55.677>you <00:27:55.679>do, 00:27:55.680 --> 00:27:57.350 align:start position:0% <00:27:55.680>>> <00:27:55.773>The <00:27:55.866>next <00:27:55.960>thing <00:27:56.053>is <00:27:56.146>the <00:27:56.240>whatever <00:27:56.333>you <00:27:56.426>do, <00:27:56.520>whatever <00:27:56.613>you <00:27:56.706>build, <00:27:56.800>whatever <00:27:56.893>the <00:27:56.986>way <00:27:57.080>you 00:27:57.350 --> 00:27:57.360 align:start position:0% <00:27:57.350>whatever <00:27:57.351>you <00:27:57.352>build, <00:27:57.354>whatever <00:27:57.356>the <00:27:57.357>way <00:27:57.359>you 00:27:57.360 --> 00:27:58.750 align:start position:0% <00:27:57.360>whatever <00:27:57.449>you <00:27:57.538>build, <00:27:57.628>whatever <00:27:57.717>the <00:27:57.806>way <00:27:57.896>you <00:27:57.985>interact <00:27:58.074>with <00:27:58.164>the <00:27:58.253>agent, <00:27:58.342>it <00:27:58.432>has <00:27:58.521>to <00:27:58.610>be 00:27:58.750 --> 00:27:58.760 align:start position:0% <00:27:58.750>interact <00:27:58.751>with <00:27:58.752>the <00:27:58.753>agent, <00:27:58.755>it <00:27:58.756>has <00:27:58.757>to <00:27:58.759>be 00:27:58.760 --> 00:28:00.550 align:start position:0% <00:27:58.760>interact <00:27:58.853>with <00:27:58.946>the <00:27:59.040>agent, <00:27:59.133>it <00:27:59.226>has <00:27:59.320>to <00:27:59.413>be <00:27:59.506>agentic <00:27:59.600>first. <00:27:59.693>No <00:27:59.786>one <00:27:59.879>has <00:27:59.973>time <00:28:00.066>to <00:28:00.160>click 00:28:00.550 --> 00:28:00.560 align:start position:0% <00:28:00.550>agentic <00:28:00.551>first. <00:28:00.552>No <00:28:00.553>one <00:28:00.555>has <00:28:00.556>time <00:28:00.557>to <00:28:00.559>click 00:28:00.560 --> 00:28:02.870 align:start position:0% <00:28:00.560>agentic <00:28:00.659>first. <00:28:00.760>No <00:28:00.860>one <00:28:00.960>has <00:28:01.060>time <00:28:01.159>to <00:28:01.260>click <00:28:01.360>the <00:28:01.460>buttons, <00:28:01.560>open <00:28:01.659>UI, <00:28:01.760>like <00:28:01.860>figure <00:28:01.960>out 00:28:02.870 --> 00:28:02.880 align:start position:0% <00:28:02.870>the <00:28:02.871>buttons, <00:28:02.873>open <00:28:02.874>UI, <00:28:02.876>like <00:28:02.877>figure <00:28:02.879>out 00:28:02.880 --> 00:28:04.470 align:start position:0% <00:28:02.880>the <00:28:02.996>buttons, <00:28:03.113>open <00:28:03.230>UI, <00:28:03.346>like <00:28:03.463>figure <00:28:03.580>out <00:28:03.696>what <00:28:03.813>the <00:28:03.930>hell <00:28:04.046>is <00:28:04.163>going <00:28:04.280>on. 00:28:04.470 --> 00:28:04.480 align:start position:0% <00:28:04.470>what <00:28:04.471>the <00:28:04.473>hell <00:28:04.475>is <00:28:04.477>going <00:28:04.479>on. 00:28:04.480 --> 00:28:05.750 align:start position:0% <00:28:04.480>what <00:28:04.583>the <00:28:04.687>hell <00:28:04.791>is <00:28:04.895>going <00:28:04.999>on. <00:28:05.103>They <00:28:05.207>will <00:28:05.311>be <00:28:05.415>interacting <00:28:05.519>with <00:28:05.623>your 00:28:05.750 --> 00:28:05.760 align:start position:0% <00:28:05.750>They <00:28:05.751>will <00:28:05.753>be <00:28:05.755>interacting <00:28:05.757>with <00:28:05.759>your 00:28:05.760 --> 00:28:07.750 align:start position:0% <00:28:05.760>They <00:28:05.876>will <00:28:05.993>be <00:28:06.110>interacting <00:28:06.226>with <00:28:06.343>your <00:28:06.460>system <00:28:06.576>through <00:28:06.693>their <00:28:06.810>code <00:28:06.926>and <00:28:07.043>agent. <00:28:07.160>So, 00:28:07.750 --> 00:28:07.760 align:start position:0% <00:28:07.750>system <00:28:07.751>through <00:28:07.753>their <00:28:07.754>code <00:28:07.756>and <00:28:07.757>agent. <00:28:07.759>So, 00:28:07.760 --> 00:28:09.430 align:start position:0% <00:28:07.760>system <00:28:07.853>through <00:28:07.946>their <00:28:08.040>code <00:28:08.133>and <00:28:08.226>agent. <00:28:08.320>So, <00:28:08.413>you <00:28:08.506>have <00:28:08.600>you <00:28:08.693>have <00:28:08.786>to <00:28:08.879>make <00:28:08.973>your <00:28:09.066>system <00:28:09.160>to 00:28:09.430 --> 00:28:09.440 align:start position:0% <00:28:09.430>you <00:28:09.431>have <00:28:09.432>you <00:28:09.433>have <00:28:09.434>to <00:28:09.435>make <00:28:09.436>your <00:28:09.437>system <00:28:09.439>to 00:28:09.440 --> 00:28:11.270 align:start position:0% <00:28:09.440>you <00:28:09.533>have <00:28:09.626>you <00:28:09.720>have <00:28:09.813>to <00:28:09.906>make <00:28:10.000>your <00:28:10.093>system <00:28:10.186>to <00:28:10.280>be <00:28:10.373>agentic <00:28:10.466>friendly, <00:28:10.560>have <00:28:10.653>to <00:28:10.746>be <00:28:10.840>agentic 00:28:11.270 --> 00:28:11.280 align:start position:0% <00:28:11.270>be <00:28:11.271>agentic <00:28:11.273>friendly, <00:28:11.274>have <00:28:11.276>to <00:28:11.277>be <00:28:11.279>agentic 00:28:11.280 --> 00:28:13.350 align:start position:0% <00:28:11.280>be <00:28:11.373>agentic <00:28:11.466>friendly, <00:28:11.560>have <00:28:11.653>to <00:28:11.746>be <00:28:11.840>agentic <00:28:11.933>first. <00:28:12.026>And <00:28:12.120>MCP <00:28:12.213>seems <00:28:12.306>like <00:28:12.399>a <00:28:12.493>good <00:28:12.586>way <00:28:12.680>to 00:28:13.350 --> 00:28:13.360 align:start position:0% <00:28:13.350>first. <00:28:13.351>And <00:28:13.352>MCP <00:28:13.353>seems <00:28:13.354>like <00:28:13.355>a <00:28:13.356>good <00:28:13.357>way <00:28:13.359>to 00:28:13.360 --> 00:28:15.030 align:start position:0% <00:28:13.360>first. <00:28:13.500>And <00:28:13.639>MCP <00:28:13.780>seems <00:28:13.919>like <00:28:14.060>a <00:28:14.199>good <00:28:14.340>way <00:28:14.479>to <00:28:14.620>do <00:28:14.760>this. 00:28:15.030 --> 00:28:15.040 align:start position:0% <00:28:15.030>do <00:28:15.039>this. 00:28:15.040 --> 00:28:17.150 align:start position:0% <00:28:15.040>do <00:28:15.273>this. <00:28:15.506>And <00:28:15.740>the <00:28:15.973>most <00:28:16.206>important <00:28:16.440>part, 00:28:17.150 --> 00:28:17.160 align:start position:0% <00:28:17.150>And <00:28:17.152>the <00:28:17.154>most <00:28:17.156>important <00:28:17.159>part, 00:28:17.160 --> 00:28:18.390 align:start position:0% <00:28:17.160>And <00:28:17.260>the <00:28:17.361>most <00:28:17.461>important <00:28:17.562>part, <00:28:17.663>if <00:28:17.763>you're <00:28:17.864>buying <00:28:17.965>off <00:28:18.065>the <00:28:18.166>shelf <00:28:18.267>or 00:28:18.390 --> 00:28:18.400 align:start position:0% <00:28:18.390>if <00:28:18.391>you're <00:28:18.393>buying <00:28:18.394>off <00:28:18.396>the <00:28:18.397>shelf <00:28:18.399>or 00:28:18.400 --> 00:28:20.670 align:start position:0% <00:28:18.400>if <00:28:18.516>you're <00:28:18.633>buying <00:28:18.750>off <00:28:18.866>the <00:28:18.983>shelf <00:28:19.100>or <00:28:19.216>building, <00:28:19.333>you're <00:28:19.450>not <00:28:19.566>solving <00:28:19.683>a <00:28:19.800>technical 00:28:20.670 --> 00:28:20.680 align:start position:0% <00:28:20.670>building, <00:28:20.671>you're <00:28:20.673>not <00:28:20.675>solving <00:28:20.677>a <00:28:20.679>technical 00:28:20.680 --> 00:28:22.630 align:start position:0% <00:28:20.680>building, <00:28:20.835>you're <00:28:20.991>not <00:28:21.146>solving <00:28:21.302>a <00:28:21.457>technical <00:28:21.613>problem. <00:28:21.768>You're <00:28:21.924>shaping <00:28:22.080>your 00:28:22.630 --> 00:28:22.640 align:start position:0% <00:28:22.630>problem. <00:28:22.633>You're <00:28:22.636>shaping <00:28:22.639>your 00:28:22.640 --> 00:28:24.430 align:start position:0% <00:28:22.640>problem. <00:28:22.840>You're <00:28:23.040>shaping <00:28:23.240>your <00:28:23.440>sociotechnical <00:28:23.640>culture <00:28:23.840>in <00:28:24.040>your 00:28:24.430 --> 00:28:24.440 align:start position:0% <00:28:24.430>sociotechnical <00:28:24.433>culture <00:28:24.436>in <00:28:24.439>your 00:28:24.440 --> 00:28:25.590 align:start position:0% <00:28:24.440>sociotechnical <00:28:24.612>culture <00:28:24.785>in <00:28:24.957>your <00:28:25.129>organization. <00:28:25.302>You're <00:28:25.475>creating 00:28:25.590 --> 00:28:25.600 align:start position:0% <00:28:25.590>organization. <00:28:25.594>You're <00:28:25.599>creating 00:28:25.600 --> 00:28:26.910 align:start position:0% <00:28:25.600>organization. <00:28:25.993>You're <00:28:26.386>creating <00:28:26.779>incentives. 00:28:26.910 --> 00:28:26.920 align:start position:0% incentives. 00:28:26.920 --> 00:28:28.590 align:start position:0% <00:28:26.920>incentives. <00:28:27.095>You <00:28:27.270>have <00:28:27.445>to <00:28:27.620>be <00:28:27.795>really <00:28:27.970>careful <00:28:28.145>what <00:28:28.320>kind 00:28:28.590 --> 00:28:28.600 align:start position:0% <00:28:28.590>You <00:28:28.591>have <00:28:28.592>to <00:28:28.593>be <00:28:28.595>really <00:28:28.596>careful <00:28:28.597>what <00:28:28.599>kind 00:28:28.600 --> 00:28:29.710 align:start position:0% <00:28:28.600>You <00:28:28.683>have <00:28:28.766>to <00:28:28.849>be <00:28:28.933>really <00:28:29.016>careful <00:28:29.099>what <00:28:29.182>kind <00:28:29.266>of <00:28:29.349>incentives <00:28:29.432>you're <00:28:29.515>creating <00:28:29.599>because 00:28:29.710 --> 00:28:29.720 align:start position:0% <00:28:29.710>of <00:28:29.712>incentives <00:28:29.714>you're <00:28:29.716>creating <00:28:29.719>because 00:28:29.720 --> 00:28:30.990 align:start position:0% <00:28:29.720>of <00:28:29.834>incentives <00:28:29.948>you're <00:28:30.062>creating <00:28:30.177>because <00:28:30.291>you're <00:28:30.405>going <00:28:30.520>to <00:28:30.634>get <00:28:30.748>some <00:28:30.863>first-order 00:28:30.990 --> 00:28:31.000 align:start position:0% <00:28:30.990>you're <00:28:30.991>going <00:28:30.993>to <00:28:30.995>get <00:28:30.997>some <00:28:30.999>first-order 00:28:31.000 --> 00:28:32.350 align:start position:0% <00:28:31.000>you're <00:28:31.110>going <00:28:31.220>to <00:28:31.331>get <00:28:31.441>some <00:28:31.552>first-order <00:28:31.662>effects, <00:28:31.773>but <00:28:31.883>there <00:28:31.994>will <00:28:32.104>be <00:28:32.215>some 00:28:32.350 --> 00:28:32.360 align:start position:0% <00:28:32.350>effects, <00:28:32.351>but <00:28:32.353>there <00:28:32.355>will <00:28:32.357>be <00:28:32.359>some 00:28:32.360 --> 00:28:34.030 align:start position:0% <00:28:32.360>effects, <00:28:32.487>but <00:28:32.614>there <00:28:32.741>will <00:28:32.869>be <00:28:32.996>some <00:28:33.123>second-order <00:28:33.250>effects, <00:28:33.378>and <00:28:33.505>you <00:28:33.632>have <00:28:33.760>to 00:28:34.030 --> 00:28:34.040 align:start position:0% <00:28:34.030>second-order <00:28:34.031>effects, <00:28:34.033>and <00:28:34.035>you <00:28:34.037>have <00:28:34.039>to 00:28:34.040 --> 00:28:35.750 align:start position:0% <00:28:34.040>second-order <00:28:34.156>effects, <00:28:34.273>and <00:28:34.389>you <00:28:34.506>have <00:28:34.623>to <00:28:34.740>keep <00:28:34.856>your <00:28:34.973>eyes <00:28:35.090>open, <00:28:35.206>watch <00:28:35.323>for <00:28:35.440>those 00:28:35.750 --> 00:28:35.760 align:start position:0% <00:28:35.750>keep <00:28:35.751>your <00:28:35.753>eyes <00:28:35.754>open, <00:28:35.756>watch <00:28:35.757>for <00:28:35.759>those 00:28:35.760 --> 00:28:37.110 align:start position:0% <00:28:35.760>keep <00:28:35.846>your <00:28:35.933>eyes <00:28:36.020>open, <00:28:36.107>watch <00:28:36.193>for <00:28:36.280>those <00:28:36.367>effects, <00:28:36.454>and <00:28:36.541>be <00:28:36.627>able <00:28:36.714>to <00:28:36.801>react <00:28:36.888>to <00:28:36.975>them 00:28:37.110 --> 00:28:37.120 align:start position:0% <00:28:37.110>effects, <00:28:37.111>and <00:28:37.112>be <00:28:37.113>able <00:28:37.115>to <00:28:37.116>react <00:28:37.117>to <00:28:37.119>them 00:28:37.120 --> 00:28:40.190 align:start position:0% <00:28:37.120>effects, <00:28:37.219>and <00:28:37.320>be <00:28:37.419>able <00:28:37.520>to <00:28:37.620>react <00:28:37.719>to <00:28:37.820>them <00:28:37.919>and <00:28:38.020>adapt. <00:28:38.120>And <00:28:38.219>this <00:28:38.320>is <00:28:38.419>really <00:28:38.520>important. 00:28:40.190 --> 00:28:40.200 align:start position:0% <00:28:40.190>and <00:28:40.191>adapt. <00:28:40.193>And <00:28:40.194>this <00:28:40.196>is <00:28:40.197>really <00:28:40.199>important. 00:28:40.200 --> 00:28:42.030 align:start position:0% <00:28:40.200>and <00:28:40.293>adapt. <00:28:40.386>And <00:28:40.480>this <00:28:40.573>is <00:28:40.666>really <00:28:40.760>important. <00:28:40.853>And <00:28:40.946>that <00:28:41.040>is <00:28:41.133>about <00:28:41.226>it. <00:28:41.320>We <00:28:41.413>have <00:28:41.506>3 <00:28:41.600>minutes 00:28:42.030 --> 00:28:42.040 align:start position:0% <00:28:42.030>And <00:28:42.031>that <00:28:42.032>is <00:28:42.033>about <00:28:42.034>it. <00:28:42.035>We <00:28:42.036>have <00:28:42.037>3 <00:28:42.039>minutes 00:28:42.040 --> 00:28:44.550 align:start position:0% <00:28:42.040>And <00:28:42.139>that <00:28:42.240>is <00:28:42.340>about <00:28:42.440>it. <00:28:42.540>We <00:28:42.639>have <00:28:42.740>3 <00:28:42.840>minutes <00:28:42.940>left, <00:28:43.040>but <00:28:43.139>we're <00:28:43.240>not <00:28:43.340>going <00:28:43.440>to 00:28:44.550 --> 00:28:44.560 align:start position:0% <00:28:44.550>left, <00:28:44.551>but <00:28:44.553>we're <00:28:44.555>not <00:28:44.557>going <00:28:44.559>to 00:28:44.560 --> 00:28:46.030 align:start position:0% <00:28:44.560>left, <00:28:44.661>but <00:28:44.763>we're <00:28:44.865>not <00:28:44.967>going <00:28:45.068>to <00:28:45.170>be <00:28:45.272>able <00:28:45.374>to <00:28:45.475>to <00:28:45.577>all <00:28:45.679>the <00:28:45.781>questions, <00:28:45.883>but 00:28:46.030 --> 00:28:46.040 align:start position:0% <00:28:46.030>be <00:28:46.031>able <00:28:46.032>to <00:28:46.033>to <00:28:46.035>all <00:28:46.036>the <00:28:46.037>questions, <00:28:46.039>but 00:28:46.040 --> 00:28:47.350 align:start position:0% <00:28:46.040>be <00:28:46.118>able <00:28:46.197>to <00:28:46.275>to <00:28:46.354>all <00:28:46.433>the <00:28:46.511>questions, <00:28:46.590>but <00:28:46.668>more <00:28:46.747>importantly, <00:28:46.826>we <00:28:46.904>have <00:28:46.983>a <00:28:47.061>booth <00:28:47.140>in <00:28:47.218>the 00:28:47.350 --> 00:28:47.360 align:start position:0% <00:28:47.350>more <00:28:47.351>importantly, <00:28:47.352>we <00:28:47.353>have <00:28:47.355>a <00:28:47.356>booth <00:28:47.357>in <00:28:47.359>the 00:28:47.360 --> 00:28:49.790 align:start position:0% <00:28:47.360>more <00:28:47.467>importantly, <00:28:47.575>we <00:28:47.683>have <00:28:47.790>a <00:28:47.898>booth <00:28:48.006>in <00:28:48.113>the <00:28:48.221>other <00:28:48.329>building <00:28:48.436>near <00:28:48.544>stage <00:28:48.652>four, <00:28:48.760>Finn 00:28:49.790 --> 00:28:49.800 align:start position:0% <00:28:49.790>other <00:28:49.791>building <00:28:49.793>near <00:28:49.795>stage <00:28:49.797>four, <00:28:49.799>Finn 00:28:49.800 --> 00:28:51.750 align:start position:0% <00:28:49.800>other <00:28:49.907>building <00:28:50.015>near <00:28:50.123>stage <00:28:50.230>four, <00:28:50.338>Finn <00:28:50.446>booth. <00:28:50.553>Come <00:28:50.661>talk <00:28:50.769>to <00:28:50.876>me. <00:28:50.984>I'll <00:28:51.092>tell <00:28:51.200>you 00:28:51.750 --> 00:28:51.760 align:start position:0% <00:28:51.750>booth. <00:28:51.751>Come <00:28:51.752>talk <00:28:51.753>to <00:28:51.755>me. <00:28:51.756>I'll <00:28:51.757>tell <00:28:51.759>you 00:28:51.760 --> 00:28:54.630 align:start position:0% <00:28:51.760>booth. <00:28:51.853>Come <00:28:51.946>talk <00:28:52.040>to <00:28:52.133>me. <00:28:52.226>I'll <00:28:52.320>tell <00:28:52.413>you <00:28:52.506>all <00:28:52.600>the <00:28:52.693>details. <00:28:52.786>Unlike <00:28:52.879>some <00:28:52.973>some <00:28:53.066>of <00:28:53.160>the 00:28:54.630 --> 00:28:54.640 align:start position:0% <00:28:54.630>all <00:28:54.631>the <00:28:54.632>details. <00:28:54.633>Unlike <00:28:54.635>some <00:28:54.636>some <00:28:54.637>of <00:28:54.639>the 00:28:54.640 --> 00:28:56.110 align:start position:0% <00:28:54.640>all <00:28:54.734>the <00:28:54.829>details. <00:28:54.923>Unlike <00:28:55.018>some <00:28:55.112>some <00:28:55.207>of <00:28:55.301>the <00:28:55.396>vendors <00:28:55.490>in <00:28:55.585>here <00:28:55.679>who <00:28:55.774>do <00:28:55.868>code <00:28:55.963>review 00:28:56.110 --> 00:28:56.120 align:start position:0% <00:28:56.110>vendors <00:28:56.111>in <00:28:56.112>here <00:28:56.114>who <00:28:56.116>do <00:28:56.117>code <00:28:56.119>review 00:28:56.120 --> 00:28:57.750 align:start position:0% <00:28:56.120>vendors <00:28:56.227>in <00:28:56.335>here <00:28:56.443>who <00:28:56.550>do <00:28:56.658>code <00:28:56.766>review <00:28:56.873>agents, <00:28:56.981>they're <00:28:57.089>quite <00:28:57.196>like <00:28:57.304>KG <00:28:57.412>you <00:28:57.520>ask 00:28:57.750 --> 00:28:57.760 align:start position:0% <00:28:57.750>agents, <00:28:57.751>they're <00:28:57.753>quite <00:28:57.754>like <00:28:57.756>KG <00:28:57.757>you <00:28:57.759>ask 00:28:57.760 --> 00:28:58.910 align:start position:0% <00:28:57.760>agents, <00:28:57.833>they're <00:28:57.907>quite <00:28:57.981>like <00:28:58.055>KG <00:28:58.129>you <00:28:58.203>ask <00:28:58.277>them <00:28:58.351>a <00:28:58.425>question <00:28:58.499>like, <00:28:58.573>"I'm <00:28:58.647>not <00:28:58.721>going <00:28:58.795>to 00:28:58.910 --> 00:28:58.920 align:start position:0% <00:28:58.910>them <00:28:58.911>a <00:28:58.912>question <00:28:58.913>like, <00:28:58.915>"I'm <00:28:58.916>not <00:28:58.917>going <00:28:58.919>to 00:28:58.920 --> 00:29:00.190 align:start position:0% <00:28:58.920>them <00:28:59.015>a <00:28:59.110>question <00:28:59.205>like, <00:28:59.301>"I'm <00:28:59.396>not <00:28:59.491>going <00:28:59.586>to <00:28:59.682>tell <00:28:59.777>you <00:28:59.872>proprietary <00:28:59.967>information." <00:29:00.063>We 00:29:00.190 --> 00:29:00.200 align:start position:0% <00:29:00.190>tell <00:29:00.192>you <00:29:00.194>proprietary <00:29:00.196>information." <00:29:00.199>We 00:29:00.200 --> 00:29:01.430 align:start position:0% <00:29:00.200>tell <00:29:00.292>you <00:29:00.384>proprietary <00:29:00.476>information." <00:29:00.569>We <00:29:00.661>don't <00:29:00.753>sell <00:29:00.845>this <00:29:00.938>stuff, <00:29:01.030>so <00:29:01.122>we <00:29:01.214>don't <00:29:01.307>care. 00:29:01.430 --> 00:29:01.440 align:start position:0% <00:29:01.430>don't <00:29:01.431>sell <00:29:01.432>this <00:29:01.433>stuff, <00:29:01.435>so <00:29:01.436>we <00:29:01.437>don't <00:29:01.439>care. 00:29:01.440 --> 00:29:02.830 align:start position:0% <00:29:01.440>don't <00:29:01.529>sell <00:29:01.618>this <00:29:01.708>stuff, <00:29:01.797>so <00:29:01.886>we <00:29:01.976>don't <00:29:02.065>care. <00:29:02.154>We'll <00:29:02.244>tell <00:29:02.333>you <00:29:02.422>everything. <00:29:02.512>So, <00:29:02.601>come <00:29:02.691>talk 00:29:02.830 --> 00:29:02.840 align:start position:0% <00:29:02.830>We'll <00:29:02.831>tell <00:29:02.832>you <00:29:02.834>everything. <00:29:02.836>So, <00:29:02.837>come <00:29:02.839>talk 00:29:02.840 --> 00:29:04.430 align:start position:0% <00:29:02.840>We'll <00:29:02.933>tell <00:29:03.026>you <00:29:03.120>everything. <00:29:03.213>So, <00:29:03.306>come <00:29:03.399>talk <00:29:03.493>to <00:29:03.586>us <00:29:03.679>in <00:29:03.773>the <00:29:03.866>Finn <00:29:03.959>booth. <00:29:04.053>Thank <00:29:04.146>you <00:29:04.240>so 00:29:04.430 --> 00:29:04.440 align:start position:0% <00:29:04.430>to <00:29:04.431>us <00:29:04.432>in <00:29:04.433>the <00:29:04.434>Finn <00:29:04.435>booth. <00:29:04.436>Thank <00:29:04.437>you <00:29:04.439>so 00:29:04.440 --> 00:29:07.550 align:start position:0% <00:29:04.440>to <00:29:04.595>us <00:29:04.751>in <00:29:04.906>the <00:29:05.062>Finn <00:29:05.217>booth. <00:29:05.373>Thank <00:29:05.528>you <00:29:05.684>so <00:29:05.840>much. 00:29:07.560 --> 00:29:10.030 align:start position:0% <00:29:07.560>>> <00:29:08.960>[applause] 00:29:10.040 --> 00:29:11.990 align:start position:0% <00:29:10.040>>> <00:29:10.240>Uh <00:29:10.440>Kesha, <00:29:10.639>stay <00:29:10.840>here <00:29:11.040>for <00:29:11.240>a <00:29:11.440>second. 00:29:11.990 --> 00:29:12.000 align:start position:0% <00:29:11.990>>> <00:29:11.991>Uh <00:29:11.992>Kesha, <00:29:11.993>stay <00:29:11.995>here <00:29:11.996>for <00:29:11.997>a <00:29:11.999>second. 00:29:12.000 --> 00:29:12.470 align:start position:0% <00:29:12.000>>> <00:29:12.047>Uh <00:29:12.094>Kesha, <00:29:12.141>stay <00:29:12.188>here <00:29:12.235>for <00:29:12.282>a <00:29:12.329>second. <00:29:12.376>>> <00:29:12.423>Yeah. 00:29:12.470 --> 00:29:12.480 align:start position:0% <00:29:12.470>>> <00:29:12.479>Yeah. 00:29:12.480 --> 00:29:14.510 align:start position:0% <00:29:12.480>>> <00:29:12.620>Yeah. <00:29:12.760>>> <00:29:12.900>We <00:29:13.040>still <00:29:13.180>have <00:29:13.320>2 <00:29:13.460>and <00:29:13.600>1/2 <00:29:13.740>minutes <00:29:13.880>left. 00:29:14.510 --> 00:29:14.520 align:start position:0% <00:29:14.510>>> <00:29:14.511>We <00:29:14.512>still <00:29:14.513>have <00:29:14.514>2 <00:29:14.515>and <00:29:14.516>1/2 <00:29:14.517>minutes <00:29:14.519>left. 00:29:14.520 --> 00:29:14.750 align:start position:0% <00:29:14.520>>> <00:29:14.538>We <00:29:14.557>still <00:29:14.576>have <00:29:14.595>2 <00:29:14.614>and <00:29:14.632>1/2 <00:29:14.651>minutes <00:29:14.670>left. <00:29:14.689>>> <00:29:14.708>Oh, <00:29:14.727>yeah. 00:29:14.750 --> 00:29:14.760 align:start position:0% <00:29:14.750>>> <00:29:14.754>Oh, <00:29:14.759>yeah. 00:29:14.760 --> 00:29:15.950 align:start position:0% <00:29:14.760>>> <00:29:14.867>Oh, <00:29:14.974>yeah. <00:29:15.081>>> <00:29:15.188>And <00:29:15.295>there's <00:29:15.402>actually <00:29:15.509>been <00:29:15.616>a <00:29:15.723>lot <00:29:15.831>of 00:29:15.950 --> 00:29:15.960 align:start position:0% <00:29:15.950>>> <00:29:15.951>And <00:29:15.952>there's <00:29:15.953>actually <00:29:15.955>been <00:29:15.956>a <00:29:15.957>lot <00:29:15.959>of 00:29:15.960 --> 00:29:17.190 align:start position:0% <00:29:15.960>>> <00:29:16.045>And <00:29:16.130>there's <00:29:16.215>actually <00:29:16.300>been <00:29:16.385>a <00:29:16.470>lot <00:29:16.556>of <00:29:16.641>questions <00:29:16.726>even <00:29:16.811>though <00:29:16.896>I <00:29:16.981>said <00:29:17.067>no 00:29:17.190 --> 00:29:17.200 align:start position:0% <00:29:17.190>questions <00:29:17.191>even <00:29:17.193>though <00:29:17.195>I <00:29:17.197>said <00:29:17.199>no 00:29:17.200 --> 00:29:19.070 align:start position:0% <00:29:17.200>questions <00:29:17.327>even <00:29:17.454>though <00:29:17.581>I <00:29:17.709>said <00:29:17.836>no <00:29:17.963>questions, <00:29:18.090>but <00:29:18.218>that's <00:29:18.345>amazing <00:29:18.472>because <00:29:18.600>we 00:29:19.070 --> 00:29:19.080 align:start position:0% <00:29:19.070>questions, <00:29:19.071>but <00:29:19.073>that's <00:29:19.075>amazing <00:29:19.077>because <00:29:19.079>we 00:29:19.080 --> 00:29:20.750 align:start position:0% <00:29:19.080>questions, <00:29:19.187>but <00:29:19.295>that's <00:29:19.403>amazing <00:29:19.510>because <00:29:19.618>we <00:29:19.726>actually <00:29:19.833>got <00:29:19.941>some <00:29:20.049>good <00:29:20.156>ones. <00:29:20.264>And <00:29:20.372>I <00:29:20.480>have 00:29:20.750 --> 00:29:20.760 align:start position:0% <00:29:20.750>actually <00:29:20.751>got <00:29:20.752>some <00:29:20.753>good <00:29:20.755>ones. <00:29:20.756>And <00:29:20.757>I <00:29:20.759>have 00:29:20.760 --> 00:29:22.470 align:start position:0% <00:29:20.760>actually <00:29:20.867>got <00:29:20.975>some <00:29:21.083>good <00:29:21.190>ones. <00:29:21.298>And <00:29:21.406>I <00:29:21.513>have <00:29:21.621>one <00:29:21.729>that's <00:29:21.836>dear <00:29:21.944>to <00:29:22.052>my <00:29:22.160>heart. 00:29:22.470 --> 00:29:22.480 align:start position:0% <00:29:22.470>one <00:29:22.471>that's <00:29:22.473>dear <00:29:22.475>to <00:29:22.477>my <00:29:22.479>heart. 00:29:22.480 --> 00:29:22.910 align:start position:0% <00:29:22.480>one <00:29:22.535>that's <00:29:22.590>dear <00:29:22.645>to <00:29:22.701>my <00:29:22.756>heart. <00:29:22.811>>> <00:29:22.867>Cool. 00:29:22.910 --> 00:29:22.920 align:start position:0% <00:29:22.910>>> <00:29:22.919>Cool. 00:29:22.920 --> 00:29:25.670 align:start position:0% <00:29:22.920>>> <00:29:23.047>Cool. <00:29:23.174>>> <00:29:23.301>Um <00:29:23.429>Dennis <00:29:23.556>asks, <00:29:23.683>uh <00:29:23.810>one <00:29:23.938>part <00:29:24.065>of <00:29:24.192>a <00:29:24.320>PR 00:29:25.670 --> 00:29:25.680 align:start position:0% <00:29:25.670>>> <00:29:25.671>Um <00:29:25.672>Dennis <00:29:25.673>asks, <00:29:25.674>uh <00:29:25.675>one <00:29:25.676>part <00:29:25.677>of <00:29:25.678>a <00:29:25.679>PR 00:29:25.680 --> 00:29:27.670 align:start position:0% <00:29:25.680>>> <00:29:25.787>Um <00:29:25.895>Dennis <00:29:26.003>asks, <00:29:26.110>uh <00:29:26.218>one <00:29:26.326>part <00:29:26.433>of <00:29:26.541>a <00:29:26.649>PR <00:29:26.756>review <00:29:26.864>is <00:29:26.972>knowledge <00:29:27.080>sharing. 00:29:27.670 --> 00:29:27.680 align:start position:0% <00:29:27.670>review <00:29:27.673>is <00:29:27.676>knowledge <00:29:27.679>sharing. 00:29:27.680 --> 00:29:29.510 align:start position:0% <00:29:27.680>review <00:29:27.820>is <00:29:27.960>knowledge <00:29:28.100>sharing. <00:29:28.240>That's <00:29:28.380>mostly <00:29:28.520>lost <00:29:28.660>with <00:29:28.800>all <00:29:28.940>the <00:29:29.080>reviews 00:29:29.510 --> 00:29:29.520 align:start position:0% <00:29:29.510>That's <00:29:29.511>mostly <00:29:29.513>lost <00:29:29.514>with <00:29:29.516>all <00:29:29.517>the <00:29:29.519>reviews 00:29:29.520 --> 00:29:31.350 align:start position:0% <00:29:29.520>That's <00:29:29.636>mostly <00:29:29.753>lost <00:29:29.870>with <00:29:29.986>all <00:29:30.103>the <00:29:30.220>reviews <00:29:30.336>approval. <00:29:30.453>Do <00:29:30.570>you <00:29:30.686>think <00:29:30.803>the <00:29:30.920>knowledge 00:29:31.350 --> 00:29:31.360 align:start position:0% <00:29:31.350>approval. <00:29:31.351>Do <00:29:31.353>you <00:29:31.355>think <00:29:31.357>the <00:29:31.359>knowledge 00:29:31.360 --> 00:29:33.550 align:start position:0% <00:29:31.360>approval. <00:29:31.500>Do <00:29:31.639>you <00:29:31.780>think <00:29:31.919>the <00:29:32.060>knowledge <00:29:32.199>sharing <00:29:32.340>part <00:29:32.479>is <00:29:32.620>still <00:29:32.760>important? 00:29:33.550 --> 00:29:33.560 align:start position:0% <00:29:33.550>sharing <00:29:33.552>part <00:29:33.554>is <00:29:33.556>still <00:29:33.559>important? 00:29:33.560 --> 00:29:35.070 align:start position:0% <00:29:33.560>sharing <00:29:33.695>part <00:29:33.831>is <00:29:33.967>still <00:29:34.103>important? <00:29:34.239>>> <00:29:34.375>Yeah, <00:29:34.511>knowledge <00:29:34.647>sharing <00:29:34.783>is <00:29:34.918>really 00:29:35.070 --> 00:29:35.080 align:start position:0% <00:29:35.070>>> <00:29:35.071>Yeah, <00:29:35.073>knowledge <00:29:35.075>sharing <00:29:35.077>is <00:29:35.079>really 00:29:35.080 --> 00:29:36.710 align:start position:0% <00:29:35.080>>> <00:29:35.196>Yeah, <00:29:35.313>knowledge <00:29:35.429>sharing <00:29:35.546>is <00:29:35.663>really <00:29:35.780>important. <00:29:35.896>Uh <00:29:36.013>in <00:29:36.129>fact, <00:29:36.246>we <00:29:36.363>we've <00:29:36.480>been 00:29:36.710 --> 00:29:36.720 align:start position:0% <00:29:36.710>important. <00:29:36.711>Uh <00:29:36.713>in <00:29:36.714>fact, <00:29:36.716>we <00:29:36.717>we've <00:29:36.719>been 00:29:36.720 --> 00:29:38.710 align:start position:0% <00:29:36.720>important. <00:29:36.820>Uh <00:29:36.920>in <00:29:37.020>fact, <00:29:37.120>we <00:29:37.220>we've <00:29:37.320>been <00:29:37.420>talking <00:29:37.520>about <00:29:37.620>this <00:29:37.720>one <00:29:37.820>aspect <00:29:37.920>of <00:29:38.020>the <00:29:38.120>and 00:29:38.710 --> 00:29:38.720 align:start position:0% <00:29:38.710>talking <00:29:38.711>about <00:29:38.712>this <00:29:38.713>one <00:29:38.715>aspect <00:29:38.716>of <00:29:38.717>the <00:29:38.719>and 00:29:38.720 --> 00:29:40.150 align:start position:0% <00:29:38.720>talking <00:29:38.827>about <00:29:38.934>this <00:29:39.041>one <00:29:39.149>aspect <00:29:39.256>of <00:29:39.363>the <00:29:39.470>and <00:29:39.578>again <00:29:39.685>it's <00:29:39.792>a <00:29:39.899>socio-technical <00:29:40.007>system, 00:29:40.150 --> 00:29:40.160 align:start position:0% <00:29:40.150>again <00:29:40.152>it's <00:29:40.154>a <00:29:40.156>socio-technical <00:29:40.159>system, 00:29:40.160 --> 00:29:42.310 align:start position:0% <00:29:40.160>again <00:29:40.276>it's <00:29:40.393>a <00:29:40.510>socio-technical <00:29:40.626>system, <00:29:40.743>right? <00:29:40.860>In <00:29:40.976>fact, <00:29:41.093>it's <00:29:41.210>a <00:29:41.326>lot <00:29:41.443>more <00:29:41.560>social 00:29:42.310 --> 00:29:42.320 align:start position:0% <00:29:42.310>right? <00:29:42.311>In <00:29:42.312>fact, <00:29:42.313>it's <00:29:42.315>a <00:29:42.316>lot <00:29:42.317>more <00:29:42.319>social 00:29:42.320 --> 00:29:44.110 align:start position:0% <00:29:42.320>right? <00:29:42.419>In <00:29:42.520>fact, <00:29:42.620>it's <00:29:42.720>a <00:29:42.820>lot <00:29:42.919>more <00:29:43.020>social <00:29:43.120>social <00:29:43.220>than <00:29:43.320>technical. <00:29:43.419>We <00:29:43.520>used <00:29:43.620>to <00:29:43.720>have 00:29:44.110 --> 00:29:44.120 align:start position:0% <00:29:44.110>social <00:29:44.111>than <00:29:44.112>technical. <00:29:44.114>We <00:29:44.116>used <00:29:44.117>to <00:29:44.119>have 00:29:44.120 --> 00:29:45.710 align:start position:0% <00:29:44.120>social <00:29:44.236>than <00:29:44.353>technical. <00:29:44.469>We <00:29:44.586>used <00:29:44.703>to <00:29:44.820>have <00:29:44.936>this <00:29:45.053>amazing <00:29:45.169>process <00:29:45.286>where <00:29:45.403>folks <00:29:45.520>were 00:29:45.710 --> 00:29:45.720 align:start position:0% <00:29:45.710>this <00:29:45.711>amazing <00:29:45.713>process <00:29:45.715>where <00:29:45.717>folks <00:29:45.719>were 00:29:45.720 --> 00:29:48.110 align:start position:0% <00:29:45.720>this <00:29:45.860>amazing <00:29:46.000>process <00:29:46.140>where <00:29:46.280>folks <00:29:46.420>were <00:29:46.560>sharing <00:29:46.700>technical <00:29:46.840>design <00:29:46.980>documents <00:29:47.120>or 00:29:48.110 --> 00:29:48.120 align:start position:0% <00:29:48.110>sharing <00:29:48.112>technical <00:29:48.114>design <00:29:48.116>documents <00:29:48.119>or 00:29:48.120 --> 00:29:50.110 align:start position:0% <00:29:48.120>sharing <00:29:48.247>technical <00:29:48.374>design <00:29:48.501>documents <00:29:48.629>or <00:29:48.756>like <00:29:48.883>tech <00:29:49.010>plans <00:29:49.138>before <00:29:49.265>writing <00:29:49.392>the <00:29:49.520>code. 00:29:50.110 --> 00:29:50.120 align:start position:0% <00:29:50.110>like <00:29:50.111>tech <00:29:50.112>plans <00:29:50.114>before <00:29:50.116>writing <00:29:50.117>the <00:29:50.119>code. 00:29:50.120 --> 00:29:51.790 align:start position:0% <00:29:50.120>like <00:29:50.219>tech <00:29:50.320>plans <00:29:50.419>before <00:29:50.520>writing <00:29:50.620>the <00:29:50.719>code. <00:29:50.820>But <00:29:50.919>now <00:29:51.020>writing <00:29:51.120>the <00:29:51.219>code <00:29:51.320>became <00:29:51.419>so <00:29:51.520>cheap 00:29:51.790 --> 00:29:51.800 align:start position:0% <00:29:51.790>But <00:29:51.791>now <00:29:51.792>writing <00:29:51.793>the <00:29:51.795>code <00:29:51.796>became <00:29:51.797>so <00:29:51.799>cheap 00:29:51.800 --> 00:29:53.270 align:start position:0% <00:29:51.800>But <00:29:51.894>now <00:29:51.989>writing <00:29:52.083>the <00:29:52.178>code <00:29:52.272>became <00:29:52.367>so <00:29:52.461>cheap <00:29:52.556>that <00:29:52.650>everyone <00:29:52.745>like, <00:29:52.839>"Ah, <00:29:52.934>just <00:29:53.028>write <00:29:53.123>a 00:29:53.270 --> 00:29:53.280 align:start position:0% <00:29:53.270>that <00:29:53.271>everyone <00:29:53.273>like, <00:29:53.274>"Ah, <00:29:53.276>just <00:29:53.277>write <00:29:53.279>a 00:29:53.280 --> 00:29:55.110 align:start position:0% <00:29:53.280>that <00:29:53.379>everyone <00:29:53.480>like, <00:29:53.580>"Ah, <00:29:53.680>just <00:29:53.780>write <00:29:53.879>a <00:29:53.980>code, <00:29:54.080>create <00:29:54.180>a <00:29:54.280>massive <00:29:54.379>PR <00:29:54.480>and <00:29:54.580>present <00:29:54.680>it 00:29:55.110 --> 00:29:55.120 align:start position:0% <00:29:55.110>code, <00:29:55.111>create <00:29:55.112>a <00:29:55.113>massive <00:29:55.115>PR <00:29:55.116>and <00:29:55.117>present <00:29:55.119>it 00:29:55.120 --> 00:29:56.750 align:start position:0% <00:29:55.120>code, <00:29:55.219>create <00:29:55.320>a <00:29:55.419>massive <00:29:55.520>PR <00:29:55.620>and <00:29:55.719>present <00:29:55.820>it <00:29:55.919>for <00:29:56.020>review." <00:29:56.120>And <00:29:56.219>then <00:29:56.320>it <00:29:56.419>it <00:29:56.520>becomes 00:29:56.750 --> 00:29:56.760 align:start position:0% <00:29:56.750>for <00:29:56.751>review." <00:29:56.753>And <00:29:56.754>then <00:29:56.756>it <00:29:56.757>it <00:29:56.759>becomes 00:29:56.760 --> 00:29:58.150 align:start position:0% <00:29:56.760>for <00:29:56.864>review." <00:29:56.968>And <00:29:57.072>then <00:29:57.177>it <00:29:57.281>it <00:29:57.385>becomes <00:29:57.489>really <00:29:57.594>hard <00:29:57.698>to <00:29:57.802>untangle <00:29:57.906>whether <00:29:58.011>that 00:29:58.150 --> 00:29:58.160 align:start position:0% <00:29:58.150>really <00:29:58.151>hard <00:29:58.153>to <00:29:58.155>untangle <00:29:58.157>whether <00:29:58.159>that 00:29:58.160 --> 00:30:00.230 align:start position:0% <00:29:58.160>really <00:29:58.267>hard <00:29:58.375>to <00:29:58.483>untangle <00:29:58.590>whether <00:29:58.698>that <00:29:58.806>approach <00:29:58.913>is <00:29:59.021>good <00:29:59.129>or <00:29:59.236>not. <00:29:59.344>So, <00:29:59.452>we <00:29:59.560>we 00:30:00.230 --> 00:30:00.240 align:start position:0% <00:30:00.230>approach <00:30:00.231>is <00:30:00.232>good <00:30:00.233>or <00:30:00.235>not. <00:30:00.236>So, <00:30:00.237>we <00:30:00.239>we 00:30:00.240 --> 00:30:01.550 align:start position:0% <00:30:00.240>approach <00:30:00.347>is <00:30:00.454>good <00:30:00.561>or <00:30:00.668>not. <00:30:00.775>So, <00:30:00.883>we <00:30:00.990>we <00:30:01.097>thinking <00:30:01.204>about <00:30:01.311>reintroducing <00:30:01.418>that 00:30:01.550 --> 00:30:01.560 align:start position:0% <00:30:01.550>thinking <00:30:01.553>about <00:30:01.556>reintroducing <00:30:01.559>that 00:30:01.560 --> 00:30:04.070 align:start position:0% <00:30:01.560>thinking <00:30:01.700>about <00:30:01.840>reintroducing <00:30:01.980>that <00:30:02.120>problem <00:30:02.260>uh <00:30:02.399>that <00:30:02.540>process <00:30:02.679>back <00:30:02.820>into <00:30:02.960>our 00:30:04.070 --> 00:30:04.080 align:start position:0% <00:30:04.070>problem <00:30:04.071>uh <00:30:04.072>that <00:30:04.074>process <00:30:04.076>back <00:30:04.077>into <00:30:04.079>our 00:30:04.080 --> 00:30:05.990 align:start position:0% <00:30:04.080>problem <00:30:04.187>uh <00:30:04.295>that <00:30:04.403>process <00:30:04.510>back <00:30:04.618>into <00:30:04.726>our <00:30:04.833>culture, <00:30:04.941>but <00:30:05.049>make <00:30:05.156>it <00:30:05.264>more <00:30:05.372>agentic <00:30:05.480>and 00:30:05.990 --> 00:30:06.000 align:start position:0% <00:30:05.990>culture, <00:30:05.991>but <00:30:05.993>make <00:30:05.994>it <00:30:05.996>more <00:30:05.997>agentic <00:30:05.999>and 00:30:06.000 --> 00:30:07.710 align:start position:0% <00:30:06.000>culture, <00:30:06.107>but <00:30:06.215>make <00:30:06.323>it <00:30:06.430>more <00:30:06.538>agentic <00:30:06.646>and <00:30:06.753>just <00:30:06.861>encourage <00:30:06.969>and <00:30:07.076>make <00:30:07.184>it <00:30:07.292>easier <00:30:07.400>for 00:30:07.710 --> 00:30:07.720 align:start position:0% <00:30:07.710>just <00:30:07.711>encourage <00:30:07.713>and <00:30:07.714>make <00:30:07.716>it <00:30:07.717>easier <00:30:07.719>for 00:30:07.720 --> 00:30:09.190 align:start position:0% <00:30:07.720>just <00:30:07.830>encourage <00:30:07.940>and <00:30:08.050>make <00:30:08.161>it <00:30:08.271>easier <00:30:08.381>for <00:30:08.491>folks <00:30:08.602>to <00:30:08.712>create <00:30:08.822>those <00:30:08.932>tech <00:30:09.043>design 00:30:09.190 --> 00:30:09.200 align:start position:0% <00:30:09.190>folks <00:30:09.191>to <00:30:09.193>create <00:30:09.195>those <00:30:09.197>tech <00:30:09.199>design 00:30:09.200 --> 00:30:10.870 align:start position:0% <00:30:09.200>folks <00:30:09.340>to <00:30:09.480>create <00:30:09.620>those <00:30:09.760>tech <00:30:09.900>design <00:30:10.040>documents <00:30:10.180>and <00:30:10.320>share <00:30:10.460>the <00:30:10.600>approaches 00:30:10.870 --> 00:30:10.880 align:start position:0% <00:30:10.870>documents <00:30:10.872>and <00:30:10.874>share <00:30:10.876>the <00:30:10.879>approaches 00:30:10.880 --> 00:30:12.670 align:start position:0% <00:30:10.880>documents <00:30:10.996>and <00:30:11.113>share <00:30:11.230>the <00:30:11.346>approaches <00:30:11.463>before <00:30:11.580>they <00:30:11.696>generate <00:30:11.813>a <00:30:11.930>lot <00:30:12.046>of <00:30:12.163>code. <00:30:12.280>And 00:30:12.670 --> 00:30:12.680 align:start position:0% <00:30:12.670>before <00:30:12.671>they <00:30:12.672>generate <00:30:12.673>a <00:30:12.675>lot <00:30:12.676>of <00:30:12.677>code. <00:30:12.679>And 00:30:12.680 --> 00:30:14.990 align:start position:0% <00:30:12.680>before <00:30:12.767>they <00:30:12.855>generate <00:30:12.942>a <00:30:13.030>lot <00:30:13.117>of <00:30:13.205>code. <00:30:13.292>And <00:30:13.380>I <00:30:13.467>I <00:30:13.555>think <00:30:13.642>that <00:30:13.730>will <00:30:13.817>be <00:30:13.905>a <00:30:13.992>good <00:30:14.080>uh 00:30:14.990 --> 00:30:15.000 align:start position:0% <00:30:14.990>I <00:30:14.991>I <00:30:14.992>think <00:30:14.993>that <00:30:14.994>will <00:30:14.995>be <00:30:14.996>a <00:30:14.997>good <00:30:14.999>uh 00:30:15.000 --> 00:30:16.750 align:start position:0% <00:30:15.000>I <00:30:15.100>I <00:30:15.200>think <00:30:15.300>that <00:30:15.400>will <00:30:15.500>be <00:30:15.600>a <00:30:15.700>good <00:30:15.800>uh <00:30:15.900>environment <00:30:16.000>to <00:30:16.100>learn <00:30:16.200>especially <00:30:16.300>for <00:30:16.400>the 00:30:16.750 --> 00:30:16.760 align:start position:0% <00:30:16.750>environment <00:30:16.751>to <00:30:16.753>learn <00:30:16.755>especially <00:30:16.757>for <00:30:16.759>the 00:30:16.760 --> 00:30:18.870 align:start position:0% <00:30:16.760>environment <00:30:16.876>to <00:30:16.993>learn <00:30:17.110>especially <00:30:17.226>for <00:30:17.343>the <00:30:17.460>newcomers, <00:30:17.576>for <00:30:17.693>less <00:30:17.810>senior <00:30:17.926>folks <00:30:18.043>to <00:30:18.160>get 00:30:18.870 --> 00:30:18.880 align:start position:0% <00:30:18.870>newcomers, <00:30:18.871>for <00:30:18.873>less <00:30:18.874>senior <00:30:18.876>folks <00:30:18.877>to <00:30:18.879>get 00:30:18.880 --> 00:30:20.310 align:start position:0% <00:30:18.880>newcomers, <00:30:18.987>for <00:30:19.094>less <00:30:19.201>senior <00:30:19.309>folks <00:30:19.416>to <00:30:19.523>get <00:30:19.630>some <00:30:19.738>exposure <00:30:19.845>time <00:30:19.952>with <00:30:20.059>an <00:30:20.167>expert 00:30:20.310 --> 00:30:20.320 align:start position:0% <00:30:20.310>some <00:30:20.311>exposure <00:30:20.313>time <00:30:20.315>with <00:30:20.317>an <00:30:20.319>expert 00:30:20.320 --> 00:30:22.070 align:start position:0% <00:30:20.320>some <00:30:20.419>exposure <00:30:20.520>time <00:30:20.620>with <00:30:20.720>an <00:30:20.820>expert <00:30:20.919>because <00:30:21.020>when <00:30:21.120>you <00:30:21.220>when <00:30:21.320>you <00:30:21.419>go <00:30:21.520>in <00:30:21.620>deep <00:30:21.720>on 00:30:22.070 --> 00:30:22.080 align:start position:0% <00:30:22.070>because <00:30:22.071>when <00:30:22.072>you <00:30:22.073>when <00:30:22.074>you <00:30:22.075>go <00:30:22.076>in <00:30:22.077>deep <00:30:22.079>on 00:30:22.080 --> 00:30:23.630 align:start position:0% <00:30:22.080>because <00:30:22.196>when <00:30:22.312>you <00:30:22.428>when <00:30:22.545>you <00:30:22.661>go <00:30:22.777>in <00:30:22.893>deep <00:30:23.010>on <00:30:23.126>agentic <00:30:23.242>interactions, <00:30:23.358>sometimes <00:30:23.475>it 00:30:23.630 --> 00:30:23.640 align:start position:0% <00:30:23.630>agentic <00:30:23.633>interactions, <00:30:23.636>sometimes <00:30:23.639>it 00:30:23.640 --> 00:30:25.470 align:start position:0% <00:30:23.640>agentic <00:30:23.767>interactions, <00:30:23.894>sometimes <00:30:24.021>it <00:30:24.149>almost <00:30:24.276>becomes <00:30:24.403>frowned <00:30:24.530>upon <00:30:24.658>to <00:30:24.785>talk <00:30:24.912>to <00:30:25.040>a 00:30:25.470 --> 00:30:25.480 align:start position:0% <00:30:25.470>almost <00:30:25.471>becomes <00:30:25.472>frowned <00:30:25.473>upon <00:30:25.475>to <00:30:25.476>talk <00:30:25.477>to <00:30:25.479>a 00:30:25.480 --> 00:30:26.910 align:start position:0% <00:30:25.480>almost <00:30:25.565>becomes <00:30:25.651>frowned <00:30:25.737>upon <00:30:25.823>to <00:30:25.909>talk <00:30:25.994>to <00:30:26.080>a <00:30:26.166>human, <00:30:26.252>right? <00:30:26.338>Why <00:30:26.423>do <00:30:26.509>you <00:30:26.595>talk <00:30:26.681>to <00:30:26.767>me? 00:30:26.910 --> 00:30:26.920 align:start position:0% <00:30:26.910>human, <00:30:26.911>right? <00:30:26.912>Why <00:30:26.913>do <00:30:26.915>you <00:30:26.916>talk <00:30:26.917>to <00:30:26.919>me? 00:30:26.920 --> 00:30:28.390 align:start position:0% <00:30:26.920>human, <00:30:27.008>right? <00:30:27.096>Why <00:30:27.184>do <00:30:27.272>you <00:30:27.361>talk <00:30:27.449>to <00:30:27.537>me? <00:30:27.625>Like <00:30:27.713>open <00:30:27.802>cloud <00:30:27.890>code, <00:30:27.978>it <00:30:28.066>has <00:30:28.154>all <00:30:28.243>the 00:30:28.390 --> 00:30:28.400 align:start position:0% <00:30:28.390>Like <00:30:28.391>open <00:30:28.392>cloud <00:30:28.393>code, <00:30:28.395>it <00:30:28.396>has <00:30:28.397>all <00:30:28.399>the 00:30:28.400 --> 00:30:30.910 align:start position:0% <00:30:28.400>Like <00:30:28.493>open <00:30:28.586>cloud <00:30:28.680>code, <00:30:28.773>it <00:30:28.866>has <00:30:28.960>all <00:30:29.053>the <00:30:29.146>answers. <00:30:29.240>So, <00:30:29.333>this <00:30:29.426>is <00:30:29.520>kind <00:30:29.613>of <00:30:29.706>hurts <00:30:29.800>the 00:30:30.910 --> 00:30:30.920 align:start position:0% <00:30:30.910>answers. <00:30:30.911>So, <00:30:30.912>this <00:30:30.913>is <00:30:30.915>kind <00:30:30.916>of <00:30:30.917>hurts <00:30:30.919>the 00:30:30.920 --> 00:30:32.510 align:start position:0% <00:30:30.920>answers. <00:30:31.013>So, <00:30:31.106>this <00:30:31.200>is <00:30:31.293>kind <00:30:31.386>of <00:30:31.480>hurts <00:30:31.573>the <00:30:31.666>the <00:30:31.760>learning. <00:30:31.853>So, <00:30:31.946>we <00:30:32.040>want <00:30:32.133>to <00:30:32.226>create <00:30:32.320>this 00:30:32.510 --> 00:30:32.520 align:start position:0% <00:30:32.510>the <00:30:32.511>learning. <00:30:32.512>So, <00:30:32.513>we <00:30:32.515>want <00:30:32.516>to <00:30:32.517>create <00:30:32.519>this 00:30:32.520 --> 00:30:34.750 align:start position:0% <00:30:32.520>the <00:30:32.620>learning. <00:30:32.720>So, <00:30:32.820>we <00:30:32.920>want <00:30:33.020>to <00:30:33.120>create <00:30:33.220>this <00:30:33.320>opportunity <00:30:33.420>and <00:30:33.520>maybe <00:30:33.620>the <00:30:33.720>tech <00:30:33.820>plans <00:30:33.920>and 00:30:34.750 --> 00:30:34.760 align:start position:0% <00:30:34.750>opportunity <00:30:34.751>and <00:30:34.753>maybe <00:30:34.754>the <00:30:34.756>tech <00:30:34.757>plans <00:30:34.759>and 00:30:34.760 --> 00:30:36.990 align:start position:0% <00:30:34.760>opportunity <00:30:34.876>and <00:30:34.993>maybe <00:30:35.110>the <00:30:35.226>tech <00:30:35.343>plans <00:30:35.460>and <00:30:35.576>reintroducing <00:30:35.693>that <00:30:35.810>process <00:30:35.926>back <00:30:36.043>is <00:30:36.160>that 00:30:36.990 --> 00:30:37.000 align:start position:0% <00:30:36.990>reintroducing <00:30:36.991>that <00:30:36.993>process <00:30:36.995>back <00:30:36.997>is <00:30:36.999>that 00:30:37.000 --> 00:30:39.110 align:start position:0% <00:30:37.000>reintroducing <00:30:37.140>that <00:30:37.280>process <00:30:37.420>back <00:30:37.560>is <00:30:37.700>that <00:30:37.840>uh <00:30:37.980>solution. <00:30:38.120>We'll <00:30:38.260>We'll <00:30:38.400>see. 00:30:39.110 --> 00:30:39.120 align:start position:0% <00:30:39.110>uh <00:30:39.112>solution. <00:30:39.114>We'll <00:30:39.116>We'll <00:30:39.119>see. 00:30:39.120 --> 00:30:40.950 align:start position:0% <00:30:39.120>uh <00:30:39.227>solution. <00:30:39.335>We'll <00:30:39.443>We'll <00:30:39.550>see. <00:30:39.658>>> <00:30:39.766>perfect <00:30:39.873>answer. <00:30:39.981>How <00:30:40.089>do <00:30:40.196>you <00:30:40.304>How <00:30:40.412>would <00:30:40.520>you 00:30:40.950 --> 00:30:40.960 align:start position:0% <00:30:40.950>>> <00:30:40.951>perfect <00:30:40.952>answer. <00:30:40.953>How <00:30:40.954>do <00:30:40.955>you <00:30:40.956>How <00:30:40.957>would <00:30:40.959>you 00:30:40.960 --> 00:30:43.510 align:start position:0% <00:30:40.960>>> <00:30:41.042>perfect <00:30:41.124>answer. <00:30:41.207>How <00:30:41.289>do <00:30:41.371>you <00:30:41.454>How <00:30:41.536>would <00:30:41.618>you <00:30:41.701>recommend <00:30:41.783>to <00:30:41.865>do <00:30:41.948>it <00:30:42.030>like <00:30:42.112>in <00:30:42.195>a <00:30:42.277>fast <00:30:42.360>way? 00:30:43.510 --> 00:30:43.520 align:start position:0% <00:30:43.510>recommend <00:30:43.511>to <00:30:43.512>do <00:30:43.513>it <00:30:43.514>like <00:30:43.515>in <00:30:43.516>a <00:30:43.517>fast <00:30:43.519>way? 00:30:43.520 --> 00:30:45.230 align:start position:0% <00:30:43.520>recommend <00:30:43.607>to <00:30:43.695>do <00:30:43.782>it <00:30:43.870>like <00:30:43.957>in <00:30:44.045>a <00:30:44.132>fast <00:30:44.220>way? <00:30:44.307>Or <00:30:44.395>how <00:30:44.482>how <00:30:44.570>do <00:30:44.657>you <00:30:44.745>usually <00:30:44.832>combine <00:30:44.920>it? 00:30:45.230 --> 00:30:45.240 align:start position:0% <00:30:45.230>Or <00:30:45.231>how <00:30:45.232>how <00:30:45.233>do <00:30:45.235>you <00:30:45.236>usually <00:30:45.237>combine <00:30:45.239>it? 00:30:45.240 --> 00:30:46.030 align:start position:0% <00:30:45.240>Or <00:30:45.299>how <00:30:45.358>how <00:30:45.417>do <00:30:45.477>you <00:30:45.536>usually <00:30:45.595>combine <00:30:45.654>it? <00:30:45.714>>> <00:30:45.773>In <00:30:45.832>an <00:30:45.891>agentic <00:30:45.951>way? 00:30:46.030 --> 00:30:46.040 align:start position:0% <00:30:46.030>>> <00:30:46.032>In <00:30:46.034>an <00:30:46.036>agentic <00:30:46.039>way? 00:30:46.040 --> 00:30:47.190 align:start position:0% <00:30:46.040>>> <00:30:46.212>In <00:30:46.385>an <00:30:46.557>agentic <00:30:46.730>way? <00:30:46.902>>> <00:30:47.075>Yeah. 00:30:47.190 --> 00:30:47.200 align:start position:0% <00:30:47.190>>> <00:30:47.199>Yeah. 00:30:47.200 --> 00:30:48.710 align:start position:0% <00:30:47.200>>> <00:30:47.351>Yeah. <00:30:47.502>>> <00:30:47.653>So, <00:30:47.804>anytime <00:30:47.955>you <00:30:48.106>open <00:30:48.257>a <00:30:48.408>Claude <00:30:48.559>Claude 00:30:48.710 --> 00:30:48.720 align:start position:0% <00:30:48.710>>> <00:30:48.711>So, <00:30:48.712>anytime <00:30:48.713>you <00:30:48.715>open <00:30:48.716>a <00:30:48.717>Claude <00:30:48.719>Claude 00:30:48.720 --> 00:30:50.350 align:start position:0% <00:30:48.720>>> <00:30:48.820>So, <00:30:48.920>anytime <00:30:49.020>you <00:30:49.120>open <00:30:49.220>a <00:30:49.320>Claude <00:30:49.420>Claude <00:30:49.520>session <00:30:49.620>and <00:30:49.720>you <00:30:49.820>like <00:30:49.920>five <00:30:50.020>code <00:30:50.120>some 00:30:50.350 --> 00:30:50.360 align:start position:0% <00:30:50.350>session <00:30:50.351>and <00:30:50.352>you <00:30:50.354>like <00:30:50.356>five <00:30:50.357>code <00:30:50.359>some 00:30:50.360 --> 00:30:51.870 align:start position:0% <00:30:50.360>session <00:30:50.483>and <00:30:50.607>you <00:30:50.730>like <00:30:50.854>five <00:30:50.977>code <00:30:51.101>some <00:30:51.224>code, <00:30:51.348>you're <00:30:51.471>making <00:30:51.595>some <00:30:51.718>decisions, 00:30:51.870 --> 00:30:51.880 align:start position:0% <00:30:51.870>code, <00:30:51.872>you're <00:30:51.874>making <00:30:51.876>some <00:30:51.879>decisions, 00:30:51.880 --> 00:30:53.070 align:start position:0% <00:30:51.880>code, <00:30:51.977>you're <00:30:52.074>making <00:30:52.172>some <00:30:52.269>decisions, <00:30:52.366>right? <00:30:52.464>Claude <00:30:52.561>Claude <00:30:52.658>might <00:30:52.756>ask <00:30:52.853>you, <00:30:52.951>"Oh, 00:30:53.070 --> 00:30:53.080 align:start position:0% <00:30:53.070>right? <00:30:53.071>Claude <00:30:53.072>Claude <00:30:53.074>might <00:30:53.076>ask <00:30:53.077>you, <00:30:53.079>"Oh, 00:30:53.080 --> 00:30:54.630 align:start position:0% <00:30:53.080>right? <00:30:53.173>Claude <00:30:53.265>Claude <00:30:53.359>might <00:30:53.452>ask <00:30:53.545>you, <00:30:53.638>"Oh, <00:30:53.731>what <00:30:53.824>do <00:30:53.917>we <00:30:54.010>do <00:30:54.103>here? <00:30:54.196>What <00:30:54.289>do <00:30:54.382>we <00:30:54.475>here?" 00:30:54.630 --> 00:30:54.640 align:start position:0% <00:30:54.630>what <00:30:54.631>do <00:30:54.632>we <00:30:54.633>do <00:30:54.634>here? <00:30:54.635>What <00:30:54.636>do <00:30:54.637>we <00:30:54.639>here?" 00:30:54.640 --> 00:30:56.030 align:start position:0% <00:30:54.640>what <00:30:54.723>do <00:30:54.806>we <00:30:54.890>do <00:30:54.973>here? <00:30:55.057>What <00:30:55.140>do <00:30:55.223>we <00:30:55.307>here?" <00:30:55.390>So, <00:30:55.474>all <00:30:55.557>of <00:30:55.640>those <00:30:55.724>decisions <00:30:55.807>are <00:30:55.891>getting 00:30:56.030 --> 00:30:56.040 align:start position:0% <00:30:56.030>So, <00:30:56.031>all <00:30:56.033>of <00:30:56.034>those <00:30:56.036>decisions <00:30:56.037>are <00:30:56.039>getting 00:30:56.040 --> 00:30:57.790 align:start position:0% <00:30:56.040>So, <00:30:56.156>all <00:30:56.273>of <00:30:56.389>those <00:30:56.506>decisions <00:30:56.623>are <00:30:56.740>getting <00:30:56.856>lost <00:30:56.973>in <00:30:57.090>the <00:30:57.206>session. <00:30:57.323>They're <00:30:57.440>never 00:30:57.790 --> 00:30:57.800 align:start position:0% <00:30:57.790>lost <00:30:57.791>in <00:30:57.793>the <00:30:57.795>session. <00:30:57.797>They're <00:30:57.799>never 00:30:57.800 --> 00:31:00.030 align:start position:0% <00:30:57.800>lost <00:30:57.927>in <00:30:58.054>the <00:30:58.181>session. <00:30:58.309>They're <00:30:58.436>never <00:30:58.563>materialize <00:30:58.690>anywhere. <00:30:58.818>If <00:30:58.945>you <00:30:59.072>can <00:30:59.200>capture 00:31:00.030 --> 00:31:00.040 align:start position:0% <00:31:00.030>materialize <00:31:00.031>anywhere. <00:31:00.033>If <00:31:00.035>you <00:31:00.037>can <00:31:00.039>capture 00:31:00.040 --> 00:31:02.870 align:start position:0% <00:31:00.040>materialize <00:31:00.156>anywhere. <00:31:00.273>If <00:31:00.389>you <00:31:00.506>can <00:31:00.623>capture <00:31:00.740>them <00:31:00.856>right <00:31:00.973>at <00:31:01.090>that <00:31:01.206>moment <00:31:01.323>and <00:31:01.440>then 00:31:02.870 --> 00:31:02.880 align:start position:0% <00:31:02.870>them <00:31:02.871>right <00:31:02.873>at <00:31:02.874>that <00:31:02.876>moment <00:31:02.877>and <00:31:02.879>then 00:31:02.880 --> 00:31:04.870 align:start position:0% <00:31:02.880>them <00:31:02.980>right <00:31:03.080>at <00:31:03.180>that <00:31:03.280>moment <00:31:03.380>and <00:31:03.480>then <00:31:03.580>send <00:31:03.680>them <00:31:03.780>to <00:31:03.880>a <00:31:03.980>tenure <00:31:04.080>expert <00:31:04.180>like, <00:31:04.280>"Hey, 00:31:04.870 --> 00:31:04.880 align:start position:0% <00:31:04.870>send <00:31:04.871>them <00:31:04.872>to <00:31:04.873>a <00:31:04.875>tenure <00:31:04.876>expert <00:31:04.877>like, <00:31:04.879>"Hey, 00:31:04.880 --> 00:31:06.190 align:start position:0% <00:31:04.880>send <00:31:04.964>them <00:31:05.048>to <00:31:05.132>a <00:31:05.216>tenure <00:31:05.301>expert <00:31:05.385>like, <00:31:05.469>"Hey, <00:31:05.553>you're <00:31:05.637>the <00:31:05.722>expert <00:31:05.806>here. <00:31:05.890>You've <00:31:05.974>been <00:31:06.059>here 00:31:06.190 --> 00:31:06.200 align:start position:0% <00:31:06.190>you're <00:31:06.191>the <00:31:06.193>expert <00:31:06.194>here. <00:31:06.196>You've <00:31:06.197>been <00:31:06.199>here 00:31:06.200 --> 00:31:07.390 align:start position:0% <00:31:06.200>you're <00:31:06.276>the <00:31:06.353>expert <00:31:06.429>here. <00:31:06.506>You've <00:31:06.582>been <00:31:06.659>here <00:31:06.735>in <00:31:06.812>for <00:31:06.888>like <00:31:06.965>10 <00:31:07.041>years. <00:31:07.118>Could <00:31:07.194>you <00:31:07.271>please 00:31:07.390 --> 00:31:07.400 align:start position:0% <00:31:07.390>in <00:31:07.391>for <00:31:07.392>like <00:31:07.393>10 <00:31:07.395>years. <00:31:07.396>Could <00:31:07.397>you <00:31:07.399>please 00:31:07.400 --> 00:31:08.950 align:start position:0% <00:31:07.400>in <00:31:07.499>for <00:31:07.599>like <00:31:07.698>10 <00:31:07.798>years. <00:31:07.898>Could <00:31:07.997>you <00:31:08.097>please <00:31:08.197>look <00:31:08.296>at <00:31:08.396>through <00:31:08.496>those <00:31:08.595>decisions <00:31:08.695>that <00:31:08.795>I 00:31:08.950 --> 00:31:08.960 align:start position:0% <00:31:08.950>look <00:31:08.951>at <00:31:08.953>through <00:31:08.954>those <00:31:08.956>decisions <00:31:08.957>that <00:31:08.959>I 00:31:08.960 --> 00:31:10.550 align:start position:0% <00:31:08.960>look <00:31:09.060>at <00:31:09.160>through <00:31:09.260>those <00:31:09.360>decisions <00:31:09.460>that <00:31:09.560>I <00:31:09.660>made <00:31:09.760>with <00:31:09.860>Claude <00:31:09.960>in <00:31:10.060>this <00:31:10.160>session <00:31:10.260>and <00:31:10.360>let 00:31:10.550 --> 00:31:10.560 align:start position:0% <00:31:10.550>made <00:31:10.551>with <00:31:10.552>Claude <00:31:10.553>in <00:31:10.555>this <00:31:10.556>session <00:31:10.557>and <00:31:10.559>let 00:31:10.560 --> 00:31:12.150 align:start position:0% <00:31:10.560>made <00:31:10.647>with <00:31:10.735>Claude <00:31:10.822>in <00:31:10.909>this <00:31:10.997>session <00:31:11.085>and <00:31:11.172>let <00:31:11.260>me <00:31:11.347>know <00:31:11.435>if <00:31:11.522>they're <00:31:11.610>a <00:31:11.697>good <00:31:11.784>or <00:31:11.872>not." <00:31:11.960>And 00:31:12.150 --> 00:31:12.160 align:start position:0% <00:31:12.150>me <00:31:12.151>know <00:31:12.152>if <00:31:12.153>they're <00:31:12.154>a <00:31:12.155>good <00:31:12.156>or <00:31:12.157>not." <00:31:12.159>And 00:31:12.160 --> 00:31:13.510 align:start position:0% <00:31:12.160>me <00:31:12.253>know <00:31:12.346>if <00:31:12.440>they're <00:31:12.533>a <00:31:12.627>good <00:31:12.720>or <00:31:12.814>not." <00:31:12.907>And <00:31:13.001>that's <00:31:13.094>where <00:31:13.188>that <00:31:13.281>learning <00:31:13.375>opportunity 00:31:13.510 --> 00:31:13.520 align:start position:0% <00:31:13.510>that's <00:31:13.512>where <00:31:13.514>that <00:31:13.516>learning <00:31:13.519>opportunity 00:31:13.520 --> 00:31:15.070 align:start position:0% <00:31:13.520>that's <00:31:13.659>where <00:31:13.799>that <00:31:13.938>learning <00:31:14.078>opportunity <00:31:14.217>comes <00:31:14.357>in <00:31:14.496>because <00:31:14.636>immediately <00:31:14.775>you <00:31:14.915>get 00:31:15.070 --> 00:31:15.080 align:start position:0% <00:31:15.070>comes <00:31:15.071>in <00:31:15.073>because <00:31:15.075>immediately <00:31:15.077>you <00:31:15.079>get 00:31:15.080 --> 00:31:16.350 align:start position:0% <00:31:15.080>comes <00:31:15.183>in <00:31:15.287>because <00:31:15.391>immediately <00:31:15.495>you <00:31:15.599>get <00:31:15.703>exposure <00:31:15.807>to <00:31:15.911>that <00:31:16.015>expert <00:31:16.119>and <00:31:16.223>they're 00:31:16.350 --> 00:31:16.360 align:start position:0% <00:31:16.350>exposure <00:31:16.351>to <00:31:16.353>that <00:31:16.355>expert <00:31:16.357>and <00:31:16.359>they're 00:31:16.360 --> 00:31:17.870 align:start position:0% <00:31:16.360>exposure <00:31:16.473>to <00:31:16.586>that <00:31:16.699>expert <00:31:16.812>and <00:31:16.926>they're <00:31:17.039>like, <00:31:17.152>"Oh, <00:31:17.265>yeah, <00:31:17.379>I <00:31:17.492>remember <00:31:17.605>this <00:31:17.718>thing. 00:31:17.870 --> 00:31:17.880 align:start position:0% <00:31:17.870>like, <00:31:17.871>"Oh, <00:31:17.873>yeah, <00:31:17.874>I <00:31:17.876>remember <00:31:17.877>this <00:31:17.879>thing. 00:31:17.880 --> 00:31:18.870 align:start position:0% <00:31:17.880>like, <00:31:17.943>"Oh, <00:31:18.007>yeah, <00:31:18.070>I <00:31:18.134>remember <00:31:18.198>this <00:31:18.261>thing. <00:31:18.325>We <00:31:18.389>should <00:31:18.452>never <00:31:18.516>do <00:31:18.580>it <00:31:18.643>like <00:31:18.707>this. <00:31:18.771>We 00:31:18.870 --> 00:31:18.880 align:start position:0% <00:31:18.870>We <00:31:18.871>should <00:31:18.872>never <00:31:18.873>do <00:31:18.875>it <00:31:18.876>like <00:31:18.877>this. <00:31:18.879>We 00:31:18.880 --> 00:31:20.270 align:start position:0% <00:31:18.880>We <00:31:18.963>should <00:31:19.046>never <00:31:19.130>do <00:31:19.213>it <00:31:19.297>like <00:31:19.380>this. <00:31:19.463>We <00:31:19.547>should <00:31:19.630>do <00:31:19.714>it <00:31:19.797>like <00:31:19.880>that." <00:31:19.964>And <00:31:20.047>you <00:31:20.131>start 00:31:20.270 --> 00:31:20.280 align:start position:0% <00:31:20.270>should <00:31:20.271>do <00:31:20.272>it <00:31:20.273>like <00:31:20.275>that." <00:31:20.276>And <00:31:20.277>you <00:31:20.279>start 00:31:20.280 --> 00:31:22.070 align:start position:0% <00:31:20.280>should <00:31:20.387>do <00:31:20.495>it <00:31:20.603>like <00:31:20.710>that." <00:31:20.818>And <00:31:20.926>you <00:31:21.033>start <00:31:21.141>learning. <00:31:21.249>So, <00:31:21.356>I <00:31:21.464>think <00:31:21.572>capturing <00:31:21.680>those 00:31:22.070 --> 00:31:22.080 align:start position:0% <00:31:22.070>learning. <00:31:22.071>So, <00:31:22.073>I <00:31:22.075>think <00:31:22.077>capturing <00:31:22.079>those 00:31:22.080 --> 00:31:25.030 align:start position:0% <00:31:22.080>learning. <00:31:22.187>So, <00:31:22.295>I <00:31:22.403>think <00:31:22.510>capturing <00:31:22.618>those <00:31:22.726>decisions <00:31:22.833>that <00:31:22.941>you <00:31:23.049>make <00:31:23.156>on <00:31:23.264>on <00:31:23.372>the <00:31:23.480>hourly 00:31:25.030 --> 00:31:25.040 align:start position:0% <00:31:25.030>decisions <00:31:25.031>that <00:31:25.032>you <00:31:25.033>make <00:31:25.035>on <00:31:25.036>on <00:31:25.037>the <00:31:25.039>hourly 00:31:25.040 --> 00:31:27.150 align:start position:0% <00:31:25.040>decisions <00:31:25.133>that <00:31:25.226>you <00:31:25.320>make <00:31:25.413>on <00:31:25.506>on <00:31:25.600>the <00:31:25.693>hourly <00:31:25.786>basis <00:31:25.879>in <00:31:25.973>in <00:31:26.066>the <00:31:26.159>sessions <00:31:26.253>and <00:31:26.346>then <00:31:26.440>piping 00:31:27.150 --> 00:31:27.160 align:start position:0% <00:31:27.150>basis <00:31:27.151>in <00:31:27.152>in <00:31:27.153>the <00:31:27.155>sessions <00:31:27.156>and <00:31:27.157>then <00:31:27.159>piping 00:31:27.160 --> 00:31:28.910 align:start position:0% <00:31:27.160>basis <00:31:27.260>in <00:31:27.360>in <00:31:27.460>the <00:31:27.560>sessions <00:31:27.660>and <00:31:27.760>then <00:31:27.860>piping <00:31:27.960>them <00:31:28.060>through <00:31:28.160>the <00:31:28.260>experts <00:31:28.360>is <00:31:28.460>as <00:31:28.560>a 00:31:28.910 --> 00:31:28.920 align:start position:0% <00:31:28.910>them <00:31:28.911>through <00:31:28.913>the <00:31:28.914>experts <00:31:28.916>is <00:31:28.917>as <00:31:28.919>a 00:31:28.920 --> 00:31:30.630 align:start position:0% <00:31:28.920>them <00:31:29.036>through <00:31:29.153>the <00:31:29.270>experts <00:31:29.386>is <00:31:29.503>as <00:31:29.620>a <00:31:29.736>potential <00:31:29.853>way <00:31:29.970>to <00:31:30.086>to <00:31:30.203>solve <00:31:30.320>this. 00:31:30.630 --> 00:31:30.640 align:start position:0% <00:31:30.630>potential <00:31:30.631>way <00:31:30.633>to <00:31:30.635>to <00:31:30.637>solve <00:31:30.639>this. 00:31:30.640 --> 00:31:33.670 align:start position:0% <00:31:30.640>potential <00:31:30.747>way <00:31:30.855>to <00:31:30.963>to <00:31:31.070>solve <00:31:31.178>this. <00:31:31.286>>> <00:31:31.393>Perfect. <00:31:31.501>Thank <00:31:31.609>you <00:31:31.716>so <00:31:31.824>much, <00:31:31.932>Keshia. <00:31:32.040>Big 00:31:33.670 --> 00:31:33.680 align:start position:0% <00:31:33.670>>> <00:31:33.671>Perfect. <00:31:33.672>Thank <00:31:33.673>you <00:31:33.675>so <00:31:33.676>much, <00:31:33.677>Keshia. <00:31:33.679>Big 00:31:33.680 --> 00:31:36.236 align:start position:0% <00:31:33.680>>> <00:31:33.787>Perfect. <00:31:33.895>Thank <00:31:34.003>you <00:31:34.110>so <00:31:34.218>much, <00:31:34.326>Keshia. <00:31:34.433>Big <00:31:34.541>round <00:31:34.649>of <00:31:34.756>applause <00:31:34.864>for <00:31:34.972>Keshia, <00:31:35.080>please. 00:31:36.236 --> 00:31:36.246 align:start position:0% <00:31:36.236>round <00:31:36.237>of <00:31:36.239>applause <00:31:36.241>for <00:31:36.243>Keshia, <00:31:36.245>please. 00:31:36.246 --> 00:31:40.590 align:start position:0% <00:31:36.246>round <00:31:36.446>of <00:31:36.646>applause <00:31:36.846>for <00:31:37.046>Keshia, <00:31:37.246>please. <00:31:37.446>>> <00:31:37.646>[applause] 00:31:40.600 --> 00:31:43.150 align:start position:0% <00:31:40.600>>> <00:31:40.879>Finally, <00:31:41.159>somebody <00:31:41.439>who <00:31:41.719>matches <00:31:42.000>my 00:31:43.150 --> 00:31:43.160 align:start position:0% <00:31:43.150>>> <00:31:43.151>Finally, <00:31:43.153>somebody <00:31:43.155>who <00:31:43.157>matches <00:31:43.159>my 00:31:43.160 --> 00:31:46.070 align:start position:0% <00:31:43.160>>> <00:31:43.300>Finally, <00:31:43.440>somebody <00:31:43.580>who <00:31:43.720>matches <00:31:43.860>my <00:31:44.000>over-the-top <00:31:44.140>energy. <00:31:44.280>Um <00:31:44.420>please <00:31:44.560>stay 00:31:46.070 --> 00:31:46.080 align:start position:0% <00:31:46.070>over-the-top <00:31:46.072>energy. <00:31:46.074>Um <00:31:46.076>please <00:31:46.079>stay 00:31:46.080 --> 00:31:48.230 align:start position:0% <00:31:46.080>over-the-top <00:31:46.196>energy. <00:31:46.313>Um <00:31:46.429>please <00:31:46.546>stay <00:31:46.663>tuned, <00:31:46.780>guys. <00:31:46.896>Um <00:31:47.013>like <00:31:47.129>the <00:31:47.246>next <00:31:47.363>talk <00:31:47.480>is 00:31:48.230 --> 00:31:48.240 align:start position:0% <00:31:48.230>tuned, <00:31:48.231>guys. <00:31:48.232>Um <00:31:48.233>like <00:31:48.235>the <00:31:48.236>next <00:31:48.237>talk <00:31:48.239>is 00:31:48.240 --> 00:31:50.070 align:start position:0% <00:31:48.240>tuned, <00:31:48.356>guys. <00:31:48.473>Um <00:31:48.590>like <00:31:48.706>the <00:31:48.823>next <00:31:48.940>talk <00:31:49.056>is <00:31:49.173>going <00:31:49.290>to <00:31:49.406>be <00:31:49.523>summarize <00:31:49.640>basically 00:31:50.070 --> 00:31:50.080 align:start position:0% <00:31:50.070>going <00:31:50.072>to <00:31:50.074>be <00:31:50.076>summarize <00:31:50.079>basically 00:31:50.080 --> 00:31:51.750 align:start position:0% <00:31:50.080>going <00:31:50.196>to <00:31:50.313>be <00:31:50.429>summarize <00:31:50.546>basically <00:31:50.663>everything <00:31:50.780>we've <00:31:50.896>heard <00:31:51.013>so <00:31:51.129>far <00:31:51.246>in <00:31:51.363>a <00:31:51.480>lot 00:31:51.750 --> 00:31:51.760 align:start position:0% <00:31:51.750>everything <00:31:51.751>we've <00:31:51.752>heard <00:31:51.753>so <00:31:51.755>far <00:31:51.756>in <00:31:51.757>a <00:31:51.759>lot 00:31:51.760 --> 00:31:54.750 align:start position:0% <00:31:51.760>everything <00:31:51.853>we've <00:31:51.946>heard <00:31:52.040>so <00:31:52.133>far <00:31:52.226>in <00:31:52.320>a <00:31:52.413>lot <00:31:52.506>better <00:31:52.600>way. <00:31:52.693>Uh <00:31:52.786>next <00:31:52.879>up <00:31:52.973>is <00:31:53.066>David <00:31:53.160>Tielke 00:31:54.750 --> 00:31:54.760 align:start position:0% <00:31:54.750>better <00:31:54.751>way. <00:31:54.752>Uh <00:31:54.753>next <00:31:54.755>up <00:31:54.756>is <00:31:54.757>David <00:31:54.759>Tielke 00:31:54.760 --> 00:31:56.710 align:start position:0% <00:31:54.760>better <00:31:54.860>way. <00:31:54.960>Uh <00:31:55.060>next <00:31:55.160>up <00:31:55.260>is <00:31:55.360>David <00:31:55.460>Tielke <00:31:55.560>and <00:31:55.660>he <00:31:55.760>will <00:31:55.860>be <00:31:55.960>talking <00:31:56.060>about <00:31:56.160>AI-driven 00:31:56.710 --> 00:31:56.720 align:start position:0% <00:31:56.710>and <00:31:56.711>he <00:31:56.713>will <00:31:56.714>be <00:31:56.716>talking <00:31:56.717>about <00:31:56.719>AI-driven 00:31:56.720 --> 00:31:59.070 align:start position:0% <00:31:56.720>and <00:31:56.827>he <00:31:56.935>will <00:31:57.043>be <00:31:57.150>talking <00:31:57.258>about <00:31:57.366>AI-driven <00:31:57.473>development. <00:31:57.581>He <00:31:57.689>will <00:31:57.796>tell <00:31:57.904>us <00:31:58.012>which <00:31:58.120>tools 00:31:59.070 --> 00:31:59.080 align:start position:0% <00:31:59.070>development. <00:31:59.071>He <00:31:59.072>will <00:31:59.074>tell <00:31:59.076>us <00:31:59.077>which <00:31:59.079>tools 00:31:59.080 --> 00:32:02.030 align:start position:0% <00:31:59.080>development. <00:31:59.207>He <00:31:59.334>will <00:31:59.461>tell <00:31:59.589>us <00:31:59.716>which <00:31:59.843>tools <00:31:59.970>really <00:32:00.098>add <00:32:00.225>value <00:32:00.352>and <00:32:00.480>where 00:32:02.030 --> 00:32:02.040 align:start position:0% <00:32:02.030>really <00:32:02.032>add <00:32:02.034>value <00:32:02.036>and <00:32:02.039>where 00:32:02.040 --> 00:32:04.270 align:start position:0% <00:32:02.040>really <00:32:02.147>add <00:32:02.255>value <00:32:02.363>and <00:32:02.470>where <00:32:02.578>uh <00:32:02.686>yeah, <00:32:02.793>where <00:32:02.901>are <00:32:03.009>the <00:32:03.116>value <00:32:03.224>on <00:32:03.332>and <00:32:03.440>how 00:32:04.270 --> 00:32:04.280 align:start position:0% <00:32:04.270>uh <00:32:04.271>yeah, <00:32:04.272>where <00:32:04.273>are <00:32:04.274>the <00:32:04.275>value <00:32:04.276>on <00:32:04.277>and <00:32:04.279>how 00:32:04.280 --> 00:32:06.590 align:start position:0% <00:32:04.280>uh <00:32:04.367>yeah, <00:32:04.455>where <00:32:04.542>are <00:32:04.629>the <00:32:04.717>value <00:32:04.805>on <00:32:04.892>and <00:32:04.980>how <00:32:05.067>do <00:32:05.155>we <00:32:05.242>use <00:32:05.330>them. <00:32:05.417>Thank <00:32:05.504>you <00:32:05.592>very <00:32:05.680>much. 00:32:06.590 --> 00:32:06.600 align:start position:0% <00:32:06.590>do <00:32:06.591>we <00:32:06.592>use <00:32:06.593>them. <00:32:06.595>Thank <00:32:06.596>you <00:32:06.597>very <00:32:06.599>much. 00:32:06.600 --> 00:32:07.677 align:start position:0% <00:32:06.600>do <00:32:06.707>we <00:32:06.815>use <00:32:06.923>them. <00:32:07.030>Thank <00:32:07.138>you <00:32:07.246>very <00:32:07.353>much. <00:32:07.461>>> <00:32:07.569>Hey. 00:32:07.677 --> 00:32:07.687 align:start position:0% <00:32:07.677>>> <00:32:07.686>Hey. 00:32:07.687 --> 00:32:09.707 align:start position:0% <00:32:07.687>>> <00:32:08.153>Hey. <00:32:08.620>>> <00:32:09.087>[laughter]