WEBVTT

00:00:02.880 --> 00:00:05.270 align:start position:0%
<00:00:02.880>Thank <00:00:03.159>you <00:00:03.440>for <00:00:03.719>the <00:00:04.000>kind <00:00:04.279>introduction.

00:00:05.270 --> 00:00:05.280 align:start position:0%
<00:00:05.270>Thank <00:00:05.271>you <00:00:05.273>for <00:00:05.275>the <00:00:05.277>kind <00:00:05.279>introduction.

00:00:05.280 --> 00:00:06.870 align:start position:0%
<00:00:05.280>Thank <00:00:05.387>you <00:00:05.495>for <00:00:05.603>the <00:00:05.710>kind <00:00:05.818>introduction. <00:00:05.926>Nice <00:00:06.033>to <00:00:06.141>see <00:00:06.249>quite <00:00:06.356>a <00:00:06.464>lot <00:00:06.572>of <00:00:06.680>people

00:00:06.870 --> 00:00:06.880 align:start position:0%
<00:00:06.870>Nice <00:00:06.871>to <00:00:06.872>see <00:00:06.873>quite <00:00:06.875>a <00:00:06.876>lot <00:00:06.877>of <00:00:06.879>people

00:00:06.880 --> 00:00:09.230 align:start position:0%
<00:00:06.880>Nice <00:00:06.979>to <00:00:07.080>see <00:00:07.180>quite <00:00:07.280>a <00:00:07.380>lot <00:00:07.479>of <00:00:07.580>people <00:00:07.680>showing <00:00:07.779>up <00:00:07.880>for <00:00:07.979>I <00:00:08.080>would <00:00:08.180>think <00:00:08.280>rather

00:00:09.230 --> 00:00:09.240 align:start position:0%
<00:00:09.230>showing <00:00:09.231>up <00:00:09.233>for <00:00:09.234>I <00:00:09.236>would <00:00:09.237>think <00:00:09.239>rather

00:00:09.240 --> 00:00:12.470 align:start position:0%
<00:00:09.240>showing <00:00:09.367>up <00:00:09.494>for <00:00:09.621>I <00:00:09.749>would <00:00:09.876>think <00:00:10.003>rather <00:00:10.130>niche <00:00:10.258>topic <00:00:10.385>of <00:00:10.512>something <00:00:10.640>data.

00:00:12.470 --> 00:00:12.480 align:start position:0%
<00:00:12.470>niche <00:00:12.472>topic <00:00:12.474>of <00:00:12.476>something <00:00:12.479>data.

00:00:12.480 --> 00:00:15.070 align:start position:0%
<00:00:12.480>niche <00:00:12.596>topic <00:00:12.713>of <00:00:12.830>something <00:00:12.946>data. <00:00:13.063>And <00:00:13.180>I <00:00:13.296>imagine <00:00:13.413>quite <00:00:13.530>some <00:00:13.646>quite <00:00:13.763>some <00:00:13.880>of

00:00:15.070 --> 00:00:15.080 align:start position:0%
<00:00:15.070>And <00:00:15.071>I <00:00:15.072>imagine <00:00:15.073>quite <00:00:15.075>some <00:00:15.076>quite <00:00:15.077>some <00:00:15.079>of

00:00:15.080 --> 00:00:17.950 align:start position:0%
<00:00:15.080>And <00:00:15.173>I <00:00:15.266>imagine <00:00:15.360>quite <00:00:15.453>some <00:00:15.546>quite <00:00:15.640>some <00:00:15.733>of <00:00:15.826>you <00:00:15.920>feel <00:00:16.013>like <00:00:16.106>you <00:00:16.200>heard <00:00:16.293>of <00:00:16.386>this <00:00:16.480>parquet

00:00:17.950 --> 00:00:17.960 align:start position:0%
<00:00:17.950>you <00:00:17.951>feel <00:00:17.952>like <00:00:17.953>you <00:00:17.955>heard <00:00:17.956>of <00:00:17.957>this <00:00:17.959>parquet

00:00:17.960 --> 00:00:19.830 align:start position:0%
<00:00:17.960>you <00:00:18.060>feel <00:00:18.160>like <00:00:18.260>you <00:00:18.360>heard <00:00:18.460>of <00:00:18.560>this <00:00:18.660>parquet <00:00:18.760>thing <00:00:18.860>and <00:00:18.960>some <00:00:19.060>people <00:00:19.160>were <00:00:19.260>talking <00:00:19.360>about

00:00:19.830 --> 00:00:19.840 align:start position:0%
<00:00:19.830>thing <00:00:19.831>and <00:00:19.833>some <00:00:19.834>people <00:00:19.836>were <00:00:19.837>talking <00:00:19.839>about

00:00:19.840 --> 00:00:22.950 align:start position:0%
<00:00:19.840>thing <00:00:19.933>and <00:00:20.026>some <00:00:20.120>people <00:00:20.213>were <00:00:20.306>talking <00:00:20.400>about <00:00:20.493>this <00:00:20.586>and <00:00:20.680>all <00:00:20.773>this <00:00:20.866>hip <00:00:20.960>new <00:00:21.053>iceberg. <00:00:21.146>So <00:00:21.240>I

00:00:22.950 --> 00:00:22.960 align:start position:0%
<00:00:22.950>this <00:00:22.951>and <00:00:22.952>all <00:00:22.953>this <00:00:22.954>hip <00:00:22.955>new <00:00:22.956>iceberg. <00:00:22.957>So <00:00:22.959>I

00:00:22.960 --> 00:00:23.750 align:start position:0%
<00:00:22.960>this <00:00:23.039>and <00:00:23.118>all <00:00:23.197>this <00:00:23.276>hip <00:00:23.355>new <00:00:23.434>iceberg. <00:00:23.513>So <00:00:23.592>I <00:00:23.671>I

00:00:23.750 --> 00:00:23.760 align:start position:0%
I

00:00:23.760 --> 00:00:25.590 align:start position:0%
<00:00:23.760>I <00:00:23.993>one <00:00:24.226>question, <00:00:24.460>who <00:00:24.693>would <00:00:24.926>consider <00:00:25.160>himself

00:00:25.590 --> 00:00:25.600 align:start position:0%
<00:00:25.590>one <00:00:25.591>question, <00:00:25.593>who <00:00:25.595>would <00:00:25.597>consider <00:00:25.599>himself

00:00:25.600 --> 00:00:28.190 align:start position:0%
<00:00:25.600>one <00:00:25.716>question, <00:00:25.833>who <00:00:25.950>would <00:00:26.066>consider <00:00:26.183>himself <00:00:26.300>a <00:00:26.416>software <00:00:26.533>developer <00:00:26.650>instead <00:00:26.766>of <00:00:26.883>a <00:00:27.000>data

00:00:28.190 --> 00:00:28.200 align:start position:0%
<00:00:28.190>a <00:00:28.191>software <00:00:28.193>developer <00:00:28.194>instead <00:00:28.196>of <00:00:28.197>a <00:00:28.198>data

00:00:28.200 --> 00:00:30.070 align:start position:0%
<00:00:28.200>a <00:00:28.400>software <00:00:28.599>developer <00:00:28.800>instead <00:00:29.000>of <00:00:29.200>a <00:00:29.400>data <00:00:29.599>engineer?

00:00:30.070 --> 00:00:30.080 align:start position:0%
engineer?

00:00:30.080 --> 00:00:32.710 align:start position:0%
<00:00:30.080>engineer? <00:00:30.313>Okay, <00:00:30.546>quite <00:00:30.779>some <00:00:31.013>software <00:00:31.246>developers. <00:00:31.479>So

00:00:32.710 --> 00:00:32.720 align:start position:0%
<00:00:32.710>Okay, <00:00:32.711>quite <00:00:32.713>some <00:00:32.715>software <00:00:32.717>developers. <00:00:32.719>So

00:00:32.720 --> 00:00:34.870 align:start position:0%
<00:00:32.720>Okay, <00:00:32.827>quite <00:00:32.935>some <00:00:33.043>software <00:00:33.150>developers. <00:00:33.258>So <00:00:33.366>for <00:00:33.473>those <00:00:33.581>of <00:00:33.689>you <00:00:33.796>that <00:00:33.904>are <00:00:34.012>not <00:00:34.120>software

00:00:34.870 --> 00:00:34.880 align:start position:0%
<00:00:34.870>for <00:00:34.871>those <00:00:34.872>of <00:00:34.873>you <00:00:34.875>that <00:00:34.876>are <00:00:34.877>not <00:00:34.879>software

00:00:34.880 --> 00:00:36.150 align:start position:0%
<00:00:34.880>for <00:00:34.975>those <00:00:35.070>of <00:00:35.165>you <00:00:35.261>that <00:00:35.356>are <00:00:35.451>not <00:00:35.546>software <00:00:35.642>developers, <00:00:35.737>this <00:00:35.832>is <00:00:35.927>a <00:00:36.022>basic

00:00:36.150 --> 00:00:36.160 align:start position:0%
<00:00:36.150>developers, <00:00:36.152>this <00:00:36.154>is <00:00:36.156>a <00:00:36.159>basic

00:00:36.160 --> 00:00:38.030 align:start position:0%
<00:00:36.160>developers, <00:00:36.300>this <00:00:36.440>is <00:00:36.580>a <00:00:36.720>basic <00:00:36.860>introduction. <00:00:37.000>If <00:00:37.139>you <00:00:37.279>never <00:00:37.419>heard <00:00:37.559>of

00:00:38.030 --> 00:00:38.040 align:start position:0%
<00:00:38.030>introduction. <00:00:38.031>If <00:00:38.033>you <00:00:38.035>never <00:00:38.037>heard <00:00:38.039>of

00:00:38.040 --> 00:00:39.790 align:start position:0%
<00:00:38.040>introduction. <00:00:38.167>If <00:00:38.294>you <00:00:38.421>never <00:00:38.549>heard <00:00:38.676>of <00:00:38.803>iceberg, <00:00:38.930>never <00:00:39.058>heard <00:00:39.185>of <00:00:39.312>DuckDB, <00:00:39.440>feel

00:00:39.790 --> 00:00:39.800 align:start position:0%
<00:00:39.790>iceberg, <00:00:39.791>never <00:00:39.793>heard <00:00:39.795>of <00:00:39.797>DuckDB, <00:00:39.799>feel

00:00:39.800 --> 00:00:42.030 align:start position:0%
<00:00:39.800>iceberg, <00:00:39.916>never <00:00:40.033>heard <00:00:40.150>of <00:00:40.266>DuckDB, <00:00:40.383>feel <00:00:40.500>free. <00:00:40.616>You <00:00:40.733>will <00:00:40.849>learn <00:00:40.966>something, <00:00:41.083>but <00:00:41.199>it's

00:00:42.030 --> 00:00:42.040 align:start position:0%
<00:00:42.030>free. <00:00:42.031>You <00:00:42.033>will <00:00:42.034>learn <00:00:42.036>something, <00:00:42.037>but <00:00:42.039>it's

00:00:42.040 --> 00:00:44.790 align:start position:0%
<00:00:42.040>free. <00:00:42.167>You <00:00:42.294>will <00:00:42.421>learn <00:00:42.549>something, <00:00:42.676>but <00:00:42.803>it's <00:00:42.930>really <00:00:43.058>more <00:00:43.185>about <00:00:43.312>hey, <00:00:43.440>why

00:00:44.790 --> 00:00:44.800 align:start position:0%
<00:00:44.790>really <00:00:44.792>more <00:00:44.794>about <00:00:44.796>hey, <00:00:44.799>why

00:00:44.800 --> 00:00:46.750 align:start position:0%
<00:00:44.800>really <00:00:44.940>more <00:00:45.080>about <00:00:45.220>hey, <00:00:45.360>why <00:00:45.500>are <00:00:45.640>these <00:00:45.779>data <00:00:45.919>people <00:00:46.059>talking <00:00:46.199>about

00:00:46.750 --> 00:00:46.760 align:start position:0%
<00:00:46.750>are <00:00:46.751>these <00:00:46.753>data <00:00:46.755>people <00:00:46.757>talking <00:00:46.759>about

00:00:46.760 --> 00:00:49.190 align:start position:0%
<00:00:46.760>are <00:00:46.887>these <00:00:47.014>data <00:00:47.141>people <00:00:47.269>talking <00:00:47.396>about <00:00:47.523>iceberg, <00:00:47.650>about <00:00:47.778>Delta <00:00:47.905>and <00:00:48.032>parquet? <00:00:48.160>This

00:00:49.190 --> 00:00:49.200 align:start position:0%
<00:00:49.190>iceberg, <00:00:49.191>about <00:00:49.193>Delta <00:00:49.195>and <00:00:49.197>parquet? <00:00:49.199>This

00:00:49.200 --> 00:00:52.110 align:start position:0%
<00:00:49.200>iceberg, <00:00:49.340>about <00:00:49.480>Delta <00:00:49.620>and <00:00:49.760>parquet? <00:00:49.900>This <00:00:50.040>is <00:00:50.180>the <00:00:50.320>the <00:00:50.460>main <00:00:50.600>part.

00:00:52.110 --> 00:00:52.120 align:start position:0%
<00:00:52.110>is <00:00:52.112>the <00:00:52.114>the <00:00:52.116>main <00:00:52.119>part.

00:00:52.120 --> 00:00:53.070 align:start position:0%
<00:00:52.120>is <00:00:52.291>the <00:00:52.461>the <00:00:52.632>main <00:00:52.804>part. <00:00:52.975>So

00:00:53.070 --> 00:00:53.080 align:start position:0%
So

00:00:53.080 --> 00:00:56.270 align:start position:0%
<00:00:53.080>So <00:00:53.360>it <00:00:53.640>all <00:00:53.920>started <00:00:54.199>with <00:00:54.480>uh

00:00:56.270 --> 00:00:56.280 align:start position:0%
<00:00:56.270>it <00:00:56.272>all <00:00:56.274>started <00:00:56.276>with <00:00:56.279>uh

00:00:56.280 --> 00:00:58.310 align:start position:0%
<00:00:56.280>it <00:00:56.396>all <00:00:56.513>started <00:00:56.630>with <00:00:56.746>uh <00:00:56.863>a <00:00:56.980>while <00:00:57.096>ago <00:00:57.213>in <00:00:57.330>the <00:00:57.446>Hadoop <00:00:57.563>days <00:00:57.680>when

00:00:58.310 --> 00:00:58.320 align:start position:0%
<00:00:58.310>a <00:00:58.311>while <00:00:58.312>ago <00:00:58.313>in <00:00:58.315>the <00:00:58.316>Hadoop <00:00:58.317>days <00:00:58.319>when

00:00:58.320 --> 00:01:00.390 align:start position:0%
<00:00:58.320>a <00:00:58.420>while <00:00:58.520>ago <00:00:58.620>in <00:00:58.720>the <00:00:58.820>Hadoop <00:00:58.920>days <00:00:59.020>when <00:00:59.120>there <00:00:59.220>was <00:00:59.320>the <00:00:59.420>separation <00:00:59.520>of <00:00:59.620>storage <00:00:59.720>and

00:01:00.390 --> 00:01:00.400 align:start position:0%
<00:01:00.390>there <00:01:00.391>was <00:01:00.393>the <00:01:00.394>separation <00:01:00.396>of <00:01:00.397>storage <00:01:00.399>and

00:01:00.400 --> 00:01:03.510 align:start position:0%
<00:01:00.400>there <00:01:00.507>was <00:01:00.615>the <00:01:00.723>separation <00:01:00.830>of <00:01:00.938>storage <00:01:01.046>and <00:01:01.153>compute. <00:01:01.261>We <00:01:01.369>had <00:01:01.476>one <00:01:01.584>big <00:01:01.692>database <00:01:01.800>before,

00:01:03.510 --> 00:01:03.520 align:start position:0%
<00:01:03.510>compute. <00:01:03.511>We <00:01:03.513>had <00:01:03.514>one <00:01:03.516>big <00:01:03.517>database <00:01:03.519>before,

00:01:03.520 --> 00:01:05.310 align:start position:0%
<00:01:03.520>compute. <00:01:03.620>We <00:01:03.720>had <00:01:03.820>one <00:01:03.920>big <00:01:04.019>database <00:01:04.120>before, <00:01:04.220>there <00:01:04.320>was <00:01:04.420>all <00:01:04.519>the <00:01:04.620>storage <00:01:04.720>in <00:01:04.820>there. <00:01:04.920>You

00:01:05.310 --> 00:01:05.320 align:start position:0%
<00:01:05.310>there <00:01:05.311>was <00:01:05.312>all <00:01:05.313>the <00:01:05.315>storage <00:01:05.316>in <00:01:05.317>there. <00:01:05.318>You

00:01:05.320 --> 00:01:07.630 align:start position:0%
<00:01:05.319>there <00:01:05.413>was <00:01:05.506>all <00:01:05.600>the <00:01:05.693>storage <00:01:05.786>in <00:01:05.880>there. <00:01:05.973>You <00:01:06.066>put <00:01:06.160>SQL <00:01:06.253>queries <00:01:06.346>against <00:01:06.440>it, <00:01:06.533>you <00:01:06.626>get <00:01:06.720>your

00:01:07.630 --> 00:01:07.640 align:start position:0%
<00:01:07.630>put <00:01:07.631>SQL <00:01:07.632>queries <00:01:07.633>against <00:01:07.635>it, <00:01:07.636>you <00:01:07.637>get <00:01:07.639>your

00:01:07.640 --> 00:01:10.510 align:start position:0%
<00:01:07.640>put <00:01:07.740>SQL <00:01:07.840>queries <00:01:07.940>against <00:01:08.040>it, <00:01:08.140>you <00:01:08.240>get <00:01:08.340>your <00:01:08.440>results <00:01:08.540>back <00:01:08.640>and <00:01:08.740>this <00:01:08.840>was <00:01:08.940>then <00:01:09.040>separated

00:01:10.510 --> 00:01:10.520 align:start position:0%
<00:01:10.510>results <00:01:10.511>back <00:01:10.513>and <00:01:10.514>this <00:01:10.516>was <00:01:10.517>then <00:01:10.518>separated

00:01:10.520 --> 00:01:12.430 align:start position:0%
<00:01:10.520>results <00:01:10.636>back <00:01:10.753>and <00:01:10.869>this <00:01:10.986>was <00:01:11.103>then <00:01:11.220>separated <00:01:11.336>into <00:01:11.453>two <00:01:11.570>things. <00:01:11.686>Basically, <00:01:11.803>the <00:01:11.920>one

00:01:12.430 --> 00:01:12.440 align:start position:0%
<00:01:12.430>into <00:01:12.431>two <00:01:12.433>things. <00:01:12.435>Basically, <00:01:12.437>the <00:01:12.439>one

00:01:12.440 --> 00:01:13.950 align:start position:0%
<00:01:12.440>into <00:01:12.544>two <00:01:12.649>things. <00:01:12.753>Basically, <00:01:12.858>the <00:01:12.962>one <00:01:13.067>thing <00:01:13.171>is <00:01:13.276>the <00:01:13.380>storage <00:01:13.485>back <00:01:13.589>in <00:01:13.694>then <00:01:13.799>in

00:01:13.950 --> 00:01:13.960 align:start position:0%
<00:01:13.950>thing <00:01:13.951>is <00:01:13.952>the <00:01:13.953>storage <00:01:13.955>back <00:01:13.956>in <00:01:13.957>then <00:01:13.959>in

00:01:13.960 --> 00:01:16.990 align:start position:0%
<00:01:13.960>thing <00:01:14.060>is <00:01:14.160>the <00:01:14.260>storage <00:01:14.360>back <00:01:14.460>in <00:01:14.560>then <00:01:14.660>in <00:01:14.760>Hadoop <00:01:14.860>days, <00:01:14.960>it <00:01:15.060>was <00:01:15.160>HDFS, <00:01:15.260>stored <00:01:15.360>some

00:01:16.990 --> 00:01:17.000 align:start position:0%
<00:01:16.990>Hadoop <00:01:16.991>days, <00:01:16.993>it <00:01:16.994>was <00:01:16.996>HDFS, <00:01:16.997>stored <00:01:16.999>some

00:01:17.000 --> 00:01:19.350 align:start position:0%
<00:01:17.000>Hadoop <00:01:17.116>days, <00:01:17.233>it <00:01:17.350>was <00:01:17.466>HDFS, <00:01:17.583>stored <00:01:17.700>some <00:01:17.816>storage, <00:01:17.933>now <00:01:18.050>it's <00:01:18.166>more <00:01:18.283>likely <00:01:18.400>blob

00:01:19.350 --> 00:01:19.360 align:start position:0%
<00:01:19.350>storage, <00:01:19.351>now <00:01:19.353>it's <00:01:19.355>more <00:01:19.357>likely <00:01:19.359>blob

00:01:19.360 --> 00:01:21.270 align:start position:0%
<00:01:19.360>storage, <00:01:19.515>now <00:01:19.671>it's <00:01:19.826>more <00:01:19.982>likely <00:01:20.137>blob <00:01:20.293>storage <00:01:20.448>and <00:01:20.604>was <00:01:20.760>compute

00:01:21.270 --> 00:01:21.280 align:start position:0%
<00:01:21.270>storage <00:01:21.273>and <00:01:21.276>was <00:01:21.279>compute

00:01:21.280 --> 00:01:23.350 align:start position:0%
<00:01:21.280>storage <00:01:21.407>and <00:01:21.534>was <00:01:21.661>compute <00:01:21.789>up <00:01:21.916>on <00:01:22.043>this. <00:01:22.170>What's <00:01:22.298>the <00:01:22.425>benefit <00:01:22.552>of <00:01:22.680>this?

00:01:23.350 --> 00:01:23.360 align:start position:0%
<00:01:23.350>up <00:01:23.351>on <00:01:23.352>this. <00:01:23.353>What's <00:01:23.355>the <00:01:23.356>benefit <00:01:23.357>of <00:01:23.359>this?

00:01:23.360 --> 00:01:25.150 align:start position:0%
<00:01:23.360>up <00:01:23.467>on <00:01:23.575>this. <00:01:23.683>What's <00:01:23.790>the <00:01:23.898>benefit <00:01:24.006>of <00:01:24.113>this? <00:01:24.221>You <00:01:24.329>can <00:01:24.436>scale <00:01:24.544>those <00:01:24.652>independently. <00:01:24.760>You

00:01:25.150 --> 00:01:25.160 align:start position:0%
<00:01:25.150>You <00:01:25.151>can <00:01:25.153>scale <00:01:25.155>those <00:01:25.157>independently. <00:01:25.158>You

00:01:25.160 --> 00:01:25.910 align:start position:0%
<00:01:25.160>You <00:01:25.272>can <00:01:25.384>scale <00:01:25.497>those <00:01:25.610>independently. <00:01:25.722>You <00:01:25.835>can

00:01:25.910 --> 00:01:25.920 align:start position:0%
can

00:01:25.920 --> 00:01:27.390 align:start position:0%
<00:01:25.920>can <00:01:26.085>have <00:01:26.250>the <00:01:26.416>storage, <00:01:26.581>have <00:01:26.746>all <00:01:26.912>the <00:01:27.077>data <00:01:27.243>in

00:01:27.390 --> 00:01:27.400 align:start position:0%
<00:01:27.390>have <00:01:27.391>the <00:01:27.392>storage, <00:01:27.393>have <00:01:27.395>all <00:01:27.396>the <00:01:27.397>data <00:01:27.399>in

00:01:27.400 --> 00:01:29.190 align:start position:0%
<00:01:27.400>have <00:01:27.493>the <00:01:27.586>storage, <00:01:27.680>have <00:01:27.773>all <00:01:27.866>the <00:01:27.960>data <00:01:28.053>in <00:01:28.146>there <00:01:28.240>and <00:01:28.333>if <00:01:28.426>there's <00:01:28.520>no <00:01:28.613>query, <00:01:28.706>you <00:01:28.800>can

00:01:29.190 --> 00:01:29.200 align:start position:0%
<00:01:29.190>there <00:01:29.191>and <00:01:29.192>if <00:01:29.193>there's <00:01:29.195>no <00:01:29.196>query, <00:01:29.197>you <00:01:29.199>can

00:01:29.200 --> 00:01:31.110 align:start position:0%
<00:01:29.200>there <00:01:29.340>and <00:01:29.480>if <00:01:29.620>there's <00:01:29.760>no <00:01:29.900>query, <00:01:30.040>you <00:01:30.180>can <00:01:30.320>reduce <00:01:30.460>the <00:01:30.600>compute.

00:01:31.110 --> 00:01:31.120 align:start position:0%
<00:01:31.110>reduce <00:01:31.114>the <00:01:31.119>compute.

00:01:31.120 --> 00:01:32.750 align:start position:0%
<00:01:31.120>reduce <00:01:31.260>the <00:01:31.400>compute. <00:01:31.540>So <00:01:31.680>you <00:01:31.820>pay <00:01:31.960>less <00:01:32.100>or <00:01:32.240>you <00:01:32.380>can <00:01:32.520>even

00:01:32.750 --> 00:01:32.760 align:start position:0%
<00:01:32.750>So <00:01:32.751>you <00:01:32.752>pay <00:01:32.753>less <00:01:32.755>or <00:01:32.756>you <00:01:32.757>can <00:01:32.758>even

00:01:32.760 --> 00:01:34.510 align:start position:0%
<00:01:32.759>So <00:01:32.867>you <00:01:32.975>pay <00:01:33.083>less <00:01:33.190>or <00:01:33.298>you <00:01:33.406>can <00:01:33.513>even <00:01:33.621>completely <00:01:33.729>skip <00:01:33.836>the <00:01:33.944>compute, <00:01:34.052>so <00:01:34.160>you

00:01:34.510 --> 00:01:34.520 align:start position:0%
<00:01:34.509>completely <00:01:34.511>skip <00:01:34.513>the <00:01:34.515>compute, <00:01:34.517>so <00:01:34.519>you

00:01:34.520 --> 00:01:36.270 align:start position:0%
<00:01:34.520>completely <00:01:34.627>skip <00:01:34.735>the <00:01:34.843>compute, <00:01:34.950>so <00:01:35.058>you <00:01:35.166>don't <00:01:35.273>have <00:01:35.381>to <00:01:35.489>pay <00:01:35.596>anything. <00:01:35.704>So <00:01:35.812>you <00:01:35.920>just

00:01:36.270 --> 00:01:36.280 align:start position:0%
<00:01:36.270>don't <00:01:36.271>have <00:01:36.272>to <00:01:36.273>pay <00:01:36.275>anything. <00:01:36.276>So <00:01:36.277>you <00:01:36.279>just

00:01:36.280 --> 00:01:38.670 align:start position:0%
<00:01:36.280>don't <00:01:36.373>have <00:01:36.466>to <00:01:36.560>pay <00:01:36.653>anything. <00:01:36.746>So <00:01:36.840>you <00:01:36.933>just <00:01:37.026>have <00:01:37.120>the <00:01:37.213>storage <00:01:37.306>and <00:01:37.400>above <00:01:37.493>it <00:01:37.586>a <00:01:37.680>query

00:01:38.670 --> 00:01:38.680 align:start position:0%
<00:01:38.670>have <00:01:38.671>the <00:01:38.672>storage <00:01:38.673>and <00:01:38.675>above <00:01:38.676>it <00:01:38.677>a <00:01:38.679>query

00:01:38.680 --> 00:01:40.710 align:start position:0%
<00:01:38.680>have <00:01:38.796>the <00:01:38.913>storage <00:01:39.030>and <00:01:39.146>above <00:01:39.263>it <00:01:39.380>a <00:01:39.496>query <00:01:39.613>engine <00:01:39.730>that <00:01:39.846>actually <00:01:39.963>executes <00:01:40.080>queries

00:01:40.710 --> 00:01:40.720 align:start position:0%
<00:01:40.710>engine <00:01:40.712>that <00:01:40.714>actually <00:01:40.716>executes <00:01:40.719>queries

00:01:40.720 --> 00:01:42.710 align:start position:0%
<00:01:40.720>engine <00:01:40.836>that <00:01:40.953>actually <00:01:41.070>executes <00:01:41.186>queries <00:01:41.303>and <00:01:41.420>gives <00:01:41.536>you <00:01:41.653>the <00:01:41.770>results <00:01:41.886>you <00:01:42.003>want <00:01:42.120>from

00:01:42.710 --> 00:01:42.720 align:start position:0%
<00:01:42.710>and <00:01:42.711>gives <00:01:42.712>you <00:01:42.713>the <00:01:42.715>results <00:01:42.716>you <00:01:42.717>want <00:01:42.719>from

00:01:42.720 --> 00:01:44.110 align:start position:0%
<00:01:42.720>and <00:01:42.859>gives <00:01:42.998>you <00:01:43.137>the <00:01:43.276>results <00:01:43.414>you <00:01:43.554>want <00:01:43.693>from <00:01:43.832>the <00:01:43.971>storage.

00:01:44.110 --> 00:01:44.120 align:start position:0%
<00:01:44.110>the <00:01:44.119>storage.

00:01:44.120 --> 00:01:46.070 align:start position:0%
<00:01:44.120>the <00:01:44.295>storage. <00:01:44.470>And <00:01:44.645>as <00:01:44.820>I <00:01:44.995>said, <00:01:45.170>usually <00:01:45.345>the <00:01:45.520>storage

00:01:46.070 --> 00:01:46.080 align:start position:0%
<00:01:46.070>And <00:01:46.071>as <00:01:46.073>I <00:01:46.074>said, <00:01:46.076>usually <00:01:46.077>the <00:01:46.079>storage

00:01:46.080 --> 00:01:47.710 align:start position:0%
<00:01:46.080>And <00:01:46.220>as <00:01:46.360>I <00:01:46.500>said, <00:01:46.640>usually <00:01:46.780>the <00:01:46.920>storage <00:01:47.060>nowadays <00:01:47.200>for <00:01:47.340>those <00:01:47.480>analytical

00:01:47.710 --> 00:01:47.720 align:start position:0%
<00:01:47.710>nowadays <00:01:47.713>for <00:01:47.716>those <00:01:47.719>analytical

00:01:47.720 --> 00:01:49.950 align:start position:0%
<00:01:47.720>nowadays <00:01:47.920>for <00:01:48.120>those <00:01:48.320>analytical <00:01:48.520>applications, <00:01:48.720>analytical <00:01:48.920>stuff <00:01:49.120>is

00:01:49.950 --> 00:01:49.960 align:start position:0%
<00:01:49.950>applications, <00:01:49.953>analytical <00:01:49.956>stuff <00:01:49.959>is

00:01:49.960 --> 00:01:51.470 align:start position:0%
<00:01:49.960>applications, <00:01:50.186>analytical <00:01:50.413>stuff <00:01:50.639>is <00:01:50.866>a <00:01:51.092>blob <00:01:51.319>storage,

00:01:51.470 --> 00:01:51.480 align:start position:0%
<00:01:51.470>a <00:01:51.474>blob <00:01:51.478>storage,

00:01:51.480 --> 00:01:53.910 align:start position:0%
<00:01:51.479>a <00:01:51.654>blob <00:01:51.829>storage, <00:01:52.005>S3, <00:01:52.179>Azure <00:01:52.354>Data <00:01:52.529>Lake, <00:01:52.704>Google <00:01:52.880>Cloud

00:01:53.910 --> 00:01:53.920 align:start position:0%
<00:01:53.910>S3, <00:01:53.911>Azure <00:01:53.913>Data <00:01:53.915>Lake, <00:01:53.917>Google <00:01:53.919>Cloud

00:01:53.920 --> 00:01:56.190 align:start position:0%
<00:01:53.920>S3, <00:01:54.047>Azure <00:01:54.174>Data <00:01:54.301>Lake, <00:01:54.429>Google <00:01:54.556>Cloud <00:01:54.683>Storage <00:01:54.810>or <00:01:54.938>whatever, <00:01:55.065>MinIO <00:01:55.192>and <00:01:55.320>S3

00:01:56.190 --> 00:01:56.200 align:start position:0%
<00:01:56.190>Storage <00:01:56.191>or <00:01:56.193>whatever, <00:01:56.195>MinIO <00:01:56.197>and <00:01:56.199>S3

00:01:56.200 --> 00:01:57.830 align:start position:0%
<00:01:56.200>Storage <00:01:56.433>or <00:01:56.666>whatever, <00:01:56.900>MinIO <00:01:57.133>and <00:01:57.366>S3 <00:01:57.600>compatible

00:01:57.830 --> 00:01:57.840 align:start position:0%
compatible

00:01:57.840 --> 00:01:59.790 align:start position:0%
<00:01:57.840>compatible <00:01:58.306>systems. <00:01:58.773>They <00:01:59.240>are.

00:01:59.790 --> 00:01:59.800 align:start position:0%
<00:01:59.789>systems. <00:01:59.794>They <00:01:59.798>are.

00:01:59.800 --> 00:02:02.270 align:start position:0%
<00:01:59.800>systems. <00:01:59.940>They <00:02:00.080>are. <00:02:00.220>Now, <00:02:00.360>the <00:02:00.500>question <00:02:00.640>is <00:02:00.780>how <00:02:00.920>would <00:02:01.060>we <00:02:01.200>store

00:02:02.270 --> 00:02:02.280 align:start position:0%
<00:02:02.270>Now, <00:02:02.271>the <00:02:02.272>question <00:02:02.273>is <00:02:02.275>how <00:02:02.276>would <00:02:02.277>we <00:02:02.279>store

00:02:02.280 --> 00:02:04.070 align:start position:0%
<00:02:02.280>Now, <00:02:02.367>the <00:02:02.455>question <00:02:02.542>is <00:02:02.630>how <00:02:02.717>would <00:02:02.805>we <00:02:02.892>store <00:02:02.980>data <00:02:03.067>in <00:02:03.155>a <00:02:03.242>storage? <00:02:03.330>For <00:02:03.417>those <00:02:03.505>of <00:02:03.592>you <00:02:03.680>who

00:02:04.070 --> 00:02:04.080 align:start position:0%
<00:02:04.070>data <00:02:04.071>in <00:02:04.072>a <00:02:04.073>storage? <00:02:04.074>For <00:02:04.075>those <00:02:04.076>of <00:02:04.077>you <00:02:04.079>who

00:02:04.080 --> 00:02:05.670 align:start position:0%
<00:02:04.080>data <00:02:04.173>in <00:02:04.266>a <00:02:04.360>storage? <00:02:04.453>For <00:02:04.546>those <00:02:04.640>of <00:02:04.733>you <00:02:04.826>who <00:02:04.920>know <00:02:05.013>those <00:02:05.106>storages, <00:02:05.200>most <00:02:05.293>likely <00:02:05.386>a <00:02:05.480>lot

00:02:05.670 --> 00:02:05.680 align:start position:0%
<00:02:05.670>know <00:02:05.671>those <00:02:05.673>storages, <00:02:05.674>most <00:02:05.676>likely <00:02:05.677>a <00:02:05.679>lot

00:02:05.680 --> 00:02:06.750 align:start position:0%
<00:02:05.680>know <00:02:05.800>those <00:02:05.920>storages, <00:02:06.041>most <00:02:06.161>likely <00:02:06.281>a <00:02:06.402>lot <00:02:06.522>of <00:02:06.643>you,

00:02:06.750 --> 00:02:06.760 align:start position:0%
<00:02:06.750>of <00:02:06.759>you,

00:02:06.760 --> 00:02:09.190 align:start position:0%
<00:02:06.760>of <00:02:06.960>you, <00:02:07.160>it's <00:02:07.360>basically <00:02:07.560>files <00:02:07.760>that <00:02:07.960>you <00:02:08.160>store

00:02:09.190 --> 00:02:09.200 align:start position:0%
<00:02:09.190>it's <00:02:09.191>basically <00:02:09.193>files <00:02:09.195>that <00:02:09.197>you <00:02:09.198>store

00:02:09.200 --> 00:02:10.430 align:start position:0%
<00:02:09.199>it's <00:02:09.338>basically <00:02:09.476>files <00:02:09.615>that <00:02:09.753>you <00:02:09.891>store <00:02:10.030>there. <00:02:10.168>It's <00:02:10.307>not

00:02:10.430 --> 00:02:10.440 align:start position:0%
<00:02:10.430>there. <00:02:10.434>It's <00:02:10.439>not

00:02:10.440 --> 00:02:12.910 align:start position:0%
<00:02:10.440>there. <00:02:10.639>It's <00:02:10.840>not <00:02:11.039>something <00:02:11.240>really <00:02:11.440>sophisticated, <00:02:11.640>but <00:02:11.840>it's

00:02:12.910 --> 00:02:12.920 align:start position:0%
<00:02:12.910>something <00:02:12.912>really <00:02:12.914>sophisticated, <00:02:12.916>but <00:02:12.918>it's

00:02:12.920 --> 00:02:14.510 align:start position:0%
<00:02:12.920>something <00:02:13.047>really <00:02:13.174>sophisticated, <00:02:13.301>but <00:02:13.429>it's <00:02:13.556>just <00:02:13.683>files. <00:02:13.810>And <00:02:13.938>the <00:02:14.065>first <00:02:14.192>thing <00:02:14.320>if

00:02:14.510 --> 00:02:14.520 align:start position:0%
<00:02:14.510>just <00:02:14.511>files. <00:02:14.513>And <00:02:14.514>the <00:02:14.516>first <00:02:14.517>thing <00:02:14.519>if

00:02:14.520 --> 00:02:16.230 align:start position:0%
<00:02:14.520>just <00:02:14.620>files. <00:02:14.720>And <00:02:14.820>the <00:02:14.920>first <00:02:15.020>thing <00:02:15.120>if <00:02:15.220>people <00:02:15.320>think <00:02:15.420>about <00:02:15.520>files <00:02:15.620>and <00:02:15.720>data <00:02:15.820>is <00:02:15.920>of

00:02:16.230 --> 00:02:16.240 align:start position:0%
<00:02:16.230>people <00:02:16.231>think <00:02:16.232>about <00:02:16.233>files <00:02:16.235>and <00:02:16.236>data <00:02:16.237>is <00:02:16.239>of

00:02:16.240 --> 00:02:19.150 align:start position:0%
<00:02:16.240>people <00:02:16.367>think <00:02:16.494>about <00:02:16.621>files <00:02:16.749>and <00:02:16.876>data <00:02:17.003>is <00:02:17.130>of <00:02:17.258>course <00:02:17.385>CSV <00:02:17.512>and <00:02:17.640>JSON.

00:02:19.150 --> 00:02:19.160 align:start position:0%
<00:02:19.150>course <00:02:19.153>CSV <00:02:19.156>and <00:02:19.159>JSON.

00:02:19.160 --> 00:02:22.470 align:start position:0%
<00:02:19.160>course <00:02:19.267>CSV <00:02:19.375>and <00:02:19.483>JSON. <00:02:19.590>And <00:02:19.698>why <00:02:19.806>is <00:02:19.913>CSV <00:02:20.021>and <00:02:20.129>JSON <00:02:20.236>not <00:02:20.344>a <00:02:20.452>good <00:02:20.560>idea

00:02:22.470 --> 00:02:22.480 align:start position:0%
<00:02:22.470>And <00:02:22.471>why <00:02:22.472>is <00:02:22.472>CSV <00:02:22.474>and <00:02:22.475>JSON <00:02:22.476>not <00:02:22.477>a <00:02:22.477>good <00:02:22.478>idea

00:02:22.480 --> 00:02:24.030 align:start position:0%
<00:02:22.480>And <00:02:22.587>why <00:02:22.694>is <00:02:22.801>CSV <00:02:22.909>and <00:02:23.016>JSON <00:02:23.123>not <00:02:23.231>a <00:02:23.338>good <00:02:23.445>idea <00:02:23.553>to <00:02:23.660>to <00:02:23.767>store <00:02:23.875>this?

00:02:24.030 --> 00:02:24.040 align:start position:0%
<00:02:24.030>to <00:02:24.033>to <00:02:24.036>store <00:02:24.039>this?

00:02:24.040 --> 00:02:25.949 align:start position:0%
<00:02:24.040>to <00:02:24.167>to <00:02:24.294>store <00:02:24.421>this? <00:02:24.549>This <00:02:24.676>is <00:02:24.803>some <00:02:24.930>basic <00:02:25.058>data. <00:02:25.185>We <00:02:25.312>have <00:02:25.440>an

00:02:25.949 --> 00:02:25.959 align:start position:0%
<00:02:25.949>This <00:02:25.950>is <00:02:25.951>some <00:02:25.952>basic <00:02:25.954>data. <00:02:25.955>We <00:02:25.956>have <00:02:25.958>an

00:02:25.959 --> 00:02:27.990 align:start position:0%
<00:02:25.959>This <00:02:26.046>is <00:02:26.134>some <00:02:26.221>basic <00:02:26.309>data. <00:02:26.396>We <00:02:26.484>have <00:02:26.571>an <00:02:26.659>order. <00:02:26.746>We <00:02:26.834>have <00:02:26.921>a <00:02:27.009>customer <00:02:27.096>ID. <00:02:27.184>We <00:02:27.271>have <00:02:27.359>a

00:02:27.990 --> 00:02:28.000 align:start position:0%
<00:02:27.990>order. <00:02:27.991>We <00:02:27.992>have <00:02:27.993>a <00:02:27.994>customer <00:02:27.995>ID. <00:02:27.996>We <00:02:27.997>have <00:02:27.999>a

00:02:28.000 --> 00:02:29.870 align:start position:0%
<00:02:28.000>order. <00:02:28.093>We <00:02:28.186>have <00:02:28.280>a <00:02:28.373>customer <00:02:28.466>ID. <00:02:28.560>We <00:02:28.653>have <00:02:28.746>a <00:02:28.840>product <00:02:28.933>category <00:02:29.026>and <00:02:29.120>we <00:02:29.213>have <00:02:29.306>an <00:02:29.400>order

00:02:29.870 --> 00:02:29.880 align:start position:0%
<00:02:29.870>product <00:02:29.871>category <00:02:29.873>and <00:02:29.874>we <00:02:29.876>have <00:02:29.877>an <00:02:29.879>order

00:02:29.880 --> 00:02:31.110 align:start position:0%
<00:02:29.880>product <00:02:30.038>category <00:02:30.196>and <00:02:30.354>we <00:02:30.512>have <00:02:30.670>an <00:02:30.828>order <00:02:30.987>value.

00:02:31.110 --> 00:02:31.120 align:start position:0%
value.

00:02:31.120 --> 00:02:33.710 align:start position:0%
<00:02:31.120>value. <00:02:31.275>All <00:02:31.431>the <00:02:31.586>same <00:02:31.742>data <00:02:31.897>is <00:02:32.053>at <00:02:32.208>least <00:02:32.364>the <00:02:32.520>first

00:02:33.710 --> 00:02:33.720 align:start position:0%
<00:02:33.710>All <00:02:33.711>the <00:02:33.712>same <00:02:33.713>data <00:02:33.714>is <00:02:33.715>at <00:02:33.716>least <00:02:33.717>the <00:02:33.719>first

00:02:33.720 --> 00:02:36.150 align:start position:0%
<00:02:33.720>All <00:02:33.807>the <00:02:33.895>same <00:02:33.982>data <00:02:34.070>is <00:02:34.157>at <00:02:34.245>least <00:02:34.332>the <00:02:34.420>first <00:02:34.507>two <00:02:34.595>entries <00:02:34.682>as <00:02:34.770>you <00:02:34.857>see. <00:02:34.945>JSON <00:02:35.032>is <00:02:35.120>pretty

00:02:36.150 --> 00:02:36.160 align:start position:0%
<00:02:36.150>two <00:02:36.151>entries <00:02:36.152>as <00:02:36.153>you <00:02:36.155>see. <00:02:36.156>JSON <00:02:36.157>is <00:02:36.159>pretty

00:02:36.160 --> 00:02:38.190 align:start position:0%
<00:02:36.160>two <00:02:36.260>entries <00:02:36.359>as <00:02:36.460>you <00:02:36.560>see. <00:02:36.660>JSON <00:02:36.760>is <00:02:36.859>pretty <00:02:36.960>verbose <00:02:37.060>for <00:02:37.160>those <00:02:37.260>one <00:02:37.359>stored <00:02:37.460>as <00:02:37.560>JSON

00:02:38.190 --> 00:02:38.200 align:start position:0%
<00:02:38.190>verbose <00:02:38.191>for <00:02:38.192>those <00:02:38.194>one <00:02:38.196>stored <00:02:38.197>as <00:02:38.198>JSON

00:02:38.200 --> 00:02:40.030 align:start position:0%
<00:02:38.200>verbose <00:02:38.339>for <00:02:38.480>those <00:02:38.619>one <00:02:38.760>stored <00:02:38.899>as <00:02:39.040>JSON <00:02:39.179>could <00:02:39.320>also <00:02:39.459>be <00:02:39.600>stored

00:02:40.030 --> 00:02:40.040 align:start position:0%
<00:02:40.030>could <00:02:40.033>also <00:02:40.036>be <00:02:40.039>stored

00:02:40.040 --> 00:02:42.030 align:start position:0%
<00:02:40.040>could <00:02:40.273>also <00:02:40.506>be <00:02:40.739>stored <00:02:40.973>transposed, <00:02:41.206>but <00:02:41.440>yeah.

00:02:42.030 --> 00:02:42.040 align:start position:0%
<00:02:42.030>transposed, <00:02:42.034>but <00:02:42.039>yeah.

00:02:42.040 --> 00:02:44.310 align:start position:0%
<00:02:42.040>transposed, <00:02:42.195>but <00:02:42.351>yeah. <00:02:42.506>Now, <00:02:42.662>a <00:02:42.817>typical <00:02:42.973>analytical <00:02:43.128>query <00:02:43.284>is <00:02:43.440>like

00:02:44.310 --> 00:02:44.320 align:start position:0%
<00:02:44.310>Now, <00:02:44.311>a <00:02:44.313>typical <00:02:44.314>analytical <00:02:44.316>query <00:02:44.317>is <00:02:44.319>like

00:02:44.320 --> 00:02:47.190 align:start position:0%
<00:02:44.320>Now, <00:02:44.420>a <00:02:44.519>typical <00:02:44.620>analytical <00:02:44.720>query <00:02:44.820>is <00:02:44.920>like <00:02:45.019>give <00:02:45.120>me <00:02:45.220>the <00:02:45.320>average <00:02:45.420>order <00:02:45.519>value <00:02:45.620>for <00:02:45.720>all

00:02:47.190 --> 00:02:47.200 align:start position:0%
<00:02:47.190>give <00:02:47.191>me <00:02:47.192>the <00:02:47.193>average <00:02:47.195>order <00:02:47.196>value <00:02:47.197>for <00:02:47.198>all

00:02:47.200 --> 00:02:51.150 align:start position:0%
<00:02:47.200>give <00:02:47.299>me <00:02:47.399>the <00:02:47.500>average <00:02:47.600>order <00:02:47.700>value <00:02:47.799>for <00:02:47.899>all <00:02:48.000>orders <00:02:48.100>where <00:02:48.200>the <00:02:48.299>value <00:02:48.399>is <00:02:48.500>above <00:02:48.600>100.

00:02:51.150 --> 00:02:51.160 align:start position:0%
<00:02:51.150>orders <00:02:51.151>where <00:02:51.153>the <00:02:51.154>value <00:02:51.156>is <00:02:51.157>above <00:02:51.159>100.

00:02:51.160 --> 00:02:53.710 align:start position:0%
<00:02:51.160>orders <00:02:51.253>where <00:02:51.346>the <00:02:51.440>value <00:02:51.533>is <00:02:51.626>above <00:02:51.720>100. <00:02:51.813>If <00:02:51.906>I <00:02:52.000>would <00:02:52.093>now <00:02:52.186>execute <00:02:52.280>this <00:02:52.373>query <00:02:52.466>on <00:02:52.560>a

00:02:53.710 --> 00:02:53.720 align:start position:0%
<00:02:53.710>If <00:02:53.711>I <00:02:53.712>would <00:02:53.713>now <00:02:53.714>execute <00:02:53.715>this <00:02:53.716>query <00:02:53.717>on <00:02:53.719>a

00:02:53.720 --> 00:02:55.830 align:start position:0%
<00:02:53.720>If <00:02:53.859>I <00:02:54.000>would <00:02:54.140>now <00:02:54.280>execute <00:02:54.420>this <00:02:54.560>query <00:02:54.700>on <00:02:54.840>a <00:02:54.980>CSV <00:02:55.120>file,

00:02:55.830 --> 00:02:55.840 align:start position:0%
<00:02:55.829>CSV <00:02:55.839>file,

00:02:55.840 --> 00:02:57.470 align:start position:0%
<00:02:55.840>CSV <00:02:56.015>file, <00:02:56.190>I <00:02:56.365>would <00:02:56.540>actually <00:02:56.715>need <00:02:56.890>those <00:02:57.065>values. <00:02:57.240>I

00:02:57.470 --> 00:02:57.480 align:start position:0%
<00:02:57.470>I <00:02:57.471>would <00:02:57.472>actually <00:02:57.474>need <00:02:57.476>those <00:02:57.477>values. <00:02:57.478>I

00:02:57.480 --> 00:03:00.430 align:start position:0%
<00:02:57.480>I <00:02:57.587>would <00:02:57.695>actually <00:02:57.803>need <00:02:57.910>those <00:02:58.018>values. <00:02:58.126>I <00:02:58.233>would <00:02:58.341>need <00:02:58.449>from <00:02:58.556>the <00:02:58.664>column <00:02:58.772>the <00:02:58.880>category

00:03:00.430 --> 00:03:00.440 align:start position:0%
<00:03:00.430>would <00:03:00.431>need <00:03:00.433>from <00:03:00.434>the <00:03:00.436>column <00:03:00.437>the <00:03:00.439>category

00:03:00.440 --> 00:03:03.430 align:start position:0%
<00:03:00.440>would <00:03:00.540>need <00:03:00.640>from <00:03:00.740>the <00:03:00.840>column <00:03:00.940>the <00:03:01.040>category <00:03:01.140>and <00:03:01.240>from <00:03:01.340>the <00:03:01.440>value <00:03:01.540>some <00:03:01.640>of <00:03:01.740>the <00:03:01.840>values

00:03:03.430 --> 00:03:03.440 align:start position:0%
<00:03:03.430>and <00:03:03.431>from <00:03:03.432>the <00:03:03.433>value <00:03:03.435>some <00:03:03.436>of <00:03:03.437>the <00:03:03.439>values

00:03:03.440 --> 00:03:07.150 align:start position:0%
<00:03:03.440>and <00:03:03.547>from <00:03:03.655>the <00:03:03.763>value <00:03:03.870>some <00:03:03.978>of <00:03:04.086>the <00:03:04.193>values <00:03:04.301>based <00:03:04.409>on <00:03:04.516>the <00:03:04.624>where <00:03:04.732>condition. <00:03:04.840>So,

00:03:07.150 --> 00:03:07.160 align:start position:0%
<00:03:07.150>based <00:03:07.151>on <00:03:07.153>the <00:03:07.155>where <00:03:07.157>condition. <00:03:07.159>So,

00:03:07.160 --> 00:03:09.509 align:start position:0%
<00:03:07.160>based <00:03:07.287>on <00:03:07.414>the <00:03:07.541>where <00:03:07.669>condition. <00:03:07.796>So, <00:03:07.923>going <00:03:08.050>now <00:03:08.178>reading <00:03:08.305>these <00:03:08.432>values <00:03:08.560>would

00:03:09.509 --> 00:03:09.519 align:start position:0%
<00:03:09.509>going <00:03:09.510>now <00:03:09.512>reading <00:03:09.514>these <00:03:09.516>values <00:03:09.518>would

00:03:09.519 --> 00:03:11.550 align:start position:0%
<00:03:09.519>going <00:03:09.626>now <00:03:09.734>reading <00:03:09.842>these <00:03:09.949>values <00:03:10.057>would <00:03:10.165>mean <00:03:10.272>I <00:03:10.380>would <00:03:10.488>have <00:03:10.595>to <00:03:10.703>go <00:03:10.811>through <00:03:10.919>each

00:03:11.550 --> 00:03:11.560 align:start position:0%
<00:03:11.550>mean <00:03:11.551>I <00:03:11.552>would <00:03:11.553>have <00:03:11.555>to <00:03:11.556>go <00:03:11.557>through <00:03:11.559>each

00:03:11.560 --> 00:03:12.590 align:start position:0%
<00:03:11.560>mean <00:03:11.675>I <00:03:11.791>would <00:03:11.907>have <00:03:12.023>to <00:03:12.139>go <00:03:12.255>through <00:03:12.371>each <00:03:12.487>row,

00:03:12.590 --> 00:03:12.600 align:start position:0%
row,

00:03:12.600 --> 00:03:15.550 align:start position:0%
<00:03:12.600>row, <00:03:12.775>return <00:03:12.950>the <00:03:13.125>first <00:03:13.299>two <00:03:13.475>skip <00:03:13.650>the <00:03:13.825>first <00:03:14.000>two

00:03:15.550 --> 00:03:15.560 align:start position:0%
<00:03:15.550>return <00:03:15.551>the <00:03:15.552>first <00:03:15.553>two <00:03:15.555>skip <00:03:15.556>the <00:03:15.557>first <00:03:15.559>two

00:03:15.560 --> 00:03:17.430 align:start position:0%
<00:03:15.560>return <00:03:15.660>the <00:03:15.760>first <00:03:15.860>two <00:03:15.960>skip <00:03:16.060>the <00:03:16.160>first <00:03:16.260>two <00:03:16.360>columns, <00:03:16.460>read <00:03:16.560>the <00:03:16.660>column, <00:03:16.760>read <00:03:16.860>the <00:03:16.960>next

00:03:17.430 --> 00:03:17.440 align:start position:0%
<00:03:17.430>columns, <00:03:17.431>read <00:03:17.433>the <00:03:17.434>column, <00:03:17.436>read <00:03:17.437>the <00:03:17.439>next

00:03:17.440 --> 00:03:19.470 align:start position:0%
<00:03:17.440>columns, <00:03:17.540>read <00:03:17.640>the <00:03:17.740>column, <00:03:17.840>read <00:03:17.940>the <00:03:18.040>next <00:03:18.140>column. <00:03:18.240>Then <00:03:18.340>again <00:03:18.440>for <00:03:18.540>the <00:03:18.640>next <00:03:18.740>row, <00:03:18.840>for

00:03:19.470 --> 00:03:19.480 align:start position:0%
<00:03:19.470>column. <00:03:19.471>Then <00:03:19.472>again <00:03:19.473>for <00:03:19.475>the <00:03:19.476>next <00:03:19.477>row, <00:03:19.478>for

00:03:19.480 --> 00:03:22.750 align:start position:0%
<00:03:19.480>column. <00:03:19.562>Then <00:03:19.644>again <00:03:19.727>for <00:03:19.809>the <00:03:19.891>next <00:03:19.974>row, <00:03:20.056>for <00:03:20.138>the <00:03:20.221>next <00:03:20.303>row, <00:03:20.385>but <00:03:20.468>I <00:03:20.550>would <00:03:20.632>go <00:03:20.715>row <00:03:20.797>by <00:03:20.880>row.

00:03:22.750 --> 00:03:22.760 align:start position:0%
<00:03:22.750>the <00:03:22.751>next <00:03:22.752>row, <00:03:22.753>but <00:03:22.754>I <00:03:22.755>would <00:03:22.756>go <00:03:22.757>row <00:03:22.757>by <00:03:22.759>row.

00:03:22.760 --> 00:03:24.470 align:start position:0%
<00:03:22.760>the <00:03:22.847>next <00:03:22.935>row, <00:03:23.022>but <00:03:23.109>I <00:03:23.197>would <00:03:23.285>go <00:03:23.372>row <00:03:23.459>by <00:03:23.547>row. <00:03:23.635>But <00:03:23.722>what <00:03:23.810>we <00:03:23.897>actually <00:03:23.984>select <00:03:24.072>here <00:03:24.160>and

00:03:24.470 --> 00:03:24.480 align:start position:0%
<00:03:24.470>But <00:03:24.471>what <00:03:24.472>we <00:03:24.474>actually <00:03:24.476>select <00:03:24.477>here <00:03:24.478>and

00:03:24.480 --> 00:03:26.509 align:start position:0%
<00:03:24.480>But <00:03:24.587>what <00:03:24.695>we <00:03:24.803>actually <00:03:24.910>select <00:03:25.018>here <00:03:25.126>and <00:03:25.233>where <00:03:25.341>we <00:03:25.449>filter <00:03:25.556>on <00:03:25.664>it's <00:03:25.772>always <00:03:25.880>columns.

00:03:26.509 --> 00:03:26.519 align:start position:0%
<00:03:26.509>where <00:03:26.510>we <00:03:26.512>filter <00:03:26.513>on <00:03:26.515>it's <00:03:26.516>always <00:03:26.518>columns.

00:03:26.519 --> 00:03:28.949 align:start position:0%
<00:03:26.519>where <00:03:26.619>we <00:03:26.719>filter <00:03:26.819>on <00:03:26.919>it's <00:03:27.019>always <00:03:27.119>columns. <00:03:27.219>So, <00:03:27.319>it <00:03:27.419>would <00:03:27.519>be <00:03:27.619>way <00:03:27.719>nicer <00:03:27.819>to <00:03:27.919>actually

00:03:28.949 --> 00:03:28.959 align:start position:0%
<00:03:28.949>So, <00:03:28.950>it <00:03:28.951>would <00:03:28.952>be <00:03:28.954>way <00:03:28.955>nicer <00:03:28.956>to <00:03:28.958>actually

00:03:28.959 --> 00:03:30.590 align:start position:0%
<00:03:28.959>So, <00:03:29.059>it <00:03:29.159>would <00:03:29.259>be <00:03:29.359>way <00:03:29.459>nicer <00:03:29.559>to <00:03:29.659>actually <00:03:29.759>just <00:03:29.859>select <00:03:29.959>the <00:03:30.059>columns <00:03:30.159>and <00:03:30.259>have <00:03:30.359>it

00:03:30.590 --> 00:03:30.600 align:start position:0%
<00:03:30.590>just <00:03:30.591>select <00:03:30.593>the <00:03:30.594>columns <00:03:30.596>and <00:03:30.597>have <00:03:30.599>it

00:03:30.600 --> 00:03:32.630 align:start position:0%
<00:03:30.600>just <00:03:30.716>select <00:03:30.833>the <00:03:30.950>columns <00:03:31.066>and <00:03:31.183>have <00:03:31.299>it <00:03:31.416>really <00:03:31.533>easy <00:03:31.650>to <00:03:31.766>read <00:03:31.883>those <00:03:32.000>columns

00:03:32.630 --> 00:03:32.640 align:start position:0%
<00:03:32.630>really <00:03:32.631>easy <00:03:32.633>to <00:03:32.635>read <00:03:32.637>those <00:03:32.638>columns

00:03:32.640 --> 00:03:34.430 align:start position:0%
<00:03:32.640>really <00:03:32.747>easy <00:03:32.855>to <00:03:32.963>read <00:03:33.070>those <00:03:33.178>columns <00:03:33.286>instead <00:03:33.393>of <00:03:33.501>row <00:03:33.609>by <00:03:33.716>row <00:03:33.824>and <00:03:33.932>just <00:03:34.040>filtering

00:03:34.430 --> 00:03:34.440 align:start position:0%
<00:03:34.430>instead <00:03:34.431>of <00:03:34.432>row <00:03:34.433>by <00:03:34.435>row <00:03:34.436>and <00:03:34.437>just <00:03:34.439>filtering

00:03:34.440 --> 00:03:36.509 align:start position:0%
<00:03:34.440>instead <00:03:34.533>of <00:03:34.626>row <00:03:34.720>by <00:03:34.813>row <00:03:34.906>and <00:03:35.000>just <00:03:35.093>filtering <00:03:35.186>some <00:03:35.280>values <00:03:35.373>of <00:03:35.466>each <00:03:35.560>row, <00:03:35.653>which <00:03:35.746>is <00:03:35.840>quite

00:03:36.509 --> 00:03:36.519 align:start position:0%
<00:03:36.509>some <00:03:36.510>values <00:03:36.511>of <00:03:36.512>each <00:03:36.514>row, <00:03:36.515>which <00:03:36.516>is <00:03:36.518>quite

00:03:36.519 --> 00:03:39.310 align:start position:0%
<00:03:36.519>some <00:03:36.674>values <00:03:36.830>of <00:03:36.985>each <00:03:37.141>row, <00:03:37.296>which <00:03:37.452>is <00:03:37.607>quite <00:03:37.763>quite <00:03:37.919>slow.

00:03:39.320 --> 00:03:41.229 align:start position:0%
<00:03:39.320>So, <00:03:39.600>this <00:03:39.880>is <00:03:40.160>where <00:03:40.440>column <00:03:40.720>oriented

00:03:41.229 --> 00:03:41.239 align:start position:0%
<00:03:41.228>So, <00:03:41.230>this <00:03:41.232>is <00:03:41.234>where <00:03:41.236>column <00:03:41.238>oriented

00:03:41.239 --> 00:03:43.710 align:start position:0%
<00:03:41.239>So, <00:03:41.346>this <00:03:41.454>is <00:03:41.562>where <00:03:41.669>column <00:03:41.777>oriented <00:03:41.885>storage <00:03:41.992>comes <00:03:42.100>in. <00:03:42.208>This <00:03:42.315>one <00:03:42.423>here <00:03:42.531>is <00:03:42.639>row

00:03:43.710 --> 00:03:43.720 align:start position:0%
<00:03:43.710>storage <00:03:43.711>comes <00:03:43.712>in. <00:03:43.713>This <00:03:43.715>one <00:03:43.716>here <00:03:43.717>is <00:03:43.719>row

00:03:43.720 --> 00:03:46.710 align:start position:0%
<00:03:43.720>storage <00:03:43.813>comes <00:03:43.906>in. <00:03:44.000>This <00:03:44.093>one <00:03:44.186>here <00:03:44.280>is <00:03:44.373>row <00:03:44.466>oriented. <00:03:44.560>We <00:03:44.653>store <00:03:44.746>row <00:03:44.840>by <00:03:44.933>row <00:03:45.026>and <00:03:45.120>here

00:03:46.710 --> 00:03:46.720 align:start position:0%
<00:03:46.710>oriented. <00:03:46.711>We <00:03:46.712>store <00:03:46.713>row <00:03:46.715>by <00:03:46.716>row <00:03:46.717>and <00:03:46.719>here

00:03:46.720 --> 00:03:48.870 align:start position:0%
<00:03:46.720>oriented. <00:03:46.836>We <00:03:46.953>store <00:03:47.070>row <00:03:47.186>by <00:03:47.303>row <00:03:47.420>and <00:03:47.536>here <00:03:47.653>we <00:03:47.770>store <00:03:47.886>column <00:03:48.003>by <00:03:48.120>column.

00:03:48.870 --> 00:03:48.880 align:start position:0%
<00:03:48.870>we <00:03:48.872>store <00:03:48.874>column <00:03:48.876>by <00:03:48.879>column.

00:03:48.880 --> 00:03:50.509 align:start position:0%
<00:03:48.880>we <00:03:49.160>store <00:03:49.440>column <00:03:49.720>by <00:03:50.000>column. <00:03:50.280>Um

00:03:50.509 --> 00:03:50.519 align:start position:0%
Um

00:03:50.519 --> 00:03:52.509 align:start position:0%
<00:03:50.519>Um <00:03:50.674>So, <00:03:50.830>we <00:03:50.985>write <00:03:51.141>all <00:03:51.296>the <00:03:51.452>values <00:03:51.607>of <00:03:51.763>the <00:03:51.919>first

00:03:52.509 --> 00:03:52.519 align:start position:0%
<00:03:52.509>So, <00:03:52.510>we <00:03:52.511>write <00:03:52.512>all <00:03:52.513>the <00:03:52.514>values <00:03:52.515>of <00:03:52.516>the <00:03:52.518>first

00:03:52.519 --> 00:03:54.190 align:start position:0%
<00:03:52.519>So, <00:03:52.606>we <00:03:52.694>write <00:03:52.781>all <00:03:52.869>the <00:03:52.956>values <00:03:53.044>of <00:03:53.131>the <00:03:53.219>first <00:03:53.306>column, <00:03:53.394>then <00:03:53.481>we <00:03:53.569>write <00:03:53.656>all <00:03:53.744>the <00:03:53.831>values <00:03:53.919>of

00:03:54.190 --> 00:03:54.200 align:start position:0%
<00:03:54.190>column, <00:03:54.191>then <00:03:54.192>we <00:03:54.193>write <00:03:54.195>all <00:03:54.196>the <00:03:54.197>values <00:03:54.198>of

00:03:54.200 --> 00:03:55.870 align:start position:0%
<00:03:54.200>column, <00:03:54.287>then <00:03:54.375>we <00:03:54.462>write <00:03:54.549>all <00:03:54.637>the <00:03:54.725>values <00:03:54.812>of <00:03:54.899>the <00:03:54.987>second <00:03:55.075>columns, <00:03:55.162>and <00:03:55.250>so <00:03:55.337>on. <00:03:55.424>And <00:03:55.512>if <00:03:55.600>we

00:03:55.870 --> 00:03:55.880 align:start position:0%
<00:03:55.870>the <00:03:55.871>second <00:03:55.872>columns, <00:03:55.873>and <00:03:55.874>so <00:03:55.875>on. <00:03:55.876>And <00:03:55.877>if <00:03:55.879>we

00:03:55.880 --> 00:03:58.670 align:start position:0%
<00:03:55.880>the <00:03:55.980>second <00:03:56.079>columns, <00:03:56.180>and <00:03:56.280>so <00:03:56.380>on. <00:03:56.480>And <00:03:56.579>if <00:03:56.680>we <00:03:56.780>say, <00:03:56.880>"Hey, <00:03:56.980>select <00:03:57.079>product <00:03:57.180>category <00:03:57.280>and

00:03:58.670 --> 00:03:58.680 align:start position:0%
<00:03:58.670>say, <00:03:58.671>"Hey, <00:03:58.673>select <00:03:58.675>product <00:03:58.677>category <00:03:58.679>and

00:03:58.680 --> 00:04:00.710 align:start position:0%
<00:03:58.680>say, <00:03:58.796>"Hey, <00:03:58.913>select <00:03:59.030>product <00:03:59.146>category <00:03:59.263>and <00:03:59.380>order <00:03:59.496>value." <00:03:59.613>We <00:03:59.730>know, <00:03:59.846>"Ah, <00:03:59.963>we <00:04:00.080>need

00:04:00.710 --> 00:04:00.720 align:start position:0%
<00:04:00.710>order <00:04:00.711>value." <00:04:00.713>We <00:04:00.714>know, <00:04:00.716>"Ah, <00:04:00.717>we <00:04:00.719>need

00:04:00.720 --> 00:04:03.350 align:start position:0%
<00:04:00.720>order <00:04:00.820>value." <00:04:00.920>We <00:04:01.020>know, <00:04:01.120>"Ah, <00:04:01.220>we <00:04:01.320>need <00:04:01.420>those <00:04:01.520>two <00:04:01.620>columns." <00:04:01.720>And <00:04:01.820>we <00:04:01.920>can <00:04:02.020>just <00:04:02.120>read

00:04:03.350 --> 00:04:03.360 align:start position:0%
<00:04:03.350>those <00:04:03.351>two <00:04:03.352>columns." <00:04:03.353>And <00:04:03.355>we <00:04:03.356>can <00:04:03.357>just <00:04:03.359>read

00:04:03.360 --> 00:04:05.910 align:start position:0%
<00:04:03.360>those <00:04:03.460>two <00:04:03.560>columns." <00:04:03.660>And <00:04:03.760>we <00:04:03.860>can <00:04:03.960>just <00:04:04.060>read <00:04:04.160>them <00:04:04.260>on <00:04:04.360>disk <00:04:04.460>because <00:04:04.560>they're <00:04:04.660>stored <00:04:04.760>next

00:04:05.910 --> 00:04:05.920 align:start position:0%
<00:04:05.910>them <00:04:05.911>on <00:04:05.912>disk <00:04:05.914>because <00:04:05.916>they're <00:04:05.917>stored <00:04:05.918>next

00:04:05.920 --> 00:04:07.990 align:start position:0%
<00:04:05.920>them <00:04:06.013>on <00:04:06.106>disk <00:04:06.200>because <00:04:06.293>they're <00:04:06.386>stored <00:04:06.480>next <00:04:06.573>to <00:04:06.666>each <00:04:06.760>other <00:04:06.853>on <00:04:06.946>disk, <00:04:07.040>and <00:04:07.133>this <00:04:07.226>one <00:04:07.320>as

00:04:07.990 --> 00:04:08.000 align:start position:0%
<00:04:07.990>to <00:04:07.991>each <00:04:07.992>other <00:04:07.993>on <00:04:07.994>disk, <00:04:07.995>and <00:04:07.996>this <00:04:07.997>one <00:04:07.999>as

00:04:08.000 --> 00:04:10.550 align:start position:0%
<00:04:08.000>to <00:04:08.116>each <00:04:08.233>other <00:04:08.350>on <00:04:08.466>disk, <00:04:08.583>and <00:04:08.700>this <00:04:08.816>one <00:04:08.933>as <00:04:09.050>well. <00:04:09.166>Just <00:04:09.283>read <00:04:09.400>one

00:04:10.550 --> 00:04:10.560 align:start position:0%
<00:04:10.550>well. <00:04:10.553>Just <00:04:10.556>read <00:04:10.559>one

00:04:10.560 --> 00:04:12.590 align:start position:0%
<00:04:10.560>well. <00:04:10.700>Just <00:04:10.840>read <00:04:10.980>one <00:04:11.120>blob <00:04:11.260>of <00:04:11.400>bytes <00:04:11.540>instead <00:04:11.680>of <00:04:11.820>picking <00:04:11.960>some

00:04:12.590 --> 00:04:12.600 align:start position:0%
<00:04:12.590>blob <00:04:12.591>of <00:04:12.593>bytes <00:04:12.594>instead <00:04:12.596>of <00:04:12.597>picking <00:04:12.599>some

00:04:12.600 --> 00:04:14.550 align:start position:0%
<00:04:12.600>blob <00:04:12.700>of <00:04:12.799>bytes <00:04:12.900>instead <00:04:13.000>of <00:04:13.100>picking <00:04:13.200>some <00:04:13.299>bytes <00:04:13.400>there <00:04:13.500>in <00:04:13.600>a <00:04:13.700>file, <00:04:13.799>some <00:04:13.900>bytes <00:04:14.000>there,

00:04:14.550 --> 00:04:14.560 align:start position:0%
<00:04:14.550>bytes <00:04:14.551>there <00:04:14.552>in <00:04:14.553>a <00:04:14.555>file, <00:04:14.556>some <00:04:14.557>bytes <00:04:14.559>there,

00:04:14.560 --> 00:04:17.710 align:start position:0%
<00:04:14.560>bytes <00:04:14.667>there <00:04:14.775>in <00:04:14.883>a <00:04:14.990>file, <00:04:15.098>some <00:04:15.206>bytes <00:04:15.313>there, <00:04:15.421>some <00:04:15.529>bytes <00:04:15.636>there, <00:04:15.744>some <00:04:15.852>bytes <00:04:15.960>there.

00:04:17.710 --> 00:04:17.720 align:start position:0%
<00:04:17.709>some <00:04:17.711>bytes <00:04:17.713>there, <00:04:17.715>some <00:04:17.717>bytes <00:04:17.719>there.

00:04:17.720 --> 00:04:20.550 align:start position:0%
<00:04:17.720>some <00:04:17.836>bytes <00:04:17.953>there, <00:04:18.070>some <00:04:18.186>bytes <00:04:18.303>there. <00:04:18.420>But, <00:04:18.536>this <00:04:18.653>only <00:04:18.770>solves <00:04:18.886>the <00:04:19.003>challenge <00:04:19.120>of

00:04:20.550 --> 00:04:20.560 align:start position:0%
<00:04:20.550>But, <00:04:20.551>this <00:04:20.553>only <00:04:20.554>solves <00:04:20.555>the <00:04:20.557>challenge <00:04:20.559>of

00:04:20.560 --> 00:04:21.550 align:start position:0%
<00:04:20.560>But, <00:04:20.687>this <00:04:20.814>only <00:04:20.941>solves <00:04:21.069>the <00:04:21.196>challenge <00:04:21.323>of <00:04:21.451>um

00:04:21.550 --> 00:04:21.560 align:start position:0%
um

00:04:21.560 --> 00:04:23.510 align:start position:0%
<00:04:21.560>um <00:04:21.760>reading <00:04:21.959>by <00:04:22.160>column <00:04:22.360>instead <00:04:22.560>of <00:04:22.760>reading <00:04:22.960>by

00:04:23.510 --> 00:04:23.520 align:start position:0%
<00:04:23.510>reading <00:04:23.511>by <00:04:23.513>column <00:04:23.514>instead <00:04:23.515>of <00:04:23.517>reading <00:04:23.519>by

00:04:23.520 --> 00:04:24.590 align:start position:0%
<00:04:23.520>reading <00:04:23.657>by <00:04:23.795>column <00:04:23.932>instead <00:04:24.070>of <00:04:24.207>reading <00:04:24.345>by <00:04:24.483>row.

00:04:24.590 --> 00:04:24.600 align:start position:0%
row.

00:04:24.600 --> 00:04:26.150 align:start position:0%
<00:04:24.600>row. <00:04:24.879>And <00:04:25.158>of <00:04:25.437>course, <00:04:25.716>column-oriented <00:04:25.995>storage

00:04:26.150 --> 00:04:26.160 align:start position:0%
<00:04:26.150>And <00:04:26.152>of <00:04:26.154>course, <00:04:26.156>column-oriented <00:04:26.159>storage

00:04:26.160 --> 00:04:29.270 align:start position:0%
<00:04:26.160>And <00:04:26.287>of <00:04:26.414>course, <00:04:26.541>column-oriented <00:04:26.669>storage <00:04:26.796>comes <00:04:26.923>also <00:04:27.050>with <00:04:27.178>some <00:04:27.305>um <00:04:27.432>challenges. <00:04:27.560>If

00:04:29.270 --> 00:04:29.280 align:start position:0%
<00:04:29.270>comes <00:04:29.271>also <00:04:29.272>with <00:04:29.274>some <00:04:29.275>um <00:04:29.277>challenges. <00:04:29.279>If

00:04:29.280 --> 00:04:31.190 align:start position:0%
<00:04:29.280>comes <00:04:29.396>also <00:04:29.513>with <00:04:29.630>some <00:04:29.746>um <00:04:29.863>challenges. <00:04:29.979>If <00:04:30.096>you <00:04:30.213>think <00:04:30.330>about <00:04:30.446>writing <00:04:30.563>this <00:04:30.679>file,

00:04:31.190 --> 00:04:31.200 align:start position:0%
<00:04:31.190>you <00:04:31.191>think <00:04:31.193>about <00:04:31.195>writing <00:04:31.197>this <00:04:31.199>file,

00:04:31.200 --> 00:04:33.430 align:start position:0%
<00:04:31.200>you <00:04:31.307>think <00:04:31.415>about <00:04:31.523>writing <00:04:31.630>this <00:04:31.738>file, <00:04:31.846>adding <00:04:31.953>a <00:04:32.061>new <00:04:32.169>file, <00:04:32.276>adding <00:04:32.384>a <00:04:32.492>new <00:04:32.599>row,

00:04:33.430 --> 00:04:33.440 align:start position:0%
<00:04:33.430>adding <00:04:33.431>a <00:04:33.432>new <00:04:33.433>file, <00:04:33.435>adding <00:04:33.436>a <00:04:33.437>new <00:04:33.439>row,

00:04:33.440 --> 00:04:34.870 align:start position:0%
<00:04:33.440>adding <00:04:33.539>a <00:04:33.638>new <00:04:33.737>file, <00:04:33.836>adding <00:04:33.935>a <00:04:34.034>new <00:04:34.133>row, <00:04:34.232>it's <00:04:34.331>really <00:04:34.430>complicated <00:04:34.529>because <00:04:34.628>you <00:04:34.727>have

00:04:34.870 --> 00:04:34.880 align:start position:0%
<00:04:34.870>it's <00:04:34.871>really <00:04:34.873>complicated <00:04:34.875>because <00:04:34.877>you <00:04:34.879>have

00:04:34.880 --> 00:04:37.710 align:start position:0%
<00:04:34.880>it's <00:04:34.980>really <00:04:35.080>complicated <00:04:35.180>because <00:04:35.280>you <00:04:35.380>have <00:04:35.480>to <00:04:35.580>add <00:04:35.680>one <00:04:35.780>one <00:04:35.880>value <00:04:35.980>to <00:04:36.080>each <00:04:36.180>of <00:04:36.280>the

00:04:37.710 --> 00:04:37.720 align:start position:0%
<00:04:37.710>to <00:04:37.711>add <00:04:37.712>one <00:04:37.713>one <00:04:37.714>value <00:04:37.715>to <00:04:37.716>each <00:04:37.717>of <00:04:37.719>the

00:04:37.720 --> 00:04:40.030 align:start position:0%
<00:04:37.720>to <00:04:37.813>add <00:04:37.906>one <00:04:38.000>one <00:04:38.093>value <00:04:38.186>to <00:04:38.280>each <00:04:38.373>of <00:04:38.466>the <00:04:38.560>columns. <00:04:38.653>So, <00:04:38.746>it's <00:04:38.840>not <00:04:38.933>really <00:04:39.026>made <00:04:39.120>for

00:04:40.030 --> 00:04:40.040 align:start position:0%
<00:04:40.030>columns. <00:04:40.031>So, <00:04:40.033>it's <00:04:40.034>not <00:04:40.036>really <00:04:40.037>made <00:04:40.039>for

00:04:40.040 --> 00:04:41.630 align:start position:0%
<00:04:40.040>columns. <00:04:40.167>So, <00:04:40.294>it's <00:04:40.421>not <00:04:40.549>really <00:04:40.676>made <00:04:40.803>for <00:04:40.930>writing. <00:04:41.058>It's <00:04:41.185>really <00:04:41.312>optimized <00:04:41.440>for

00:04:41.630 --> 00:04:41.640 align:start position:0%
<00:04:41.630>writing. <00:04:41.632>It's <00:04:41.634>really <00:04:41.636>optimized <00:04:41.639>for

00:04:41.640 --> 00:04:44.670 align:start position:0%
<00:04:41.640>writing. <00:04:41.756>It's <00:04:41.873>really <00:04:41.990>optimized <00:04:42.106>for <00:04:42.223>reading. <00:04:42.340>But, <00:04:42.456>how <00:04:42.573>do <00:04:42.690>we <00:04:42.806>now <00:04:42.923>say, <00:04:43.039>"Hey,

00:04:44.670 --> 00:04:44.680 align:start position:0%
<00:04:44.670>reading. <00:04:44.671>But, <00:04:44.672>how <00:04:44.673>do <00:04:44.675>we <00:04:44.676>now <00:04:44.677>say, <00:04:44.679>"Hey,

00:04:44.680 --> 00:04:46.750 align:start position:0%
<00:04:44.680>reading. <00:04:44.773>But, <00:04:44.866>how <00:04:44.960>do <00:04:45.053>we <00:04:45.146>now <00:04:45.240>say, <00:04:45.333>"Hey, <00:04:45.426>but <00:04:45.520>we <00:04:45.613>only <00:04:45.706>want <00:04:45.800>the <00:04:45.893>where <00:04:45.986>the <00:04:46.080>order

00:04:46.750 --> 00:04:46.760 align:start position:0%
<00:04:46.750>but <00:04:46.751>we <00:04:46.752>only <00:04:46.753>want <00:04:46.755>the <00:04:46.756>where <00:04:46.757>the <00:04:46.759>order

00:04:46.760 --> 00:04:49.430 align:start position:0%
<00:04:46.760>but <00:04:46.853>we <00:04:46.946>only <00:04:47.039>want <00:04:47.133>the <00:04:47.226>where <00:04:47.320>the <00:04:47.413>order <00:04:47.506>value <00:04:47.599>is <00:04:47.693>above <00:04:47.786>100." <00:04:47.880>So, <00:04:47.973>we <00:04:48.066>want <00:04:48.159>to

00:04:49.430 --> 00:04:49.440 align:start position:0%
<00:04:49.430>value <00:04:49.431>is <00:04:49.432>above <00:04:49.433>100." <00:04:49.435>So, <00:04:49.436>we <00:04:49.437>want <00:04:49.439>to

00:04:49.440 --> 00:04:51.230 align:start position:0%
<00:04:49.440>value <00:04:49.533>is <00:04:49.626>above <00:04:49.719>100." <00:04:49.813>So, <00:04:49.906>we <00:04:50.000>want <00:04:50.093>to <00:04:50.186>filter <00:04:50.280>out <00:04:50.373>some <00:04:50.466>of <00:04:50.560>those <00:04:50.653>values <00:04:50.746>and <00:04:50.840>only

00:04:51.230 --> 00:04:51.240 align:start position:0%
<00:04:51.230>filter <00:04:51.231>out <00:04:51.232>some <00:04:51.233>of <00:04:51.235>those <00:04:51.236>values <00:04:51.237>and <00:04:51.239>only

00:04:51.240 --> 00:04:53.230 align:start position:0%
<00:04:51.240>filter <00:04:51.356>out <00:04:51.473>some <00:04:51.590>of <00:04:51.706>those <00:04:51.823>values <00:04:51.940>and <00:04:52.056>only <00:04:52.173>have <00:04:52.290>a <00:04:52.406>few <00:04:52.523>of <00:04:52.640>them.

00:04:53.230 --> 00:04:53.240 align:start position:0%
<00:04:53.230>have <00:04:53.232>a <00:04:53.234>few <00:04:53.236>of <00:04:53.239>them.

00:04:53.240 --> 00:04:55.390 align:start position:0%
<00:04:53.240>have <00:04:53.367>a <00:04:53.494>few <00:04:53.621>of <00:04:53.749>them. <00:04:53.876>This <00:04:54.003>is <00:04:54.130>where <00:04:54.258>then <00:04:54.385>So, <00:04:54.512>Parquet <00:04:54.640>is

00:04:55.390 --> 00:04:55.400 align:start position:0%
<00:04:55.390>This <00:04:55.391>is <00:04:55.393>where <00:04:55.394>then <00:04:55.395>So, <00:04:55.397>Parquet <00:04:55.399>is

00:04:55.400 --> 00:04:57.310 align:start position:0%
<00:04:55.400>This <00:04:55.527>is <00:04:55.654>where <00:04:55.781>then <00:04:55.909>So, <00:04:56.036>Parquet <00:04:56.163>is <00:04:56.290>column-oriented, <00:04:56.418>but <00:04:56.545>they <00:04:56.672>Parquet <00:04:56.799>is

00:04:57.310 --> 00:04:57.320 align:start position:0%
<00:04:57.310>column-oriented, <00:04:57.312>but <00:04:57.314>they <00:04:57.316>Parquet <00:04:57.319>is

00:04:57.320 --> 00:04:58.909 align:start position:0%
<00:04:57.320>column-oriented, <00:04:57.520>but <00:04:57.719>they <00:04:57.920>Parquet <00:04:58.120>is <00:04:58.320>also <00:04:58.520>something <00:04:58.719>else.

00:04:58.909 --> 00:04:58.919 align:start position:0%
<00:04:58.909>also <00:04:58.913>something <00:04:58.918>else.

00:04:58.919 --> 00:05:02.150 align:start position:0%
<00:04:58.919>also <00:04:59.074>something <00:04:59.230>else. <00:04:59.385>Parquet <00:04:59.541>stores <00:04:59.696>its <00:04:59.852>data <00:05:00.007>in <00:05:00.163>so-called <00:05:00.318>row

00:05:02.150 --> 00:05:02.160 align:start position:0%
<00:05:02.150>Parquet <00:05:02.151>stores <00:05:02.153>its <00:05:02.154>data <00:05:02.156>in <00:05:02.157>so-called <00:05:02.159>row

00:05:02.160 --> 00:05:05.470 align:start position:0%
<00:05:02.160>Parquet <00:05:02.276>stores <00:05:02.393>its <00:05:02.510>data <00:05:02.626>in <00:05:02.743>so-called <00:05:02.860>row <00:05:02.976>groups. <00:05:03.093>So, <00:05:03.210>it <00:05:03.326>further <00:05:03.443>splits <00:05:03.560>those

00:05:05.470 --> 00:05:05.480 align:start position:0%
<00:05:05.470>groups. <00:05:05.471>So, <00:05:05.473>it <00:05:05.475>further <00:05:05.477>splits <00:05:05.479>those

00:05:05.480 --> 00:05:08.830 align:start position:0%
<00:05:05.480>groups. <00:05:05.587>So, <00:05:05.695>it <00:05:05.803>further <00:05:05.910>splits <00:05:06.018>those <00:05:06.126>columns <00:05:06.233>into <00:05:06.341>rows. <00:05:06.449>This <00:05:06.556>one <00:05:06.664>is <00:05:06.772>the <00:05:06.880>the

00:05:08.830 --> 00:05:08.840 align:start position:0%
<00:05:08.830>columns <00:05:08.831>into <00:05:08.832>rows. <00:05:08.833>This <00:05:08.835>one <00:05:08.836>is <00:05:08.837>the <00:05:08.839>the

00:05:08.840 --> 00:05:11.150 align:start position:0%
<00:05:08.840>columns <00:05:08.940>into <00:05:09.039>rows. <00:05:09.140>This <00:05:09.239>one <00:05:09.340>is <00:05:09.440>the <00:05:09.539>the <00:05:09.640>columns <00:05:09.739>of <00:05:09.840>the <00:05:09.940>first <00:05:10.039>three <00:05:10.140>rows, <00:05:10.239>then

00:05:11.150 --> 00:05:11.160 align:start position:0%
<00:05:11.150>columns <00:05:11.151>of <00:05:11.153>the <00:05:11.154>first <00:05:11.156>three <00:05:11.157>rows, <00:05:11.159>then

00:05:11.160 --> 00:05:13.310 align:start position:0%
<00:05:11.160>columns <00:05:11.260>of <00:05:11.360>the <00:05:11.460>first <00:05:11.560>three <00:05:11.660>rows, <00:05:11.760>then <00:05:11.860>the <00:05:11.960>columns <00:05:12.060>of <00:05:12.160>the <00:05:12.260>next <00:05:12.360>three <00:05:12.460>rows, <00:05:12.560>and

00:05:13.310 --> 00:05:13.320 align:start position:0%
<00:05:13.310>the <00:05:13.311>columns <00:05:13.312>of <00:05:13.313>the <00:05:13.315>next <00:05:13.316>three <00:05:13.317>rows, <00:05:13.319>and

00:05:13.320 --> 00:05:14.470 align:start position:0%
<00:05:13.320>the <00:05:13.435>columns <00:05:13.550>of <00:05:13.665>the <00:05:13.780>next <00:05:13.895>three <00:05:14.010>rows, <00:05:14.125>and <00:05:14.240>so <00:05:14.355>on.

00:05:14.470 --> 00:05:14.480 align:start position:0%
<00:05:14.470>so <00:05:14.479>on.

00:05:14.480 --> 00:05:16.070 align:start position:0%
<00:05:14.480>so <00:05:14.655>on. <00:05:14.830>Row <00:05:15.005>groups <00:05:15.180>are <00:05:15.355>typically <00:05:15.530>more <00:05:15.705>than <00:05:15.880>three

00:05:16.070 --> 00:05:16.080 align:start position:0%
<00:05:16.070>Row <00:05:16.071>groups <00:05:16.073>are <00:05:16.074>typically <00:05:16.075>more <00:05:16.077>than <00:05:16.079>three

00:05:16.080 --> 00:05:17.390 align:start position:0%
<00:05:16.080>Row <00:05:16.170>groups <00:05:16.261>are <00:05:16.352>typically <00:05:16.442>more <00:05:16.533>than <00:05:16.624>three <00:05:16.714>rows, <00:05:16.805>of <00:05:16.896>course. <00:05:16.986>It's <00:05:17.077>just <00:05:17.168>for <00:05:17.259>demo

00:05:17.390 --> 00:05:17.400 align:start position:0%
<00:05:17.390>rows, <00:05:17.391>of <00:05:17.393>course. <00:05:17.394>It's <00:05:17.395>just <00:05:17.397>for <00:05:17.399>demo

00:05:17.400 --> 00:05:19.990 align:start position:0%
<00:05:17.400>rows, <00:05:17.507>of <00:05:17.615>course. <00:05:17.723>It's <00:05:17.830>just <00:05:17.938>for <00:05:18.046>demo <00:05:18.153>purposes. <00:05:18.261>Um <00:05:18.369>and <00:05:18.476>for <00:05:18.584>each <00:05:18.692>row <00:05:18.799>group,

00:05:19.990 --> 00:05:20.000 align:start position:0%
<00:05:19.990>purposes. <00:05:19.991>Um <00:05:19.993>and <00:05:19.994>for <00:05:19.996>each <00:05:19.997>row <00:05:19.999>group,

00:05:20.000 --> 00:05:21.710 align:start position:0%
<00:05:20.000>purposes. <00:05:20.100>Um <00:05:20.200>and <00:05:20.300>for <00:05:20.400>each <00:05:20.500>row <00:05:20.600>group, <00:05:20.700>there <00:05:20.800>is <00:05:20.900>a <00:05:21.000>footer. <00:05:21.100>And <00:05:21.200>in <00:05:21.300>the <00:05:21.400>footer,

00:05:21.710 --> 00:05:21.720 align:start position:0%
<00:05:21.710>there <00:05:21.711>is <00:05:21.712>a <00:05:21.713>footer. <00:05:21.715>And <00:05:21.716>in <00:05:21.717>the <00:05:21.719>footer,

00:05:21.720 --> 00:05:24.150 align:start position:0%
<00:05:21.720>there <00:05:21.847>is <00:05:21.974>a <00:05:22.101>footer. <00:05:22.229>And <00:05:22.356>in <00:05:22.483>the <00:05:22.610>footer, <00:05:22.738>there <00:05:22.865>is <00:05:22.992>stored <00:05:23.120>statistics.

00:05:24.150 --> 00:05:24.160 align:start position:0%
<00:05:24.150>there <00:05:24.153>is <00:05:24.156>stored <00:05:24.159>statistics.

00:05:24.160 --> 00:05:26.230 align:start position:0%
<00:05:24.160>there <00:05:24.287>is <00:05:24.414>stored <00:05:24.541>statistics. <00:05:24.669>For <00:05:24.796>instance, <00:05:24.923>the <00:05:25.050>uh <00:05:25.178>min <00:05:25.305>and <00:05:25.432>max <00:05:25.560>value

00:05:26.230 --> 00:05:26.240 align:start position:0%
<00:05:26.230>For <00:05:26.231>instance, <00:05:26.232>the <00:05:26.233>uh <00:05:26.235>min <00:05:26.236>and <00:05:26.237>max <00:05:26.239>value

00:05:26.240 --> 00:05:28.310 align:start position:0%
<00:05:26.240>For <00:05:26.333>instance, <00:05:26.426>the <00:05:26.520>uh <00:05:26.613>min <00:05:26.706>and <00:05:26.800>max <00:05:26.893>value <00:05:26.986>for <00:05:27.080>each <00:05:27.173>of <00:05:27.266>the <00:05:27.360>columns. <00:05:27.453>For <00:05:27.546>the <00:05:27.640>first

00:05:28.310 --> 00:05:28.320 align:start position:0%
<00:05:28.310>for <00:05:28.311>each <00:05:28.312>of <00:05:28.313>the <00:05:28.315>columns. <00:05:28.316>For <00:05:28.317>the <00:05:28.319>first

00:05:28.320 --> 00:05:29.909 align:start position:0%
<00:05:28.320>for <00:05:28.420>each <00:05:28.520>of <00:05:28.620>the <00:05:28.719>columns. <00:05:28.820>For <00:05:28.920>the <00:05:29.020>first <00:05:29.120>row <00:05:29.219>group, <00:05:29.320>they <00:05:29.420>would <00:05:29.520>For <00:05:29.620>instance, <00:05:29.719>for

00:05:29.909 --> 00:05:29.919 align:start position:0%
<00:05:29.909>row <00:05:29.910>group, <00:05:29.912>they <00:05:29.913>would <00:05:29.914>For <00:05:29.916>instance, <00:05:29.918>for

00:05:29.919 --> 00:05:32.030 align:start position:0%
<00:05:29.919>row <00:05:30.019>group, <00:05:30.119>they <00:05:30.219>would <00:05:30.318>For <00:05:30.419>instance, <00:05:30.519>for <00:05:30.619>the <00:05:30.719>value, <00:05:30.818>which <00:05:30.919>is <00:05:31.019>the <00:05:31.119>last <00:05:31.219>last <00:05:31.318>one,

00:05:32.030 --> 00:05:32.040 align:start position:0%
<00:05:32.030>the <00:05:32.031>value, <00:05:32.032>which <00:05:32.033>is <00:05:32.035>the <00:05:32.036>last <00:05:32.037>last <00:05:32.039>one,

00:05:32.040 --> 00:05:34.230 align:start position:0%
<00:05:32.040>the <00:05:32.140>value, <00:05:32.240>which <00:05:32.340>is <00:05:32.440>the <00:05:32.540>last <00:05:32.640>last <00:05:32.740>one, <00:05:32.840>we <00:05:32.940>stored, <00:05:33.040>"Oh, <00:05:33.140>the <00:05:33.240>minimum <00:05:33.340>value <00:05:33.440>is

00:05:34.230 --> 00:05:34.240 align:start position:0%
<00:05:34.230>we <00:05:34.231>stored, <00:05:34.233>"Oh, <00:05:34.234>the <00:05:34.236>minimum <00:05:34.237>value <00:05:34.239>is

00:05:34.240 --> 00:05:36.030 align:start position:0%
<00:05:34.240>we <00:05:34.440>stored, <00:05:34.640>"Oh, <00:05:34.840>the <00:05:35.040>minimum <00:05:35.240>value <00:05:35.440>is <00:05:35.640>$45.50,

00:05:36.030 --> 00:05:36.040 align:start position:0%
$45.50,

00:05:36.040 --> 00:05:39.510 align:start position:0%
<00:05:36.040>$45.50, <00:05:36.273>and <00:05:36.506>the <00:05:36.740>maximum <00:05:36.973>value <00:05:37.206>is <00:05:37.440>$399.99."

00:05:39.510 --> 00:05:39.520 align:start position:0%
<00:05:39.510>and <00:05:39.511>the <00:05:39.513>maximum <00:05:39.515>value <00:05:39.517>is <00:05:39.519>$399.99."

00:05:39.520 --> 00:05:43.430 align:start position:0%
<00:05:39.520>and <00:05:39.627>the <00:05:39.735>maximum <00:05:39.843>value <00:05:39.950>is <00:05:40.058>$399.99." <00:05:40.166>Um <00:05:40.273>and <00:05:40.381>there's <00:05:40.489>a <00:05:40.596>byte <00:05:40.704>position. <00:05:40.812>So, <00:05:40.919>when

00:05:43.430 --> 00:05:43.440 align:start position:0%
<00:05:43.430>Um <00:05:43.431>and <00:05:43.432>there's <00:05:43.433>a <00:05:43.435>byte <00:05:43.436>position. <00:05:43.437>So, <00:05:43.439>when

00:05:43.440 --> 00:05:45.990 align:start position:0%
<00:05:43.440>Um <00:05:43.533>and <00:05:43.626>there's <00:05:43.719>a <00:05:43.813>byte <00:05:43.906>position. <00:05:44.000>So, <00:05:44.093>when <00:05:44.186>where <00:05:44.280>in <00:05:44.373>those <00:05:44.466>large <00:05:44.560>blob <00:05:44.653>of <00:05:44.746>data <00:05:44.840>is

00:05:45.990 --> 00:05:46.000 align:start position:0%
<00:05:45.990>where <00:05:45.991>in <00:05:45.992>those <00:05:45.993>large <00:05:45.995>blob <00:05:45.996>of <00:05:45.997>data <00:05:45.999>is

00:05:46.000 --> 00:05:48.630 align:start position:0%
<00:05:46.000>where <00:05:46.107>in <00:05:46.215>those <00:05:46.323>large <00:05:46.430>blob <00:05:46.538>of <00:05:46.646>data <00:05:46.753>is <00:05:46.861>actually <00:05:46.969>where <00:05:47.076>does <00:05:47.184>which <00:05:47.292>column <00:05:47.400>begin?

00:05:48.630 --> 00:05:48.640 align:start position:0%
<00:05:48.630>actually <00:05:48.631>where <00:05:48.633>does <00:05:48.635>which <00:05:48.637>column <00:05:48.639>begin?

00:05:48.640 --> 00:05:51.030 align:start position:0%
<00:05:48.640>actually <00:05:48.740>where <00:05:48.840>does <00:05:48.940>which <00:05:49.039>column <00:05:49.140>begin? <00:05:49.240>So, <00:05:49.340>it <00:05:49.440>really <00:05:49.539>can <00:05:49.640>skip <00:05:49.740>a <00:05:49.840>lot <00:05:49.940>of <00:05:50.039>bytes

00:05:51.030 --> 00:05:51.040 align:start position:0%
<00:05:51.030>So, <00:05:51.031>it <00:05:51.032>really <00:05:51.033>can <00:05:51.034>skip <00:05:51.035>a <00:05:51.036>lot <00:05:51.037>of <00:05:51.039>bytes

00:05:51.040 --> 00:05:53.310 align:start position:0%
<00:05:51.040>So, <00:05:51.127>it <00:05:51.215>really <00:05:51.302>can <00:05:51.390>skip <00:05:51.477>a <00:05:51.565>lot <00:05:51.652>of <00:05:51.740>bytes <00:05:51.827>and <00:05:51.915>just <00:05:52.002>jump <00:05:52.090>directly <00:05:52.177>to <00:05:52.265>where <00:05:52.352>is <00:05:52.440>the

00:05:53.310 --> 00:05:53.320 align:start position:0%
<00:05:53.310>and <00:05:53.311>just <00:05:53.312>jump <00:05:53.313>directly <00:05:53.315>to <00:05:53.316>where <00:05:53.317>is <00:05:53.319>the

00:05:53.320 --> 00:05:54.910 align:start position:0%
<00:05:53.320>and <00:05:53.413>just <00:05:53.506>jump <00:05:53.599>directly <00:05:53.693>to <00:05:53.786>where <00:05:53.880>is <00:05:53.973>the <00:05:54.066>data <00:05:54.159>stored <00:05:54.253>on <00:05:54.346>disk <00:05:54.440>and <00:05:54.533>can <00:05:54.626>read <00:05:54.719>it

00:05:54.910 --> 00:05:54.920 align:start position:0%
<00:05:54.909>data <00:05:54.911>stored <00:05:54.912>on <00:05:54.913>disk <00:05:54.915>and <00:05:54.916>can <00:05:54.917>read <00:05:54.919>it

00:05:54.920 --> 00:05:56.230 align:start position:0%
<00:05:54.920>data <00:05:55.067>stored <00:05:55.214>on <00:05:55.362>disk <00:05:55.509>and <00:05:55.656>can <00:05:55.804>read <00:05:55.951>it <00:05:56.099>sequentially.

00:05:56.230 --> 00:05:56.240 align:start position:0%
sequentially.

00:05:56.240 --> 00:05:59.430 align:start position:0%
<00:05:56.240>sequentially. <00:05:56.440>Um <00:05:56.640>it <00:05:56.840>does <00:05:57.040>the <00:05:57.240>dictionary <00:05:57.440>encoding. <00:05:57.640>So,

00:05:59.430 --> 00:05:59.440 align:start position:0%
<00:05:59.430>Um <00:05:59.431>it <00:05:59.433>does <00:05:59.434>the <00:05:59.436>dictionary <00:05:59.437>encoding. <00:05:59.439>So,

00:05:59.440 --> 00:06:02.030 align:start position:0%
<00:05:59.440>Um <00:05:59.547>it <00:05:59.655>does <00:05:59.763>the <00:05:59.870>dictionary <00:05:59.978>encoding. <00:06:00.086>So, <00:06:00.193>uh <00:06:00.301>for <00:06:00.409>instance, <00:06:00.516>uh <00:06:00.624>if <00:06:00.732>the <00:06:00.840>electronics

00:06:02.030 --> 00:06:02.040 align:start position:0%
<00:06:02.030>uh <00:06:02.031>for <00:06:02.033>instance, <00:06:02.034>uh <00:06:02.036>if <00:06:02.037>the <00:06:02.039>electronics

00:06:02.040 --> 00:06:03.630 align:start position:0%
<00:06:02.040>uh <00:06:02.156>for <00:06:02.273>instance, <00:06:02.390>uh <00:06:02.506>if <00:06:02.623>the <00:06:02.740>electronics <00:06:02.856>would <00:06:02.973>be <00:06:03.090>multiple <00:06:03.206>times <00:06:03.323>in <00:06:03.440>those

00:06:03.630 --> 00:06:03.640 align:start position:0%
<00:06:03.630>would <00:06:03.631>be <00:06:03.633>multiple <00:06:03.635>times <00:06:03.637>in <00:06:03.639>those

00:06:03.640 --> 00:06:05.150 align:start position:0%
<00:06:03.640>would <00:06:03.763>be <00:06:03.887>multiple <00:06:04.010>times <00:06:04.134>in <00:06:04.257>those <00:06:04.381>columns, <00:06:04.504>it <00:06:04.628>would <00:06:04.751>actually <00:06:04.875>be <00:06:04.998>dictionary

00:06:05.150 --> 00:06:05.160 align:start position:0%
<00:06:05.150>columns, <00:06:05.151>it <00:06:05.153>would <00:06:05.155>actually <00:06:05.157>be <00:06:05.159>dictionary

00:06:05.160 --> 00:06:07.070 align:start position:0%
<00:06:05.160>columns, <00:06:05.267>it <00:06:05.375>would <00:06:05.483>actually <00:06:05.590>be <00:06:05.698>dictionary <00:06:05.806>encoded. <00:06:05.913>There <00:06:06.021>would <00:06:06.129>just <00:06:06.236>be <00:06:06.344>a <00:06:06.452>key <00:06:06.560>and

00:06:07.070 --> 00:06:07.080 align:start position:0%
<00:06:07.070>encoded. <00:06:07.071>There <00:06:07.072>would <00:06:07.073>just <00:06:07.075>be <00:06:07.076>a <00:06:07.077>key <00:06:07.079>and

00:06:07.080 --> 00:06:09.470 align:start position:0%
<00:06:07.080>encoded. <00:06:07.180>There <00:06:07.280>would <00:06:07.380>just <00:06:07.479>be <00:06:07.580>a <00:06:07.680>key <00:06:07.780>and <00:06:07.880>the <00:06:07.979>dictionary <00:06:08.080>key <00:06:08.180>one <00:06:08.280>and <00:06:08.380>then <00:06:08.479>the

00:06:09.470 --> 00:06:09.480 align:start position:0%
<00:06:09.470>the <00:06:09.471>dictionary <00:06:09.473>key <00:06:09.474>one <00:06:09.476>and <00:06:09.477>then <00:06:09.479>the

00:06:09.480 --> 00:06:10.750 align:start position:0%
<00:06:09.480>the <00:06:09.567>dictionary <00:06:09.655>key <00:06:09.743>one <00:06:09.831>and <00:06:09.919>then <00:06:10.007>the <00:06:10.095>footer <00:06:10.183>would <00:06:10.271>be <00:06:10.359>a <00:06:10.447>dictionary <00:06:10.535>where <00:06:10.623>it

00:06:10.750 --> 00:06:10.760 align:start position:0%
<00:06:10.750>footer <00:06:10.751>would <00:06:10.753>be <00:06:10.754>a <00:06:10.756>dictionary <00:06:10.757>where <00:06:10.759>it

00:06:10.760 --> 00:06:12.710 align:start position:0%
<00:06:10.760>footer <00:06:10.860>would <00:06:10.960>be <00:06:11.060>a <00:06:11.159>dictionary <00:06:11.260>where <00:06:11.360>it <00:06:11.460>says, <00:06:11.560>"Hey, <00:06:11.659>if <00:06:11.760>there's <00:06:11.860>a <00:06:11.960>key <00:06:12.060>one, <00:06:12.159>then

00:06:12.710 --> 00:06:12.720 align:start position:0%
<00:06:12.710>says, <00:06:12.711>"Hey, <00:06:12.712>if <00:06:12.713>there's <00:06:12.715>a <00:06:12.716>key <00:06:12.717>one, <00:06:12.719>then

00:06:12.720 --> 00:06:14.030 align:start position:0%
<00:06:12.720>says, <00:06:12.818>"Hey, <00:06:12.916>if <00:06:13.014>there's <00:06:13.113>a <00:06:13.211>key <00:06:13.309>one, <00:06:13.407>then <00:06:13.506>it's <00:06:13.604>called <00:06:13.702>electronic." <00:06:13.800>So, <00:06:13.899>it's

00:06:14.030 --> 00:06:14.040 align:start position:0%
<00:06:14.030>it's <00:06:14.032>called <00:06:14.034>electronic." <00:06:14.036>So, <00:06:14.039>it's

00:06:14.040 --> 00:06:16.270 align:start position:0%
<00:06:14.040>it's <00:06:14.180>called <00:06:14.320>electronic." <00:06:14.460>So, <00:06:14.600>it's <00:06:14.740>compressed. <00:06:14.880>It's <00:06:15.020>encoded <00:06:15.160>there <00:06:15.300>as <00:06:15.440>well.

00:06:16.270 --> 00:06:16.280 align:start position:0%
<00:06:16.270>compressed. <00:06:16.271>It's <00:06:16.273>encoded <00:06:16.275>there <00:06:16.277>as <00:06:16.279>well.

00:06:16.280 --> 00:06:18.790 align:start position:0%
<00:06:16.280>compressed. <00:06:16.396>It's <00:06:16.513>encoded <00:06:16.630>there <00:06:16.746>as <00:06:16.863>well. <00:06:16.979>Um <00:06:17.096>and <00:06:17.213>all <00:06:17.330>these <00:06:17.446>footer, <00:06:17.563>together <00:06:17.679>with

00:06:18.790 --> 00:06:18.800 align:start position:0%
<00:06:18.790>Um <00:06:18.791>and <00:06:18.793>all <00:06:18.794>these <00:06:18.796>footer, <00:06:18.797>together <00:06:18.799>with

00:06:18.800 --> 00:06:21.790 align:start position:0%
<00:06:18.800>Um <00:06:18.900>and <00:06:19.000>all <00:06:19.100>these <00:06:19.200>footer, <00:06:19.300>together <00:06:19.400>with <00:06:19.500>the <00:06:19.600>footer <00:06:19.700>in <00:06:19.800>the <00:06:19.900>file <00:06:20.000>itself, <00:06:20.100>so <00:06:20.200>each

00:06:21.790 --> 00:06:21.800 align:start position:0%
<00:06:21.790>the <00:06:21.791>footer <00:06:21.792>in <00:06:21.793>the <00:06:21.795>file <00:06:21.796>itself, <00:06:21.797>so <00:06:21.799>each

00:06:21.800 --> 00:06:24.670 align:start position:0%
<00:06:21.800>the <00:06:21.893>footer <00:06:21.986>in <00:06:22.080>the <00:06:22.173>file <00:06:22.266>itself, <00:06:22.360>so <00:06:22.453>each <00:06:22.546>row <00:06:22.640>group <00:06:22.733>has <00:06:22.826>a <00:06:22.920>footer <00:06:23.013>and <00:06:23.106>the <00:06:23.200>uh

00:06:24.670 --> 00:06:24.680 align:start position:0%
<00:06:24.670>row <00:06:24.671>group <00:06:24.672>has <00:06:24.673>a <00:06:24.675>footer <00:06:24.676>and <00:06:24.677>the <00:06:24.679>uh

00:06:24.680 --> 00:06:27.350 align:start position:0%
<00:06:24.680>row <00:06:24.780>group <00:06:24.880>has <00:06:24.980>a <00:06:25.080>footer <00:06:25.180>and <00:06:25.280>the <00:06:25.380>uh <00:06:25.480>the <00:06:25.580>file <00:06:25.680>itself <00:06:25.780>has <00:06:25.880>the <00:06:25.980>footer, <00:06:26.080>allows

00:06:27.350 --> 00:06:27.360 align:start position:0%
<00:06:27.350>the <00:06:27.351>file <00:06:27.353>itself <00:06:27.354>has <00:06:27.356>the <00:06:27.357>footer, <00:06:27.359>allows

00:06:27.360 --> 00:06:29.990 align:start position:0%
<00:06:27.360>the <00:06:27.476>file <00:06:27.593>itself <00:06:27.710>has <00:06:27.826>the <00:06:27.943>footer, <00:06:28.060>allows <00:06:28.176>predicate <00:06:28.293>and <00:06:28.410>projection <00:06:28.526>push <00:06:28.643>down. <00:06:28.760>What

00:06:29.990 --> 00:06:30.000 align:start position:0%
<00:06:29.990>predicate <00:06:29.991>and <00:06:29.993>projection <00:06:29.995>push <00:06:29.997>down. <00:06:29.999>What

00:06:30.000 --> 00:06:32.590 align:start position:0%
<00:06:30.000>predicate <00:06:30.155>and <00:06:30.311>projection <00:06:30.466>push <00:06:30.622>down. <00:06:30.777>What <00:06:30.933>is <00:06:31.088>meant <00:06:31.244>by <00:06:31.400>this?

00:06:32.590 --> 00:06:32.600 align:start position:0%
<00:06:32.590>is <00:06:32.593>meant <00:06:32.596>by <00:06:32.599>this?

00:06:32.600 --> 00:06:35.310 align:start position:0%
<00:06:32.600>is <00:06:32.740>meant <00:06:32.880>by <00:06:33.020>this? <00:06:33.160>The <00:06:33.300>first <00:06:33.440>thing <00:06:33.580>is <00:06:33.720>we <00:06:33.860>select <00:06:34.000>product

00:06:35.310 --> 00:06:35.320 align:start position:0%
<00:06:35.310>The <00:06:35.311>first <00:06:35.313>thing <00:06:35.314>is <00:06:35.316>we <00:06:35.317>select <00:06:35.319>product

00:06:35.320 --> 00:06:38.230 align:start position:0%
<00:06:35.320>The <00:06:35.427>first <00:06:35.535>thing <00:06:35.643>is <00:06:35.750>we <00:06:35.858>select <00:06:35.966>product <00:06:36.073>category. <00:06:36.181>This <00:06:36.289>is <00:06:36.396>the <00:06:36.504>um <00:06:36.612>projection <00:06:36.719>push

00:06:38.230 --> 00:06:38.240 align:start position:0%
<00:06:38.230>category. <00:06:38.231>This <00:06:38.233>is <00:06:38.234>the <00:06:38.236>um <00:06:38.237>projection <00:06:38.239>push

00:06:38.240 --> 00:06:40.870 align:start position:0%
<00:06:38.240>category. <00:06:38.340>This <00:06:38.440>is <00:06:38.540>the <00:06:38.640>um <00:06:38.740>projection <00:06:38.840>push <00:06:38.940>down, <00:06:39.040>if <00:06:39.140>you <00:06:39.240>think <00:06:39.340>about <00:06:39.440>the <00:06:39.540>SQL <00:06:39.640>here.

00:06:40.870 --> 00:06:40.880 align:start position:0%
<00:06:40.870>down, <00:06:40.871>if <00:06:40.872>you <00:06:40.873>think <00:06:40.875>about <00:06:40.876>the <00:06:40.877>SQL <00:06:40.879>here.

00:06:40.880 --> 00:06:43.590 align:start position:0%
<00:06:40.880>down, <00:06:40.987>if <00:06:41.095>you <00:06:41.203>think <00:06:41.310>about <00:06:41.418>the <00:06:41.526>SQL <00:06:41.633>here. <00:06:41.741>The <00:06:41.849>select <00:06:41.956>is <00:06:42.064>the <00:06:42.172>projection. <00:06:42.280>Which

00:06:43.590 --> 00:06:43.600 align:start position:0%
<00:06:43.590>The <00:06:43.591>select <00:06:43.593>is <00:06:43.595>the <00:06:43.597>projection. <00:06:43.599>Which

00:06:43.600 --> 00:06:45.430 align:start position:0%
<00:06:43.600>The <00:06:43.727>select <00:06:43.854>is <00:06:43.981>the <00:06:44.109>projection. <00:06:44.236>Which <00:06:44.363>column <00:06:44.490>do <00:06:44.618>I <00:06:44.745>want <00:06:44.872>to <00:06:45.000>have?

00:06:45.430 --> 00:06:45.440 align:start position:0%
<00:06:45.430>column <00:06:45.431>do <00:06:45.433>I <00:06:45.435>want <00:06:45.437>to <00:06:45.439>have?

00:06:45.440 --> 00:06:48.150 align:start position:0%
<00:06:45.440>column <00:06:45.547>do <00:06:45.655>I <00:06:45.763>want <00:06:45.870>to <00:06:45.978>have? <00:06:46.086>This <00:06:46.193>uh <00:06:46.301>makes <00:06:46.409>it <00:06:46.516>easy <00:06:46.624>because <00:06:46.732>we <00:06:46.840>have

00:06:48.150 --> 00:06:48.160 align:start position:0%
<00:06:48.150>This <00:06:48.151>uh <00:06:48.152>makes <00:06:48.153>it <00:06:48.155>easy <00:06:48.156>because <00:06:48.157>we <00:06:48.159>have

00:06:48.160 --> 00:06:50.550 align:start position:0%
<00:06:48.159>This <00:06:48.267>uh <00:06:48.375>makes <00:06:48.483>it <00:06:48.590>easy <00:06:48.698>because <00:06:48.806>we <00:06:48.913>have <00:06:49.021>all <00:06:49.129>these <00:06:49.236>in <00:06:49.344>uh <00:06:49.452>column-oriented <00:06:49.559>storage.

00:06:50.550 --> 00:06:50.560 align:start position:0%
<00:06:50.550>all <00:06:50.551>these <00:06:50.553>in <00:06:50.555>uh <00:06:50.557>column-oriented <00:06:50.559>storage.

00:06:50.560 --> 00:06:52.990 align:start position:0%
<00:06:50.560>all <00:06:50.667>these <00:06:50.775>in <00:06:50.883>uh <00:06:50.990>column-oriented <00:06:51.098>storage. <00:06:51.206>It <00:06:51.313>knows, <00:06:51.421>"Oh, <00:06:51.529>okay, <00:06:51.636>and <00:06:51.744>only <00:06:51.852>need <00:06:51.960>the

00:06:52.990 --> 00:06:53.000 align:start position:0%
<00:06:52.990>It <00:06:52.991>knows, <00:06:52.992>"Oh, <00:06:52.993>okay, <00:06:52.995>and <00:06:52.996>only <00:06:52.997>need <00:06:52.999>the

00:06:53.000 --> 00:06:56.430 align:start position:0%
<00:06:53.000>It <00:06:53.100>knows, <00:06:53.200>"Oh, <00:06:53.300>okay, <00:06:53.400>and <00:06:53.500>only <00:06:53.600>need <00:06:53.700>the <00:06:53.800>second <00:06:53.900>to <00:06:54.000>last <00:06:54.100>um <00:06:54.200>columns." <00:06:54.300>And <00:06:54.400>the

00:06:56.430 --> 00:06:56.440 align:start position:0%
<00:06:56.430>second <00:06:56.431>to <00:06:56.433>last <00:06:56.434>um <00:06:56.436>columns." <00:06:56.437>And <00:06:56.439>the

00:06:56.440 --> 00:06:58.630 align:start position:0%
<00:06:56.440>second <00:06:56.556>to <00:06:56.673>last <00:06:56.790>um <00:06:56.906>columns." <00:06:57.023>And <00:06:57.140>the <00:06:57.256>projection <00:06:57.373>is <00:06:57.490>actually <00:06:57.606>the <00:06:57.723>order <00:06:57.840>value

00:06:58.630 --> 00:06:58.640 align:start position:0%
<00:06:58.630>projection <00:06:58.631>is <00:06:58.633>actually <00:06:58.635>the <00:06:58.637>order <00:06:58.639>value

00:06:58.640 --> 00:07:00.310 align:start position:0%
<00:06:58.640>projection <00:06:58.767>is <00:06:58.894>actually <00:06:59.021>the <00:06:59.149>order <00:06:59.276>value <00:06:59.403>above <00:06:59.530>100. <00:06:59.658>This <00:06:59.785>is <00:06:59.912>the <00:07:00.039>so-called

00:07:00.310 --> 00:07:00.320 align:start position:0%
<00:07:00.310>above <00:07:00.311>100. <00:07:00.313>This <00:07:00.315>is <00:07:00.317>the <00:07:00.319>so-called

00:07:00.320 --> 00:07:01.710 align:start position:0%
<00:07:00.320>above <00:07:00.528>100. <00:07:00.736>This <00:07:00.945>is <00:07:01.154>the <00:07:01.362>so-called <00:07:01.570>projection.

00:07:01.710 --> 00:07:01.720 align:start position:0%
projection.

00:07:01.720 --> 00:07:03.990 align:start position:0%
<00:07:01.720>projection. <00:07:01.895>And <00:07:02.070>knowing <00:07:02.245>that <00:07:02.420>the <00:07:02.595>min <00:07:02.770>and <00:07:02.945>max <00:07:03.120>values,

00:07:03.990 --> 00:07:04.000 align:start position:0%
<00:07:03.990>And <00:07:03.991>knowing <00:07:03.992>that <00:07:03.993>the <00:07:03.995>min <00:07:03.996>and <00:07:03.997>max <00:07:03.999>values,

00:07:04.000 --> 00:07:07.190 align:start position:0%
<00:07:04.000>And <00:07:04.093>knowing <00:07:04.186>that <00:07:04.280>the <00:07:04.373>min <00:07:04.466>and <00:07:04.560>max <00:07:04.653>values, <00:07:04.746>for <00:07:04.840>instance, <00:07:04.933>um <00:07:05.026>here <00:07:05.120>the <00:07:05.213>max <00:07:05.306>value <00:07:05.400>is

00:07:07.190 --> 00:07:07.200 align:start position:0%
<00:07:07.190>for <00:07:07.191>instance, <00:07:07.192>um <00:07:07.193>here <00:07:07.195>the <00:07:07.196>max <00:07:07.197>value <00:07:07.199>is

00:07:07.200 --> 00:07:10.870 align:start position:0%
<00:07:07.200>for <00:07:07.293>instance, <00:07:07.386>um <00:07:07.479>here <00:07:07.573>the <00:07:07.666>max <00:07:07.760>value <00:07:07.853>is <00:07:07.946>89, <00:07:08.039>we <00:07:08.133>know <00:07:08.226>the <00:07:08.320>order <00:07:08.413>values <00:07:08.506>above <00:07:08.599>100.

00:07:10.870 --> 00:07:10.880 align:start position:0%
<00:07:10.870>89, <00:07:10.871>we <00:07:10.872>know <00:07:10.873>the <00:07:10.875>order <00:07:10.876>values <00:07:10.877>above <00:07:10.879>100.

00:07:10.880 --> 00:07:12.870 align:start position:0%
<00:07:10.880>89, <00:07:10.980>we <00:07:11.080>know <00:07:11.180>the <00:07:11.280>order <00:07:11.380>values <00:07:11.480>above <00:07:11.580>100. <00:07:11.680>So, <00:07:11.780>we <00:07:11.880>already <00:07:11.980>can <00:07:12.080>skip <00:07:12.180>reading <00:07:12.280>this

00:07:12.870 --> 00:07:12.880 align:start position:0%
<00:07:12.870>So, <00:07:12.871>we <00:07:12.873>already <00:07:12.874>can <00:07:12.876>skip <00:07:12.877>reading <00:07:12.879>this

00:07:12.880 --> 00:07:15.190 align:start position:0%
<00:07:12.880>So, <00:07:12.980>we <00:07:13.080>already <00:07:13.180>can <00:07:13.280>skip <00:07:13.380>reading <00:07:13.480>this <00:07:13.580>whole <00:07:13.680>whole <00:07:13.780>row <00:07:13.880>group. <00:07:13.980>So, <00:07:14.080>we <00:07:14.180>can <00:07:14.280>just

00:07:15.190 --> 00:07:15.200 align:start position:0%
<00:07:15.190>whole <00:07:15.191>whole <00:07:15.192>row <00:07:15.193>group. <00:07:15.195>So, <00:07:15.196>we <00:07:15.197>can <00:07:15.199>just

00:07:15.200 --> 00:07:17.630 align:start position:0%
<00:07:15.200>whole <00:07:15.293>whole <00:07:15.386>row <00:07:15.479>group. <00:07:15.573>So, <00:07:15.666>we <00:07:15.760>can <00:07:15.853>just <00:07:15.946>jump <00:07:16.039>to <00:07:16.133>the <00:07:16.226>first <00:07:16.320>row <00:07:16.413>group, <00:07:16.506>read <00:07:16.599>only

00:07:17.630 --> 00:07:17.640 align:start position:0%
<00:07:17.630>jump <00:07:17.631>to <00:07:17.632>the <00:07:17.633>first <00:07:17.635>row <00:07:17.636>group, <00:07:17.637>read <00:07:17.639>only

00:07:17.640 --> 00:07:19.950 align:start position:0%
<00:07:17.640>jump <00:07:17.733>to <00:07:17.826>the <00:07:17.919>first <00:07:18.013>row <00:07:18.106>group, <00:07:18.200>read <00:07:18.293>only <00:07:18.386>the <00:07:18.479>columns <00:07:18.573>we <00:07:18.666>need, <00:07:18.760>those <00:07:18.853>two, <00:07:18.946>and <00:07:19.039>we

00:07:19.950 --> 00:07:19.960 align:start position:0%
<00:07:19.950>the <00:07:19.951>columns <00:07:19.952>we <00:07:19.953>need, <00:07:19.955>those <00:07:19.956>two, <00:07:19.957>and <00:07:19.959>we

00:07:19.960 --> 00:07:21.110 align:start position:0%
<00:07:19.960>the <00:07:20.075>columns <00:07:20.190>we <00:07:20.305>need, <00:07:20.420>those <00:07:20.534>two, <00:07:20.650>and <00:07:20.765>we <00:07:20.880>are <00:07:20.995>done.

00:07:21.110 --> 00:07:21.120 align:start position:0%
<00:07:21.110>are <00:07:21.119>done.

00:07:21.120 --> 00:07:22.350 align:start position:0%
<00:07:21.120>are <00:07:21.489>done. <00:07:21.858>So, <00:07:22.227>it's

00:07:22.350 --> 00:07:22.360 align:start position:0%
<00:07:22.350>So, <00:07:22.359>it's

00:07:22.360 --> 00:07:25.150 align:start position:0%
<00:07:22.360>So, <00:07:22.560>it's <00:07:22.760>way <00:07:22.960>optimized <00:07:23.160>in <00:07:23.360>reading <00:07:23.560>because <00:07:23.760>it

00:07:25.150 --> 00:07:25.160 align:start position:0%
<00:07:25.150>way <00:07:25.151>optimized <00:07:25.153>in <00:07:25.155>reading <00:07:25.157>because <00:07:25.159>it

00:07:25.160 --> 00:07:27.070 align:start position:0%
<00:07:25.160>way <00:07:25.276>optimized <00:07:25.393>in <00:07:25.510>reading <00:07:25.626>because <00:07:25.743>it <00:07:25.860>stores <00:07:25.976>a <00:07:26.093>lot <00:07:26.210>of <00:07:26.326>meta <00:07:26.443>information. <00:07:26.560>It

00:07:27.070 --> 00:07:27.080 align:start position:0%
<00:07:27.070>stores <00:07:27.071>a <00:07:27.073>lot <00:07:27.074>of <00:07:27.075>meta <00:07:27.077>information. <00:07:27.079>It

00:07:27.080 --> 00:07:29.590 align:start position:0%
<00:07:27.080>stores <00:07:27.187>a <00:07:27.295>lot <00:07:27.403>of <00:07:27.510>meta <00:07:27.618>information. <00:07:27.726>It <00:07:27.833>stores <00:07:27.941>column-wise. <00:07:28.049>Um <00:07:28.156>it <00:07:28.264>makes <00:07:28.372>it <00:07:28.479>easy

00:07:29.590 --> 00:07:29.600 align:start position:0%
<00:07:29.590>stores <00:07:29.591>column-wise. <00:07:29.592>Um <00:07:29.594>it <00:07:29.596>makes <00:07:29.597>it <00:07:29.599>easy

00:07:29.600 --> 00:07:32.990 align:start position:0%
<00:07:29.600>stores <00:07:29.727>column-wise. <00:07:29.854>Um <00:07:29.981>it <00:07:30.109>makes <00:07:30.236>it <00:07:30.363>easy <00:07:30.490>to <00:07:30.618>read <00:07:30.745>those <00:07:30.872>this <00:07:31.000>data.

00:07:32.990 --> 00:07:33.000 align:start position:0%
<00:07:32.990>to <00:07:32.992>read <00:07:32.994>those <00:07:32.996>this <00:07:32.999>data.

00:07:33.000 --> 00:07:35.230 align:start position:0%
<00:07:33.000>to <00:07:33.127>read <00:07:33.254>those <00:07:33.381>this <00:07:33.509>data. <00:07:33.636>But <00:07:33.763>Parquet <00:07:33.890>also <00:07:34.018>has <00:07:34.145>some <00:07:34.272>downsides. <00:07:34.400>As

00:07:35.230 --> 00:07:35.240 align:start position:0%
<00:07:35.230>But <00:07:35.231>Parquet <00:07:35.233>also <00:07:35.234>has <00:07:35.236>some <00:07:35.237>downsides. <00:07:35.239>As

00:07:35.240 --> 00:07:36.830 align:start position:0%
<00:07:35.240>But <00:07:35.356>Parquet <00:07:35.473>also <00:07:35.590>has <00:07:35.706>some <00:07:35.823>downsides. <00:07:35.940>As <00:07:36.056>I <00:07:36.173>said, <00:07:36.290>really <00:07:36.406>good <00:07:36.523>for <00:07:36.640>analytical

00:07:36.830 --> 00:07:36.840 align:start position:0%
<00:07:36.830>I <00:07:36.831>said, <00:07:36.833>really <00:07:36.835>good <00:07:36.837>for <00:07:36.839>analytical

00:07:36.840 --> 00:07:38.310 align:start position:0%
<00:07:36.840>I <00:07:36.987>said, <00:07:37.134>really <00:07:37.281>good <00:07:37.428>for <00:07:37.575>analytical <00:07:37.722>queries, <00:07:37.869>just <00:07:38.016>reading <00:07:38.163>stuff,

00:07:38.310 --> 00:07:38.320 align:start position:0%
<00:07:38.310>queries, <00:07:38.313>just <00:07:38.316>reading <00:07:38.319>stuff,

00:07:38.320 --> 00:07:39.790 align:start position:0%
<00:07:38.320>queries, <00:07:38.540>just <00:07:38.761>reading <00:07:38.981>stuff, <00:07:39.202>aggregating, <00:07:39.422>selecting <00:07:39.643>columns,

00:07:39.790 --> 00:07:39.800 align:start position:0%
<00:07:39.790>aggregating, <00:07:39.794>selecting <00:07:39.799>columns,

00:07:39.800 --> 00:07:41.510 align:start position:0%
<00:07:39.800>aggregating, <00:07:40.000>selecting <00:07:40.200>columns, <00:07:40.400>aggregating <00:07:40.600>stuff <00:07:40.800>on <00:07:41.000>columns, <00:07:41.200>filtering

00:07:41.510 --> 00:07:41.520 align:start position:0%
<00:07:41.510>aggregating <00:07:41.512>stuff <00:07:41.514>on <00:07:41.516>columns, <00:07:41.519>filtering

00:07:41.520 --> 00:07:43.070 align:start position:0%
<00:07:41.520>aggregating <00:07:41.659>stuff <00:07:41.799>on <00:07:41.938>columns, <00:07:42.078>filtering <00:07:42.217>on <00:07:42.357>columns. <00:07:42.496>That's <00:07:42.635>really, <00:07:42.775>really <00:07:42.914>good

00:07:43.070 --> 00:07:43.080 align:start position:0%
<00:07:43.070>on <00:07:43.071>columns. <00:07:43.073>That's <00:07:43.075>really, <00:07:43.077>really <00:07:43.079>good

00:07:43.080 --> 00:07:44.870 align:start position:0%
<00:07:43.080>on <00:07:43.235>columns. <00:07:43.391>That's <00:07:43.546>really, <00:07:43.702>really <00:07:43.857>good <00:07:44.013>in <00:07:44.168>uh <00:07:44.324>with <00:07:44.479>parquet.

00:07:44.870 --> 00:07:44.880 align:start position:0%
<00:07:44.870>in <00:07:44.873>uh <00:07:44.876>with <00:07:44.879>parquet.

00:07:44.880 --> 00:07:45.830 align:start position:0%
<00:07:44.880>in <00:07:45.093>uh <00:07:45.307>with <00:07:45.521>parquet. <00:07:45.735>But

00:07:45.830 --> 00:07:45.840 align:start position:0%
But

00:07:45.840 --> 00:07:47.630 align:start position:0%
<00:07:45.840>But <00:07:46.040>in <00:07:46.240>the <00:07:46.440>beginning <00:07:46.640>I <00:07:46.840>had <00:07:47.040>those <00:07:47.240>database

00:07:47.630 --> 00:07:47.640 align:start position:0%
<00:07:47.630>in <00:07:47.631>the <00:07:47.633>beginning <00:07:47.634>I <00:07:47.635>had <00:07:47.637>those <00:07:47.639>database

00:07:47.640 --> 00:07:49.630 align:start position:0%
<00:07:47.640>in <00:07:47.756>the <00:07:47.873>beginning <00:07:47.990>I <00:07:48.106>had <00:07:48.223>those <00:07:48.340>database <00:07:48.456>and <00:07:48.573>everybody <00:07:48.690>of <00:07:48.806>you <00:07:48.923>knows <00:07:49.039>relational

00:07:49.630 --> 00:07:49.640 align:start position:0%
<00:07:49.630>and <00:07:49.631>everybody <00:07:49.633>of <00:07:49.635>you <00:07:49.637>knows <00:07:49.639>relational

00:07:49.640 --> 00:07:51.910 align:start position:0%
<00:07:49.640>and <00:07:49.756>everybody <00:07:49.873>of <00:07:49.990>you <00:07:50.106>knows <00:07:50.223>relational <00:07:50.340>database <00:07:50.456>like <00:07:50.573>Postgres <00:07:50.690>or <00:07:50.806>so, <00:07:50.923>there <00:07:51.039>is

00:07:51.910 --> 00:07:51.920 align:start position:0%
<00:07:51.909>database <00:07:51.911>like <00:07:51.913>Postgres <00:07:51.914>or <00:07:51.916>so, <00:07:51.917>there <00:07:51.919>is

00:07:51.920 --> 00:07:53.750 align:start position:0%
<00:07:51.920>database <00:07:52.027>like <00:07:52.135>Postgres <00:07:52.243>or <00:07:52.350>so, <00:07:52.458>there <00:07:52.566>is <00:07:52.673>no <00:07:52.781>ACID <00:07:52.889>compliance. <00:07:52.996>I <00:07:53.104>cannot <00:07:53.212>do <00:07:53.320>any

00:07:53.750 --> 00:07:53.760 align:start position:0%
<00:07:53.750>no <00:07:53.751>ACID <00:07:53.753>compliance. <00:07:53.754>I <00:07:53.756>cannot <00:07:53.757>do <00:07:53.759>any

00:07:53.760 --> 00:07:55.550 align:start position:0%
<00:07:53.760>no <00:07:53.867>ACID <00:07:53.975>compliance. <00:07:54.083>I <00:07:54.190>cannot <00:07:54.298>do <00:07:54.406>any <00:07:54.513>transactions <00:07:54.621>on <00:07:54.729>it. <00:07:54.836>I <00:07:54.944>don't <00:07:55.052>get <00:07:55.159>any

00:07:55.550 --> 00:07:55.560 align:start position:0%
<00:07:55.550>transactions <00:07:55.551>on <00:07:55.553>it. <00:07:55.554>I <00:07:55.556>don't <00:07:55.557>get <00:07:55.559>any

00:07:55.560 --> 00:07:57.550 align:start position:0%
<00:07:55.560>transactions <00:07:55.687>on <00:07:55.814>it. <00:07:55.941>I <00:07:56.069>don't <00:07:56.196>get <00:07:56.323>any <00:07:56.450>guarantees <00:07:56.578>on <00:07:56.705>reading, <00:07:56.832>writing <00:07:56.960>with

00:07:57.550 --> 00:07:57.560 align:start position:0%
<00:07:57.550>guarantees <00:07:57.552>on <00:07:57.554>reading, <00:07:57.556>writing <00:07:57.559>with

00:07:57.560 --> 00:08:00.110 align:start position:0%
<00:07:57.560>guarantees <00:07:57.700>on <00:07:57.840>reading, <00:07:57.980>writing <00:07:58.120>with <00:07:58.260>multiple <00:07:58.400>writers <00:07:58.540>or <00:07:58.680>readers. <00:07:58.820>This <00:07:58.960>won't

00:08:00.110 --> 00:08:00.120 align:start position:0%
<00:08:00.110>multiple <00:08:00.111>writers <00:08:00.113>or <00:08:00.115>readers. <00:08:00.117>This <00:08:00.119>won't

00:08:00.120 --> 00:08:02.990 align:start position:0%
<00:08:00.120>multiple <00:08:00.260>writers <00:08:00.400>or <00:08:00.540>readers. <00:08:00.680>This <00:08:00.820>won't <00:08:00.960>work. <00:08:01.100>Um <00:08:01.240>performance <00:08:01.380>and <00:08:01.520>scalability,

00:08:02.990 --> 00:08:03.000 align:start position:0%
<00:08:02.990>work. <00:08:02.992>Um <00:08:02.994>performance <00:08:02.996>and <00:08:02.999>scalability,

00:08:03.000 --> 00:08:05.150 align:start position:0%
<00:08:03.000>work. <00:08:03.116>Um <00:08:03.233>performance <00:08:03.350>and <00:08:03.466>scalability, <00:08:03.583>think <00:08:03.700>of <00:08:03.816>it. <00:08:03.933>I <00:08:04.050>can <00:08:04.166>split <00:08:04.283>those <00:08:04.400>parquet

00:08:05.150 --> 00:08:05.160 align:start position:0%
<00:08:05.150>think <00:08:05.151>of <00:08:05.152>it. <00:08:05.153>I <00:08:05.155>can <00:08:05.156>split <00:08:05.157>those <00:08:05.159>parquet

00:08:05.160 --> 00:08:07.230 align:start position:0%
<00:08:05.160>think <00:08:05.247>of <00:08:05.335>it. <00:08:05.422>I <00:08:05.510>can <00:08:05.597>split <00:08:05.685>those <00:08:05.772>parquet <00:08:05.860>files. <00:08:05.947>I <00:08:06.035>can <00:08:06.122>have <00:08:06.210>very <00:08:06.297>a <00:08:06.385>lot <00:08:06.472>of <00:08:06.560>my

00:08:07.230 --> 00:08:07.240 align:start position:0%
<00:08:07.230>files. <00:08:07.231>I <00:08:07.232>can <00:08:07.233>have <00:08:07.234>very <00:08:07.235>a <00:08:07.236>lot <00:08:07.237>of <00:08:07.239>my

00:08:07.240 --> 00:08:09.030 align:start position:0%
<00:08:07.240>files. <00:08:07.367>I <00:08:07.494>can <00:08:07.621>have <00:08:07.749>very <00:08:07.876>a <00:08:08.003>lot <00:08:08.130>of <00:08:08.258>my <00:08:08.385>parquet <00:08:08.512>files. <00:08:08.640>Um

00:08:09.030 --> 00:08:09.040 align:start position:0%
<00:08:09.030>parquet <00:08:09.034>files. <00:08:09.039>Um

00:08:09.040 --> 00:08:11.390 align:start position:0%
<00:08:09.040>parquet <00:08:09.180>files. <00:08:09.320>Um <00:08:09.460>what <00:08:09.600>is <00:08:09.740>if <00:08:09.880>there's <00:08:10.020>really, <00:08:10.160>really <00:08:10.300>I <00:08:10.440>have

00:08:11.390 --> 00:08:11.400 align:start position:0%
<00:08:11.390>what <00:08:11.391>is <00:08:11.392>if <00:08:11.393>there's <00:08:11.395>really, <00:08:11.396>really <00:08:11.397>I <00:08:11.399>have

00:08:11.400 --> 00:08:13.430 align:start position:0%
<00:08:11.400>what <00:08:11.516>is <00:08:11.633>if <00:08:11.750>there's <00:08:11.866>really, <00:08:11.983>really <00:08:12.099>I <00:08:12.216>have <00:08:12.333>terabytes <00:08:12.450>of <00:08:12.566>data <00:08:12.683>and <00:08:12.799>I

00:08:13.430 --> 00:08:13.440 align:start position:0%
<00:08:13.430>terabytes <00:08:13.432>of <00:08:13.434>data <00:08:13.436>and <00:08:13.439>I

00:08:13.440 --> 00:08:15.150 align:start position:0%
<00:08:13.440>terabytes <00:08:13.556>of <00:08:13.673>data <00:08:13.790>and <00:08:13.906>I <00:08:14.023>have <00:08:14.140>to <00:08:14.256>read <00:08:14.373>all <00:08:14.490>of <00:08:14.606>those <00:08:14.723>parquet <00:08:14.840>files

00:08:15.150 --> 00:08:15.160 align:start position:0%
<00:08:15.150>have <00:08:15.151>to <00:08:15.152>read <00:08:15.153>all <00:08:15.155>of <00:08:15.156>those <00:08:15.157>parquet <00:08:15.159>files

00:08:15.160 --> 00:08:16.870 align:start position:0%
<00:08:15.160>have <00:08:15.253>to <00:08:15.346>read <00:08:15.440>all <00:08:15.533>of <00:08:15.626>those <00:08:15.720>parquet <00:08:15.813>files <00:08:15.906>just <00:08:16.000>to <00:08:16.093>find <00:08:16.186>one <00:08:16.280>row <00:08:16.373>in <00:08:16.466>those <00:08:16.560>parquet

00:08:16.870 --> 00:08:16.880 align:start position:0%
<00:08:16.870>just <00:08:16.871>to <00:08:16.872>find <00:08:16.873>one <00:08:16.875>row <00:08:16.876>in <00:08:16.877>those <00:08:16.879>parquet

00:08:16.880 --> 00:08:19.190 align:start position:0%
<00:08:16.880>just <00:08:16.980>to <00:08:17.080>find <00:08:17.180>one <00:08:17.280>row <00:08:17.380>in <00:08:17.480>those <00:08:17.580>parquet <00:08:17.680>files. <00:08:17.780>That <00:08:17.880>doesn't <00:08:17.980>scale <00:08:18.080>at <00:08:18.180>all. <00:08:18.280>Um

00:08:19.190 --> 00:08:19.200 align:start position:0%
<00:08:19.190>files. <00:08:19.191>That <00:08:19.193>doesn't <00:08:19.194>scale <00:08:19.195>at <00:08:19.197>all. <00:08:19.199>Um

00:08:19.200 --> 00:08:21.070 align:start position:0%
<00:08:19.200>files. <00:08:19.307>That <00:08:19.415>doesn't <00:08:19.523>scale <00:08:19.630>at <00:08:19.738>all. <00:08:19.846>Um <00:08:19.953>schema <00:08:20.061>evolution, <00:08:20.169>so <00:08:20.276>adding <00:08:20.384>a <00:08:20.492>new <00:08:20.599>column

00:08:21.070 --> 00:08:21.080 align:start position:0%
<00:08:21.070>schema <00:08:21.071>evolution, <00:08:21.073>so <00:08:21.074>adding <00:08:21.075>a <00:08:21.077>new <00:08:21.079>column

00:08:21.080 --> 00:08:22.110 align:start position:0%
<00:08:21.080>schema <00:08:21.183>evolution, <00:08:21.286>so <00:08:21.389>adding <00:08:21.492>a <00:08:21.595>new <00:08:21.698>column <00:08:21.801>and <00:08:21.904>so <00:08:22.007>on.

00:08:22.110 --> 00:08:22.120 align:start position:0%
<00:08:22.110>and <00:08:22.114>so <00:08:22.119>on.

00:08:22.120 --> 00:08:24.790 align:start position:0%
<00:08:22.120>and <00:08:22.295>so <00:08:22.470>on. <00:08:22.645>Also <00:08:22.820>complicated <00:08:22.995>here. <00:08:23.170>And <00:08:23.345>as <00:08:23.520>you've

00:08:24.790 --> 00:08:24.800 align:start position:0%
<00:08:24.790>Also <00:08:24.791>complicated <00:08:24.793>here. <00:08:24.795>And <00:08:24.797>as <00:08:24.799>you've

00:08:24.800 --> 00:08:27.230 align:start position:0%
<00:08:24.800>Also <00:08:24.927>complicated <00:08:25.054>here. <00:08:25.181>And <00:08:25.309>as <00:08:25.436>you've <00:08:25.563>seen <00:08:25.690>as <00:08:25.818>I've <00:08:25.945>always <00:08:26.072>said <00:08:26.200>something,

00:08:27.230 --> 00:08:27.240 align:start position:0%
<00:08:27.230>seen <00:08:27.231>as <00:08:27.233>I've <00:08:27.235>always <00:08:27.237>said <00:08:27.239>something,

00:08:27.240 --> 00:08:29.030 align:start position:0%
<00:08:27.240>seen <00:08:27.380>as <00:08:27.520>I've <00:08:27.660>always <00:08:27.800>said <00:08:27.940>something, <00:08:28.080>writing <00:08:28.220>is <00:08:28.360>really <00:08:28.500>complicated <00:08:28.640>because

00:08:29.030 --> 00:08:29.040 align:start position:0%
<00:08:29.030>writing <00:08:29.032>is <00:08:29.034>really <00:08:29.036>complicated <00:08:29.039>because

00:08:29.040 --> 00:08:30.950 align:start position:0%
<00:08:29.040>writing <00:08:29.167>is <00:08:29.294>really <00:08:29.421>complicated <00:08:29.549>because <00:08:29.676>basically <00:08:29.803>you <00:08:29.930>have <00:08:30.058>to <00:08:30.185>append <00:08:30.312>one <00:08:30.440>thing

00:08:30.950 --> 00:08:30.960 align:start position:0%
<00:08:30.950>basically <00:08:30.951>you <00:08:30.953>have <00:08:30.954>to <00:08:30.955>append <00:08:30.957>one <00:08:30.959>thing

00:08:30.960 --> 00:08:33.550 align:start position:0%
<00:08:30.960>basically <00:08:31.067>you <00:08:31.175>have <00:08:31.283>to <00:08:31.390>append <00:08:31.498>one <00:08:31.606>thing <00:08:31.713>to <00:08:31.821>every <00:08:31.929>row. <00:08:32.036>And <00:08:32.144>basically <00:08:32.252>this <00:08:32.360>makes

00:08:33.550 --> 00:08:33.560 align:start position:0%
<00:08:33.549>to <00:08:33.551>every <00:08:33.553>row. <00:08:33.554>And <00:08:33.555>basically <00:08:33.557>this <00:08:33.558>makes

00:08:33.560 --> 00:08:35.350 align:start position:0%
<00:08:33.559>to <00:08:33.687>every <00:08:33.814>row. <00:08:33.941>And <00:08:34.069>basically <00:08:34.196>this <00:08:34.323>makes <00:08:34.450>this <00:08:34.578>file <00:08:34.705>format <00:08:34.832>an <00:08:34.959>append-only.

00:08:35.350 --> 00:08:35.360 align:start position:0%
<00:08:35.350>this <00:08:35.352>file <00:08:35.354>format <00:08:35.356>an <00:08:35.359>append-only.

00:08:35.360 --> 00:08:37.190 align:start position:0%
<00:08:35.360>this <00:08:35.593>file <00:08:35.826>format <00:08:36.060>an <00:08:36.293>append-only. <00:08:36.526>Changing <00:08:36.760>something,

00:08:37.190 --> 00:08:37.200 align:start position:0%
<00:08:37.190>Changing <00:08:37.199>something,

00:08:37.200 --> 00:08:38.510 align:start position:0%
<00:08:37.200>Changing <00:08:37.593>something, <00:08:37.986>a <00:08:38.379>value,

00:08:38.510 --> 00:08:38.520 align:start position:0%
<00:08:38.510>a <00:08:38.519>value,

00:08:38.520 --> 00:08:40.029 align:start position:0%
<00:08:38.520>a <00:08:38.670>value, <00:08:38.821>not <00:08:38.972>really <00:08:39.123>a <00:08:39.274>good <00:08:39.425>thing <00:08:39.576>in <00:08:39.727>parquet. <00:08:39.878>So

00:08:40.029 --> 00:08:40.039 align:start position:0%
<00:08:40.029>not <00:08:40.030>really <00:08:40.031>a <00:08:40.032>good <00:08:40.034>thing <00:08:40.035>in <00:08:40.036>parquet. <00:08:40.038>So

00:08:40.039 --> 00:08:41.750 align:start position:0%
<00:08:40.039>not <00:08:40.146>really <00:08:40.254>a <00:08:40.362>good <00:08:40.469>thing <00:08:40.577>in <00:08:40.685>parquet. <00:08:40.792>So <00:08:40.900>it's <00:08:41.008>really <00:08:41.115>more <00:08:41.223>like <00:08:41.331>adding, <00:08:41.438>adding,

00:08:41.750 --> 00:08:41.760 align:start position:0%
<00:08:41.750>it's <00:08:41.751>really <00:08:41.753>more <00:08:41.755>like <00:08:41.757>adding, <00:08:41.759>adding,

00:08:41.760 --> 00:08:42.909 align:start position:0%
<00:08:41.760>it's <00:08:41.907>really <00:08:42.055>more <00:08:42.203>like <00:08:42.350>adding, <00:08:42.498>adding, <00:08:42.646>adding <00:08:42.794>and

00:08:42.909 --> 00:08:42.919 align:start position:0%
<00:08:42.909>adding <00:08:42.918>and

00:08:42.919 --> 00:08:44.390 align:start position:0%
<00:08:42.919>adding <00:08:43.580>and <00:08:44.242>overwriting

00:08:44.390 --> 00:08:44.400 align:start position:0%
overwriting

00:08:44.400 --> 00:08:45.670 align:start position:0%
<00:08:44.400>overwriting <00:08:45.543>stuff.

00:08:45.670 --> 00:08:45.680 align:start position:0%
stuff.

00:08:45.680 --> 00:08:47.950 align:start position:0%
<00:08:45.680>stuff. <00:08:45.880>This <00:08:46.079>is <00:08:46.280>where <00:08:46.479>those <00:08:46.680>open <00:08:46.880>table <00:08:47.079>formats

00:08:47.950 --> 00:08:47.960 align:start position:0%
<00:08:47.950>This <00:08:47.951>is <00:08:47.953>where <00:08:47.954>those <00:08:47.956>open <00:08:47.957>table <00:08:47.959>formats

00:08:47.960 --> 00:08:50.230 align:start position:0%
<00:08:47.960>This <00:08:48.053>is <00:08:48.146>where <00:08:48.240>those <00:08:48.333>open <00:08:48.426>table <00:08:48.520>formats <00:08:48.613>come <00:08:48.706>in. <00:08:48.800>So <00:08:48.893>we <00:08:48.986>have <00:08:49.080>parquet <00:08:49.173>as <00:08:49.266>a <00:08:49.360>file

00:08:50.230 --> 00:08:50.240 align:start position:0%
<00:08:50.230>come <00:08:50.231>in. <00:08:50.232>So <00:08:50.233>we <00:08:50.234>have <00:08:50.235>parquet <00:08:50.236>as <00:08:50.237>a <00:08:50.239>file

00:08:50.240 --> 00:08:53.310 align:start position:0%
<00:08:50.240>come <00:08:50.340>in. <00:08:50.440>So <00:08:50.540>we <00:08:50.640>have <00:08:50.740>parquet <00:08:50.840>as <00:08:50.940>a <00:08:51.040>file <00:08:51.140>format <00:08:51.240>but <00:08:51.340>it's <00:08:51.440>not <00:08:51.540>really <00:08:51.640>flexible.

00:08:53.310 --> 00:08:53.320 align:start position:0%
<00:08:53.310>format <00:08:53.311>but <00:08:53.313>it's <00:08:53.315>not <00:08:53.317>really <00:08:53.319>flexible.

00:08:53.320 --> 00:08:54.630 align:start position:0%
<00:08:53.320>format <00:08:53.488>but <00:08:53.656>it's <00:08:53.825>not <00:08:53.993>really <00:08:54.162>flexible. <00:08:54.330>And <00:08:54.499>there's

00:08:54.630 --> 00:08:54.640 align:start position:0%
<00:08:54.630>And <00:08:54.639>there's

00:08:54.640 --> 00:08:57.110 align:start position:0%
<00:08:54.640>And <00:08:54.795>there's <00:08:54.951>multiple <00:08:55.106>of <00:08:55.262>those <00:08:55.417>formats. <00:08:55.573>One <00:08:55.728>of <00:08:55.884>One <00:08:56.040>is

00:08:57.110 --> 00:08:57.120 align:start position:0%
<00:08:57.110>multiple <00:08:57.111>of <00:08:57.112>those <00:08:57.113>formats. <00:08:57.115>One <00:08:57.116>of <00:08:57.117>One <00:08:57.119>is

00:08:57.120 --> 00:08:58.829 align:start position:0%
<00:08:57.120>multiple <00:08:57.220>of <00:08:57.320>those <00:08:57.420>formats. <00:08:57.520>One <00:08:57.620>of <00:08:57.720>One <00:08:57.820>is <00:08:57.920>Iceberg <00:08:58.020>which <00:08:58.120>is <00:08:58.220>the <00:08:58.320>most <00:08:58.420>popular. <00:08:58.520>It's

00:08:58.829 --> 00:08:58.839 align:start position:0%
<00:08:58.829>Iceberg <00:08:58.830>which <00:08:58.832>is <00:08:58.833>the <00:08:58.834>most <00:08:58.836>popular. <00:08:58.838>It's

00:08:58.839 --> 00:09:00.670 align:start position:0%
<00:08:58.839>Iceberg <00:08:58.955>which <00:08:59.072>is <00:08:59.189>the <00:08:59.305>most <00:08:59.422>popular. <00:08:59.539>It's <00:08:59.655>an <00:08:59.772>Apache <00:08:59.888>project, <00:09:00.005>Apache <00:09:00.122>Iceberg. <00:09:00.238>Then

00:09:00.670 --> 00:09:00.680 align:start position:0%
<00:09:00.670>an <00:09:00.671>Apache <00:09:00.673>project, <00:09:00.675>Apache <00:09:00.677>Iceberg. <00:09:00.679>Then

00:09:00.680 --> 00:09:03.750 align:start position:0%
<00:09:00.680>an <00:09:00.796>Apache <00:09:00.913>project, <00:09:01.030>Apache <00:09:01.146>Iceberg. <00:09:01.263>Then <00:09:01.380>there's <00:09:01.496>Delta <00:09:01.613>Lake <00:09:01.729>from <00:09:01.846>the <00:09:01.963>now <00:09:02.079>Linux

00:09:03.750 --> 00:09:03.760 align:start position:0%
<00:09:03.750>there's <00:09:03.751>Delta <00:09:03.753>Lake <00:09:03.754>from <00:09:03.756>the <00:09:03.757>now <00:09:03.759>Linux

00:09:03.760 --> 00:09:05.510 align:start position:0%
<00:09:03.760>there's <00:09:03.887>Delta <00:09:04.014>Lake <00:09:04.141>from <00:09:04.269>the <00:09:04.396>now <00:09:04.523>Linux <00:09:04.650>Foundation <00:09:04.778>but <00:09:04.905>basically <00:09:05.032>it's <00:09:05.160>the

00:09:05.510 --> 00:09:05.520 align:start position:0%
<00:09:05.510>Foundation <00:09:05.512>but <00:09:05.514>basically <00:09:05.516>it's <00:09:05.519>the

00:09:05.520 --> 00:09:07.470 align:start position:0%
<00:09:05.520>Foundation <00:09:05.753>but <00:09:05.986>basically <00:09:06.220>it's <00:09:06.453>the <00:09:06.686>Databricks <00:09:06.920>project.

00:09:07.470 --> 00:09:07.480 align:start position:0%
<00:09:07.470>Databricks <00:09:07.479>project.

00:09:07.480 --> 00:09:08.670 align:start position:0%
<00:09:07.480>Databricks <00:09:07.613>project. <00:09:07.747>It's <00:09:07.881>open <00:09:08.015>source <00:09:08.149>but <00:09:08.283>a <00:09:08.417>lot <00:09:08.550>of

00:09:08.670 --> 00:09:08.680 align:start position:0%
<00:09:08.670>It's <00:09:08.671>open <00:09:08.673>source <00:09:08.674>but <00:09:08.675>a <00:09:08.677>lot <00:09:08.679>of

00:09:08.680 --> 00:09:10.670 align:start position:0%
<00:09:08.680>It's <00:09:08.807>open <00:09:08.934>source <00:09:09.061>but <00:09:09.189>a <00:09:09.316>lot <00:09:09.443>of <00:09:09.570>contributors <00:09:09.698>are <00:09:09.825>from <00:09:09.952>Databricks. <00:09:10.079>Then

00:09:10.670 --> 00:09:10.680 align:start position:0%
<00:09:10.670>contributors <00:09:10.672>are <00:09:10.674>from <00:09:10.676>Databricks. <00:09:10.679>Then

00:09:10.680 --> 00:09:12.630 align:start position:0%
<00:09:10.680>contributors <00:09:10.807>are <00:09:10.934>from <00:09:11.061>Databricks. <00:09:11.189>Then <00:09:11.316>there's <00:09:11.443>Duck <00:09:11.570>Lake <00:09:11.698>from <00:09:11.825>the <00:09:11.952>vendors <00:09:12.079>of

00:09:12.630 --> 00:09:12.640 align:start position:0%
<00:09:12.630>there's <00:09:12.631>Duck <00:09:12.633>Lake <00:09:12.634>from <00:09:12.636>the <00:09:12.637>vendors <00:09:12.639>of

00:09:12.640 --> 00:09:13.910 align:start position:0%
<00:09:12.640>there's <00:09:12.803>Duck <00:09:12.966>Lake <00:09:13.129>from <00:09:13.293>the <00:09:13.456>vendors <00:09:13.619>of <00:09:13.783>DuckDB.

00:09:13.910 --> 00:09:13.920 align:start position:0%
DuckDB.

00:09:13.920 --> 00:09:15.470 align:start position:0%
<00:09:13.920>DuckDB. <00:09:14.119>And <00:09:14.318>there's <00:09:14.517>Apache <00:09:14.717>Hudi <00:09:14.916>which <00:09:15.115>is <00:09:15.315>a

00:09:15.470 --> 00:09:15.480 align:start position:0%
<00:09:15.470>And <00:09:15.471>there's <00:09:15.473>Apache <00:09:15.474>Hudi <00:09:15.476>which <00:09:15.477>is <00:09:15.479>a

00:09:15.480 --> 00:09:18.790 align:start position:0%
<00:09:15.480>And <00:09:15.596>there's <00:09:15.713>Apache <00:09:15.830>Hudi <00:09:15.946>which <00:09:16.063>is <00:09:16.180>a <00:09:16.296>little <00:09:16.413>bit <00:09:16.530>more <00:09:16.646>on <00:09:16.763>streaming <00:09:16.880>workloads.

00:09:18.790 --> 00:09:18.800 align:start position:0%
<00:09:18.790>little <00:09:18.791>bit <00:09:18.793>more <00:09:18.795>on <00:09:18.797>streaming <00:09:18.799>workloads.

00:09:18.800 --> 00:09:20.670 align:start position:0%
<00:09:18.800>little <00:09:18.900>bit <00:09:19.000>more <00:09:19.099>on <00:09:19.199>streaming <00:09:19.300>workloads. <00:09:19.400>So <00:09:19.500>what <00:09:19.599>are <00:09:19.699>they <00:09:19.800>doing? <00:09:19.900>So <00:09:20.000>first <00:09:20.099>of <00:09:20.199>all,

00:09:20.670 --> 00:09:20.680 align:start position:0%
<00:09:20.670>So <00:09:20.671>what <00:09:20.672>are <00:09:20.673>they <00:09:20.674>doing? <00:09:20.675>So <00:09:20.676>first <00:09:20.677>of <00:09:20.679>all,

00:09:20.680 --> 00:09:22.710 align:start position:0%
<00:09:20.680>So <00:09:20.767>what <00:09:20.854>are <00:09:20.942>they <00:09:21.030>doing? <00:09:21.117>So <00:09:21.204>first <00:09:21.292>of <00:09:21.380>all, <00:09:21.467>they <00:09:21.555>are <00:09:21.642>built <00:09:21.729>on <00:09:21.817>parquet. <00:09:21.905>They <00:09:21.992>are <00:09:22.079>not

00:09:22.710 --> 00:09:22.720 align:start position:0%
<00:09:22.710>they <00:09:22.711>are <00:09:22.712>built <00:09:22.713>on <00:09:22.715>parquet. <00:09:22.716>They <00:09:22.717>are <00:09:22.719>not

00:09:22.720 --> 00:09:24.430 align:start position:0%
<00:09:22.720>they <00:09:22.836>are <00:09:22.953>built <00:09:23.070>on <00:09:23.186>parquet. <00:09:23.303>They <00:09:23.420>are <00:09:23.536>not <00:09:23.653>replacing <00:09:23.770>parquet. <00:09:23.886>They <00:09:24.003>are <00:09:24.120>still

00:09:24.430 --> 00:09:24.440 align:start position:0%
<00:09:24.430>replacing <00:09:24.432>parquet. <00:09:24.434>They <00:09:24.436>are <00:09:24.439>still

00:09:24.440 --> 00:09:27.110 align:start position:0%
<00:09:24.440>replacing <00:09:24.580>parquet. <00:09:24.720>They <00:09:24.860>are <00:09:25.000>still <00:09:25.140>parquet <00:09:25.280>underneath. <00:09:25.420>So <00:09:25.560>data <00:09:25.700>is <00:09:25.840>still

00:09:27.110 --> 00:09:27.120 align:start position:0%
<00:09:27.110>parquet <00:09:27.111>underneath. <00:09:27.113>So <00:09:27.115>data <00:09:27.117>is <00:09:27.119>still

00:09:27.120 --> 00:09:28.990 align:start position:0%
<00:09:27.120>parquet <00:09:27.236>underneath. <00:09:27.353>So <00:09:27.470>data <00:09:27.586>is <00:09:27.703>still <00:09:27.820>stored <00:09:27.936>in <00:09:28.053>parquet <00:09:28.170>but <00:09:28.286>they <00:09:28.403>add <00:09:28.520>something

00:09:28.990 --> 00:09:29.000 align:start position:0%
<00:09:28.990>stored <00:09:28.991>in <00:09:28.993>parquet <00:09:28.994>but <00:09:28.996>they <00:09:28.997>add <00:09:28.999>something

00:09:29.000 --> 00:09:30.630 align:start position:0%
<00:09:29.000>stored <00:09:29.107>in <00:09:29.215>parquet <00:09:29.323>but <00:09:29.430>they <00:09:29.538>add <00:09:29.646>something <00:09:29.753>to <00:09:29.861>it. <00:09:29.969>From <00:09:30.076>parquet <00:09:30.184>they <00:09:30.292>get <00:09:30.400>the

00:09:30.630 --> 00:09:30.640 align:start position:0%
<00:09:30.630>to <00:09:30.631>it. <00:09:30.633>From <00:09:30.634>parquet <00:09:30.636>they <00:09:30.637>get <00:09:30.639>the

00:09:30.640 --> 00:09:32.950 align:start position:0%
<00:09:30.640>to <00:09:30.795>it. <00:09:30.951>From <00:09:31.106>parquet <00:09:31.262>they <00:09:31.417>get <00:09:31.573>the <00:09:31.728>interoperability. <00:09:31.884>So <00:09:32.040>basically

00:09:32.950 --> 00:09:32.960 align:start position:0%
<00:09:32.950>interoperability. <00:09:32.954>So <00:09:32.959>basically

00:09:32.960 --> 00:09:34.750 align:start position:0%
<00:09:32.960>interoperability. <00:09:33.310>So <00:09:33.660>basically <00:09:34.010>parquet <00:09:34.360>is

00:09:34.750 --> 00:09:34.760 align:start position:0%
<00:09:34.750>parquet <00:09:34.759>is

00:09:34.760 --> 00:09:37.230 align:start position:0%
<00:09:34.760>parquet <00:09:34.915>is <00:09:35.071>I <00:09:35.226>don't <00:09:35.382>know, <00:09:35.537>15, <00:09:35.693>maybe <00:09:35.848>20 <00:09:36.004>years <00:09:36.160>old.

00:09:37.230 --> 00:09:37.240 align:start position:0%
<00:09:37.230>I <00:09:37.231>don't <00:09:37.232>know, <00:09:37.233>15, <00:09:37.235>maybe <00:09:37.236>20 <00:09:37.237>years <00:09:37.239>old.

00:09:37.240 --> 00:09:39.230 align:start position:0%
<00:09:37.240>I <00:09:37.340>don't <00:09:37.440>know, <00:09:37.540>15, <00:09:37.640>maybe <00:09:37.740>20 <00:09:37.840>years <00:09:37.940>old. <00:09:38.040>But <00:09:38.140>it's <00:09:38.240>a <00:09:38.340>really, <00:09:38.440>really <00:09:38.540>old <00:09:38.640>and

00:09:39.230 --> 00:09:39.240 align:start position:0%
<00:09:39.230>But <00:09:39.231>it's <00:09:39.233>a <00:09:39.234>really, <00:09:39.236>really <00:09:39.237>old <00:09:39.239>and

00:09:39.240 --> 00:09:40.910 align:start position:0%
<00:09:39.240>But <00:09:39.356>it's <00:09:39.473>a <00:09:39.590>really, <00:09:39.706>really <00:09:39.823>old <00:09:39.940>and <00:09:40.056>established <00:09:40.173>format. <00:09:40.290>There's <00:09:40.406>a <00:09:40.523>lot <00:09:40.640>of

00:09:40.910 --> 00:09:40.920 align:start position:0%
<00:09:40.910>established <00:09:40.911>format. <00:09:40.913>There's <00:09:40.915>a <00:09:40.917>lot <00:09:40.919>of

00:09:40.920 --> 00:09:43.190 align:start position:0%
<00:09:40.920>established <00:09:41.060>format. <00:09:41.199>There's <00:09:41.339>a <00:09:41.479>lot <00:09:41.620>of <00:09:41.760>libraries <00:09:41.900>reading, <00:09:42.040>writing <00:09:42.180>parquet, <00:09:42.319>and

00:09:43.190 --> 00:09:43.200 align:start position:0%
<00:09:43.190>libraries <00:09:43.192>reading, <00:09:43.194>writing <00:09:43.196>parquet, <00:09:43.199>and

00:09:43.200 --> 00:09:45.590 align:start position:0%
<00:09:43.200>libraries <00:09:43.355>reading, <00:09:43.511>writing <00:09:43.666>parquet, <00:09:43.822>and <00:09:43.977>it's <00:09:44.133>pretty <00:09:44.288>well-known <00:09:44.444>standard. <00:09:44.600>There's

00:09:45.590 --> 00:09:45.600 align:start position:0%
<00:09:45.590>it's <00:09:45.592>pretty <00:09:45.594>well-known <00:09:45.596>standard. <00:09:45.599>There's

00:09:45.600 --> 00:09:47.350 align:start position:0%
<00:09:45.600>it's <00:09:45.740>pretty <00:09:45.880>well-known <00:09:46.020>standard. <00:09:46.160>There's <00:09:46.300>the <00:09:46.440>encoding <00:09:46.580>and <00:09:46.720>compression. <00:09:46.860>I <00:09:47.000>only

00:09:47.350 --> 00:09:47.360 align:start position:0%
<00:09:47.350>the <00:09:47.351>encoding <00:09:47.353>and <00:09:47.355>compression. <00:09:47.357>I <00:09:47.359>only

00:09:47.360 --> 00:09:49.230 align:start position:0%
<00:09:47.360>the <00:09:47.487>encoding <00:09:47.614>and <00:09:47.741>compression. <00:09:47.869>I <00:09:47.996>only <00:09:48.123>showed <00:09:48.250>you <00:09:48.378>the <00:09:48.505>dictionary <00:09:48.632>encoding <00:09:48.760>that

00:09:49.230 --> 00:09:49.240 align:start position:0%
<00:09:49.230>showed <00:09:49.231>you <00:09:49.233>the <00:09:49.235>dictionary <00:09:49.237>encoding <00:09:49.239>that

00:09:49.240 --> 00:09:50.510 align:start position:0%
<00:09:49.240>showed <00:09:49.354>you <00:09:49.468>the <00:09:49.582>dictionary <00:09:49.697>encoding <00:09:49.811>that <00:09:49.925>talked <00:09:50.040>about <00:09:50.154>the <00:09:50.268>dictionary <00:09:50.383>encoding.

00:09:50.510 --> 00:09:50.520 align:start position:0%
<00:09:50.510>talked <00:09:50.512>about <00:09:50.514>the <00:09:50.516>dictionary <00:09:50.519>encoding.

00:09:50.520 --> 00:09:52.150 align:start position:0%
<00:09:50.520>talked <00:09:50.660>about <00:09:50.800>the <00:09:50.939>dictionary <00:09:51.079>encoding. <00:09:51.220>There's <00:09:51.360>way <00:09:51.500>more <00:09:51.640>things <00:09:51.780>with <00:09:51.920>snappy

00:09:52.150 --> 00:09:52.160 align:start position:0%
<00:09:52.150>There's <00:09:52.151>way <00:09:52.153>more <00:09:52.155>things <00:09:52.157>with <00:09:52.159>snappy

00:09:52.160 --> 00:09:54.310 align:start position:0%
<00:09:52.160>There's <00:09:52.287>way <00:09:52.414>more <00:09:52.541>things <00:09:52.669>with <00:09:52.796>snappy <00:09:52.923>compression <00:09:53.050>and <00:09:53.178>so <00:09:53.305>on. <00:09:53.432>They <00:09:53.560>are

00:09:54.310 --> 00:09:54.320 align:start position:0%
<00:09:54.310>compression <00:09:54.311>and <00:09:54.313>so <00:09:54.315>on. <00:09:54.317>They <00:09:54.319>are

00:09:54.320 --> 00:09:56.110 align:start position:0%
<00:09:54.320>compression <00:09:54.436>and <00:09:54.553>so <00:09:54.670>on. <00:09:54.786>They <00:09:54.903>are <00:09:55.020>splittable. <00:09:55.136>As <00:09:55.253>I <00:09:55.370>said, <00:09:55.486>you <00:09:55.603>can <00:09:55.720>have

00:09:56.110 --> 00:09:56.120 align:start position:0%
<00:09:56.110>splittable. <00:09:56.111>As <00:09:56.113>I <00:09:56.114>said, <00:09:56.116>you <00:09:56.117>can <00:09:56.119>have

00:09:56.120 --> 00:09:58.830 align:start position:0%
<00:09:56.120>splittable. <00:09:56.227>As <00:09:56.335>I <00:09:56.443>said, <00:09:56.550>you <00:09:56.658>can <00:09:56.766>have <00:09:56.873>multiple <00:09:56.981>parquet <00:09:57.089>files, <00:09:57.196>put <00:09:57.304>them <00:09:57.412>all <00:09:57.520>in

00:09:58.830 --> 00:09:58.840 align:start position:0%
<00:09:58.830>multiple <00:09:58.831>parquet <00:09:58.833>files, <00:09:58.834>put <00:09:58.836>them <00:09:58.837>all <00:09:58.839>in

00:09:58.840 --> 00:10:00.750 align:start position:0%
<00:09:58.840>multiple <00:09:58.947>parquet <00:09:59.055>files, <00:09:59.163>put <00:09:59.270>them <00:09:59.378>all <00:09:59.486>in <00:09:59.593>a <00:09:59.701>dictionary <00:09:59.809>and <00:09:59.916>say <00:10:00.024>in <00:10:00.132>reader, <00:10:00.240>"Hey,

00:10:00.750 --> 00:10:00.760 align:start position:0%
<00:10:00.750>a <00:10:00.751>dictionary <00:10:00.753>and <00:10:00.754>say <00:10:00.756>in <00:10:00.757>reader, <00:10:00.759>"Hey,

00:10:00.760 --> 00:10:02.710 align:start position:0%
<00:10:00.760>a <00:10:00.867>dictionary <00:10:00.975>and <00:10:01.083>say <00:10:01.190>in <00:10:01.298>reader, <00:10:01.406>"Hey, <00:10:01.513>read <00:10:01.621>this <00:10:01.729>directory <00:10:01.836>are <00:10:01.944>full <00:10:02.052>of <00:10:02.160>parquet

00:10:02.710 --> 00:10:02.720 align:start position:0%
<00:10:02.710>read <00:10:02.711>this <00:10:02.713>directory <00:10:02.714>are <00:10:02.716>full <00:10:02.717>of <00:10:02.719>parquet

00:10:02.720 --> 00:10:04.270 align:start position:0%
<00:10:02.720>read <00:10:02.819>this <00:10:02.919>directory <00:10:03.018>are <00:10:03.118>full <00:10:03.218>of <00:10:03.317>parquet <00:10:03.417>files <00:10:03.517>and <00:10:03.616>you <00:10:03.716>basically <00:10:03.816>treat <00:10:03.915>it <00:10:04.015>as <00:10:04.115>one

00:10:04.270 --> 00:10:04.280 align:start position:0%
<00:10:04.270>files <00:10:04.271>and <00:10:04.272>you <00:10:04.273>basically <00:10:04.275>treat <00:10:04.276>it <00:10:04.277>as <00:10:04.279>one

00:10:04.280 --> 00:10:06.310 align:start position:0%
<00:10:04.280>files <00:10:04.396>and <00:10:04.513>you <00:10:04.630>basically <00:10:04.746>treat <00:10:04.863>it <00:10:04.980>as <00:10:05.096>one <00:10:05.213>file, <00:10:05.329>but <00:10:05.446>you <00:10:05.563>can <00:10:05.680>also

00:10:06.310 --> 00:10:06.320 align:start position:0%
<00:10:06.310>file, <00:10:06.312>but <00:10:06.314>you <00:10:06.316>can <00:10:06.319>also

00:10:06.320 --> 00:10:09.270 align:start position:0%
<00:10:06.320>file, <00:10:06.475>but <00:10:06.631>you <00:10:06.786>can <00:10:06.942>also <00:10:07.097>parallelize <00:10:07.253>them <00:10:07.408>on <00:10:07.564>multiple <00:10:07.720>files,

00:10:09.270 --> 00:10:09.280 align:start position:0%
<00:10:09.270>parallelize <00:10:09.272>them <00:10:09.274>on <00:10:09.276>multiple <00:10:09.279>files,

00:10:09.280 --> 00:10:11.390 align:start position:0%
<00:10:09.280>parallelize <00:10:09.407>them <00:10:09.534>on <00:10:09.661>multiple <00:10:09.789>files, <00:10:09.916>and <00:10:10.043>it <00:10:10.170>can <00:10:10.298>do <00:10:10.425>this <00:10:10.552>partition <00:10:10.680>this

00:10:11.390 --> 00:10:11.400 align:start position:0%
<00:10:11.390>and <00:10:11.391>it <00:10:11.393>can <00:10:11.394>do <00:10:11.396>this <00:10:11.397>partition <00:10:11.399>this

00:10:11.400 --> 00:10:13.270 align:start position:0%
<00:10:11.400>and <00:10:11.507>it <00:10:11.615>can <00:10:11.723>do <00:10:11.830>this <00:10:11.938>partition <00:10:12.046>this <00:10:12.153>pruning <00:10:12.261>and <00:10:12.369>skipping <00:10:12.476>of <00:10:12.584>columns <00:10:12.692>that <00:10:12.800>I

00:10:13.270 --> 00:10:13.280 align:start position:0%
<00:10:13.270>pruning <00:10:13.271>and <00:10:13.273>skipping <00:10:13.274>of <00:10:13.276>columns <00:10:13.277>that <00:10:13.279>I

00:10:13.280 --> 00:10:14.750 align:start position:0%
<00:10:13.280>pruning <00:10:13.468>and <00:10:13.658>skipping <00:10:13.847>of <00:10:14.036>columns <00:10:14.225>that <00:10:14.414>I <00:10:14.603>just

00:10:14.750 --> 00:10:14.760 align:start position:0%
just

00:10:14.760 --> 00:10:16.430 align:start position:0%
<00:10:14.760>just <00:10:14.960>showed <00:10:15.160>you <00:10:15.360>with <00:10:15.560>with <00:10:15.760>the <00:10:15.960>row <00:10:16.160>groups.

00:10:16.430 --> 00:10:16.440 align:start position:0%
<00:10:16.430>showed <00:10:16.431>you <00:10:16.433>with <00:10:16.434>with <00:10:16.436>the <00:10:16.437>row <00:10:16.439>groups.

00:10:16.440 --> 00:10:18.710 align:start position:0%
<00:10:16.440>showed <00:10:16.540>you <00:10:16.640>with <00:10:16.740>with <00:10:16.840>the <00:10:16.940>row <00:10:17.040>groups. <00:10:17.140>That's <00:10:17.240>all <00:10:17.340>what <00:10:17.440>we <00:10:17.540>get <00:10:17.640>from <00:10:17.740>parquet. <00:10:17.840>But

00:10:18.710 --> 00:10:18.720 align:start position:0%
<00:10:18.710>That's <00:10:18.711>all <00:10:18.712>what <00:10:18.713>we <00:10:18.715>get <00:10:18.716>from <00:10:18.717>parquet. <00:10:18.719>But

00:10:18.720 --> 00:10:21.230 align:start position:0%
<00:10:18.720>That's <00:10:18.820>all <00:10:18.920>what <00:10:19.020>we <00:10:19.120>get <00:10:19.220>from <00:10:19.320>parquet. <00:10:19.420>But <00:10:19.520>we <00:10:19.620>don't <00:10:19.720>and <00:10:19.820>those <00:10:19.920>open <00:10:20.020>table <00:10:20.120>formats

00:10:21.230 --> 00:10:21.240 align:start position:0%
<00:10:21.230>we <00:10:21.231>don't <00:10:21.233>and <00:10:21.234>those <00:10:21.236>open <00:10:21.237>table <00:10:21.239>formats

00:10:21.240 --> 00:10:23.550 align:start position:0%
<00:10:21.240>we <00:10:21.347>don't <00:10:21.455>and <00:10:21.563>those <00:10:21.670>open <00:10:21.778>table <00:10:21.886>formats <00:10:21.993>now <00:10:22.101>add <00:10:22.209>a <00:10:22.316>schema <00:10:22.424>evolution, <00:10:22.532>the <00:10:22.640>asset

00:10:23.550 --> 00:10:23.560 align:start position:0%
<00:10:23.550>now <00:10:23.551>add <00:10:23.553>a <00:10:23.554>schema <00:10:23.555>evolution, <00:10:23.557>the <00:10:23.559>asset

00:10:23.560 --> 00:10:26.070 align:start position:0%
<00:10:23.560>now <00:10:23.676>add <00:10:23.793>a <00:10:23.910>schema <00:10:24.026>evolution, <00:10:24.143>the <00:10:24.260>asset <00:10:24.376>compliance, <00:10:24.493>scaling <00:10:24.609>it <00:10:24.726>to <00:10:24.843>really <00:10:24.959>large

00:10:26.070 --> 00:10:26.080 align:start position:0%
<00:10:26.070>compliance, <00:10:26.071>scaling <00:10:26.073>it <00:10:26.075>to <00:10:26.077>really <00:10:26.079>large

00:10:26.080 --> 00:10:27.830 align:start position:0%
<00:10:26.080>compliance, <00:10:26.187>scaling <00:10:26.295>it <00:10:26.403>to <00:10:26.510>really <00:10:26.618>large <00:10:26.726>amounts <00:10:26.833>of <00:10:26.941>data <00:10:27.049>without <00:10:27.156>the <00:10:27.264>need <00:10:27.372>to <00:10:27.480>read

00:10:27.830 --> 00:10:27.840 align:start position:0%
<00:10:27.830>amounts <00:10:27.831>of <00:10:27.832>data <00:10:27.833>without <00:10:27.835>the <00:10:27.836>need <00:10:27.837>to <00:10:27.839>read

00:10:27.840 --> 00:10:29.550 align:start position:0%
<00:10:27.840>amounts <00:10:27.967>of <00:10:28.094>data <00:10:28.221>without <00:10:28.349>the <00:10:28.476>need <00:10:28.603>to <00:10:28.730>read <00:10:28.858>all <00:10:28.985>the <00:10:29.112>parquet <00:10:29.240>files,

00:10:29.550 --> 00:10:29.560 align:start position:0%
<00:10:29.550>all <00:10:29.553>the <00:10:29.555>parquet <00:10:29.559>files,

00:10:29.560 --> 00:10:31.710 align:start position:0%
<00:10:29.560>all <00:10:29.734>the <00:10:29.910>parquet <00:10:30.084>files, <00:10:30.260>maintenance <00:10:30.435>operations <00:10:30.609>like <00:10:30.785>cleaning <00:10:30.959>up

00:10:31.710 --> 00:10:31.720 align:start position:0%
<00:10:31.710>maintenance <00:10:31.712>operations <00:10:31.714>like <00:10:31.716>cleaning <00:10:31.719>up

00:10:31.720 --> 00:10:33.310 align:start position:0%
<00:10:31.720>maintenance <00:10:31.953>operations <00:10:32.186>like <00:10:32.420>cleaning <00:10:32.653>up <00:10:32.886>old <00:10:33.120>data,

00:10:33.310 --> 00:10:33.320 align:start position:0%
<00:10:33.310>old <00:10:33.319>data,

00:10:33.320 --> 00:10:36.190 align:start position:0%
<00:10:33.320>old <00:10:33.495>data, <00:10:33.670>the <00:10:33.845>possibility <00:10:34.020>to <00:10:34.195>time <00:10:34.370>travel <00:10:34.545>to <00:10:34.720>say

00:10:36.190 --> 00:10:36.200 align:start position:0%
<00:10:36.190>the <00:10:36.191>possibility <00:10:36.193>to <00:10:36.194>time <00:10:36.196>travel <00:10:36.197>to <00:10:36.199>say

00:10:36.200 --> 00:10:38.110 align:start position:0%
<00:10:36.200>the <00:10:36.300>possibility <00:10:36.400>to <00:10:36.500>time <00:10:36.600>travel <00:10:36.700>to <00:10:36.800>say <00:10:36.900>like, <00:10:37.000>"Hey, <00:10:37.100>what <00:10:37.200>was <00:10:37.300>the <00:10:37.400>data <00:10:37.500>2 <00:10:37.600>days

00:10:38.110 --> 00:10:38.120 align:start position:0%
<00:10:38.110>like, <00:10:38.111>"Hey, <00:10:38.112>what <00:10:38.113>was <00:10:38.115>the <00:10:38.116>data <00:10:38.117>2 <00:10:38.119>days

00:10:38.120 --> 00:10:39.390 align:start position:0%
<00:10:38.120>like, <00:10:38.262>"Hey, <00:10:38.405>what <00:10:38.548>was <00:10:38.691>the <00:10:38.834>data <00:10:38.977>2 <00:10:39.120>days <00:10:39.263>ago?"

00:10:39.390 --> 00:10:39.400 align:start position:0%
ago?"

00:10:39.400 --> 00:10:40.790 align:start position:0%
<00:10:39.400>ago?" <00:10:39.556>If <00:10:39.712>you <00:10:39.869>stored <00:10:40.025>all <00:10:40.181>the <00:10:40.338>history, <00:10:40.494>you <00:10:40.651>can

00:10:40.790 --> 00:10:40.800 align:start position:0%
<00:10:40.790>If <00:10:40.791>you <00:10:40.792>stored <00:10:40.793>all <00:10:40.795>the <00:10:40.796>history, <00:10:40.797>you <00:10:40.799>can

00:10:40.800 --> 00:10:43.230 align:start position:0%
<00:10:40.800>If <00:10:40.893>you <00:10:40.986>stored <00:10:41.079>all <00:10:41.173>the <00:10:41.266>history, <00:10:41.359>you <00:10:41.453>can <00:10:41.546>just <00:10:41.640>switch <00:10:41.733>back <00:10:41.826>the <00:10:41.920>version <00:10:42.013>or <00:10:42.106>the <00:10:42.199>time

00:10:43.230 --> 00:10:43.240 align:start position:0%
<00:10:43.230>just <00:10:43.231>switch <00:10:43.232>back <00:10:43.233>the <00:10:43.235>version <00:10:43.236>or <00:10:43.237>the <00:10:43.239>time

00:10:43.240 --> 00:10:45.030 align:start position:0%
<00:10:43.240>just <00:10:43.347>switch <00:10:43.455>back <00:10:43.563>the <00:10:43.670>version <00:10:43.778>or <00:10:43.886>the <00:10:43.993>time <00:10:44.101>stamp <00:10:44.209>you <00:10:44.316>want <00:10:44.424>to <00:10:44.532>read <00:10:44.640>from.

00:10:45.030 --> 00:10:45.040 align:start position:0%
<00:10:45.030>stamp <00:10:45.031>you <00:10:45.033>want <00:10:45.035>to <00:10:45.037>read <00:10:45.039>from.

00:10:45.040 --> 00:10:47.150 align:start position:0%
<00:10:45.040>stamp <00:10:45.167>you <00:10:45.294>want <00:10:45.421>to <00:10:45.549>read <00:10:45.676>from. <00:10:45.803>It <00:10:45.930>adds <00:10:46.058>mutability, <00:10:46.185>so <00:10:46.312>changing <00:10:46.439>columns

00:10:47.150 --> 00:10:47.160 align:start position:0%
<00:10:47.150>It <00:10:47.151>adds <00:10:47.153>mutability, <00:10:47.155>so <00:10:47.157>changing <00:10:47.159>columns

00:10:47.160 --> 00:10:50.070 align:start position:0%
<00:10:47.160>It <00:10:47.300>adds <00:10:47.439>mutability, <00:10:47.579>so <00:10:47.719>changing <00:10:47.860>columns <00:10:48.000>actually, <00:10:48.140>and <00:10:48.280>it <00:10:48.420>adds <00:10:48.560>partitioning.

00:10:50.070 --> 00:10:50.080 align:start position:0%
<00:10:50.070>actually, <00:10:50.072>and <00:10:50.074>it <00:10:50.076>adds <00:10:50.079>partitioning.

00:10:50.080 --> 00:10:51.550 align:start position:0%
<00:10:50.080>actually, <00:10:50.227>and <00:10:50.374>it <00:10:50.521>adds <00:10:50.668>partitioning. <00:10:50.815>How <00:10:50.962>do <00:10:51.108>they <00:10:51.256>do <00:10:51.403>this?

00:10:51.550 --> 00:10:51.560 align:start position:0%
<00:10:51.550>How <00:10:51.552>do <00:10:51.554>they <00:10:51.556>do <00:10:51.559>this?

00:10:51.560 --> 00:10:54.670 align:start position:0%
<00:10:51.560>How <00:10:51.676>do <00:10:51.793>they <00:10:51.910>do <00:10:52.026>this? <00:10:52.143>I <00:10:52.260>will <00:10:52.376>show <00:10:52.493>it <00:10:52.609>first <00:10:52.726>on <00:10:52.843>on <00:10:52.959>Delta.

00:10:54.670 --> 00:10:54.680 align:start position:0%
<00:10:54.670>I <00:10:54.671>will <00:10:54.672>show <00:10:54.673>it <00:10:54.675>first <00:10:54.676>on <00:10:54.677>on <00:10:54.679>Delta.

00:10:54.680 --> 00:10:57.190 align:start position:0%
<00:10:54.680>I <00:10:54.773>will <00:10:54.866>show <00:10:54.959>it <00:10:55.053>first <00:10:55.146>on <00:10:55.239>on <00:10:55.333>Delta. <00:10:55.426>So <00:10:55.520>Delta <00:10:55.613>basically, <00:10:55.706>as <00:10:55.800>you <00:10:55.893>see <00:10:55.986>here, <00:10:56.079>you

00:10:57.190 --> 00:10:57.200 align:start position:0%
<00:10:57.190>So <00:10:57.191>Delta <00:10:57.192>basically, <00:10:57.193>as <00:10:57.195>you <00:10:57.196>see <00:10:57.197>here, <00:10:57.199>you

00:10:57.200 --> 00:10:59.829 align:start position:0%
<00:10:57.200>So <00:10:57.287>Delta <00:10:57.375>basically, <00:10:57.462>as <00:10:57.550>you <00:10:57.637>see <00:10:57.725>here, <00:10:57.812>you <00:10:57.900>still <00:10:57.987>have <00:10:58.075>the <00:10:58.162>file <00:10:58.250>with <00:10:58.337>the <00:10:58.425>data <00:10:58.512>in <00:10:58.600>it,

00:10:59.829 --> 00:10:59.839 align:start position:0%
<00:10:59.829>still <00:10:59.830>have <00:10:59.831>the <00:10:59.832>file <00:10:59.833>with <00:10:59.834>the <00:10:59.835>data <00:10:59.836>in <00:10:59.838>it,

00:10:59.839 --> 00:11:01.710 align:start position:0%
<00:10:59.839>still <00:10:59.921>have <00:11:00.003>the <00:11:00.086>file <00:11:00.168>with <00:11:00.250>the <00:11:00.333>data <00:11:00.415>in <00:11:00.497>it, <00:11:00.580>and <00:11:00.662>it <00:11:00.744>adds <00:11:00.827>a <00:11:00.909>Delta <00:11:00.991>log, <00:11:01.074>which <00:11:01.156>is <00:11:01.238>a

00:11:01.710 --> 00:11:01.720 align:start position:0%
<00:11:01.710>and <00:11:01.711>it <00:11:01.712>adds <00:11:01.713>a <00:11:01.714>Delta <00:11:01.715>log, <00:11:01.716>which <00:11:01.717>is <00:11:01.719>a

00:11:01.720 --> 00:11:03.350 align:start position:0%
<00:11:01.720>and <00:11:01.860>it <00:11:02.000>adds <00:11:02.140>a <00:11:02.280>Delta <00:11:02.420>log, <00:11:02.560>which <00:11:02.700>is <00:11:02.840>a <00:11:02.980>transaction <00:11:03.120>log.

00:11:03.350 --> 00:11:03.360 align:start position:0%
<00:11:03.350>transaction <00:11:03.359>log.

00:11:03.360 --> 00:11:05.110 align:start position:0%
<00:11:03.360>transaction <00:11:03.515>log. <00:11:03.671>It <00:11:03.826>surprise <00:11:03.982>some <00:11:04.137>of <00:11:04.293>you <00:11:04.448>know <00:11:04.604>a <00:11:04.760>little

00:11:05.110 --> 00:11:05.120 align:start position:0%
<00:11:05.110>It <00:11:05.111>surprise <00:11:05.112>some <00:11:05.113>of <00:11:05.115>you <00:11:05.116>know <00:11:05.117>a <00:11:05.119>little

00:11:05.120 --> 00:11:06.790 align:start position:0%
<00:11:05.120>It <00:11:05.220>surprise <00:11:05.320>some <00:11:05.420>of <00:11:05.520>you <00:11:05.620>know <00:11:05.720>a <00:11:05.820>little <00:11:05.920>bit <00:11:06.020>more <00:11:06.120>about <00:11:06.220>database. <00:11:06.320>They <00:11:06.420>have <00:11:06.520>They

00:11:06.790 --> 00:11:06.800 align:start position:0%
<00:11:06.790>bit <00:11:06.791>more <00:11:06.793>about <00:11:06.794>database. <00:11:06.795>They <00:11:06.797>have <00:11:06.799>They

00:11:06.800 --> 00:11:09.230 align:start position:0%
<00:11:06.800>bit <00:11:06.916>more <00:11:07.033>about <00:11:07.150>database. <00:11:07.266>They <00:11:07.383>have <00:11:07.500>They <00:11:07.616>just <00:11:07.733>reinvented <00:11:07.849>databases. <00:11:07.966>Yeah, <00:11:08.083>kind <00:11:08.199>of

00:11:09.230 --> 00:11:09.240 align:start position:0%
<00:11:09.230>just <00:11:09.231>reinvented <00:11:09.233>databases. <00:11:09.235>Yeah, <00:11:09.237>kind <00:11:09.239>of

00:11:09.240 --> 00:11:11.190 align:start position:0%
<00:11:09.240>just <00:11:09.415>reinvented <00:11:09.590>databases. <00:11:09.765>Yeah, <00:11:09.940>kind <00:11:10.115>of <00:11:10.290>they <00:11:10.465>did <00:11:10.640>sometimes.

00:11:11.190 --> 00:11:11.200 align:start position:0%
<00:11:11.190>they <00:11:11.194>did <00:11:11.199>sometimes.

00:11:11.200 --> 00:11:12.670 align:start position:0%
<00:11:11.200>they <00:11:11.347>did <00:11:11.494>sometimes. <00:11:11.641>Totally <00:11:11.788>fair, <00:11:11.935>well, <00:11:12.082>but <00:11:12.229>with <00:11:12.376>a <00:11:12.522>cheap

00:11:12.670 --> 00:11:12.680 align:start position:0%
<00:11:12.670>Totally <00:11:12.671>fair, <00:11:12.673>well, <00:11:12.674>but <00:11:12.675>with <00:11:12.677>a <00:11:12.679>cheap

00:11:12.680 --> 00:11:14.990 align:start position:0%
<00:11:12.680>Totally <00:11:12.796>fair, <00:11:12.913>well, <00:11:13.030>but <00:11:13.146>with <00:11:13.263>a <00:11:13.380>cheap <00:11:13.496>storage <00:11:13.613>underneath <00:11:13.729>with <00:11:13.846>S3 <00:11:13.963>or <00:11:14.079>something

00:11:14.990 --> 00:11:15.000 align:start position:0%
<00:11:14.990>storage <00:11:14.991>underneath <00:11:14.993>with <00:11:14.995>S3 <00:11:14.997>or <00:11:14.999>something

00:11:15.000 --> 00:11:16.030 align:start position:0%
<00:11:15.000>storage <00:11:15.132>underneath <00:11:15.264>with <00:11:15.397>S3 <00:11:15.529>or <00:11:15.662>something <00:11:15.794>like <00:11:15.927>this.

00:11:16.030 --> 00:11:16.040 align:start position:0%
<00:11:16.030>like <00:11:16.039>this.

00:11:16.040 --> 00:11:18.470 align:start position:0%
<00:11:16.040>like <00:11:16.273>this. <00:11:16.506>And <00:11:16.740>in <00:11:16.973>this <00:11:17.206>transaction <00:11:17.439>log,

00:11:18.470 --> 00:11:18.480 align:start position:0%
<00:11:18.470>And <00:11:18.472>in <00:11:18.474>this <00:11:18.476>transaction <00:11:18.479>log,

00:11:18.480 --> 00:11:21.350 align:start position:0%
<00:11:18.480>And <00:11:18.620>in <00:11:18.760>this <00:11:18.900>transaction <00:11:19.040>log, <00:11:19.180>they <00:11:19.320>store <00:11:19.460>the <00:11:19.600>commits, <00:11:19.740>every <00:11:19.880>change

00:11:21.350 --> 00:11:21.360 align:start position:0%
<00:11:21.350>they <00:11:21.351>store <00:11:21.353>the <00:11:21.355>commits, <00:11:21.357>every <00:11:21.359>change

00:11:21.360 --> 00:11:24.310 align:start position:0%
<00:11:21.360>they <00:11:21.476>store <00:11:21.593>the <00:11:21.710>commits, <00:11:21.826>every <00:11:21.943>change <00:11:22.060>that <00:11:22.176>has <00:11:22.293>been <00:11:22.410>made <00:11:22.526>to <00:11:22.643>this <00:11:22.760>Delta

00:11:24.310 --> 00:11:24.320 align:start position:0%
<00:11:24.310>that <00:11:24.311>has <00:11:24.313>been <00:11:24.314>made <00:11:24.316>to <00:11:24.317>this <00:11:24.319>Delta

00:11:24.320 --> 00:11:28.070 align:start position:0%
<00:11:24.320>that <00:11:24.427>has <00:11:24.535>been <00:11:24.643>made <00:11:24.750>to <00:11:24.858>this <00:11:24.966>Delta <00:11:25.073>table <00:11:25.181>or <00:11:25.289>Delta <00:11:25.396>file. <00:11:25.504>So <00:11:25.612>basically, <00:11:25.720>this

00:11:28.070 --> 00:11:28.080 align:start position:0%
<00:11:28.070>table <00:11:28.071>or <00:11:28.073>Delta <00:11:28.074>file. <00:11:28.076>So <00:11:28.077>basically, <00:11:28.079>this

00:11:28.080 --> 00:11:31.030 align:start position:0%
<00:11:28.080>table <00:11:28.187>or <00:11:28.295>Delta <00:11:28.403>file. <00:11:28.510>So <00:11:28.618>basically, <00:11:28.726>this <00:11:28.833>whole <00:11:28.941>directory <00:11:29.049>my <00:11:29.156>table <00:11:29.264>is <00:11:29.372>considered <00:11:29.480>a

00:11:31.030 --> 00:11:31.040 align:start position:0%
<00:11:31.030>whole <00:11:31.031>directory <00:11:31.033>my <00:11:31.034>table <00:11:31.036>is <00:11:31.037>considered <00:11:31.039>a

00:11:31.040 --> 00:11:33.670 align:start position:0%
<00:11:31.040>whole <00:11:31.167>directory <00:11:31.294>my <00:11:31.421>table <00:11:31.549>is <00:11:31.676>considered <00:11:31.803>a <00:11:31.930>Delta <00:11:32.058>file <00:11:32.185>or <00:11:32.312>delta <00:11:32.439>table

00:11:33.670 --> 00:11:33.680 align:start position:0%
<00:11:33.670>Delta <00:11:33.672>file <00:11:33.674>or <00:11:33.676>delta <00:11:33.679>table

00:11:33.680 --> 00:11:36.790 align:start position:0%
<00:11:33.680>Delta <00:11:33.835>file <00:11:33.991>or <00:11:34.146>delta <00:11:34.302>table <00:11:34.457>consisting <00:11:34.613>of <00:11:34.768>multiple <00:11:34.924>small <00:11:35.079>files.

00:11:36.790 --> 00:11:36.800 align:start position:0%
<00:11:36.790>consisting <00:11:36.792>of <00:11:36.794>multiple <00:11:36.796>small <00:11:36.799>files.

00:11:36.800 --> 00:11:37.870 align:start position:0%
<00:11:36.800>consisting <00:11:36.960>of <00:11:37.121>multiple <00:11:37.281>small <00:11:37.442>files. <00:11:37.602>In <00:11:37.763>those

00:11:37.870 --> 00:11:37.880 align:start position:0%
<00:11:37.870>In <00:11:37.879>those

00:11:37.880 --> 00:11:39.910 align:start position:0%
<00:11:37.880>In <00:11:38.035>those <00:11:38.191>logs, <00:11:38.346>this <00:11:38.502>is <00:11:38.657>what <00:11:38.813>is <00:11:38.968>stored <00:11:39.124>there. <00:11:39.280>So,

00:11:39.910 --> 00:11:39.920 align:start position:0%
<00:11:39.910>logs, <00:11:39.911>this <00:11:39.912>is <00:11:39.913>what <00:11:39.915>is <00:11:39.916>stored <00:11:39.917>there. <00:11:39.919>So,

00:11:39.920 --> 00:11:41.790 align:start position:0%
<00:11:39.920>logs, <00:11:40.013>this <00:11:40.106>is <00:11:40.199>what <00:11:40.293>is <00:11:40.386>stored <00:11:40.479>there. <00:11:40.573>So, <00:11:40.666>there <00:11:40.760>was <00:11:40.853>an <00:11:40.946>operation <00:11:41.040>once <00:11:41.133>that <00:11:41.226>was <00:11:41.319>an

00:11:41.790 --> 00:11:41.800 align:start position:0%
<00:11:41.790>there <00:11:41.791>was <00:11:41.792>an <00:11:41.793>operation <00:11:41.795>once <00:11:41.796>that <00:11:41.797>was <00:11:41.799>an

00:11:41.800 --> 00:11:43.350 align:start position:0%
<00:11:41.800>there <00:11:41.954>was <00:11:42.110>an <00:11:42.265>operation <00:11:42.420>once <00:11:42.575>that <00:11:42.730>was <00:11:42.885>an <00:11:43.040>add <00:11:43.195>operation.

00:11:43.350 --> 00:11:43.360 align:start position:0%
<00:11:43.350>add <00:11:43.359>operation.

00:11:43.360 --> 00:11:44.670 align:start position:0%
<00:11:43.360>add <00:11:43.949>operation. <00:11:44.539>This

00:11:44.670 --> 00:11:44.680 align:start position:0%
This

00:11:44.680 --> 00:11:46.150 align:start position:0%
<00:11:44.680>This <00:11:44.845>data <00:11:45.010>was <00:11:45.176>added. <00:11:45.341>As <00:11:45.506>you <00:11:45.672>see, <00:11:45.837>it's <00:11:46.002>in

00:11:46.150 --> 00:11:46.160 align:start position:0%
<00:11:46.150>data <00:11:46.151>was <00:11:46.152>added. <00:11:46.153>As <00:11:46.155>you <00:11:46.156>see, <00:11:46.157>it's <00:11:46.159>in

00:11:46.160 --> 00:11:48.790 align:start position:0%
<00:11:46.160>data <00:11:46.267>was <00:11:46.375>added. <00:11:46.483>As <00:11:46.590>you <00:11:46.698>see, <00:11:46.806>it's <00:11:46.913>in <00:11:47.021>parquet <00:11:47.129>file <00:11:47.236>compressed <00:11:47.344>as <00:11:47.452>snappy. <00:11:47.560>It's

00:11:48.790 --> 00:11:48.800 align:start position:0%
<00:11:48.790>parquet <00:11:48.791>file <00:11:48.793>compressed <00:11:48.795>as <00:11:48.797>snappy. <00:11:48.799>It's

00:11:48.800 --> 00:11:50.750 align:start position:0%
<00:11:48.800>parquet <00:11:48.907>file <00:11:49.015>compressed <00:11:49.123>as <00:11:49.230>snappy. <00:11:49.338>It's <00:11:49.446>a <00:11:49.553>partial <00:11:49.661>file, <00:11:49.769>so <00:11:49.876>it's <00:11:49.984>not <00:11:50.092>really <00:11:50.199>like

00:11:50.750 --> 00:11:50.760 align:start position:0%
<00:11:50.750>a <00:11:50.751>partial <00:11:50.752>file, <00:11:50.753>so <00:11:50.755>it's <00:11:50.756>not <00:11:50.757>really <00:11:50.759>like

00:11:50.760 --> 00:11:52.710 align:start position:0%
<00:11:50.760>a <00:11:50.847>partial <00:11:50.935>file, <00:11:51.022>so <00:11:51.110>it's <00:11:51.197>not <00:11:51.285>really <00:11:51.372>like <00:11:51.460>this <00:11:51.547>is <00:11:51.635>the <00:11:51.722>data <00:11:51.810>now, <00:11:51.897>but <00:11:51.985>hey, <00:11:52.072>here's <00:11:52.160>a

00:11:52.710 --> 00:11:52.720 align:start position:0%
<00:11:52.710>this <00:11:52.711>is <00:11:52.712>the <00:11:52.713>data <00:11:52.714>now, <00:11:52.715>but <00:11:52.716>hey, <00:11:52.717>here's <00:11:52.719>a

00:11:52.720 --> 00:11:55.030 align:start position:0%
<00:11:52.720>this <00:11:52.813>is <00:11:52.906>the <00:11:53.000>data <00:11:53.093>now, <00:11:53.186>but <00:11:53.280>hey, <00:11:53.373>here's <00:11:53.466>a <00:11:53.560>part, <00:11:53.653>here's <00:11:53.746>another <00:11:53.840>part. <00:11:53.933>Um <00:11:54.026>this <00:11:54.120>is

00:11:55.030 --> 00:11:55.040 align:start position:0%
<00:11:55.030>part, <00:11:55.031>here's <00:11:55.033>another <00:11:55.034>part. <00:11:55.036>Um <00:11:55.037>this <00:11:55.039>is

00:11:55.040 --> 00:11:57.750 align:start position:0%
<00:11:55.040>part, <00:11:55.156>here's <00:11:55.273>another <00:11:55.390>part. <00:11:55.506>Um <00:11:55.623>this <00:11:55.740>is <00:11:55.856>side <00:11:55.973>modification, <00:11:56.089>and <00:11:56.206>it's <00:11:56.323>some <00:11:56.439>status

00:11:57.750 --> 00:11:57.760 align:start position:0%
<00:11:57.750>side <00:11:57.751>modification, <00:11:57.753>and <00:11:57.755>it's <00:11:57.757>some <00:11:57.759>status

00:11:57.760 --> 00:12:00.230 align:start position:0%
<00:11:57.760>side <00:11:57.867>modification, <00:11:57.975>and <00:11:58.083>it's <00:11:58.190>some <00:11:58.298>status <00:11:58.406>and <00:11:58.513>min <00:11:58.621>max <00:11:58.729>values <00:11:58.836>null <00:11:58.944>counts. <00:11:59.052>So, <00:11:59.160>it's

00:12:00.230 --> 00:12:00.240 align:start position:0%
<00:12:00.230>and <00:12:00.231>min <00:12:00.232>max <00:12:00.233>values <00:12:00.235>null <00:12:00.236>counts. <00:12:00.237>So, <00:12:00.239>it's

00:12:00.240 --> 00:12:02.070 align:start position:0%
<00:12:00.240>and <00:12:00.380>min <00:12:00.520>max <00:12:00.660>values <00:12:00.800>null <00:12:00.940>counts. <00:12:01.080>So, <00:12:01.220>it's <00:12:01.360>add <00:12:01.500>statistics <00:12:01.640>again.

00:12:02.070 --> 00:12:02.080 align:start position:0%
<00:12:02.070>add <00:12:02.074>statistics <00:12:02.079>again.

00:12:02.080 --> 00:12:04.150 align:start position:0%
<00:12:02.080>add <00:12:02.220>statistics <00:12:02.360>again. <00:12:02.500>So, <00:12:02.640>it <00:12:02.780>also <00:12:02.920>has <00:12:03.060>statistics <00:12:03.200>the <00:12:03.340>same <00:12:03.480>as

00:12:04.150 --> 00:12:04.160 align:start position:0%
<00:12:04.150>So, <00:12:04.151>it <00:12:04.152>also <00:12:04.153>has <00:12:04.155>statistics <00:12:04.156>the <00:12:04.157>same <00:12:04.159>as

00:12:04.160 --> 00:12:06.630 align:start position:0%
<00:12:04.160>So, <00:12:04.276>it <00:12:04.393>also <00:12:04.510>has <00:12:04.626>statistics <00:12:04.743>the <00:12:04.860>same <00:12:04.976>as <00:12:05.093>parquet <00:12:05.209>has <00:12:05.326>statistics, <00:12:05.443>more <00:12:05.560>statistics

00:12:06.630 --> 00:12:06.640 align:start position:0%
<00:12:06.630>parquet <00:12:06.632>has <00:12:06.634>statistics, <00:12:06.636>more <00:12:06.639>statistics

00:12:06.640 --> 00:12:08.910 align:start position:0%
<00:12:06.640>parquet <00:12:06.814>has <00:12:06.990>statistics, <00:12:07.165>more <00:12:07.340>statistics <00:12:07.515>on <00:12:07.689>the <00:12:07.865>delta <00:12:08.040>side.

00:12:08.910 --> 00:12:08.920 align:start position:0%
<00:12:08.910>on <00:12:08.913>the <00:12:08.915>delta <00:12:08.919>side.

00:12:08.920 --> 00:12:11.830 align:start position:0%
<00:12:08.920>on <00:12:09.027>the <00:12:09.135>delta <00:12:09.243>side. <00:12:09.350>What <00:12:09.458>is <00:12:09.566>this <00:12:09.673>used <00:12:09.781>for? <00:12:09.889>If <00:12:09.996>you <00:12:10.104>read <00:12:10.212>now <00:12:10.319>a

00:12:11.830 --> 00:12:11.840 align:start position:0%
<00:12:11.830>What <00:12:11.831>is <00:12:11.832>this <00:12:11.833>used <00:12:11.834>for? <00:12:11.835>If <00:12:11.836>you <00:12:11.837>read <00:12:11.838>now <00:12:11.839>a

00:12:11.840 --> 00:12:14.950 align:start position:0%
<00:12:11.840>What <00:12:11.922>is <00:12:12.004>this <00:12:12.087>used <00:12:12.169>for? <00:12:12.251>If <00:12:12.334>you <00:12:12.416>read <00:12:12.498>now <00:12:12.581>a <00:12:12.663>delta <00:12:12.745>table <00:12:12.828>or <00:12:12.910>a <00:12:12.992>delta <00:12:13.075>folder, <00:12:13.157>um <00:12:13.240>it

00:12:14.950 --> 00:12:14.960 align:start position:0%
<00:12:14.950>delta <00:12:14.951>table <00:12:14.952>or <00:12:14.953>a <00:12:14.955>delta <00:12:14.956>folder, <00:12:14.957>um <00:12:14.959>it

00:12:14.960 --> 00:12:17.550 align:start position:0%
<00:12:14.960>delta <00:12:15.060>table <00:12:15.160>or <00:12:15.260>a <00:12:15.360>delta <00:12:15.460>folder, <00:12:15.560>um <00:12:15.660>it <00:12:15.760>looks <00:12:15.860>into <00:12:15.960>these <00:12:16.060>commit <00:12:16.160>log <00:12:16.260>and <00:12:16.360>knows

00:12:17.550 --> 00:12:17.560 align:start position:0%
<00:12:17.550>looks <00:12:17.551>into <00:12:17.553>these <00:12:17.554>commit <00:12:17.555>log <00:12:17.557>and <00:12:17.559>knows

00:12:17.560 --> 00:12:19.510 align:start position:0%
<00:12:17.560>looks <00:12:17.660>into <00:12:17.760>these <00:12:17.859>commit <00:12:17.959>log <00:12:18.060>and <00:12:18.160>knows <00:12:18.260>hey, <00:12:18.359>it <00:12:18.459>uses <00:12:18.560>these <00:12:18.660>min <00:12:18.760>and <00:12:18.859>max <00:12:18.959>values

00:12:19.510 --> 00:12:19.520 align:start position:0%
<00:12:19.510>hey, <00:12:19.511>it <00:12:19.512>uses <00:12:19.513>these <00:12:19.515>min <00:12:19.516>and <00:12:19.517>max <00:12:19.519>values

00:12:19.520 --> 00:12:22.270 align:start position:0%
<00:12:19.520>hey, <00:12:19.620>it <00:12:19.720>uses <00:12:19.819>these <00:12:19.920>min <00:12:20.020>and <00:12:20.120>max <00:12:20.220>values <00:12:20.319>again <00:12:20.420>to <00:12:20.520>filter <00:12:20.620>whole <00:12:20.720>parquet <00:12:20.819>files, <00:12:20.920>not

00:12:22.270 --> 00:12:22.280 align:start position:0%
<00:12:22.270>again <00:12:22.271>to <00:12:22.273>filter <00:12:22.274>whole <00:12:22.276>parquet <00:12:22.277>files, <00:12:22.279>not

00:12:22.280 --> 00:12:23.870 align:start position:0%
<00:12:22.280>again <00:12:22.380>to <00:12:22.480>filter <00:12:22.579>whole <00:12:22.680>parquet <00:12:22.780>files, <00:12:22.880>not <00:12:22.980>only <00:12:23.079>to <00:12:23.180>filter <00:12:23.280>row <00:12:23.380>groups, <00:12:23.480>but <00:12:23.579>now <00:12:23.680>we

00:12:23.870 --> 00:12:23.880 align:start position:0%
<00:12:23.870>only <00:12:23.871>to <00:12:23.872>filter <00:12:23.873>row <00:12:23.875>groups, <00:12:23.876>but <00:12:23.877>now <00:12:23.879>we

00:12:23.880 --> 00:12:25.510 align:start position:0%
<00:12:23.880>only <00:12:23.987>to <00:12:24.095>filter <00:12:24.203>row <00:12:24.310>groups, <00:12:24.418>but <00:12:24.526>now <00:12:24.633>we <00:12:24.741>filter <00:12:24.849>whole <00:12:24.956>parquet <00:12:25.064>files <00:12:25.172>with <00:12:25.280>this

00:12:25.510 --> 00:12:25.520 align:start position:0%
<00:12:25.510>filter <00:12:25.511>whole <00:12:25.513>parquet <00:12:25.515>files <00:12:25.517>with <00:12:25.519>this

00:12:25.520 --> 00:12:27.270 align:start position:0%
<00:12:25.520>filter <00:12:25.753>whole <00:12:25.986>parquet <00:12:26.220>files <00:12:26.453>with <00:12:26.686>this <00:12:26.920>information.

00:12:27.270 --> 00:12:27.280 align:start position:0%
information.

00:12:27.280 --> 00:12:29.910 align:start position:0%
<00:12:27.280>information. <00:12:27.480>So, <00:12:27.680>delta <00:12:27.880>follows <00:12:28.079>the <00:12:28.280>line <00:12:28.480>of <00:12:28.680>a

00:12:29.910 --> 00:12:29.920 align:start position:0%
<00:12:29.910>So, <00:12:29.911>delta <00:12:29.913>follows <00:12:29.914>the <00:12:29.915>line <00:12:29.917>of <00:12:29.919>a

00:12:29.920 --> 00:12:31.910 align:start position:0%
<00:12:29.920>So, <00:12:30.094>delta <00:12:30.270>follows <00:12:30.444>the <00:12:30.620>line <00:12:30.795>of <00:12:30.969>a <00:12:31.145>transaction <00:12:31.319>log.

00:12:31.910 --> 00:12:31.920 align:start position:0%
<00:12:31.910>transaction <00:12:31.919>log.

00:12:31.920 --> 00:12:35.310 align:start position:0%
<00:12:31.920>transaction <00:12:32.075>log. <00:12:32.231>And <00:12:32.386>Iceberg <00:12:32.542>is <00:12:32.697>using <00:12:32.853>metadata <00:12:33.008>to <00:12:33.164>do <00:12:33.319>so.

00:12:35.310 --> 00:12:35.320 align:start position:0%
<00:12:35.310>And <00:12:35.311>Iceberg <00:12:35.312>is <00:12:35.313>using <00:12:35.315>metadata <00:12:35.316>to <00:12:35.317>do <00:12:35.319>so.

00:12:35.320 --> 00:12:37.829 align:start position:0%
<00:12:35.320>And <00:12:35.427>Iceberg <00:12:35.535>is <00:12:35.643>using <00:12:35.750>metadata <00:12:35.858>to <00:12:35.966>do <00:12:36.073>so. <00:12:36.181>Seems <00:12:36.289>really <00:12:36.396>complicated <00:12:36.504>in <00:12:36.612>this <00:12:36.720>case.

00:12:37.829 --> 00:12:37.839 align:start position:0%
<00:12:37.829>Seems <00:12:37.830>really <00:12:37.832>complicated <00:12:37.834>in <00:12:37.836>this <00:12:37.838>case.

00:12:37.839 --> 00:12:40.110 align:start position:0%
<00:12:37.839>Seems <00:12:38.039>really <00:12:38.238>complicated <00:12:38.439>in <00:12:38.638>this <00:12:38.839>case. <00:12:39.039>Um <00:12:39.238>but

00:12:40.110 --> 00:12:40.120 align:start position:0%
<00:12:40.110>Um <00:12:40.119>but

00:12:40.120 --> 00:12:42.030 align:start position:0%
<00:12:40.120>Um <00:12:40.260>but <00:12:40.400>if <00:12:40.540>you <00:12:40.680>look <00:12:40.820>in <00:12:40.960>this, <00:12:41.100>we <00:12:41.240>have <00:12:41.380>the <00:12:41.520>delta

00:12:42.030 --> 00:12:42.040 align:start position:0%
<00:12:42.030>if <00:12:42.031>you <00:12:42.032>look <00:12:42.033>in <00:12:42.034>this, <00:12:42.035>we <00:12:42.036>have <00:12:42.037>the <00:12:42.039>delta

00:12:42.040 --> 00:12:43.590 align:start position:0%
<00:12:42.040>if <00:12:42.132>you <00:12:42.226>look <00:12:42.319>in <00:12:42.412>this, <00:12:42.505>we <00:12:42.598>have <00:12:42.691>the <00:12:42.784>delta <00:12:42.877>files <00:12:42.970>a <00:12:43.063>data <00:12:43.156>files <00:12:43.249>again <00:12:43.342>where <00:12:43.435>the

00:12:43.590 --> 00:12:43.600 align:start position:0%
<00:12:43.590>files <00:12:43.591>a <00:12:43.593>data <00:12:43.594>files <00:12:43.596>again <00:12:43.597>where <00:12:43.599>the

00:12:43.600 --> 00:12:45.990 align:start position:0%
<00:12:43.600>files <00:12:43.707>a <00:12:43.815>data <00:12:43.923>files <00:12:44.030>again <00:12:44.138>where <00:12:44.246>the <00:12:44.353>actual <00:12:44.461>data <00:12:44.569>is <00:12:44.676>stored. <00:12:44.784>This <00:12:44.892>is <00:12:45.000>still

00:12:45.990 --> 00:12:46.000 align:start position:0%
<00:12:45.990>actual <00:12:45.991>data <00:12:45.993>is <00:12:45.994>stored. <00:12:45.996>This <00:12:45.997>is <00:12:45.999>still

00:12:46.000 --> 00:12:47.190 align:start position:0%
<00:12:46.000>actual <00:12:46.153>data <00:12:46.306>is <00:12:46.459>stored. <00:12:46.612>This <00:12:46.765>is <00:12:46.918>still <00:12:47.071>parquet.

00:12:47.190 --> 00:12:47.200 align:start position:0%
parquet.

00:12:47.200 --> 00:12:49.550 align:start position:0%
<00:12:47.200>parquet. <00:12:47.400>Surprise, <00:12:47.600>we <00:12:47.800>always <00:12:48.000>do <00:12:48.200>parquet. <00:12:48.400>And <00:12:48.600>then

00:12:49.550 --> 00:12:49.560 align:start position:0%
<00:12:49.550>Surprise, <00:12:49.551>we <00:12:49.553>always <00:12:49.554>do <00:12:49.555>parquet. <00:12:49.557>And <00:12:49.559>then

00:12:49.560 --> 00:12:53.670 align:start position:0%
<00:12:49.560>Surprise, <00:12:49.676>we <00:12:49.793>always <00:12:49.910>do <00:12:50.026>parquet. <00:12:50.143>And <00:12:50.260>then <00:12:50.376>we <00:12:50.493>have <00:12:50.609>multiple <00:12:50.726>metadata <00:12:50.843>files. <00:12:50.959>Um

00:12:53.670 --> 00:12:53.680 align:start position:0%
<00:12:53.670>we <00:12:53.671>have <00:12:53.673>multiple <00:12:53.675>metadata <00:12:53.677>files. <00:12:53.679>Um

00:12:53.680 --> 00:12:55.590 align:start position:0%
<00:12:53.680>we <00:12:53.787>have <00:12:53.895>multiple <00:12:54.003>metadata <00:12:54.110>files. <00:12:54.218>Um <00:12:54.326>and <00:12:54.433>every <00:12:54.541>time <00:12:54.649>you <00:12:54.756>put <00:12:54.864>something <00:12:54.972>new <00:12:55.079>in

00:12:55.590 --> 00:12:55.600 align:start position:0%
<00:12:55.590>and <00:12:55.591>every <00:12:55.592>time <00:12:55.593>you <00:12:55.595>put <00:12:55.596>something <00:12:55.597>new <00:12:55.599>in

00:12:55.600 --> 00:12:58.150 align:start position:0%
<00:12:55.600>and <00:12:55.700>every <00:12:55.800>time <00:12:55.900>you <00:12:56.000>put <00:12:56.100>something <00:12:56.200>new <00:12:56.300>in <00:12:56.400>this, <00:12:56.500>there's <00:12:56.600>a <00:12:56.700>new <00:12:56.800>metadata <00:12:56.900>file <00:12:57.000>that

00:12:58.150 --> 00:12:58.160 align:start position:0%
<00:12:58.150>this, <00:12:58.151>there's <00:12:58.153>a <00:12:58.154>new <00:12:58.156>metadata <00:12:58.157>file <00:12:58.159>that

00:12:58.160 --> 00:13:00.310 align:start position:0%
<00:12:58.160>this, <00:12:58.260>there's <00:12:58.360>a <00:12:58.459>new <00:12:58.560>metadata <00:12:58.660>file <00:12:58.760>that <00:12:58.860>it <00:12:58.959>gets <00:12:59.060>created <00:12:59.160>and <00:12:59.260>a <00:12:59.360>new <00:12:59.459>snapshot <00:12:59.560>is

00:13:00.310 --> 00:13:00.320 align:start position:0%
<00:13:00.310>it <00:13:00.311>gets <00:13:00.312>created <00:13:00.313>and <00:13:00.315>a <00:13:00.316>new <00:13:00.317>snapshot <00:13:00.319>is

00:13:00.320 --> 00:13:02.430 align:start position:0%
<00:13:00.320>it <00:13:00.420>gets <00:13:00.520>created <00:13:00.620>and <00:13:00.720>a <00:13:00.820>new <00:13:00.920>snapshot <00:13:01.020>is <00:13:01.120>created. <00:13:01.220>This <00:13:01.320>one <00:13:01.420>is <00:13:01.520>snapshot <00:13:01.620>zero, <00:13:01.720>and

00:13:02.430 --> 00:13:02.440 align:start position:0%
<00:13:02.430>created. <00:13:02.431>This <00:13:02.433>one <00:13:02.434>is <00:13:02.436>snapshot <00:13:02.437>zero, <00:13:02.439>and

00:13:02.440 --> 00:13:04.910 align:start position:0%
<00:13:02.440>created. <00:13:02.540>This <00:13:02.640>one <00:13:02.740>is <00:13:02.840>snapshot <00:13:02.940>zero, <00:13:03.040>and <00:13:03.140>then <00:13:03.240>we <00:13:03.340>have <00:13:03.440>a <00:13:03.540>manifest <00:13:03.640>uh <00:13:03.740>list <00:13:03.840>and

00:13:04.910 --> 00:13:04.920 align:start position:0%
<00:13:04.910>then <00:13:04.911>we <00:13:04.912>have <00:13:04.913>a <00:13:04.915>manifest <00:13:04.916>uh <00:13:04.917>list <00:13:04.919>and

00:13:04.920 --> 00:13:06.950 align:start position:0%
<00:13:04.920>then <00:13:05.036>we <00:13:05.153>have <00:13:05.270>a <00:13:05.386>manifest <00:13:05.503>uh <00:13:05.620>list <00:13:05.736>and <00:13:05.853>manifest <00:13:05.969>files <00:13:06.086>which <00:13:06.203>further <00:13:06.319>cascaded

00:13:06.950 --> 00:13:06.960 align:start position:0%
<00:13:06.950>manifest <00:13:06.952>files <00:13:06.954>which <00:13:06.956>further <00:13:06.959>cascaded

00:13:06.960 --> 00:13:09.230 align:start position:0%
<00:13:06.960>manifest <00:13:07.067>files <00:13:07.175>which <00:13:07.283>further <00:13:07.390>cascaded <00:13:07.498>down <00:13:07.606>and <00:13:07.713>then <00:13:07.821>link <00:13:07.929>to <00:13:08.036>data <00:13:08.144>files. <00:13:08.252>And <00:13:08.360>if

00:13:09.230 --> 00:13:09.240 align:start position:0%
<00:13:09.230>down <00:13:09.231>and <00:13:09.232>then <00:13:09.233>link <00:13:09.234>to <00:13:09.235>data <00:13:09.236>files. <00:13:09.237>And <00:13:09.239>if

00:13:09.240 --> 00:13:11.350 align:start position:0%
<00:13:09.240>down <00:13:09.322>and <00:13:09.404>then <00:13:09.487>link <00:13:09.569>to <00:13:09.651>data <00:13:09.734>files. <00:13:09.816>And <00:13:09.898>if <00:13:09.981>you <00:13:10.063>add <00:13:10.145>new <00:13:10.228>data, <00:13:10.310>then <00:13:10.392>you <00:13:10.475>have <00:13:10.557>a <00:13:10.640>new

00:13:11.350 --> 00:13:11.360 align:start position:0%
<00:13:11.350>you <00:13:11.351>add <00:13:11.352>new <00:13:11.353>data, <00:13:11.354>then <00:13:11.355>you <00:13:11.356>have <00:13:11.357>a <00:13:11.359>new

00:13:11.360 --> 00:13:14.190 align:start position:0%
<00:13:11.360>you <00:13:11.447>add <00:13:11.535>new <00:13:11.622>data, <00:13:11.710>then <00:13:11.797>you <00:13:11.885>have <00:13:11.972>a <00:13:12.060>new <00:13:12.147>snapshot <00:13:12.235>file <00:13:12.322>um <00:13:12.410>and <00:13:12.497>a <00:13:12.585>new <00:13:12.672>manifest <00:13:12.760>file

00:13:14.190 --> 00:13:14.200 align:start position:0%
<00:13:14.190>snapshot <00:13:14.191>file <00:13:14.192>um <00:13:14.193>and <00:13:14.195>a <00:13:14.196>new <00:13:14.197>manifest <00:13:14.199>file

00:13:14.200 --> 00:13:16.310 align:start position:0%
<00:13:14.200>snapshot <00:13:14.300>file <00:13:14.400>um <00:13:14.500>and <00:13:14.600>a <00:13:14.700>new <00:13:14.800>manifest <00:13:14.900>file <00:13:15.000>is <00:13:15.100>created. <00:13:15.200>The <00:13:15.300>old <00:13:15.400>manifest <00:13:15.500>files <00:13:15.600>are

00:13:16.310 --> 00:13:16.320 align:start position:0%
<00:13:16.310>is <00:13:16.311>created. <00:13:16.313>The <00:13:16.314>old <00:13:16.316>manifest <00:13:16.317>files <00:13:16.319>are

00:13:16.320 --> 00:13:18.550 align:start position:0%
<00:13:16.320>is <00:13:16.427>created. <00:13:16.535>The <00:13:16.643>old <00:13:16.750>manifest <00:13:16.858>files <00:13:16.966>are <00:13:17.073>referenced <00:13:17.181>as <00:13:17.289>well, <00:13:17.396>and <00:13:17.504>new <00:13:17.612>data <00:13:17.720>files.

00:13:18.550 --> 00:13:18.560 align:start position:0%
<00:13:18.550>referenced <00:13:18.551>as <00:13:18.553>well, <00:13:18.554>and <00:13:18.555>new <00:13:18.557>data <00:13:18.559>files.

00:13:18.560 --> 00:13:20.670 align:start position:0%
<00:13:18.560>referenced <00:13:18.676>as <00:13:18.793>well, <00:13:18.910>and <00:13:19.026>new <00:13:19.143>data <00:13:19.260>files. <00:13:19.376>So, <00:13:19.493>basically <00:13:19.609>it <00:13:19.726>just <00:13:19.843>says, <00:13:19.959>"Hey,

00:13:20.670 --> 00:13:20.680 align:start position:0%
<00:13:20.670>So, <00:13:20.671>basically <00:13:20.673>it <00:13:20.675>just <00:13:20.677>says, <00:13:20.679>"Hey,

00:13:20.680 --> 00:13:23.430 align:start position:0%
<00:13:20.680>So, <00:13:20.787>basically <00:13:20.895>it <00:13:21.003>just <00:13:21.110>says, <00:13:21.218>"Hey, <00:13:21.326>this <00:13:21.433>is <00:13:21.541>the <00:13:21.649>data <00:13:21.756>that <00:13:21.864>belongs <00:13:21.972>um <00:13:22.079>into

00:13:23.430 --> 00:13:23.440 align:start position:0%
<00:13:23.430>this <00:13:23.431>is <00:13:23.432>the <00:13:23.433>data <00:13:23.435>that <00:13:23.436>belongs <00:13:23.437>um <00:13:23.439>into

00:13:23.440 --> 00:13:24.750 align:start position:0%
<00:13:23.440>this <00:13:23.571>is <00:13:23.702>the <00:13:23.833>data <00:13:23.964>that <00:13:24.095>belongs <00:13:24.226>um <00:13:24.357>into <00:13:24.488>this <00:13:24.619>table."

00:13:24.750 --> 00:13:24.760 align:start position:0%
<00:13:24.750>this <00:13:24.759>table."

00:13:24.760 --> 00:13:26.829 align:start position:0%
<00:13:24.760>this <00:13:24.935>table." <00:13:25.110>It's <00:13:25.285>not <00:13:25.460>stored <00:13:25.635>as <00:13:25.810>a <00:13:25.985>transaction <00:13:26.160>log

00:13:26.829 --> 00:13:26.839 align:start position:0%
<00:13:26.829>It's <00:13:26.830>not <00:13:26.832>stored <00:13:26.833>as <00:13:26.834>a <00:13:26.836>transaction <00:13:26.838>log

00:13:26.839 --> 00:13:28.590 align:start position:0%
<00:13:26.839>It's <00:13:26.946>not <00:13:27.054>stored <00:13:27.162>as <00:13:27.269>a <00:13:27.377>transaction <00:13:27.485>log <00:13:27.592>like <00:13:27.700>in <00:13:27.808>delta <00:13:27.915>where <00:13:28.023>each <00:13:28.131>transaction <00:13:28.238>is

00:13:28.590 --> 00:13:28.600 align:start position:0%
<00:13:28.590>like <00:13:28.591>in <00:13:28.593>delta <00:13:28.594>where <00:13:28.596>each <00:13:28.597>transaction <00:13:28.599>is

00:13:28.600 --> 00:13:30.790 align:start position:0%
<00:13:28.600>like <00:13:28.700>in <00:13:28.800>delta <00:13:28.900>where <00:13:29.000>each <00:13:29.100>transaction <00:13:29.200>is <00:13:29.300>this, <00:13:29.400>but <00:13:29.500>more <00:13:29.600>like <00:13:29.700>a <00:13:29.800>snapshot. <00:13:29.900>This <00:13:30.000>is

00:13:30.790 --> 00:13:30.800 align:start position:0%
<00:13:30.790>this, <00:13:30.791>but <00:13:30.792>more <00:13:30.793>like <00:13:30.795>a <00:13:30.796>snapshot. <00:13:30.797>This <00:13:30.799>is

00:13:30.800 --> 00:13:32.270 align:start position:0%
<00:13:30.800>this, <00:13:30.894>but <00:13:30.988>more <00:13:31.083>like <00:13:31.178>a <00:13:31.272>snapshot. <00:13:31.367>This <00:13:31.461>is <00:13:31.555>the <00:13:31.650>snapshot <00:13:31.745>then <00:13:31.839>an <00:13:31.934>addition <00:13:32.028>is <00:13:32.122>done.

00:13:32.270 --> 00:13:32.280 align:start position:0%
<00:13:32.270>the <00:13:32.271>snapshot <00:13:32.273>then <00:13:32.274>an <00:13:32.276>addition <00:13:32.277>is <00:13:32.279>done.

00:13:32.280 --> 00:13:33.790 align:start position:0%
<00:13:32.280>the <00:13:32.377>snapshot <00:13:32.474>then <00:13:32.571>an <00:13:32.668>addition <00:13:32.765>is <00:13:32.862>done. <00:13:32.959>This <00:13:33.056>is <00:13:33.153>the <00:13:33.250>snapshot. <00:13:33.347>This <00:13:33.444>is <00:13:33.541>the <00:13:33.639>data

00:13:33.790 --> 00:13:33.800 align:start position:0%
<00:13:33.790>This <00:13:33.791>is <00:13:33.792>the <00:13:33.793>snapshot. <00:13:33.795>This <00:13:33.796>is <00:13:33.797>the <00:13:33.799>data

00:13:33.800 --> 00:13:36.430 align:start position:0%
<00:13:33.800>This <00:13:33.927>is <00:13:34.054>the <00:13:34.181>snapshot. <00:13:34.309>This <00:13:34.436>is <00:13:34.563>the <00:13:34.690>data <00:13:34.818>we <00:13:34.945>have <00:13:35.072>in <00:13:35.199>it.

00:13:36.430 --> 00:13:36.440 align:start position:0%
<00:13:36.430>we <00:13:36.433>have <00:13:36.436>in <00:13:36.439>it.

00:13:36.440 --> 00:13:38.270 align:start position:0%
<00:13:36.440>we <00:13:36.567>have <00:13:36.694>in <00:13:36.821>it. <00:13:36.949>And <00:13:37.076>we <00:13:37.203>have <00:13:37.330>the <00:13:37.458>catalog, <00:13:37.585>and <00:13:37.712>I'm <00:13:37.840>coming

00:13:38.270 --> 00:13:38.280 align:start position:0%
<00:13:38.270>And <00:13:38.271>we <00:13:38.272>have <00:13:38.273>the <00:13:38.275>catalog, <00:13:38.276>and <00:13:38.277>I'm <00:13:38.279>coming

00:13:38.280 --> 00:13:43.430 align:start position:0%
<00:13:38.280>And <00:13:38.396>we <00:13:38.513>have <00:13:38.630>the <00:13:38.746>catalog, <00:13:38.863>and <00:13:38.980>I'm <00:13:39.096>coming <00:13:39.213>this <00:13:39.329>to <00:13:39.446>this <00:13:39.563>now. <00:13:39.680>So,

00:13:43.440 --> 00:13:45.710 align:start position:0%
<00:13:43.440>the <00:13:43.640>catalog <00:13:43.840>is <00:13:44.040>now <00:13:44.240>the <00:13:44.440>thing <00:13:44.640>that <00:13:44.840>comes

00:13:45.710 --> 00:13:45.720 align:start position:0%
<00:13:45.710>the <00:13:45.711>catalog <00:13:45.712>is <00:13:45.713>now <00:13:45.715>the <00:13:45.716>thing <00:13:45.717>that <00:13:45.719>comes

00:13:45.720 --> 00:13:47.030 align:start position:0%
<00:13:45.720>the <00:13:45.827>catalog <00:13:45.934>is <00:13:46.041>now <00:13:46.148>the <00:13:46.255>thing <00:13:46.363>that <00:13:46.470>comes <00:13:46.577>on <00:13:46.684>top <00:13:46.791>of <00:13:46.899>it.

00:13:47.030 --> 00:13:47.040 align:start position:0%
<00:13:47.030>on <00:13:47.033>top <00:13:47.036>of <00:13:47.039>it.

00:13:47.040 --> 00:13:49.710 align:start position:0%
<00:13:47.040>on <00:13:47.180>top <00:13:47.319>of <00:13:47.459>it. <00:13:47.599>Delta <00:13:47.740>and <00:13:47.880>Iceberg <00:13:48.020>is <00:13:48.160>basically <00:13:48.300>just <00:13:48.439>a

00:13:49.710 --> 00:13:49.720 align:start position:0%
<00:13:49.710>Delta <00:13:49.711>and <00:13:49.713>Iceberg <00:13:49.714>is <00:13:49.716>basically <00:13:49.717>just <00:13:49.719>a

00:13:49.720 --> 00:13:52.550 align:start position:0%
<00:13:49.720>Delta <00:13:49.820>and <00:13:49.920>Iceberg <00:13:50.020>is <00:13:50.120>basically <00:13:50.220>just <00:13:50.320>a <00:13:50.420>file <00:13:50.520>format <00:13:50.620>or <00:13:50.720>a <00:13:50.820>folder <00:13:50.920>format, <00:13:51.020>if <00:13:51.120>you

00:13:52.550 --> 00:13:52.560 align:start position:0%
<00:13:52.550>file <00:13:52.551>format <00:13:52.552>or <00:13:52.553>a <00:13:52.555>folder <00:13:52.556>format, <00:13:52.557>if <00:13:52.559>you

00:13:52.560 --> 00:13:53.950 align:start position:0%
<00:13:52.560>file <00:13:52.638>format <00:13:52.716>or <00:13:52.794>a <00:13:52.872>folder <00:13:52.950>format, <00:13:53.029>if <00:13:53.107>you <00:13:53.185>want <00:13:53.263>to, <00:13:53.341>because <00:13:53.420>most <00:13:53.498>of <00:13:53.576>the <00:13:53.654>time <00:13:53.732>it's <00:13:53.811>a

00:13:53.950 --> 00:13:53.960 align:start position:0%
<00:13:53.950>want <00:13:53.951>to, <00:13:53.952>because <00:13:53.953>most <00:13:53.954>of <00:13:53.955>the <00:13:53.956>time <00:13:53.957>it's <00:13:53.959>a

00:13:53.960 --> 00:13:55.670 align:start position:0%
<00:13:53.960>want <00:13:54.076>to, <00:13:54.193>because <00:13:54.310>most <00:13:54.426>of <00:13:54.543>the <00:13:54.660>time <00:13:54.776>it's <00:13:54.893>a <00:13:55.010>folder <00:13:55.126>that <00:13:55.243>is <00:13:55.360>stored.

00:13:55.670 --> 00:13:55.680 align:start position:0%
<00:13:55.670>folder <00:13:55.673>that <00:13:55.675>is <00:13:55.679>stored.

00:13:55.680 --> 00:13:58.110 align:start position:0%
<00:13:55.680>folder <00:13:55.854>that <00:13:56.030>is <00:13:56.204>stored. <00:13:56.380>What <00:13:56.555>doesn't <00:13:56.729>come <00:13:56.905>with <00:13:57.079>it

00:13:58.110 --> 00:13:58.120 align:start position:0%
<00:13:58.110>What <00:13:58.112>doesn't <00:13:58.114>come <00:13:58.116>with <00:13:58.119>it

00:13:58.120 --> 00:14:02.030 align:start position:0%
<00:13:58.120>What <00:13:58.260>doesn't <00:13:58.400>come <00:13:58.540>with <00:13:58.680>it <00:13:58.820>is <00:13:58.960>anything <00:13:59.100>that <00:13:59.240>makes <00:13:59.380>accessible <00:13:59.520>access

00:14:02.030 --> 00:14:02.040 align:start position:0%
<00:14:02.030>is <00:14:02.031>anything <00:14:02.033>that <00:14:02.035>makes <00:14:02.037>accessible <00:14:02.039>access

00:14:02.040 --> 00:14:05.310 align:start position:0%
<00:14:02.040>is <00:14:02.240>anything <00:14:02.439>that <00:14:02.640>makes <00:14:02.839>accessible <00:14:03.040>access <00:14:03.240>like <00:14:03.439>controllable.

00:14:05.310 --> 00:14:05.320 align:start position:0%
<00:14:05.310>like <00:14:05.319>controllable.

00:14:05.320 --> 00:14:07.910 align:start position:0%
<00:14:05.320>like <00:14:05.475>controllable. <00:14:05.631>There's <00:14:05.786>a <00:14:05.942>lot <00:14:06.097>of <00:14:06.253>tools <00:14:06.408>that <00:14:06.564>can <00:14:06.720>actually

00:14:07.910 --> 00:14:07.920 align:start position:0%
<00:14:07.910>There's <00:14:07.911>a <00:14:07.912>lot <00:14:07.913>of <00:14:07.915>tools <00:14:07.916>that <00:14:07.917>can <00:14:07.919>actually

00:14:07.920 --> 00:14:11.270 align:start position:0%
<00:14:07.920>There's <00:14:08.027>a <00:14:08.135>lot <00:14:08.243>of <00:14:08.350>tools <00:14:08.458>that <00:14:08.566>can <00:14:08.673>actually <00:14:08.781>read <00:14:08.889>a <00:14:08.996>Delta <00:14:09.104>or <00:14:09.212>Iceberg <00:14:09.319>files.

00:14:11.270 --> 00:14:11.280 align:start position:0%
<00:14:11.270>read <00:14:11.271>a <00:14:11.273>Delta <00:14:11.275>or <00:14:11.277>Iceberg <00:14:11.279>files.

00:14:11.280 --> 00:14:13.510 align:start position:0%
<00:14:11.280>read <00:14:11.387>a <00:14:11.495>Delta <00:14:11.603>or <00:14:11.710>Iceberg <00:14:11.818>files. <00:14:11.926>But <00:14:12.033>what <00:14:12.141>you <00:14:12.249>usually <00:14:12.356>also <00:14:12.464>want <00:14:12.572>is <00:14:12.680>you

00:14:13.510 --> 00:14:13.520 align:start position:0%
<00:14:13.510>But <00:14:13.511>what <00:14:13.512>you <00:14:13.513>usually <00:14:13.515>also <00:14:13.516>want <00:14:13.517>is <00:14:13.519>you

00:14:13.520 --> 00:14:16.790 align:start position:0%
<00:14:13.520>But <00:14:13.613>what <00:14:13.706>you <00:14:13.800>usually <00:14:13.893>also <00:14:13.986>want <00:14:14.079>is <00:14:14.173>you <00:14:14.266>want <00:14:14.360>access <00:14:14.453>control. <00:14:14.546>You <00:14:14.640>want <00:14:14.733>to <00:14:14.826>have <00:14:14.920>uh

00:14:16.790 --> 00:14:16.800 align:start position:0%
<00:14:16.790>want <00:14:16.791>access <00:14:16.792>control. <00:14:16.793>You <00:14:16.795>want <00:14:16.796>to <00:14:16.797>have <00:14:16.799>uh

00:14:16.800 --> 00:14:18.310 align:start position:0%
<00:14:16.800>want <00:14:16.904>access <00:14:17.009>control. <00:14:17.113>You <00:14:17.218>want <00:14:17.322>to <00:14:17.427>have <00:14:17.531>uh <00:14:17.636>credential <00:14:17.740>vending. <00:14:17.845>So, <00:14:17.949>for <00:14:18.054>instance, <00:14:18.159>if

00:14:18.310 --> 00:14:18.320 align:start position:0%
<00:14:18.310>credential <00:14:18.311>vending. <00:14:18.313>So, <00:14:18.315>for <00:14:18.317>instance, <00:14:18.319>if

00:14:18.320 --> 00:14:21.190 align:start position:0%
<00:14:18.320>credential <00:14:18.427>vending. <00:14:18.535>So, <00:14:18.643>for <00:14:18.750>instance, <00:14:18.858>if <00:14:18.966>someone <00:14:19.073>says, <00:14:19.181>"Hey, <00:14:19.289>I <00:14:19.396>want <00:14:19.504>to <00:14:19.612>read <00:14:19.720>this

00:14:21.190 --> 00:14:21.200 align:start position:0%
<00:14:21.190>someone <00:14:21.191>says, <00:14:21.192>"Hey, <00:14:21.193>I <00:14:21.195>want <00:14:21.196>to <00:14:21.197>read <00:14:21.199>this

00:14:21.200 --> 00:14:23.470 align:start position:0%
<00:14:21.200>someone <00:14:21.300>says, <00:14:21.400>"Hey, <00:14:21.500>I <00:14:21.600>want <00:14:21.700>to <00:14:21.800>read <00:14:21.900>this <00:14:22.000>table, <00:14:22.100>this <00:14:22.200>Delta <00:14:22.300>table, <00:14:22.400>or <00:14:22.500>this <00:14:22.600>Iceberg

00:14:23.470 --> 00:14:23.480 align:start position:0%
<00:14:23.470>table, <00:14:23.471>this <00:14:23.473>Delta <00:14:23.474>table, <00:14:23.476>or <00:14:23.477>this <00:14:23.479>Iceberg

00:14:23.480 --> 00:14:25.910 align:start position:0%
<00:14:23.480>table, <00:14:23.635>this <00:14:23.791>Delta <00:14:23.946>table, <00:14:24.102>or <00:14:24.257>this <00:14:24.413>Iceberg <00:14:24.568>table." <00:14:24.724>Um <00:14:24.880>then

00:14:25.910 --> 00:14:25.920 align:start position:0%
<00:14:25.910>table." <00:14:25.914>Um <00:14:25.919>then

00:14:25.920 --> 00:14:28.230 align:start position:0%
<00:14:25.920>table." <00:14:26.075>Um <00:14:26.231>then <00:14:26.386>you <00:14:26.542>basically <00:14:26.697>give <00:14:26.853>this <00:14:27.008>client <00:14:27.164>access <00:14:27.319>to

00:14:28.230 --> 00:14:28.240 align:start position:0%
<00:14:28.230>you <00:14:28.231>basically <00:14:28.233>give <00:14:28.234>this <00:14:28.236>client <00:14:28.237>access <00:14:28.239>to

00:14:28.240 --> 00:14:30.430 align:start position:0%
<00:14:28.240>you <00:14:28.356>basically <00:14:28.473>give <00:14:28.590>this <00:14:28.706>client <00:14:28.823>access <00:14:28.940>to <00:14:29.056>the <00:14:29.173>underlying <00:14:29.290>data <00:14:29.406>underneath. <00:14:29.523>And <00:14:29.640>this

00:14:30.430 --> 00:14:30.440 align:start position:0%
<00:14:30.430>the <00:14:30.431>underlying <00:14:30.433>data <00:14:30.435>underneath. <00:14:30.437>And <00:14:30.439>this

00:14:30.440 --> 00:14:32.430 align:start position:0%
<00:14:30.440>the <00:14:30.567>underlying <00:14:30.694>data <00:14:30.821>underneath. <00:14:30.949>And <00:14:31.076>this <00:14:31.203>is <00:14:31.330>done <00:14:31.458>by <00:14:31.585>so-called <00:14:31.712>credential <00:14:31.840>vending.

00:14:32.430 --> 00:14:32.440 align:start position:0%
<00:14:32.430>is <00:14:32.431>done <00:14:32.433>by <00:14:32.435>so-called <00:14:32.437>credential <00:14:32.439>vending.

00:14:32.440 --> 00:14:33.990 align:start position:0%
<00:14:32.440>is <00:14:32.556>done <00:14:32.672>by <00:14:32.788>so-called <00:14:32.905>credential <00:14:33.021>vending. <00:14:33.137>It <00:14:33.253>says, <00:14:33.370>"Hey, <00:14:33.486>okay, <00:14:33.602>you're <00:14:33.718>allowed <00:14:33.835>to

00:14:33.990 --> 00:14:34.000 align:start position:0%
<00:14:33.990>It <00:14:33.991>says, <00:14:33.993>"Hey, <00:14:33.994>okay, <00:14:33.996>you're <00:14:33.997>allowed <00:14:33.999>to

00:14:34.000 --> 00:14:36.630 align:start position:0%
<00:14:34.000>It <00:14:34.100>says, <00:14:34.200>"Hey, <00:14:34.300>okay, <00:14:34.400>you're <00:14:34.500>allowed <00:14:34.600>to <00:14:34.700>query <00:14:34.800>to <00:14:34.900>read <00:14:35.000>this <00:14:35.100>data. <00:14:35.200>The <00:14:35.300>catalog <00:14:35.400>has

00:14:36.630 --> 00:14:36.640 align:start position:0%
<00:14:36.630>query <00:14:36.631>to <00:14:36.632>read <00:14:36.633>this <00:14:36.635>data. <00:14:36.636>The <00:14:36.637>catalog <00:14:36.639>has

00:14:36.640 --> 00:14:39.590 align:start position:0%
<00:14:36.640>query <00:14:36.740>to <00:14:36.840>read <00:14:36.939>this <00:14:37.040>data. <00:14:37.140>The <00:14:37.240>catalog <00:14:37.340>has <00:14:37.439>the <00:14:37.540>control <00:14:37.640>over <00:14:37.740>this. <00:14:37.840>Um <00:14:37.939>here's <00:14:38.040>the

00:14:39.590 --> 00:14:39.600 align:start position:0%
<00:14:39.590>the <00:14:39.591>control <00:14:39.593>over <00:14:39.594>this. <00:14:39.596>Um <00:14:39.597>here's <00:14:39.599>the

00:14:39.600 --> 00:14:41.829 align:start position:0%
<00:14:39.600>the <00:14:39.707>control <00:14:39.815>over <00:14:39.923>this. <00:14:40.030>Um <00:14:40.138>here's <00:14:40.246>the <00:14:40.353>path <00:14:40.461>to <00:14:40.569>the <00:14:40.676>actual <00:14:40.784>parquet <00:14:40.892>files, <00:14:41.000>and

00:14:41.829 --> 00:14:41.839 align:start position:0%
<00:14:41.829>path <00:14:41.830>to <00:14:41.832>the <00:14:41.833>actual <00:14:41.834>parquet <00:14:41.836>files, <00:14:41.838>and

00:14:41.839 --> 00:14:43.110 align:start position:0%
<00:14:41.839>path <00:14:41.934>to <00:14:42.029>the <00:14:42.124>actual <00:14:42.220>parquet <00:14:42.315>files, <00:14:42.410>and <00:14:42.506>here's <00:14:42.601>the <00:14:42.696>credential <00:14:42.792>to <00:14:42.887>read <00:14:42.982>those

00:14:43.110 --> 00:14:43.120 align:start position:0%
<00:14:43.110>here's <00:14:43.111>the <00:14:43.113>credential <00:14:43.115>to <00:14:43.117>read <00:14:43.119>those

00:14:43.120 --> 00:14:45.390 align:start position:0%
<00:14:43.120>here's <00:14:43.260>the <00:14:43.400>credential <00:14:43.540>to <00:14:43.680>read <00:14:43.820>those <00:14:43.960>parquet <00:14:44.100>files. <00:14:44.240>Go <00:14:44.380>with <00:14:44.520>it."

00:14:45.390 --> 00:14:45.400 align:start position:0%
<00:14:45.390>parquet <00:14:45.392>files. <00:14:45.394>Go <00:14:45.396>with <00:14:45.399>it."

00:14:45.400 --> 00:14:48.550 align:start position:0%
<00:14:45.400>parquet <00:14:45.507>files. <00:14:45.615>Go <00:14:45.723>with <00:14:45.830>it." <00:14:45.938>So, <00:14:46.046>and <00:14:46.153>this <00:14:46.261>is <00:14:46.369>all <00:14:46.476>done <00:14:46.584>by <00:14:46.692>the <00:14:46.800>catalog.

00:14:48.550 --> 00:14:48.560 align:start position:0%
<00:14:48.550>So, <00:14:48.551>and <00:14:48.552>this <00:14:48.553>is <00:14:48.554>all <00:14:48.555>done <00:14:48.556>by <00:14:48.557>the <00:14:48.559>catalog.

00:14:48.560 --> 00:14:50.310 align:start position:0%
<00:14:48.560>So, <00:14:48.653>and <00:14:48.746>this <00:14:48.839>is <00:14:48.933>all <00:14:49.026>done <00:14:49.119>by <00:14:49.213>the <00:14:49.306>catalog. <00:14:49.400>And <00:14:49.493>this <00:14:49.586>is <00:14:49.680>currently <00:14:49.773>the <00:14:49.866>standard <00:14:49.959>where

00:14:50.310 --> 00:14:50.320 align:start position:0%
<00:14:50.310>And <00:14:50.311>this <00:14:50.313>is <00:14:50.314>currently <00:14:50.316>the <00:14:50.317>standard <00:14:50.319>where

00:14:50.320 --> 00:14:51.950 align:start position:0%
<00:14:50.320>And <00:14:50.495>this <00:14:50.670>is <00:14:50.845>currently <00:14:51.020>the <00:14:51.195>standard <00:14:51.370>where <00:14:51.545>everything <00:14:51.720>is

00:14:51.950 --> 00:14:51.960 align:start position:0%
<00:14:51.950>everything <00:14:51.959>is

00:14:51.960 --> 00:14:54.030 align:start position:0%
<00:14:51.960>everything <00:14:52.135>is <00:14:52.310>um <00:14:52.485>or <00:14:52.660>everybody's <00:14:52.835>working <00:14:53.010>on. <00:14:53.185>So, <00:14:53.360>we

00:14:54.030 --> 00:14:54.040 align:start position:0%
<00:14:54.030>um <00:14:54.031>or <00:14:54.033>everybody's <00:14:54.034>working <00:14:54.036>on. <00:14:54.037>So, <00:14:54.039>we

00:14:54.040 --> 00:14:56.350 align:start position:0%
<00:14:54.040>um <00:14:54.147>or <00:14:54.255>everybody's <00:14:54.363>working <00:14:54.470>on. <00:14:54.578>So, <00:14:54.686>we <00:14:54.793>have <00:14:54.901>data <00:14:55.009>stored <00:14:55.116>in <00:14:55.224>parquet. <00:14:55.332>We <00:14:55.439>have

00:14:56.350 --> 00:14:56.360 align:start position:0%
<00:14:56.350>have <00:14:56.351>data <00:14:56.353>stored <00:14:56.354>in <00:14:56.356>parquet. <00:14:56.357>We <00:14:56.359>have

00:14:56.360 --> 00:14:59.550 align:start position:0%
<00:14:56.360>have <00:14:56.476>data <00:14:56.593>stored <00:14:56.710>in <00:14:56.826>parquet. <00:14:56.943>We <00:14:57.060>have <00:14:57.176>metadata <00:14:57.293>stored <00:14:57.410>in <00:14:57.526>JSON <00:14:57.643>files, <00:14:57.760>Avro

00:14:59.550 --> 00:14:59.560 align:start position:0%
<00:14:59.550>metadata <00:14:59.551>stored <00:14:59.553>in <00:14:59.555>JSON <00:14:59.557>files, <00:14:59.559>Avro

00:14:59.560 --> 00:15:02.270 align:start position:0%
<00:14:59.560>metadata <00:14:59.667>stored <00:14:59.775>in <00:14:59.883>JSON <00:14:59.990>files, <00:15:00.098>Avro <00:15:00.206>files. <00:15:00.313>Um <00:15:00.421>and <00:15:00.529>then <00:15:00.636>we <00:15:00.744>have <00:15:00.852>this <00:15:00.959>catalog

00:15:02.270 --> 00:15:02.280 align:start position:0%
<00:15:02.270>files. <00:15:02.271>Um <00:15:02.272>and <00:15:02.273>then <00:15:02.275>we <00:15:02.276>have <00:15:02.277>this <00:15:02.279>catalog

00:15:02.280 --> 00:15:03.510 align:start position:0%
<00:15:02.280>files. <00:15:02.372>Um <00:15:02.464>and <00:15:02.556>then <00:15:02.649>we <00:15:02.741>have <00:15:02.833>this <00:15:02.925>catalog <00:15:03.018>layer <00:15:03.110>underneath, <00:15:03.202>and <00:15:03.294>you <00:15:03.387>usually

00:15:03.510 --> 00:15:03.520 align:start position:0%
<00:15:03.510>layer <00:15:03.512>underneath, <00:15:03.514>and <00:15:03.516>you <00:15:03.519>usually

00:15:03.520 --> 00:15:05.870 align:start position:0%
<00:15:03.520>layer <00:15:03.660>underneath, <00:15:03.800>and <00:15:03.939>you <00:15:04.079>usually <00:15:04.220>connect <00:15:04.360>through <00:15:04.500>this <00:15:04.640>catalog. <00:15:04.780>And <00:15:04.920>in

00:15:05.870 --> 00:15:05.880 align:start position:0%
<00:15:05.870>connect <00:15:05.871>through <00:15:05.873>this <00:15:05.875>catalog. <00:15:05.877>And <00:15:05.879>in

00:15:05.880 --> 00:15:08.270 align:start position:0%
<00:15:05.880>connect <00:15:05.996>through <00:15:06.113>this <00:15:06.230>catalog. <00:15:06.346>And <00:15:06.463>in <00:15:06.580>this <00:15:06.696>catalog, <00:15:06.813>you <00:15:06.930>don't <00:15:07.046>talk <00:15:07.163>about <00:15:07.280>files

00:15:08.270 --> 00:15:08.280 align:start position:0%
<00:15:08.270>this <00:15:08.271>catalog, <00:15:08.273>you <00:15:08.274>don't <00:15:08.276>talk <00:15:08.277>about <00:15:08.279>files

00:15:08.280 --> 00:15:10.190 align:start position:0%
<00:15:08.280>this <00:15:08.396>catalog, <00:15:08.513>you <00:15:08.630>don't <00:15:08.746>talk <00:15:08.863>about <00:15:08.980>files <00:15:09.096>anymore, <00:15:09.213>but <00:15:09.329>you <00:15:09.446>talk <00:15:09.563>about <00:15:09.680>tables,

00:15:10.190 --> 00:15:10.200 align:start position:0%
<00:15:10.190>anymore, <00:15:10.191>but <00:15:10.193>you <00:15:10.195>talk <00:15:10.197>about <00:15:10.199>tables,

00:15:10.200 --> 00:15:12.590 align:start position:0%
<00:15:10.200>anymore, <00:15:10.316>but <00:15:10.433>you <00:15:10.550>talk <00:15:10.666>about <00:15:10.783>tables, <00:15:10.900>which <00:15:11.016>are <00:15:11.133>then <00:15:11.250>backed <00:15:11.366>by <00:15:11.483>files. <00:15:11.600>Sounds

00:15:12.590 --> 00:15:12.600 align:start position:0%
<00:15:12.590>which <00:15:12.591>are <00:15:12.593>then <00:15:12.594>backed <00:15:12.596>by <00:15:12.597>files. <00:15:12.599>Sounds

00:15:12.600 --> 00:15:16.030 align:start position:0%
<00:15:12.600>which <00:15:12.716>are <00:15:12.833>then <00:15:12.950>backed <00:15:13.066>by <00:15:13.183>files. <00:15:13.300>Sounds <00:15:13.416>pretty <00:15:13.533>complicated. <00:15:13.650>Um <00:15:13.766>and <00:15:13.883>might <00:15:14.000>be

00:15:16.030 --> 00:15:16.040 align:start position:0%
<00:15:16.030>pretty <00:15:16.031>complicated. <00:15:16.033>Um <00:15:16.035>and <00:15:16.037>might <00:15:16.039>be

00:15:16.040 --> 00:15:18.310 align:start position:0%
<00:15:16.040>pretty <00:15:16.180>complicated. <00:15:16.319>Um <00:15:16.459>and <00:15:16.599>might <00:15:16.740>be <00:15:16.880>or <00:15:17.020>maybe <00:15:17.160>something <00:15:17.300>over-engineered <00:15:17.439>as

00:15:18.310 --> 00:15:18.320 align:start position:0%
<00:15:18.310>or <00:15:18.312>maybe <00:15:18.314>something <00:15:18.316>over-engineered <00:15:18.319>as

00:15:18.320 --> 00:15:20.190 align:start position:0%
<00:15:18.320>or <00:15:18.436>maybe <00:15:18.553>something <00:15:18.670>over-engineered <00:15:18.786>as <00:15:18.903>well. <00:15:19.020>And <00:15:19.136>I <00:15:19.253>would <00:15:19.370>say, <00:15:19.486>"Yeah, <00:15:19.603>it <00:15:19.720>might

00:15:20.190 --> 00:15:20.200 align:start position:0%
<00:15:20.190>well. <00:15:20.191>And <00:15:20.192>I <00:15:20.193>would <00:15:20.195>say, <00:15:20.196>"Yeah, <00:15:20.197>it <00:15:20.199>might

00:15:20.200 --> 00:15:21.430 align:start position:0%
<00:15:20.200>well. <00:15:20.273>And <00:15:20.347>I <00:15:20.421>would <00:15:20.495>say, <00:15:20.569>"Yeah, <00:15:20.642>it <00:15:20.716>might <00:15:20.790>be <00:15:20.864>at <00:15:20.938>some <00:15:21.011>points, <00:15:21.085>but <00:15:21.159>it <00:15:21.233>makes <00:15:21.307>it

00:15:21.430 --> 00:15:21.440 align:start position:0%
<00:15:21.430>be <00:15:21.431>at <00:15:21.432>some <00:15:21.433>points, <00:15:21.435>but <00:15:21.436>it <00:15:21.437>makes <00:15:21.439>it

00:15:21.440 --> 00:15:24.870 align:start position:0%
<00:15:21.440>be <00:15:21.547>at <00:15:21.655>some <00:15:21.763>points, <00:15:21.870>but <00:15:21.978>it <00:15:22.086>makes <00:15:22.193>it <00:15:22.301>really <00:15:22.409>flexible <00:15:22.516>on <00:15:22.624>the <00:15:22.732>storage <00:15:22.840>option.

00:15:24.870 --> 00:15:24.880 align:start position:0%
<00:15:24.870>really <00:15:24.871>flexible <00:15:24.873>on <00:15:24.875>the <00:15:24.877>storage <00:15:24.879>option.

00:15:24.880 --> 00:15:27.670 align:start position:0%
<00:15:24.880>really <00:15:24.987>flexible <00:15:25.095>on <00:15:25.203>the <00:15:25.310>storage <00:15:25.418>option. <00:15:25.526>And <00:15:25.633>for <00:15:25.741>the <00:15:25.849>catalog, <00:15:25.956>there's <00:15:26.064>a <00:15:26.172>lot <00:15:26.280>of

00:15:27.670 --> 00:15:27.680 align:start position:0%
<00:15:27.670>And <00:15:27.671>for <00:15:27.672>the <00:15:27.673>catalog, <00:15:27.675>there's <00:15:27.676>a <00:15:27.677>lot <00:15:27.679>of

00:15:27.680 --> 00:15:30.110 align:start position:0%
<00:15:27.680>And <00:15:27.773>for <00:15:27.866>the <00:15:27.959>catalog, <00:15:28.053>there's <00:15:28.146>a <00:15:28.239>lot <00:15:28.333>of <00:15:28.426>um <00:15:28.520>and <00:15:28.613>this <00:15:28.706>is <00:15:28.800>now <00:15:28.893>the <00:15:28.986>Iceberg <00:15:29.079>catalog

00:15:30.110 --> 00:15:30.120 align:start position:0%
<00:15:30.110>um <00:15:30.111>and <00:15:30.112>this <00:15:30.113>is <00:15:30.115>now <00:15:30.116>the <00:15:30.117>Iceberg <00:15:30.119>catalog

00:15:30.120 --> 00:15:32.470 align:start position:0%
<00:15:30.120>um <00:15:30.213>and <00:15:30.306>this <00:15:30.400>is <00:15:30.493>now <00:15:30.586>the <00:15:30.680>Iceberg <00:15:30.773>catalog <00:15:30.866>here. <00:15:30.960>Delta <00:15:31.053>has <00:15:31.146>its <00:15:31.240>own <00:15:31.333>one, <00:15:31.426>uh <00:15:31.520>the

00:15:32.470 --> 00:15:32.480 align:start position:0%
<00:15:32.470>here. <00:15:32.471>Delta <00:15:32.472>has <00:15:32.473>its <00:15:32.475>own <00:15:32.476>one, <00:15:32.477>uh <00:15:32.479>the

00:15:32.480 --> 00:15:35.830 align:start position:0%
<00:15:32.480>here. <00:15:32.587>Delta <00:15:32.695>has <00:15:32.803>its <00:15:32.910>own <00:15:33.018>one, <00:15:33.126>uh <00:15:33.233>the <00:15:33.341>Unity <00:15:33.449>catalog. <00:15:33.556>The <00:15:33.664>Iceberg <00:15:33.772>catalog <00:15:33.880>here

00:15:35.830 --> 00:15:35.840 align:start position:0%
<00:15:35.830>Unity <00:15:35.831>catalog. <00:15:35.833>The <00:15:35.835>Iceberg <00:15:35.837>catalog <00:15:35.839>here

00:15:35.840 --> 00:15:37.990 align:start position:0%
<00:15:35.840>Unity <00:15:35.967>catalog. <00:15:36.094>The <00:15:36.221>Iceberg <00:15:36.349>catalog <00:15:36.476>here <00:15:36.603>is <00:15:36.730>Apache <00:15:36.858>Polaris, <00:15:36.985>an <00:15:37.112>open <00:15:37.240>source

00:15:37.990 --> 00:15:38.000 align:start position:0%
<00:15:37.990>is <00:15:37.991>Apache <00:15:37.993>Polaris, <00:15:37.995>an <00:15:37.997>open <00:15:37.999>source

00:15:38.000 --> 00:15:41.030 align:start position:0%
<00:15:38.000>is <00:15:38.116>Apache <00:15:38.233>Polaris, <00:15:38.350>an <00:15:38.466>open <00:15:38.583>source <00:15:38.700>catalog <00:15:38.816>for <00:15:38.933>for <00:15:39.050>Iceberg <00:15:39.166>tables. <00:15:39.283>Uh <00:15:39.400>for

00:15:41.030 --> 00:15:41.040 align:start position:0%
<00:15:41.030>catalog <00:15:41.031>for <00:15:41.033>for <00:15:41.034>Iceberg <00:15:41.036>tables. <00:15:41.037>Uh <00:15:41.039>for

00:15:41.040 --> 00:15:43.150 align:start position:0%
<00:15:41.040>catalog <00:15:41.147>for <00:15:41.255>for <00:15:41.363>Iceberg <00:15:41.470>tables. <00:15:41.578>Uh <00:15:41.686>for <00:15:41.793>Delta <00:15:41.901>is <00:15:42.009>there's <00:15:42.116>the <00:15:42.224>open <00:15:42.332>source <00:15:42.439>Unity

00:15:43.150 --> 00:15:43.160 align:start position:0%
<00:15:43.150>Delta <00:15:43.151>is <00:15:43.153>there's <00:15:43.154>the <00:15:43.156>open <00:15:43.157>source <00:15:43.159>Unity

00:15:43.160 --> 00:15:45.510 align:start position:0%
<00:15:43.160>Delta <00:15:43.300>is <00:15:43.439>there's <00:15:43.579>the <00:15:43.719>open <00:15:43.860>source <00:15:44.000>Unity <00:15:44.140>catalog. <00:15:44.280>To <00:15:44.420>be <00:15:44.560>honest,

00:15:45.510 --> 00:15:45.520 align:start position:0%
<00:15:45.510>catalog. <00:15:45.513>To <00:15:45.516>be <00:15:45.519>honest,

00:15:45.520 --> 00:15:47.550 align:start position:0%
<00:15:45.520>catalog. <00:15:45.647>To <00:15:45.774>be <00:15:45.901>honest, <00:15:46.029>if <00:15:46.156>you <00:15:46.283>look <00:15:46.410>at <00:15:46.538>them, <00:15:46.665>always <00:15:46.792>I <00:15:46.920>would

00:15:47.550 --> 00:15:47.560 align:start position:0%
<00:15:47.550>if <00:15:47.551>you <00:15:47.552>look <00:15:47.553>at <00:15:47.555>them, <00:15:47.556>always <00:15:47.557>I <00:15:47.559>would

00:15:47.560 --> 00:15:49.590 align:start position:0%
<00:15:47.560>if <00:15:47.667>you <00:15:47.775>look <00:15:47.883>at <00:15:47.990>them, <00:15:48.098>always <00:15:48.206>I <00:15:48.313>would <00:15:48.421>always <00:15:48.529>go <00:15:48.636>with <00:15:48.744>Iceberg <00:15:48.852>for <00:15:48.959>now,

00:15:49.590 --> 00:15:49.600 align:start position:0%
<00:15:49.590>always <00:15:49.591>go <00:15:49.593>with <00:15:49.595>Iceberg <00:15:49.597>for <00:15:49.599>now,

00:15:49.600 --> 00:15:50.990 align:start position:0%
<00:15:49.600>always <00:15:49.696>go <00:15:49.792>with <00:15:49.888>Iceberg <00:15:49.984>for <00:15:50.081>now, <00:15:50.177>at <00:15:50.273>least <00:15:50.369>if <00:15:50.466>I <00:15:50.562>have <00:15:50.658>to <00:15:50.754>decide <00:15:50.851>between

00:15:50.990 --> 00:15:51.000 align:start position:0%
<00:15:50.990>at <00:15:50.991>least <00:15:50.992>if <00:15:50.993>I <00:15:50.995>have <00:15:50.996>to <00:15:50.997>decide <00:15:50.999>between

00:15:51.000 --> 00:15:52.110 align:start position:0%
<00:15:51.000>at <00:15:51.111>least <00:15:51.222>if <00:15:51.333>I <00:15:51.444>have <00:15:51.555>to <00:15:51.666>decide <00:15:51.777>between <00:15:51.888>those <00:15:51.999>two.

00:15:52.110 --> 00:15:52.120 align:start position:0%
<00:15:52.110>those <00:15:52.119>two.

00:15:52.120 --> 00:15:54.350 align:start position:0%
<00:15:52.120>those <00:15:52.260>two. <00:15:52.400>Um <00:15:52.540>and <00:15:52.680>there's <00:15:52.820>a <00:15:52.960>lot <00:15:53.100>of <00:15:53.240>clients <00:15:53.380>that <00:15:53.520>can

00:15:54.350 --> 00:15:54.360 align:start position:0%
<00:15:54.350>Um <00:15:54.351>and <00:15:54.352>there's <00:15:54.353>a <00:15:54.354>lot <00:15:54.355>of <00:15:54.356>clients <00:15:54.357>that <00:15:54.359>can

00:15:54.360 --> 00:15:56.990 align:start position:0%
<00:15:54.360>Um <00:15:54.460>and <00:15:54.560>there's <00:15:54.660>a <00:15:54.760>lot <00:15:54.860>of <00:15:54.960>clients <00:15:55.060>that <00:15:55.160>can <00:15:55.260>actually <00:15:55.360>connect <00:15:55.460>to <00:15:55.560>this <00:15:55.660>um <00:15:55.760>catalog.

00:15:56.990 --> 00:15:57.000 align:start position:0%
<00:15:56.990>actually <00:15:56.991>connect <00:15:56.993>to <00:15:56.995>this <00:15:56.997>um <00:15:56.999>catalog.

00:15:57.000 --> 00:16:00.350 align:start position:0%
<00:15:57.000>actually <00:15:57.107>connect <00:15:57.215>to <00:15:57.323>this <00:15:57.430>um <00:15:57.538>catalog. <00:15:57.646>There <00:15:57.753>is <00:15:57.861>Apache <00:15:57.969>Spark, <00:15:58.076>which <00:15:58.184>is <00:15:58.292>quite <00:15:58.400>um

00:16:00.350 --> 00:16:00.360 align:start position:0%
<00:16:00.350>There <00:16:00.351>is <00:16:00.352>Apache <00:16:00.353>Spark, <00:16:00.355>which <00:16:00.356>is <00:16:00.357>quite <00:16:00.359>um

00:16:00.360 --> 00:16:01.270 align:start position:0%
<00:16:00.360>There <00:16:00.462>is <00:16:00.564>Apache <00:16:00.667>Spark, <00:16:00.769>which <00:16:00.871>is <00:16:00.974>quite <00:16:01.076>um <00:16:01.179>quite

00:16:01.270 --> 00:16:01.280 align:start position:0%
quite

00:16:01.280 --> 00:16:02.030 align:start position:0%
<00:16:01.280>quite <00:16:01.954>uh

00:16:02.030 --> 00:16:02.040 align:start position:0%
uh

00:16:02.040 --> 00:16:04.390 align:start position:0%
<00:16:02.040>uh <00:16:02.214>mature <00:16:02.390>by <00:16:02.564>now <00:16:02.740>and <00:16:02.915>is <00:16:03.089>pretty <00:16:03.265>well <00:16:03.439>known

00:16:04.390 --> 00:16:04.400 align:start position:0%
<00:16:04.390>mature <00:16:04.391>by <00:16:04.392>now <00:16:04.393>and <00:16:04.395>is <00:16:04.396>pretty <00:16:04.397>well <00:16:04.399>known

00:16:04.400 --> 00:16:05.870 align:start position:0%
<00:16:04.400>mature <00:16:04.494>by <00:16:04.589>now <00:16:04.683>and <00:16:04.778>is <00:16:04.872>pretty <00:16:04.967>well <00:16:05.061>known <00:16:05.156>in <00:16:05.250>the <00:16:05.345>data <00:16:05.439>community, <00:16:05.534>but <00:16:05.628>there's <00:16:05.723>also

00:16:05.870 --> 00:16:05.880 align:start position:0%
<00:16:05.870>in <00:16:05.871>the <00:16:05.873>data <00:16:05.874>community, <00:16:05.876>but <00:16:05.877>there's <00:16:05.879>also

00:16:05.880 --> 00:16:07.510 align:start position:0%
<00:16:05.880>in <00:16:05.996>the <00:16:06.113>data <00:16:06.230>community, <00:16:06.346>but <00:16:06.463>there's <00:16:06.580>also <00:16:06.696>a <00:16:06.813>client <00:16:06.930>for <00:16:07.046>Iceberg. <00:16:07.163>There's <00:16:07.280>Trino,

00:16:07.510 --> 00:16:07.520 align:start position:0%
<00:16:07.510>a <00:16:07.511>client <00:16:07.513>for <00:16:07.515>Iceberg. <00:16:07.517>There's <00:16:07.519>Trino,

00:16:07.520 --> 00:16:08.790 align:start position:0%
<00:16:07.520>a <00:16:07.623>client <00:16:07.727>for <00:16:07.831>Iceberg. <00:16:07.935>There's <00:16:08.039>Trino, <00:16:08.143>which <00:16:08.247>is <00:16:08.351>a <00:16:08.455>secret <00:16:08.559>query <00:16:08.663>engine,

00:16:08.790 --> 00:16:08.800 align:start position:0%
<00:16:08.790>which <00:16:08.791>is <00:16:08.793>a <00:16:08.795>secret <00:16:08.797>query <00:16:08.799>engine,

00:16:08.800 --> 00:16:10.350 align:start position:0%
<00:16:08.800>which <00:16:08.926>is <00:16:09.053>a <00:16:09.180>secret <00:16:09.307>query <00:16:09.434>engine, <00:16:09.560>Snowflake, <00:16:09.687>Dremio, <00:16:09.814>a <00:16:09.941>lot <00:16:10.068>of <00:16:10.195>query

00:16:10.350 --> 00:16:10.360 align:start position:0%
<00:16:10.350>Snowflake, <00:16:10.351>Dremio, <00:16:10.353>a <00:16:10.355>lot <00:16:10.357>of <00:16:10.359>query

00:16:10.360 --> 00:16:12.990 align:start position:0%
<00:16:10.360>Snowflake, <00:16:10.476>Dremio, <00:16:10.593>a <00:16:10.710>lot <00:16:10.826>of <00:16:10.943>query <00:16:11.060>engines <00:16:11.176>um <00:16:11.293>can <00:16:11.410>access <00:16:11.526>this <00:16:11.643>data. <00:16:11.760>You

00:16:12.990 --> 00:16:13.000 align:start position:0%
<00:16:12.990>engines <00:16:12.991>um <00:16:12.993>can <00:16:12.994>access <00:16:12.996>this <00:16:12.997>data. <00:16:12.999>You

00:16:13.000 --> 00:16:15.430 align:start position:0%
<00:16:13.000>engines <00:16:13.107>um <00:16:13.215>can <00:16:13.323>access <00:16:13.430>this <00:16:13.538>data. <00:16:13.646>You <00:16:13.753>still <00:16:13.861>need <00:16:13.969>some <00:16:14.076>engine <00:16:14.184>that <00:16:14.292>does <00:16:14.400>the

00:16:15.430 --> 00:16:15.440 align:start position:0%
<00:16:15.430>still <00:16:15.431>need <00:16:15.433>some <00:16:15.434>engine <00:16:15.436>that <00:16:15.437>does <00:16:15.439>the

00:16:15.440 --> 00:16:17.150 align:start position:0%
<00:16:15.440>still <00:16:15.556>need <00:16:15.673>some <00:16:15.790>engine <00:16:15.906>that <00:16:16.023>does <00:16:16.140>the <00:16:16.256>query. <00:16:16.373>You <00:16:16.490>don't <00:16:16.606>only <00:16:16.723>have <00:16:16.840>storage

00:16:17.150 --> 00:16:17.160 align:start position:0%
<00:16:17.150>query. <00:16:17.151>You <00:16:17.153>don't <00:16:17.155>only <00:16:17.157>have <00:16:17.159>storage

00:16:17.160 --> 00:16:19.390 align:start position:0%
<00:16:17.160>query. <00:16:17.287>You <00:16:17.414>don't <00:16:17.541>only <00:16:17.669>have <00:16:17.796>storage <00:16:17.923>underneath. <00:16:18.050>So, <00:16:18.178>Iceberg <00:16:18.305>and <00:16:18.432>the <00:16:18.560>catalog

00:16:19.390 --> 00:16:19.400 align:start position:0%
<00:16:19.390>underneath. <00:16:19.391>So, <00:16:19.393>Iceberg <00:16:19.395>and <00:16:19.397>the <00:16:19.399>catalog

00:16:19.400 --> 00:16:21.950 align:start position:0%
<00:16:19.400>underneath. <00:16:19.527>So, <00:16:19.654>Iceberg <00:16:19.781>and <00:16:19.909>the <00:16:20.036>catalog <00:16:20.163>doesn't <00:16:20.290>do <00:16:20.418>anything <00:16:20.545>on <00:16:20.672>computer, <00:16:20.800>just

00:16:21.950 --> 00:16:21.960 align:start position:0%
<00:16:21.950>doesn't <00:16:21.951>do <00:16:21.953>anything <00:16:21.955>on <00:16:21.957>computer, <00:16:21.959>just

00:16:21.960 --> 00:16:24.870 align:start position:0%
<00:16:21.960>doesn't <00:16:22.076>do <00:16:22.193>anything <00:16:22.310>on <00:16:22.426>computer, <00:16:22.543>just <00:16:22.660>stores <00:16:22.776>data. <00:16:22.893>You <00:16:23.010>still <00:16:23.126>need <00:16:23.243>the <00:16:23.360>compute

00:16:24.870 --> 00:16:24.880 align:start position:0%
<00:16:24.870>stores <00:16:24.871>data. <00:16:24.873>You <00:16:24.874>still <00:16:24.876>need <00:16:24.877>the <00:16:24.879>compute

00:16:24.880 --> 00:16:26.630 align:start position:0%
<00:16:24.880>stores <00:16:24.987>data. <00:16:25.095>You <00:16:25.203>still <00:16:25.310>need <00:16:25.418>the <00:16:25.526>compute <00:16:25.633>above <00:16:25.741>it, <00:16:25.849>and <00:16:25.956>there's <00:16:26.064>plenty <00:16:26.172>of <00:16:26.280>options

00:16:26.630 --> 00:16:26.640 align:start position:0%
<00:16:26.630>above <00:16:26.631>it, <00:16:26.633>and <00:16:26.634>there's <00:16:26.636>plenty <00:16:26.637>of <00:16:26.639>options

00:16:26.640 --> 00:16:31.270 align:start position:0%
<00:16:26.640>above <00:16:26.814>it, <00:16:26.990>and <00:16:27.165>there's <00:16:27.340>plenty <00:16:27.515>of <00:16:27.689>options <00:16:27.865>in <00:16:28.040>compute.

00:16:31.280 --> 00:16:33.190 align:start position:0%
<00:16:31.280>Now, <00:16:31.480>there's <00:16:31.680>also <00:16:31.880>a <00:16:32.079>fourth <00:16:32.280>one <00:16:32.480>in <00:16:32.680>the

00:16:33.190 --> 00:16:33.200 align:start position:0%
<00:16:33.190>Now, <00:16:33.191>there's <00:16:33.192>also <00:16:33.193>a <00:16:33.195>fourth <00:16:33.196>one <00:16:33.197>in <00:16:33.199>the

00:16:33.200 --> 00:16:35.670 align:start position:0%
<00:16:33.200>Now, <00:16:33.293>there's <00:16:33.386>also <00:16:33.480>a <00:16:33.573>fourth <00:16:33.666>one <00:16:33.760>in <00:16:33.853>the <00:16:33.946>title, <00:16:34.040>which <00:16:34.133>is <00:16:34.226>Duck <00:16:34.320>Lake. <00:16:34.413>And <00:16:34.506>Duck <00:16:34.600>Lake

00:16:35.670 --> 00:16:35.680 align:start position:0%
<00:16:35.670>title, <00:16:35.671>which <00:16:35.672>is <00:16:35.673>Duck <00:16:35.675>Lake. <00:16:35.676>And <00:16:35.677>Duck <00:16:35.679>Lake

00:16:35.680 --> 00:16:38.270 align:start position:0%
<00:16:35.680>title, <00:16:35.773>which <00:16:35.866>is <00:16:35.959>Duck <00:16:36.053>Lake. <00:16:36.146>And <00:16:36.239>Duck <00:16:36.333>Lake <00:16:36.426>is <00:16:36.520>a <00:16:36.613>project <00:16:36.706>of <00:16:36.800>the <00:16:36.893>founders <00:16:36.986>of <00:16:37.079>and

00:16:38.270 --> 00:16:38.280 align:start position:0%
<00:16:38.270>is <00:16:38.271>a <00:16:38.272>project <00:16:38.273>of <00:16:38.275>the <00:16:38.276>founders <00:16:38.277>of <00:16:38.279>and

00:16:38.280 --> 00:16:40.110 align:start position:0%
<00:16:38.280>is <00:16:38.387>a <00:16:38.495>project <00:16:38.603>of <00:16:38.710>the <00:16:38.818>founders <00:16:38.926>of <00:16:39.033>and <00:16:39.141>inventors <00:16:39.249>of <00:16:39.356>DuckDB, <00:16:39.464>which <00:16:39.572>is <00:16:39.680>an

00:16:40.110 --> 00:16:40.120 align:start position:0%
<00:16:40.110>inventors <00:16:40.111>of <00:16:40.113>DuckDB, <00:16:40.115>which <00:16:40.117>is <00:16:40.119>an

00:16:40.120 --> 00:16:41.470 align:start position:0%
<00:16:40.120>inventors <00:16:40.322>of <00:16:40.525>DuckDB, <00:16:40.727>which <00:16:40.930>is <00:16:41.132>an <00:16:41.335>embedded

00:16:41.470 --> 00:16:41.480 align:start position:0%
embedded

00:16:41.480 --> 00:16:44.550 align:start position:0%
<00:16:41.480>embedded <00:16:41.830>really <00:16:42.180>fast, <00:16:42.530>small <00:16:42.880>and

00:16:44.550 --> 00:16:44.560 align:start position:0%
<00:16:44.550>really <00:16:44.553>fast, <00:16:44.555>small <00:16:44.559>and

00:16:44.560 --> 00:16:45.270 align:start position:0%
<00:16:44.560>really <00:16:44.719>fast, <00:16:44.879>small <00:16:45.039>and <00:16:45.199>uh

00:16:45.270 --> 00:16:45.280 align:start position:0%
uh

00:16:45.280 --> 00:16:47.190 align:start position:0%
<00:16:45.280>uh <00:16:45.980>lightweight <00:16:46.680>um

00:16:47.190 --> 00:16:47.200 align:start position:0%
<00:16:47.190>lightweight <00:16:47.199>um

00:16:47.200 --> 00:16:49.070 align:start position:0%
<00:16:47.200>lightweight <00:16:47.433>um <00:16:47.666>database <00:16:47.900>for <00:16:48.133>analytical <00:16:48.366>purposes. <00:16:48.600>And

00:16:49.070 --> 00:16:49.080 align:start position:0%
<00:16:49.070>database <00:16:49.072>for <00:16:49.074>analytical <00:16:49.076>purposes. <00:16:49.079>And

00:16:49.080 --> 00:16:50.390 align:start position:0%
<00:16:49.080>database <00:16:49.248>for <00:16:49.416>analytical <00:16:49.585>purposes. <00:16:49.753>And <00:16:49.922>they <00:16:50.090>said, <00:16:50.259>"Hey,

00:16:50.390 --> 00:16:50.400 align:start position:0%
<00:16:50.390>they <00:16:50.394>said, <00:16:50.399>"Hey,

00:16:50.400 --> 00:16:52.310 align:start position:0%
<00:16:50.400>they <00:16:50.527>said, <00:16:50.654>"Hey, <00:16:50.781>this <00:16:50.909>is <00:16:51.036>all <00:16:51.163>the <00:16:51.290>stuff <00:16:51.418>that <00:16:51.545>we <00:16:51.672>do <00:16:51.800>to

00:16:52.310 --> 00:16:52.320 align:start position:0%
<00:16:52.310>this <00:16:52.311>is <00:16:52.312>all <00:16:52.313>the <00:16:52.314>stuff <00:16:52.315>that <00:16:52.316>we <00:16:52.317>do <00:16:52.319>to

00:16:52.320 --> 00:16:54.750 align:start position:0%
<00:16:52.320>this <00:16:52.413>is <00:16:52.506>all <00:16:52.600>the <00:16:52.693>stuff <00:16:52.786>that <00:16:52.880>we <00:16:52.973>do <00:16:53.066>to <00:16:53.160>store <00:16:53.253>data, <00:16:53.346>and <00:16:53.440>we <00:16:53.533>have <00:16:53.626>all <00:16:53.720>these

00:16:54.750 --> 00:16:54.760 align:start position:0%
<00:16:54.750>store <00:16:54.751>data, <00:16:54.753>and <00:16:54.754>we <00:16:54.756>have <00:16:54.757>all <00:16:54.759>these

00:16:54.760 --> 00:16:56.950 align:start position:0%
<00:16:54.760>store <00:16:54.867>data, <00:16:54.975>and <00:16:55.083>we <00:16:55.190>have <00:16:55.298>all <00:16:55.406>these <00:16:55.513>metadata <00:16:55.621>files <00:16:55.729>just <00:16:55.836>to <00:16:55.944>have <00:16:56.052>a <00:16:56.160>catalog,

00:16:56.950 --> 00:16:56.960 align:start position:0%
<00:16:56.950>metadata <00:16:56.951>files <00:16:56.953>just <00:16:56.954>to <00:16:56.956>have <00:16:56.957>a <00:16:56.959>catalog,

00:16:56.960 --> 00:16:59.670 align:start position:0%
<00:16:56.960>metadata <00:16:57.047>files <00:16:57.135>just <00:16:57.222>to <00:16:57.310>have <00:16:57.397>a <00:16:57.485>catalog, <00:16:57.572>which <00:16:57.660>is <00:16:57.747>in <00:16:57.835>the <00:16:57.922>end <00:16:58.010>a <00:16:58.097>database <00:16:58.185>on <00:16:58.272>top <00:16:58.360>of

00:16:59.670 --> 00:16:59.680 align:start position:0%
<00:16:59.670>which <00:16:59.670>is <00:16:59.671>in <00:16:59.673>the <00:16:59.674>end <00:16:59.675>a <00:16:59.675>database <00:16:59.676>on <00:16:59.678>top <00:16:59.679>of

00:16:59.680 --> 00:17:03.230 align:start position:0%
<00:16:59.680>which <00:16:59.762>is <00:16:59.844>in <00:16:59.927>the <00:17:00.009>end <00:17:00.091>a <00:17:00.174>database <00:17:00.256>on <00:17:00.338>top <00:17:00.421>of <00:17:00.503>it <00:17:00.585>um <00:17:00.668>to <00:17:00.750>point <00:17:00.832>to <00:17:00.915>those <00:17:00.997>metadata <00:17:01.079>files.

00:17:03.230 --> 00:17:03.240 align:start position:0%
<00:17:03.230>it <00:17:03.231>um <00:17:03.232>to <00:17:03.233>point <00:17:03.235>to <00:17:03.236>those <00:17:03.237>metadata <00:17:03.239>files.

00:17:03.240 --> 00:17:06.670 align:start position:0%
<00:17:03.240>it <00:17:03.367>um <00:17:03.494>to <00:17:03.621>point <00:17:03.749>to <00:17:03.876>those <00:17:04.003>metadata <00:17:04.130>files. <00:17:04.258>Sounds <00:17:04.385>really <00:17:04.512>complicated. <00:17:04.640>Just

00:17:06.670 --> 00:17:06.680 align:start position:0%
<00:17:06.670>Sounds <00:17:06.673>really <00:17:06.676>complicated. <00:17:06.679>Just

00:17:06.680 --> 00:17:08.670 align:start position:0%
<00:17:06.680>Sounds <00:17:06.807>really <00:17:06.934>complicated. <00:17:07.061>Just <00:17:07.189>metadata <00:17:07.316>and <00:17:07.443>files, <00:17:07.570>and <00:17:07.698>in <00:17:07.825>the <00:17:07.952>end <00:17:08.080>we

00:17:08.670 --> 00:17:08.680 align:start position:0%
<00:17:08.670>metadata <00:17:08.671>and <00:17:08.672>files, <00:17:08.673>and <00:17:08.675>in <00:17:08.676>the <00:17:08.677>end <00:17:08.679>we

00:17:08.680 --> 00:17:10.630 align:start position:0%
<00:17:08.680>metadata <00:17:08.780>and <00:17:08.880>files, <00:17:08.980>and <00:17:09.080>in <00:17:09.180>the <00:17:09.280>end <00:17:09.380>we <00:17:09.480>need <00:17:09.580>a <00:17:09.680>database <00:17:09.780>anyways, <00:17:09.880>but <00:17:09.980>they <00:17:10.080>say,

00:17:10.630 --> 00:17:10.640 align:start position:0%
<00:17:10.630>need <00:17:10.631>a <00:17:10.633>database <00:17:10.634>anyways, <00:17:10.636>but <00:17:10.637>they <00:17:10.639>say,

00:17:10.640 --> 00:17:12.590 align:start position:0%
<00:17:10.640>need <00:17:10.740>a <00:17:10.840>database <00:17:10.940>anyways, <00:17:11.040>but <00:17:11.140>they <00:17:11.240>say, <00:17:11.340>"Hey, <00:17:11.440>but <00:17:11.540>we <00:17:11.640>get <00:17:11.740>the <00:17:11.840>point <00:17:11.940>of <00:17:12.040>storing

00:17:12.590 --> 00:17:12.600 align:start position:0%
<00:17:12.589>"Hey, <00:17:12.591>but <00:17:12.592>we <00:17:12.593>get <00:17:12.595>the <00:17:12.596>point <00:17:12.597>of <00:17:12.598>storing

00:17:12.600 --> 00:17:14.710 align:start position:0%
<00:17:12.599>"Hey, <00:17:12.699>but <00:17:12.800>we <00:17:12.899>get <00:17:13.000>the <00:17:13.099>point <00:17:13.199>of <00:17:13.300>storing <00:17:13.399>data <00:17:13.500>in <00:17:13.599>Parquet, <00:17:13.699>because <00:17:13.800>that <00:17:13.899>is <00:17:14.000>really

00:17:14.710 --> 00:17:14.720 align:start position:0%
<00:17:14.710>data <00:17:14.711>in <00:17:14.713>Parquet, <00:17:14.714>because <00:17:14.716>that <00:17:14.717>is <00:17:14.719>really

00:17:14.720 --> 00:17:16.550 align:start position:0%
<00:17:14.720>data <00:17:14.813>in <00:17:14.906>Parquet, <00:17:15.000>because <00:17:15.093>that <00:17:15.186>is <00:17:15.280>really <00:17:15.373>really <00:17:15.466>cheap <00:17:15.560>in <00:17:15.653>the <00:17:15.746>end. <00:17:15.839>You <00:17:15.933>can <00:17:16.026>just <00:17:16.120>as

00:17:16.550 --> 00:17:16.560 align:start position:0%
<00:17:16.550>really <00:17:16.551>cheap <00:17:16.552>in <00:17:16.553>the <00:17:16.554>end. <00:17:16.555>You <00:17:16.556>can <00:17:16.557>just <00:17:16.559>as

00:17:16.560 --> 00:17:18.470 align:start position:0%
<00:17:16.560>really <00:17:16.642>cheap <00:17:16.724>in <00:17:16.807>the <00:17:16.889>end. <00:17:16.971>You <00:17:17.054>can <00:17:17.136>just <00:17:17.218>as <00:17:17.301>I <00:17:17.383>said, <00:17:17.465>store <00:17:17.548>it <00:17:17.630>in <00:17:17.712>a <00:17:17.795>blob <00:17:17.877>storage. <00:17:17.960>You

00:17:18.470 --> 00:17:18.480 align:start position:0%
<00:17:18.470>I <00:17:18.471>said, <00:17:18.472>store <00:17:18.473>it <00:17:18.474>in <00:17:18.475>a <00:17:18.476>blob <00:17:18.477>storage. <00:17:18.479>You

00:17:18.480 --> 00:17:20.829 align:start position:0%
<00:17:18.480>I <00:17:18.573>said, <00:17:18.666>store <00:17:18.760>it <00:17:18.853>in <00:17:18.946>a <00:17:19.040>blob <00:17:19.133>storage. <00:17:19.226>You <00:17:19.319>don't <00:17:19.413>need <00:17:19.506>a <00:17:19.599>full <00:17:19.693>database <00:17:19.786>for <00:17:19.880>it.

00:17:20.829 --> 00:17:20.839 align:start position:0%
<00:17:20.829>don't <00:17:20.830>need <00:17:20.831>a <00:17:20.833>full <00:17:20.835>database <00:17:20.836>for <00:17:20.838>it.

00:17:20.839 --> 00:17:22.470 align:start position:0%
<00:17:20.839>don't <00:17:20.938>need <00:17:21.039>a <00:17:21.138>full <00:17:21.239>database <00:17:21.339>for <00:17:21.438>it. <00:17:21.539>And <00:17:21.638>they <00:17:21.739>just <00:17:21.839>said, <00:17:21.938>"Hey, <00:17:22.039>why <00:17:22.138>not <00:17:22.239>put

00:17:22.470 --> 00:17:22.480 align:start position:0%
<00:17:22.470>And <00:17:22.471>they <00:17:22.472>just <00:17:22.473>said, <00:17:22.475>"Hey, <00:17:22.476>why <00:17:22.477>not <00:17:22.479>put

00:17:22.480 --> 00:17:24.870 align:start position:0%
<00:17:22.480>And <00:17:22.596>they <00:17:22.713>just <00:17:22.829>said, <00:17:22.946>"Hey, <00:17:23.063>why <00:17:23.180>not <00:17:23.296>put <00:17:23.413>everything <00:17:23.530>in <00:17:23.646>a <00:17:23.763>database?" <00:17:23.880>Because

00:17:24.870 --> 00:17:24.880 align:start position:0%
<00:17:24.869>everything <00:17:24.872>in <00:17:24.874>a <00:17:24.876>database?" <00:17:24.879>Because

00:17:24.880 --> 00:17:27.110 align:start position:0%
<00:17:24.880>everything <00:17:25.007>in <00:17:25.134>a <00:17:25.261>database?" <00:17:25.389>Because <00:17:25.516>thinking <00:17:25.643>about <00:17:25.770>this, <00:17:25.898>if <00:17:26.025>you <00:17:26.152>put <00:17:26.280>all

00:17:27.110 --> 00:17:27.120 align:start position:0%
<00:17:27.109>thinking <00:17:27.111>about <00:17:27.112>this, <00:17:27.114>if <00:17:27.116>you <00:17:27.117>put <00:17:27.118>all

00:17:27.120 --> 00:17:30.070 align:start position:0%
<00:17:27.119>thinking <00:17:27.227>about <00:17:27.335>this, <00:17:27.443>if <00:17:27.550>you <00:17:27.658>put <00:17:27.766>all <00:17:27.873>these <00:17:27.981>stuff <00:17:28.089>here <00:17:28.196>into <00:17:28.304>an <00:17:28.412>S3 <00:17:28.520>bucket,

00:17:30.070 --> 00:17:30.080 align:start position:0%
<00:17:30.070>these <00:17:30.071>stuff <00:17:30.072>here <00:17:30.074>into <00:17:30.076>an <00:17:30.077>S3 <00:17:30.079>bucket,

00:17:30.080 --> 00:17:32.230 align:start position:0%
<00:17:30.080>these <00:17:30.179>stuff <00:17:30.280>here <00:17:30.379>into <00:17:30.480>an <00:17:30.580>S3 <00:17:30.679>bucket, <00:17:30.780>those <00:17:30.879>are <00:17:30.980>all <00:17:31.080>small <00:17:31.179>files <00:17:31.280>in <00:17:31.379>an <00:17:31.480>S3

00:17:32.230 --> 00:17:32.240 align:start position:0%
<00:17:32.230>those <00:17:32.231>are <00:17:32.232>all <00:17:32.233>small <00:17:32.235>files <00:17:32.236>in <00:17:32.237>an <00:17:32.239>S3

00:17:32.240 --> 00:17:34.230 align:start position:0%
<00:17:32.240>those <00:17:32.340>are <00:17:32.440>all <00:17:32.540>small <00:17:32.640>files <00:17:32.740>in <00:17:32.840>an <00:17:32.940>S3 <00:17:33.040>bucket. <00:17:33.140>Every <00:17:33.240>time <00:17:33.340>you <00:17:33.440>have <00:17:33.540>to <00:17:33.640>access

00:17:34.230 --> 00:17:34.240 align:start position:0%
<00:17:34.230>bucket. <00:17:34.231>Every <00:17:34.233>time <00:17:34.234>you <00:17:34.236>have <00:17:34.237>to <00:17:34.239>access

00:17:34.240 --> 00:17:36.310 align:start position:0%
<00:17:34.240>bucket. <00:17:34.340>Every <00:17:34.440>time <00:17:34.540>you <00:17:34.640>have <00:17:34.740>to <00:17:34.840>access <00:17:34.940>them, <00:17:35.040>you <00:17:35.140>do <00:17:35.240>an <00:17:35.340>request <00:17:35.440>against <00:17:35.540>the <00:17:35.640>S3,

00:17:36.310 --> 00:17:36.320 align:start position:0%
<00:17:36.310>them, <00:17:36.311>you <00:17:36.312>do <00:17:36.313>an <00:17:36.315>request <00:17:36.316>against <00:17:36.317>the <00:17:36.319>S3,

00:17:36.320 --> 00:17:38.390 align:start position:0%
<00:17:36.320>them, <00:17:36.419>you <00:17:36.520>do <00:17:36.620>an <00:17:36.720>request <00:17:36.820>against <00:17:36.919>the <00:17:37.020>S3, <00:17:37.120>get <00:17:37.220>some <00:17:37.320>time <00:17:37.419>again <00:17:37.520>again <00:17:37.620>again. <00:17:37.720>It

00:17:38.390 --> 00:17:38.400 align:start position:0%
<00:17:38.390>get <00:17:38.391>some <00:17:38.393>time <00:17:38.394>again <00:17:38.396>again <00:17:38.397>again. <00:17:38.399>It

00:17:38.400 --> 00:17:40.910 align:start position:0%
<00:17:38.400>get <00:17:38.516>some <00:17:38.633>time <00:17:38.750>again <00:17:38.866>again <00:17:38.983>again. <00:17:39.100>It <00:17:39.216>costs <00:17:39.333>money. <00:17:39.450>Each <00:17:39.566>request <00:17:39.683>costs <00:17:39.800>money.

00:17:40.910 --> 00:17:40.920 align:start position:0%
<00:17:40.910>costs <00:17:40.911>money. <00:17:40.913>Each <00:17:40.915>request <00:17:40.917>costs <00:17:40.919>money.

00:17:40.920 --> 00:17:45.790 align:start position:0%
<00:17:40.920>costs <00:17:41.027>money. <00:17:41.135>Each <00:17:41.243>request <00:17:41.350>costs <00:17:41.458>money. <00:17:41.566>It <00:17:41.673>costs <00:17:41.781>time <00:17:41.889>because <00:17:41.996>of <00:17:42.104>the <00:17:42.212>latency. <00:17:42.320>Um

00:17:45.790 --> 00:17:45.800 align:start position:0%
<00:17:45.790>It <00:17:45.791>costs <00:17:45.792>time <00:17:45.793>because <00:17:45.795>of <00:17:45.796>the <00:17:45.797>latency. <00:17:45.799>Um

00:17:45.800 --> 00:17:46.750 align:start position:0%
<00:17:45.800>It <00:17:45.885>costs <00:17:45.971>time <00:17:46.056>because <00:17:46.142>of <00:17:46.227>the <00:17:46.312>latency. <00:17:46.398>Um <00:17:46.484>why <00:17:46.569>not <00:17:46.655>just

00:17:46.750 --> 00:17:46.760 align:start position:0%
<00:17:46.750>why <00:17:46.754>not <00:17:46.759>just

00:17:46.760 --> 00:17:48.510 align:start position:0%
<00:17:46.760>why <00:17:46.900>not <00:17:47.040>just <00:17:47.180>And <00:17:47.320>you <00:17:47.460>do <00:17:47.600>a <00:17:47.740>database <00:17:47.879>query <00:17:48.020>anyway. <00:17:48.160>Why

00:17:48.510 --> 00:17:48.520 align:start position:0%
<00:17:48.510>And <00:17:48.511>you <00:17:48.512>do <00:17:48.513>a <00:17:48.515>database <00:17:48.516>query <00:17:48.517>anyway. <00:17:48.519>Why

00:17:48.520 --> 00:17:50.590 align:start position:0%
<00:17:48.520>And <00:17:48.613>you <00:17:48.706>do <00:17:48.800>a <00:17:48.893>database <00:17:48.986>query <00:17:49.080>anyway. <00:17:49.173>Why <00:17:49.266>not <00:17:49.360>do <00:17:49.453>just <00:17:49.546>one <00:17:49.639>database <00:17:49.733>query, <00:17:49.826>get <00:17:49.920>all

00:17:50.590 --> 00:17:50.600 align:start position:0%
<00:17:50.590>not <00:17:50.591>do <00:17:50.592>just <00:17:50.593>one <00:17:50.595>database <00:17:50.596>query, <00:17:50.597>get <00:17:50.599>all

00:17:50.600 --> 00:17:52.190 align:start position:0%
<00:17:50.600>not <00:17:50.707>do <00:17:50.815>just <00:17:50.923>one <00:17:51.030>database <00:17:51.138>query, <00:17:51.246>get <00:17:51.353>all <00:17:51.461>the <00:17:51.569>metadata? <00:17:51.676>The <00:17:51.784>metadata <00:17:51.892>that <00:17:52.000>is

00:17:52.190 --> 00:17:52.200 align:start position:0%
<00:17:52.190>the <00:17:52.191>metadata? <00:17:52.193>The <00:17:52.195>metadata <00:17:52.197>that <00:17:52.199>is

00:17:52.200 --> 00:17:54.150 align:start position:0%
<00:17:52.200>the <00:17:52.316>metadata? <00:17:52.433>The <00:17:52.550>metadata <00:17:52.666>that <00:17:52.783>is <00:17:52.900>stored <00:17:53.016>in <00:17:53.133>here <00:17:53.250>is <00:17:53.366>basically <00:17:53.483>the <00:17:53.600>same.

00:17:54.150 --> 00:17:54.160 align:start position:0%
<00:17:54.150>stored <00:17:54.151>in <00:17:54.153>here <00:17:54.154>is <00:17:54.156>basically <00:17:54.157>the <00:17:54.159>same.

00:17:54.160 --> 00:17:57.350 align:start position:0%
<00:17:54.160>stored <00:17:54.260>in <00:17:54.360>here <00:17:54.460>is <00:17:54.560>basically <00:17:54.660>the <00:17:54.760>same. <00:17:54.860>It's <00:17:54.960>min <00:17:55.060>max <00:17:55.160>stuff. <00:17:55.260>It's <00:17:55.360>null <00:17:55.460>values <00:17:55.560>and

00:17:57.350 --> 00:17:57.360 align:start position:0%
<00:17:57.350>It's <00:17:57.351>min <00:17:57.352>max <00:17:57.353>stuff. <00:17:57.355>It's <00:17:57.356>null <00:17:57.357>values <00:17:57.359>and

00:17:57.360 --> 00:17:59.150 align:start position:0%
<00:17:57.360>It's <00:17:57.459>min <00:17:57.560>max <00:17:57.659>stuff. <00:17:57.760>It's <00:17:57.860>null <00:17:57.959>values <00:17:58.060>and <00:17:58.159>all <00:17:58.260>this <00:17:58.360>stuff. <00:17:58.459>So, <00:17:58.560>all <00:17:58.659>the <00:17:58.760>statistics

00:17:59.150 --> 00:17:59.160 align:start position:0%
<00:17:59.150>all <00:17:59.151>this <00:17:59.153>stuff. <00:17:59.154>So, <00:17:59.156>all <00:17:59.157>the <00:17:59.159>statistics

00:17:59.160 --> 00:18:01.830 align:start position:0%
<00:17:59.160>all <00:17:59.253>this <00:17:59.346>stuff. <00:17:59.440>So, <00:17:59.533>all <00:17:59.626>the <00:17:59.720>statistics <00:17:59.813>that <00:17:59.906>makes <00:18:00.000>it <00:18:00.093>easy <00:18:00.186>to <00:18:00.280>uh <00:18:00.373>fasten <00:18:00.466>up <00:18:00.560>those

00:18:01.830 --> 00:18:01.840 align:start position:0%
<00:18:01.830>that <00:18:01.831>makes <00:18:01.832>it <00:18:01.833>easy <00:18:01.834>to <00:18:01.835>uh <00:18:01.836>fasten <00:18:01.837>up <00:18:01.839>those

00:18:01.840 --> 00:18:04.270 align:start position:0%
<00:18:01.840>that <00:18:01.947>makes <00:18:02.055>it <00:18:02.163>easy <00:18:02.270>to <00:18:02.378>uh <00:18:02.486>fasten <00:18:02.593>up <00:18:02.701>those <00:18:02.809>query <00:18:02.916>to <00:18:03.024>skip <00:18:03.132>data <00:18:03.240>files.

00:18:04.270 --> 00:18:04.280 align:start position:0%
<00:18:04.270>query <00:18:04.272>to <00:18:04.274>skip <00:18:04.276>data <00:18:04.279>files.

00:18:04.280 --> 00:18:07.350 align:start position:0%
<00:18:04.280>query <00:18:04.396>to <00:18:04.513>skip <00:18:04.629>data <00:18:04.746>files. <00:18:04.863>Yeah. <00:18:04.980>So, <00:18:05.096>this <00:18:05.213>is <00:18:05.330>what <00:18:05.446>DuckDB <00:18:05.563>made <00:18:05.680>and

00:18:07.350 --> 00:18:07.360 align:start position:0%
<00:18:07.350>Yeah. <00:18:07.351>So, <00:18:07.352>this <00:18:07.353>is <00:18:07.355>what <00:18:07.356>DuckDB <00:18:07.357>made <00:18:07.359>and

00:18:07.360 --> 00:18:08.990 align:start position:0%
<00:18:07.360>Yeah. <00:18:07.500>So, <00:18:07.639>this <00:18:07.780>is <00:18:07.919>what <00:18:08.060>DuckDB <00:18:08.199>made <00:18:08.340>and <00:18:08.479>uh <00:18:08.620>currently <00:18:08.760>the

00:18:08.990 --> 00:18:09.000 align:start position:0%
<00:18:08.990>uh <00:18:08.994>currently <00:18:08.999>the

00:18:09.000 --> 00:18:11.030 align:start position:0%
<00:18:09.000>uh <00:18:09.200>currently <00:18:09.400>the <00:18:09.600>I <00:18:09.800>think <00:18:10.000>technically <00:18:10.200>wise <00:18:10.400>most

00:18:11.030 --> 00:18:11.040 align:start position:0%
<00:18:11.030>I <00:18:11.032>think <00:18:11.034>technically <00:18:11.036>wise <00:18:11.039>most

00:18:11.040 --> 00:18:13.630 align:start position:0%
<00:18:11.040>I <00:18:11.273>think <00:18:11.506>technically <00:18:11.740>wise <00:18:11.973>most <00:18:12.206>sophisticated <00:18:12.440>stuff.

00:18:13.630 --> 00:18:13.640 align:start position:0%
<00:18:13.630>sophisticated <00:18:13.639>stuff.

00:18:13.640 --> 00:18:16.550 align:start position:0%
<00:18:13.640>sophisticated <00:18:13.780>stuff. <00:18:13.920>So, <00:18:14.060>this <00:18:14.200>nice <00:18:14.340>what <00:18:14.480>should <00:18:14.620>I <00:18:14.760>use <00:18:14.900>now <00:18:15.040>um

00:18:16.550 --> 00:18:16.560 align:start position:0%
<00:18:16.550>So, <00:18:16.551>this <00:18:16.552>nice <00:18:16.553>what <00:18:16.554>should <00:18:16.555>I <00:18:16.556>use <00:18:16.557>now <00:18:16.559>um

00:18:16.560 --> 00:18:18.950 align:start position:0%
<00:18:16.560>So, <00:18:16.642>this <00:18:16.724>nice <00:18:16.807>what <00:18:16.889>should <00:18:16.971>I <00:18:17.054>use <00:18:17.136>now <00:18:17.218>um <00:18:17.301>when <00:18:17.383>when <00:18:17.465>I <00:18:17.548>start <00:18:17.630>with <00:18:17.712>data? <00:18:17.795>And <00:18:17.877>I <00:18:17.960>can

00:18:18.950 --> 00:18:18.960 align:start position:0%
<00:18:18.950>when <00:18:18.951>when <00:18:18.952>I <00:18:18.953>start <00:18:18.954>with <00:18:18.955>data? <00:18:18.956>And <00:18:18.957>I <00:18:18.959>can

00:18:18.960 --> 00:18:21.470 align:start position:0%
<00:18:18.960>when <00:18:19.047>when <00:18:19.135>I <00:18:19.222>start <00:18:19.310>with <00:18:19.397>data? <00:18:19.485>And <00:18:19.572>I <00:18:19.660>can <00:18:19.747>also <00:18:19.835>come <00:18:19.922>from <00:18:20.010>say <00:18:20.097>what <00:18:20.185>why <00:18:20.272>should <00:18:20.360>an

00:18:21.470 --> 00:18:21.480 align:start position:0%
<00:18:21.470>also <00:18:21.471>come <00:18:21.472>from <00:18:21.473>say <00:18:21.475>what <00:18:21.476>why <00:18:21.477>should <00:18:21.479>an

00:18:21.480 --> 00:18:23.630 align:start position:0%
<00:18:21.480>also <00:18:21.596>come <00:18:21.713>from <00:18:21.830>say <00:18:21.946>what <00:18:22.063>why <00:18:22.180>should <00:18:22.296>an <00:18:22.413>engineer <00:18:22.530>care <00:18:22.646>about <00:18:22.763>this? <00:18:22.880>So,

00:18:23.630 --> 00:18:23.640 align:start position:0%
<00:18:23.630>engineer <00:18:23.632>care <00:18:23.634>about <00:18:23.636>this? <00:18:23.639>So,

00:18:23.640 --> 00:18:25.390 align:start position:0%
<00:18:23.640>engineer <00:18:23.756>care <00:18:23.873>about <00:18:23.990>this? <00:18:24.106>So, <00:18:24.223>if <00:18:24.340>you <00:18:24.456>just <00:18:24.573>write <00:18:24.690>some <00:18:24.806>data <00:18:24.923>once, <00:18:25.040>a

00:18:25.390 --> 00:18:25.400 align:start position:0%
<00:18:25.390>if <00:18:25.391>you <00:18:25.392>just <00:18:25.393>write <00:18:25.395>some <00:18:25.396>data <00:18:25.397>once, <00:18:25.399>a

00:18:25.400 --> 00:18:28.150 align:start position:0%
<00:18:25.400>if <00:18:25.516>you <00:18:25.633>just <00:18:25.750>write <00:18:25.866>some <00:18:25.983>data <00:18:26.100>once, <00:18:26.216>a <00:18:26.333>single <00:18:26.450>writer, <00:18:26.566>not <00:18:26.683>multi-process <00:18:26.800>writer,

00:18:28.150 --> 00:18:28.160 align:start position:0%
<00:18:28.150>single <00:18:28.152>writer, <00:18:28.154>not <00:18:28.156>multi-process <00:18:28.159>writer,

00:18:28.160 --> 00:18:29.750 align:start position:0%
<00:18:28.160>single <00:18:28.287>writer, <00:18:28.414>not <00:18:28.541>multi-process <00:18:28.669>writer, <00:18:28.796>um <00:18:28.923>and <00:18:29.050>it's <00:18:29.178>just <00:18:29.305>a <00:18:29.432>file <00:18:29.560>directory,

00:18:29.750 --> 00:18:29.760 align:start position:0%
<00:18:29.750>um <00:18:29.751>and <00:18:29.753>it's <00:18:29.754>just <00:18:29.756>a <00:18:29.757>file <00:18:29.759>directory,

00:18:29.760 --> 00:18:31.870 align:start position:0%
<00:18:29.760>um <00:18:29.867>and <00:18:29.975>it's <00:18:30.083>just <00:18:30.190>a <00:18:30.298>file <00:18:30.406>directory, <00:18:30.513>you're <00:18:30.621>fine <00:18:30.729>with <00:18:30.836>parquet. <00:18:30.944>Just <00:18:31.052>if <00:18:31.160>you

00:18:31.870 --> 00:18:31.880 align:start position:0%
<00:18:31.870>you're <00:18:31.871>fine <00:18:31.873>with <00:18:31.874>parquet. <00:18:31.876>Just <00:18:31.877>if <00:18:31.879>you

00:18:31.880 --> 00:18:32.750 align:start position:0%
<00:18:31.880>you're <00:18:31.991>fine <00:18:32.103>with <00:18:32.215>parquet. <00:18:32.327>Just <00:18:32.439>if <00:18:32.551>you <00:18:32.663>write

00:18:32.750 --> 00:18:32.760 align:start position:0%
write

00:18:32.760 --> 00:18:34.590 align:start position:0%
<00:18:32.760>write <00:18:32.993>want <00:18:33.226>to <00:18:33.460>efficiently <00:18:33.693>write <00:18:33.926>data <00:18:34.160>that

00:18:34.590 --> 00:18:34.600 align:start position:0%
<00:18:34.590>want <00:18:34.591>to <00:18:34.593>efficiently <00:18:34.595>write <00:18:34.597>data <00:18:34.599>that

00:18:34.600 --> 00:18:36.230 align:start position:0%
<00:18:34.600>want <00:18:34.716>to <00:18:34.833>efficiently <00:18:34.949>write <00:18:35.066>data <00:18:35.183>that <00:18:35.300>someone <00:18:35.416>else <00:18:35.533>reads <00:18:35.649>and <00:18:35.766>you <00:18:35.883>just <00:18:36.000>pull

00:18:36.230 --> 00:18:36.240 align:start position:0%
<00:18:36.230>someone <00:18:36.231>else <00:18:36.233>reads <00:18:36.234>and <00:18:36.236>you <00:18:36.237>just <00:18:36.239>pull

00:18:36.240 --> 00:18:38.830 align:start position:0%
<00:18:36.240>someone <00:18:36.356>else <00:18:36.473>reads <00:18:36.590>and <00:18:36.706>you <00:18:36.823>just <00:18:36.940>pull <00:18:37.056>over <00:18:37.173>the <00:18:37.290>file, <00:18:37.406>parquet <00:18:37.523>is <00:18:37.640>fine.

00:18:38.830 --> 00:18:38.840 align:start position:0%
<00:18:38.830>over <00:18:38.831>the <00:18:38.833>file, <00:18:38.835>parquet <00:18:38.837>is <00:18:38.839>fine.

00:18:38.840 --> 00:18:41.310 align:start position:0%
<00:18:38.840>over <00:18:38.980>the <00:18:39.120>file, <00:18:39.260>parquet <00:18:39.399>is <00:18:39.540>fine. <00:18:39.679>If <00:18:39.820>you <00:18:39.959>go <00:18:40.100>with <00:18:40.240>um

00:18:41.310 --> 00:18:41.320 align:start position:0%
<00:18:41.310>If <00:18:41.312>you <00:18:41.314>go <00:18:41.316>with <00:18:41.319>um

00:18:41.320 --> 00:18:43.190 align:start position:0%
<00:18:41.320>If <00:18:41.460>you <00:18:41.600>go <00:18:41.740>with <00:18:41.879>um <00:18:42.020>an <00:18:42.159>data <00:18:42.300>analytics <00:18:42.439>solution, <00:18:42.580>you <00:18:42.720>would

00:18:43.190 --> 00:18:43.200 align:start position:0%
<00:18:43.190>an <00:18:43.191>data <00:18:43.193>analytics <00:18:43.195>solution, <00:18:43.197>you <00:18:43.199>would

00:18:43.200 --> 00:18:45.230 align:start position:0%
<00:18:43.200>an <00:18:43.307>data <00:18:43.415>analytics <00:18:43.523>solution, <00:18:43.630>you <00:18:43.738>would <00:18:43.846>likely <00:18:43.953>go <00:18:44.061>with <00:18:44.169>Iceberg. <00:18:44.276>It <00:18:44.384>has <00:18:44.492>the <00:18:44.600>has

00:18:45.230 --> 00:18:45.240 align:start position:0%
<00:18:45.230>likely <00:18:45.231>go <00:18:45.232>with <00:18:45.233>Iceberg. <00:18:45.235>It <00:18:45.236>has <00:18:45.237>the <00:18:45.239>has

00:18:45.240 --> 00:18:48.230 align:start position:0%
<00:18:45.240>likely <00:18:45.340>go <00:18:45.440>with <00:18:45.540>Iceberg. <00:18:45.640>It <00:18:45.740>has <00:18:45.840>the <00:18:45.940>has <00:18:46.040>the <00:18:46.140>wide <00:18:46.240>and <00:18:46.340>the <00:18:46.440>widest <00:18:46.540>adoption <00:18:46.640>um

00:18:48.230 --> 00:18:48.240 align:start position:0%
<00:18:48.230>the <00:18:48.231>wide <00:18:48.233>and <00:18:48.234>the <00:18:48.236>widest <00:18:48.237>adoption <00:18:48.239>um

00:18:48.240 --> 00:18:50.230 align:start position:0%
<00:18:48.240>the <00:18:48.340>wide <00:18:48.440>and <00:18:48.540>the <00:18:48.640>widest <00:18:48.740>adoption <00:18:48.840>um <00:18:48.940>overall. <00:18:49.040>A <00:18:49.140>lot <00:18:49.240>of <00:18:49.340>tools <00:18:49.440>and <00:18:49.540>vendors <00:18:49.640>are

00:18:50.230 --> 00:18:50.240 align:start position:0%
<00:18:50.230>overall. <00:18:50.231>A <00:18:50.232>lot <00:18:50.233>of <00:18:50.235>tools <00:18:50.236>and <00:18:50.237>vendors <00:18:50.239>are

00:18:50.240 --> 00:18:51.950 align:start position:0%
<00:18:50.240>overall. <00:18:50.347>A <00:18:50.455>lot <00:18:50.563>of <00:18:50.670>tools <00:18:50.778>and <00:18:50.886>vendors <00:18:50.993>are <00:18:51.101>now <00:18:51.209>reading <00:18:51.316>and <00:18:51.424>writing <00:18:51.532>Iceberg. <00:18:51.640>It's

00:18:51.950 --> 00:18:51.960 align:start position:0%
<00:18:51.950>now <00:18:51.951>reading <00:18:51.953>and <00:18:51.955>writing <00:18:51.957>Iceberg. <00:18:51.959>It's

00:18:51.960 --> 00:18:53.470 align:start position:0%
<00:18:51.960>now <00:18:52.083>reading <00:18:52.207>and <00:18:52.330>writing <00:18:52.454>Iceberg. <00:18:52.577>It's <00:18:52.701>the <00:18:52.824>default <00:18:52.948>basically <00:18:53.071>when <00:18:53.195>you <00:18:53.319>really

00:18:53.470 --> 00:18:53.480 align:start position:0%
<00:18:53.470>the <00:18:53.471>default <00:18:53.473>basically <00:18:53.475>when <00:18:53.477>you <00:18:53.479>really

00:18:53.480 --> 00:18:55.590 align:start position:0%
<00:18:53.480>the <00:18:53.620>default <00:18:53.760>basically <00:18:53.900>when <00:18:54.040>you <00:18:54.180>really <00:18:54.320>need <00:18:54.460>this <00:18:54.600>open <00:18:54.740>table <00:18:54.880>format.

00:18:55.590 --> 00:18:55.600 align:start position:0%
<00:18:55.590>need <00:18:55.592>this <00:18:55.594>open <00:18:55.596>table <00:18:55.599>format.

00:18:55.600 --> 00:18:57.510 align:start position:0%
<00:18:55.600>need <00:18:55.833>this <00:18:56.066>open <00:18:56.300>table <00:18:56.533>format. <00:18:56.766>The <00:18:57.000>only

00:18:57.510 --> 00:18:57.520 align:start position:0%
<00:18:57.510>The <00:18:57.519>only

00:18:57.520 --> 00:18:59.310 align:start position:0%
<00:18:57.520>The <00:18:57.675>only <00:18:57.831>exception <00:18:57.986>I <00:18:58.142>would <00:18:58.297>make <00:18:58.453>from <00:18:58.608>this <00:18:58.764>is <00:18:58.920>if

00:18:59.310 --> 00:18:59.320 align:start position:0%
<00:18:59.310>exception <00:18:59.311>I <00:18:59.312>would <00:18:59.313>make <00:18:59.315>from <00:18:59.316>this <00:18:59.317>is <00:18:59.319>if

00:18:59.320 --> 00:19:01.630 align:start position:0%
<00:18:59.320>exception <00:18:59.413>I <00:18:59.506>would <00:18:59.600>make <00:18:59.693>from <00:18:59.786>this <00:18:59.879>is <00:18:59.973>if <00:19:00.066>you <00:19:00.159>are <00:19:00.253>uh <00:19:00.346>working <00:19:00.439>in <00:19:00.533>Databricks <00:19:00.626>or <00:19:00.720>MS

00:19:01.630 --> 00:19:01.640 align:start position:0%
<00:19:01.630>you <00:19:01.631>are <00:19:01.632>uh <00:19:01.633>working <00:19:01.635>in <00:19:01.636>Databricks <00:19:01.637>or <00:19:01.639>MS

00:19:01.640 --> 00:19:03.750 align:start position:0%
<00:19:01.640>you <00:19:01.756>are <00:19:01.873>uh <00:19:01.990>working <00:19:02.106>in <00:19:02.223>Databricks <00:19:02.340>or <00:19:02.456>MS <00:19:02.573>Fabric, <00:19:02.690>so <00:19:02.806>more <00:19:02.923>analytical <00:19:03.040>environments,

00:19:03.750 --> 00:19:03.760 align:start position:0%
<00:19:03.750>Fabric, <00:19:03.752>so <00:19:03.754>more <00:19:03.756>analytical <00:19:03.759>environments,

00:19:03.760 --> 00:19:05.350 align:start position:0%
<00:19:03.760>Fabric, <00:19:03.900>so <00:19:04.040>more <00:19:04.180>analytical <00:19:04.320>environments, <00:19:04.460>they <00:19:04.600>are <00:19:04.740>basically <00:19:04.879>Delta <00:19:05.020>native. <00:19:05.160>Then

00:19:05.350 --> 00:19:05.360 align:start position:0%
<00:19:05.350>they <00:19:05.351>are <00:19:05.353>basically <00:19:05.355>Delta <00:19:05.357>native. <00:19:05.359>Then

00:19:05.360 --> 00:19:07.470 align:start position:0%
<00:19:05.360>they <00:19:05.459>are <00:19:05.560>basically <00:19:05.659>Delta <00:19:05.760>native. <00:19:05.860>Then <00:19:05.959>you <00:19:06.060>end <00:19:06.159>up <00:19:06.260>with <00:19:06.360>Delta <00:19:06.459>most <00:19:06.560>of <00:19:06.659>the <00:19:06.760>time.

00:19:07.470 --> 00:19:07.480 align:start position:0%
<00:19:07.470>you <00:19:07.471>end <00:19:07.472>up <00:19:07.473>with <00:19:07.474>Delta <00:19:07.475>most <00:19:07.476>of <00:19:07.477>the <00:19:07.479>time.

00:19:07.480 --> 00:19:09.590 align:start position:0%
<00:19:07.480>you <00:19:07.567>end <00:19:07.655>up <00:19:07.742>with <00:19:07.830>Delta <00:19:07.917>most <00:19:08.005>of <00:19:08.092>the <00:19:08.180>time. <00:19:08.267>But <00:19:08.355>to <00:19:08.442>be <00:19:08.530>honest, <00:19:08.617>it <00:19:08.705>only <00:19:08.792>works <00:19:08.880>with

00:19:09.590 --> 00:19:09.600 align:start position:0%
<00:19:09.590>But <00:19:09.591>to <00:19:09.592>be <00:19:09.593>honest, <00:19:09.595>it <00:19:09.596>only <00:19:09.597>works <00:19:09.599>with

00:19:09.600 --> 00:19:11.710 align:start position:0%
<00:19:09.600>But <00:19:09.707>to <00:19:09.815>be <00:19:09.923>honest, <00:19:10.030>it <00:19:10.138>only <00:19:10.246>works <00:19:10.353>with <00:19:10.461>their <00:19:10.569>catalog, <00:19:10.676>the <00:19:10.784>open <00:19:10.892>source <00:19:11.000>catalog

00:19:11.710 --> 00:19:11.720 align:start position:0%
<00:19:11.710>their <00:19:11.711>catalog, <00:19:11.713>the <00:19:11.715>open <00:19:11.717>source <00:19:11.719>catalog

00:19:11.720 --> 00:19:13.470 align:start position:0%
<00:19:11.720>their <00:19:11.836>catalog, <00:19:11.953>the <00:19:12.070>open <00:19:12.186>source <00:19:12.303>catalog <00:19:12.420>that <00:19:12.536>is <00:19:12.653>also <00:19:12.770>available. <00:19:12.886>It's <00:19:13.003>in <00:19:13.120>my

00:19:13.470 --> 00:19:13.480 align:start position:0%
<00:19:13.470>that <00:19:13.471>is <00:19:13.473>also <00:19:13.474>available. <00:19:13.476>It's <00:19:13.477>in <00:19:13.479>my

00:19:13.480 --> 00:19:16.110 align:start position:0%
<00:19:13.480>that <00:19:13.587>is <00:19:13.695>also <00:19:13.803>available. <00:19:13.910>It's <00:19:14.018>in <00:19:14.126>my <00:19:14.233>opinion <00:19:14.341>barely <00:19:14.449>usable. <00:19:14.556>They <00:19:14.664>market <00:19:14.772>it <00:19:14.880>as

00:19:16.110 --> 00:19:16.120 align:start position:0%
<00:19:16.110>opinion <00:19:16.111>barely <00:19:16.112>usable. <00:19:16.114>They <00:19:16.116>market <00:19:16.117>it <00:19:16.119>as

00:19:16.120 --> 00:19:17.470 align:start position:0%
<00:19:16.120>opinion <00:19:16.254>barely <00:19:16.389>usable. <00:19:16.524>They <00:19:16.659>market <00:19:16.795>it <00:19:16.930>as <00:19:17.065>as <00:19:17.200>an <00:19:17.335>open-source

00:19:17.470 --> 00:19:17.480 align:start position:0%
<00:19:17.470>as <00:19:17.474>an <00:19:17.479>open-source

00:19:17.480 --> 00:19:19.630 align:start position:0%
<00:19:17.480>as <00:19:17.635>an <00:19:17.791>open-source <00:19:17.946>data <00:19:18.102>product, <00:19:18.257>and <00:19:18.413>but <00:19:18.568>the <00:19:18.724>features <00:19:18.880>are

00:19:19.630 --> 00:19:19.640 align:start position:0%
<00:19:19.630>data <00:19:19.631>product, <00:19:19.633>and <00:19:19.634>but <00:19:19.636>the <00:19:19.637>features <00:19:19.639>are

00:19:19.640 --> 00:19:22.310 align:start position:0%
<00:19:19.640>data <00:19:19.756>product, <00:19:19.873>and <00:19:19.990>but <00:19:20.106>the <00:19:20.223>features <00:19:20.340>are <00:19:20.456>basically <00:19:20.573>lagging <00:19:20.690>so <00:19:20.806>far <00:19:20.923>behind <00:19:21.040>behind

00:19:22.310 --> 00:19:22.320 align:start position:0%
<00:19:22.310>basically <00:19:22.311>lagging <00:19:22.313>so <00:19:22.315>far <00:19:22.317>behind <00:19:22.319>behind

00:19:22.320 --> 00:19:24.950 align:start position:0%
<00:19:22.320>basically <00:19:22.460>lagging <00:19:22.600>so <00:19:22.740>far <00:19:22.879>behind <00:19:23.020>behind <00:19:23.159>the <00:19:23.300>Databricks <00:19:23.439>native <00:19:23.580>catalog. <00:19:23.720>I

00:19:24.950 --> 00:19:24.960 align:start position:0%
<00:19:24.950>the <00:19:24.952>Databricks <00:19:24.954>native <00:19:24.956>catalog. <00:19:24.959>I

00:19:24.960 --> 00:19:26.190 align:start position:0%
<00:19:24.960>the <00:19:25.118>Databricks <00:19:25.276>native <00:19:25.434>catalog. <00:19:25.592>I <00:19:25.750>wouldn't <00:19:25.908>use <00:19:26.067>it.

00:19:26.190 --> 00:19:26.200 align:start position:0%
<00:19:26.190>wouldn't <00:19:26.194>use <00:19:26.199>it.

00:19:26.200 --> 00:19:28.230 align:start position:0%
<00:19:26.200>wouldn't <00:19:26.355>use <00:19:26.511>it. <00:19:26.666>DuckDB <00:19:26.822>is <00:19:26.977>in <00:19:27.133>my <00:19:27.288>opinion <00:19:27.444>definitely <00:19:27.600>the

00:19:28.230 --> 00:19:28.240 align:start position:0%
<00:19:28.230>DuckDB <00:19:28.231>is <00:19:28.233>in <00:19:28.234>my <00:19:28.236>opinion <00:19:28.237>definitely <00:19:28.239>the

00:19:28.240 --> 00:19:29.430 align:start position:0%
<00:19:28.240>DuckDB <00:19:28.393>is <00:19:28.546>in <00:19:28.699>my <00:19:28.852>opinion <00:19:29.005>definitely <00:19:29.158>the <00:19:29.311>most

00:19:29.430 --> 00:19:29.440 align:start position:0%
most

00:19:29.440 --> 00:19:32.590 align:start position:0%
<00:19:29.440>most <00:19:29.720>the <00:19:30.000>technical <00:19:30.280>superior <00:19:30.560>solution. <00:19:30.840>It's

00:19:32.590 --> 00:19:32.600 align:start position:0%
<00:19:32.590>the <00:19:32.592>technical <00:19:32.594>superior <00:19:32.596>solution. <00:19:32.599>It's

00:19:32.600 --> 00:19:35.230 align:start position:0%
<00:19:32.600>the <00:19:32.716>technical <00:19:32.833>superior <00:19:32.949>solution. <00:19:33.066>It's <00:19:33.183>fast. <00:19:33.300>It's <00:19:33.416>easy <00:19:33.533>to <00:19:33.649>use. <00:19:33.766>It's <00:19:33.883>not <00:19:34.000>overly

00:19:35.230 --> 00:19:35.240 align:start position:0%
<00:19:35.230>fast. <00:19:35.231>It's <00:19:35.232>easy <00:19:35.233>to <00:19:35.235>use. <00:19:35.236>It's <00:19:35.237>not <00:19:35.239>overly

00:19:35.240 --> 00:19:36.670 align:start position:0%
<00:19:35.240>fast. <00:19:35.331>It's <00:19:35.423>easy <00:19:35.515>to <00:19:35.607>use. <00:19:35.699>It's <00:19:35.791>not <00:19:35.883>overly <00:19:35.975>complex. <00:19:36.067>You <00:19:36.159>don't <00:19:36.251>have <00:19:36.343>to <00:19:36.435>understand <00:19:36.527>a

00:19:36.670 --> 00:19:36.680 align:start position:0%
<00:19:36.670>complex. <00:19:36.671>You <00:19:36.673>don't <00:19:36.674>have <00:19:36.676>to <00:19:36.677>understand <00:19:36.679>a

00:19:36.680 --> 00:19:38.310 align:start position:0%
<00:19:36.680>complex. <00:19:36.780>You <00:19:36.880>don't <00:19:36.980>have <00:19:37.080>to <00:19:37.180>understand <00:19:37.280>a <00:19:37.380>lot <00:19:37.480>of <00:19:37.580>files <00:19:37.680>and <00:19:37.780>how <00:19:37.880>they <00:19:37.980>behave. <00:19:38.080>You

00:19:38.310 --> 00:19:38.320 align:start position:0%
<00:19:38.310>lot <00:19:38.311>of <00:19:38.312>files <00:19:38.313>and <00:19:38.315>how <00:19:38.316>they <00:19:38.317>behave. <00:19:38.319>You

00:19:38.320 --> 00:19:40.790 align:start position:0%
<00:19:38.320>lot <00:19:38.419>of <00:19:38.520>files <00:19:38.620>and <00:19:38.720>how <00:19:38.820>they <00:19:38.919>behave. <00:19:39.020>You <00:19:39.120>just <00:19:39.220>have <00:19:39.320>a <00:19:39.419>database <00:19:39.520>in <00:19:39.620>Parquet <00:19:39.720>files.

00:19:40.790 --> 00:19:40.800 align:start position:0%
<00:19:40.790>just <00:19:40.791>have <00:19:40.793>a <00:19:40.794>database <00:19:40.796>in <00:19:40.797>Parquet <00:19:40.799>files.

00:19:40.800 --> 00:19:42.670 align:start position:0%
<00:19:40.800>just <00:19:40.893>have <00:19:40.986>a <00:19:41.080>database <00:19:41.173>in <00:19:41.266>Parquet <00:19:41.360>files. <00:19:41.453>You <00:19:41.546>can <00:19:41.639>set <00:19:41.733>it <00:19:41.826>up <00:19:41.919>in <00:19:42.013>seconds <00:19:42.106>or <00:19:42.200>minutes.

00:19:42.670 --> 00:19:42.680 align:start position:0%
<00:19:42.670>You <00:19:42.671>can <00:19:42.672>set <00:19:42.673>it <00:19:42.674>up <00:19:42.675>in <00:19:42.676>seconds <00:19:42.677>or <00:19:42.679>minutes.

00:19:42.680 --> 00:19:44.470 align:start position:0%
<00:19:42.680>You <00:19:42.780>can <00:19:42.880>set <00:19:42.980>it <00:19:43.080>up <00:19:43.180>in <00:19:43.280>seconds <00:19:43.380>or <00:19:43.480>minutes. <00:19:43.580>It's <00:19:43.680>really <00:19:43.780>really <00:19:43.880>easy <00:19:43.980>to <00:19:44.080>use.

00:19:44.470 --> 00:19:44.480 align:start position:0%
<00:19:44.470>It's <00:19:44.471>really <00:19:44.473>really <00:19:44.475>easy <00:19:44.477>to <00:19:44.479>use.

00:19:44.480 --> 00:19:46.270 align:start position:0%
<00:19:44.480>It's <00:19:44.607>really <00:19:44.734>really <00:19:44.861>easy <00:19:44.989>to <00:19:45.116>use. <00:19:45.243>Um <00:19:45.370>especially <00:19:45.498>if <00:19:45.625>you're <00:19:45.752>working <00:19:45.880>with

00:19:46.270 --> 00:19:46.280 align:start position:0%
<00:19:46.270>Um <00:19:46.271>especially <00:19:46.273>if <00:19:46.275>you're <00:19:46.277>working <00:19:46.279>with

00:19:46.280 --> 00:19:48.150 align:start position:0%
<00:19:46.280>Um <00:19:46.379>especially <00:19:46.480>if <00:19:46.580>you're <00:19:46.680>working <00:19:46.780>with <00:19:46.879>DuckDB <00:19:46.980>or <00:19:47.080>want <00:19:47.180>to <00:19:47.280>have <00:19:47.379>it <00:19:47.480>in <00:19:47.580>as <00:19:47.680>a

00:19:48.150 --> 00:19:48.160 align:start position:0%
<00:19:48.150>DuckDB <00:19:48.151>or <00:19:48.152>want <00:19:48.153>to <00:19:48.154>have <00:19:48.155>it <00:19:48.156>in <00:19:48.157>as <00:19:48.159>a

00:19:48.160 --> 00:19:50.030 align:start position:0%
<00:19:48.160>DuckDB <00:19:48.267>or <00:19:48.375>want <00:19:48.483>to <00:19:48.590>have <00:19:48.698>it <00:19:48.806>in <00:19:48.913>as <00:19:49.021>a <00:19:49.129>managed <00:19:49.236>service <00:19:49.344>like <00:19:49.452>with <00:19:49.560>Motherduck.

00:19:50.030 --> 00:19:50.040 align:start position:0%
<00:19:50.030>managed <00:19:50.032>service <00:19:50.034>like <00:19:50.036>with <00:19:50.039>Motherduck.

00:19:50.040 --> 00:19:51.910 align:start position:0%
<00:19:50.040>managed <00:19:50.180>service <00:19:50.320>like <00:19:50.460>with <00:19:50.600>Motherduck. <00:19:50.740>So, <00:19:50.879>if <00:19:51.020>you <00:19:51.159>want <00:19:51.300>give <00:19:51.440>them

00:19:51.910 --> 00:19:51.920 align:start position:0%
<00:19:51.910>So, <00:19:51.911>if <00:19:51.913>you <00:19:51.915>want <00:19:51.917>give <00:19:51.919>them

00:19:51.920 --> 00:19:53.030 align:start position:0%
<00:19:51.920>So, <00:19:52.003>if <00:19:52.086>you <00:19:52.169>want <00:19:52.253>give <00:19:52.336>them <00:19:52.419>spend <00:19:52.502>them <00:19:52.586>a <00:19:52.669>visit. <00:19:52.752>They're <00:19:52.835>having <00:19:52.918>a

00:19:53.030 --> 00:19:53.040 align:start position:0%
<00:19:53.030>spend <00:19:53.031>them <00:19:53.033>a <00:19:53.034>visit. <00:19:53.036>They're <00:19:53.037>having <00:19:53.039>a

00:19:53.040 --> 00:19:54.870 align:start position:0%
<00:19:53.040>spend <00:19:53.167>them <00:19:53.294>a <00:19:53.421>visit. <00:19:53.549>They're <00:19:53.676>having <00:19:53.803>a <00:19:53.930>booth <00:19:54.058>as <00:19:54.185>well. <00:19:54.312>They <00:19:54.440>will

00:19:54.870 --> 00:19:54.880 align:start position:0%
<00:19:54.870>booth <00:19:54.872>as <00:19:54.874>well. <00:19:54.876>They <00:19:54.879>will

00:19:54.880 --> 00:19:57.590 align:start position:0%
<00:19:54.880>booth <00:19:55.007>as <00:19:55.134>well. <00:19:55.261>They <00:19:55.389>will <00:19:55.516>happily <00:19:55.643>show <00:19:55.770>you <00:19:55.898>this, <00:19:56.025>I <00:19:56.152>guess. <00:19:56.280>Um

00:19:57.590 --> 00:19:57.600 align:start position:0%
<00:19:57.590>happily <00:19:57.591>show <00:19:57.592>you <00:19:57.594>this, <00:19:57.596>I <00:19:57.597>guess. <00:19:57.599>Um

00:19:57.600 --> 00:19:59.510 align:start position:0%
<00:19:57.600>happily <00:19:57.699>show <00:19:57.800>you <00:19:57.899>this, <00:19:58.000>I <00:19:58.100>guess. <00:19:58.199>Um <00:19:58.300>but <00:19:58.399>DuckDB <00:19:58.500>is <00:19:58.600>not <00:19:58.699>as <00:19:58.800>widespread. <00:19:58.899>If <00:19:59.000>you

00:19:59.510 --> 00:19:59.520 align:start position:0%
<00:19:59.510>but <00:19:59.511>DuckDB <00:19:59.512>is <00:19:59.513>not <00:19:59.515>as <00:19:59.516>widespread. <00:19:59.517>If <00:19:59.519>you

00:19:59.520 --> 00:20:00.510 align:start position:0%
<00:19:59.520>but <00:19:59.631>DuckDB <00:19:59.742>is <00:19:59.854>not <00:19:59.965>as <00:20:00.076>widespread. <00:20:00.188>If <00:20:00.299>you <00:20:00.411>just

00:20:00.510 --> 00:20:00.520 align:start position:0%
just

00:20:00.520 --> 00:20:02.590 align:start position:0%
<00:20:00.520>just <00:20:00.695>use <00:20:00.870>it <00:20:01.045>yourself, <00:20:01.220>don't <00:20:01.395>have <00:20:01.570>a <00:20:01.745>lot <00:20:01.920>of

00:20:02.590 --> 00:20:02.600 align:start position:0%
<00:20:02.590>use <00:20:02.591>it <00:20:02.592>yourself, <00:20:02.593>don't <00:20:02.595>have <00:20:02.596>a <00:20:02.597>lot <00:20:02.599>of

00:20:02.600 --> 00:20:04.830 align:start position:0%
<00:20:02.600>use <00:20:02.716>it <00:20:02.833>yourself, <00:20:02.949>don't <00:20:03.066>have <00:20:03.183>a <00:20:03.300>lot <00:20:03.416>of <00:20:03.533>different <00:20:03.649>consumers, <00:20:03.766>go <00:20:03.883>with <00:20:04.000>DuckDB

00:20:04.830 --> 00:20:04.840 align:start position:0%
<00:20:04.830>different <00:20:04.832>consumers, <00:20:04.834>go <00:20:04.836>with <00:20:04.839>DuckDB

00:20:04.840 --> 00:20:07.470 align:start position:0%
<00:20:04.840>different <00:20:04.956>consumers, <00:20:05.073>go <00:20:05.189>with <00:20:05.306>DuckDB <00:20:05.423>DuckDB, <00:20:05.540>it <00:20:05.656>works <00:20:05.773>fine. <00:20:05.889>Um <00:20:06.006>if <00:20:06.123>you <00:20:06.240>like

00:20:07.470 --> 00:20:07.480 align:start position:0%
<00:20:07.470>DuckDB, <00:20:07.471>it <00:20:07.472>works <00:20:07.473>fine. <00:20:07.475>Um <00:20:07.476>if <00:20:07.477>you <00:20:07.479>like

00:20:07.480 --> 00:20:08.870 align:start position:0%
<00:20:07.480>DuckDB, <00:20:07.584>it <00:20:07.688>works <00:20:07.792>fine. <00:20:07.897>Um <00:20:08.001>if <00:20:08.105>you <00:20:08.209>like <00:20:08.313>build <00:20:08.418>like <00:20:08.522>the <00:20:08.626>modern <00:20:08.731>enterprise

00:20:08.870 --> 00:20:08.880 align:start position:0%
<00:20:08.870>build <00:20:08.872>like <00:20:08.874>the <00:20:08.876>modern <00:20:08.879>enterprise

00:20:08.880 --> 00:20:10.430 align:start position:0%
<00:20:08.880>build <00:20:08.996>like <00:20:09.112>the <00:20:09.228>modern <00:20:09.345>enterprise <00:20:09.461>solution <00:20:09.577>that <00:20:09.693>you <00:20:09.810>see <00:20:09.926>a <00:20:10.042>lot <00:20:10.158>of <00:20:10.275>different

00:20:10.430 --> 00:20:10.440 align:start position:0%
<00:20:10.430>solution <00:20:10.431>that <00:20:10.432>you <00:20:10.433>see <00:20:10.435>a <00:20:10.436>lot <00:20:10.437>of <00:20:10.439>different

00:20:10.440 --> 00:20:12.310 align:start position:0%
<00:20:10.440>solution <00:20:10.556>that <00:20:10.673>you <00:20:10.790>see <00:20:10.906>a <00:20:11.023>lot <00:20:11.140>of <00:20:11.256>different <00:20:11.373>clients <00:20:11.490>and <00:20:11.606>technologies <00:20:11.723>connecting <00:20:11.840>to

00:20:12.310 --> 00:20:12.320 align:start position:0%
<00:20:12.310>clients <00:20:12.312>and <00:20:12.314>technologies <00:20:12.316>connecting <00:20:12.319>to

00:20:12.320 --> 00:20:14.990 align:start position:0%
<00:20:12.320>clients <00:20:12.436>and <00:20:12.553>technologies <00:20:12.669>connecting <00:20:12.786>to <00:20:12.903>this, <00:20:13.020>DuckDB <00:20:13.136>might <00:20:13.253>need <00:20:13.370>a <00:20:13.486>year <00:20:13.603>or <00:20:13.720>two,

00:20:14.990 --> 00:20:15.000 align:start position:0%
<00:20:14.990>this, <00:20:14.991>DuckDB <00:20:14.992>might <00:20:14.993>need <00:20:14.995>a <00:20:14.996>year <00:20:14.997>or <00:20:14.999>two,

00:20:15.000 --> 00:20:18.910 align:start position:0%
<00:20:15.000>this, <00:20:15.116>DuckDB <00:20:15.233>might <00:20:15.350>need <00:20:15.466>a <00:20:15.583>year <00:20:15.700>or <00:20:15.816>two, <00:20:15.933>but <00:20:16.050>it <00:20:16.166>might <00:20:16.283>come <00:20:16.400>there.

00:20:18.920 --> 00:20:20.310 align:start position:0%
<00:20:18.920>What <00:20:19.170>are <00:20:19.420>the <00:20:19.670>challenges <00:20:19.920>now? <00:20:20.171>So,

00:20:20.310 --> 00:20:20.320 align:start position:0%
<00:20:20.310>What <00:20:20.311>are <00:20:20.313>the <00:20:20.315>challenges <00:20:20.317>now? <00:20:20.319>So,

00:20:20.320 --> 00:20:22.750 align:start position:0%
<00:20:20.320>What <00:20:20.495>are <00:20:20.669>the <00:20:20.845>challenges <00:20:21.020>now? <00:20:21.195>So, <00:20:21.370>streaming <00:20:21.544>workloads, <00:20:21.720>um

00:20:22.750 --> 00:20:22.760 align:start position:0%
<00:20:22.750>streaming <00:20:22.754>workloads, <00:20:22.759>um

00:20:22.760 --> 00:20:24.110 align:start position:0%
<00:20:22.760>streaming <00:20:23.063>workloads, <00:20:23.367>um <00:20:23.671>the <00:20:23.975>reads

00:20:24.110 --> 00:20:24.120 align:start position:0%
<00:20:24.110>the <00:20:24.119>reads

00:20:24.120 --> 00:20:25.470 align:start position:0%
<00:20:24.120>the <00:20:24.423>reads <00:20:24.727>is <00:20:25.031>not <00:20:25.335>the

00:20:25.470 --> 00:20:25.480 align:start position:0%
<00:20:25.470>is <00:20:25.474>not <00:20:25.479>the

00:20:25.480 --> 00:20:27.350 align:start position:0%
<00:20:25.480>is <00:20:25.635>not <00:20:25.791>the <00:20:25.946>super <00:20:26.102>fastest <00:20:26.257>because <00:20:26.413>you <00:20:26.568>have <00:20:26.724>to <00:20:26.880>pass

00:20:27.350 --> 00:20:27.360 align:start position:0%
<00:20:27.350>super <00:20:27.351>fastest <00:20:27.352>because <00:20:27.354>you <00:20:27.356>have <00:20:27.357>to <00:20:27.359>pass

00:20:27.360 --> 00:20:29.310 align:start position:0%
<00:20:27.360>super <00:20:27.476>fastest <00:20:27.593>because <00:20:27.709>you <00:20:27.826>have <00:20:27.943>to <00:20:28.060>pass <00:20:28.176>through <00:20:28.293>all <00:20:28.409>these <00:20:28.526>metadata <00:20:28.643>files. <00:20:28.760>It's

00:20:29.310 --> 00:20:29.320 align:start position:0%
<00:20:29.310>through <00:20:29.311>all <00:20:29.313>these <00:20:29.315>metadata <00:20:29.317>files. <00:20:29.319>It's

00:20:29.320 --> 00:20:31.870 align:start position:0%
<00:20:29.320>through <00:20:29.427>all <00:20:29.535>these <00:20:29.643>metadata <00:20:29.750>files. <00:20:29.858>It's <00:20:29.966>always <00:20:30.073>a <00:20:30.181>little <00:20:30.289>bit <00:20:30.396>um <00:20:30.504>slower. <00:20:30.612>The <00:20:30.720>read

00:20:31.870 --> 00:20:31.880 align:start position:0%
<00:20:31.870>always <00:20:31.871>a <00:20:31.872>little <00:20:31.873>bit <00:20:31.875>um <00:20:31.876>slower. <00:20:31.877>The <00:20:31.879>read

00:20:31.880 --> 00:20:33.630 align:start position:0%
<00:20:31.880>always <00:20:31.987>a <00:20:32.095>little <00:20:32.203>bit <00:20:32.310>um <00:20:32.418>slower. <00:20:32.526>The <00:20:32.633>read <00:20:32.741>implication <00:20:32.849>every <00:20:32.956>time <00:20:33.064>you <00:20:33.172>write, <00:20:33.280>you

00:20:33.630 --> 00:20:33.640 align:start position:0%
<00:20:33.630>implication <00:20:33.631>every <00:20:33.633>time <00:20:33.635>you <00:20:33.637>write, <00:20:33.639>you

00:20:33.640 --> 00:20:35.790 align:start position:0%
<00:20:33.640>implication <00:20:33.733>every <00:20:33.826>time <00:20:33.920>you <00:20:34.013>write, <00:20:34.106>you <00:20:34.200>write <00:20:34.293>a <00:20:34.386>new <00:20:34.480>entry <00:20:34.573>to <00:20:34.666>a <00:20:34.760>log <00:20:34.853>or <00:20:34.946>a <00:20:35.040>metadata

00:20:35.790 --> 00:20:35.800 align:start position:0%
<00:20:35.790>write <00:20:35.791>a <00:20:35.792>new <00:20:35.793>entry <00:20:35.793>to <00:20:35.795>a <00:20:35.796>log <00:20:35.797>or <00:20:35.798>a <00:20:35.799>metadata

00:20:35.800 --> 00:20:37.630 align:start position:0%
<00:20:35.800>write <00:20:35.882>a <00:20:35.964>new <00:20:36.047>entry <00:20:36.129>to <00:20:36.211>a <00:20:36.294>log <00:20:36.376>or <00:20:36.458>a <00:20:36.541>metadata <00:20:36.623>file, <00:20:36.705>and <00:20:36.788>you <00:20:36.870>create <00:20:36.952>a <00:20:37.035>lot <00:20:37.117>of <00:20:37.200>snap

00:20:37.630 --> 00:20:37.640 align:start position:0%
<00:20:37.630>file, <00:20:37.631>and <00:20:37.632>you <00:20:37.633>create <00:20:37.635>a <00:20:37.636>lot <00:20:37.637>of <00:20:37.639>snap

00:20:37.640 --> 00:20:39.670 align:start position:0%
<00:20:37.640>file, <00:20:37.747>and <00:20:37.855>you <00:20:37.963>create <00:20:38.070>a <00:20:38.178>lot <00:20:38.286>of <00:20:38.393>snap <00:20:38.501>snapshots. <00:20:38.609>So, <00:20:38.716>this <00:20:38.824>isn't <00:20:38.932>really <00:20:39.040>fast

00:20:39.670 --> 00:20:39.680 align:start position:0%
<00:20:39.670>snapshots. <00:20:39.671>So, <00:20:39.673>this <00:20:39.675>isn't <00:20:39.677>really <00:20:39.679>fast

00:20:39.680 --> 00:20:42.430 align:start position:0%
<00:20:39.680>snapshots. <00:20:39.787>So, <00:20:39.895>this <00:20:40.003>isn't <00:20:40.110>really <00:20:40.218>fast <00:20:40.326>for <00:20:40.433>write <00:20:40.541>as <00:20:40.649>well. <00:20:40.756>And <00:20:40.864>together <00:20:40.972>with <00:20:41.080>all

00:20:42.430 --> 00:20:42.440 align:start position:0%
<00:20:42.430>for <00:20:42.431>write <00:20:42.432>as <00:20:42.433>well. <00:20:42.435>And <00:20:42.436>together <00:20:42.437>with <00:20:42.439>all

00:20:42.440 --> 00:20:44.870 align:start position:0%
<00:20:42.440>for <00:20:42.547>write <00:20:42.655>as <00:20:42.763>well. <00:20:42.870>And <00:20:42.978>together <00:20:43.086>with <00:20:43.193>all <00:20:43.301>the <00:20:43.409>applica- <00:20:43.516>I <00:20:43.624>applications <00:20:43.732>and <00:20:43.840>lookups

00:20:44.870 --> 00:20:44.880 align:start position:0%
<00:20:44.870>the <00:20:44.871>applica- <00:20:44.873>I <00:20:44.875>applications <00:20:44.877>and <00:20:44.879>lookups

00:20:44.880 --> 00:20:47.150 align:start position:0%
<00:20:44.880>the <00:20:44.980>applica- <00:20:45.080>I <00:20:45.180>applications <00:20:45.280>and <00:20:45.380>lookups <00:20:45.480>into <00:20:45.580>I <00:20:45.680>want <00:20:45.780>to <00:20:45.880>have <00:20:45.980>this <00:20:46.080>exact <00:20:46.180>value <00:20:46.280>and

00:20:47.150 --> 00:20:47.160 align:start position:0%
<00:20:47.150>into <00:20:47.151>I <00:20:47.152>want <00:20:47.153>to <00:20:47.154>have <00:20:47.155>this <00:20:47.156>exact <00:20:47.157>value <00:20:47.159>and

00:20:47.160 --> 00:20:49.670 align:start position:0%
<00:20:47.160>into <00:20:47.253>I <00:20:47.346>want <00:20:47.440>to <00:20:47.533>have <00:20:47.626>this <00:20:47.720>exact <00:20:47.813>value <00:20:47.906>and <00:20:48.000>not <00:20:48.093>some <00:20:48.186>aggregate <00:20:48.280>stuff, <00:20:48.373>um <00:20:48.466>it's <00:20:48.560>not

00:20:49.670 --> 00:20:49.680 align:start position:0%
<00:20:49.670>not <00:20:49.671>some <00:20:49.673>aggregate <00:20:49.674>stuff, <00:20:49.676>um <00:20:49.677>it's <00:20:49.679>not

00:20:49.680 --> 00:20:52.590 align:start position:0%
<00:20:49.680>not <00:20:49.787>some <00:20:49.895>aggregate <00:20:50.003>stuff, <00:20:50.110>um <00:20:50.218>it's <00:20:50.326>not <00:20:50.433>the <00:20:50.541>most <00:20:50.649>obvious <00:20:50.756>and <00:20:50.864>the <00:20:50.972>most <00:20:51.080>uh

00:20:52.590 --> 00:20:52.600 align:start position:0%
<00:20:52.590>the <00:20:52.591>most <00:20:52.592>obvious <00:20:52.594>and <00:20:52.596>the <00:20:52.597>most <00:20:52.599>uh

00:20:52.600 --> 00:20:55.070 align:start position:0%
<00:20:52.600>the <00:20:52.716>most <00:20:52.833>obvious <00:20:52.949>and <00:20:53.066>the <00:20:53.183>most <00:20:53.300>uh <00:20:53.416>the <00:20:53.533>most <00:20:53.649>the <00:20:53.766>fastest <00:20:53.883>solution. <00:20:54.000>Um

00:20:55.070 --> 00:20:55.080 align:start position:0%
<00:20:55.070>the <00:20:55.071>most <00:20:55.073>the <00:20:55.075>fastest <00:20:55.077>solution. <00:20:55.079>Um

00:20:55.080 --> 00:20:57.590 align:start position:0%
<00:20:55.080>the <00:20:55.196>most <00:20:55.313>the <00:20:55.429>fastest <00:20:55.546>solution. <00:20:55.663>Um <00:20:55.780>currently, <00:20:55.896>there's <00:20:56.013>work <00:20:56.129>on <00:20:56.246>this, <00:20:56.363>not <00:20:56.480>on

00:20:57.590 --> 00:20:57.600 align:start position:0%
<00:20:57.590>currently, <00:20:57.591>there's <00:20:57.592>work <00:20:57.594>on <00:20:57.596>this, <00:20:57.597>not <00:20:57.599>on

00:20:57.600 --> 00:20:59.430 align:start position:0%
<00:20:57.600>currently, <00:20:57.707>there's <00:20:57.815>work <00:20:57.923>on <00:20:58.030>this, <00:20:58.138>not <00:20:58.246>on <00:20:58.353>the <00:20:58.461>table <00:20:58.569>formats <00:20:58.676>itself, <00:20:58.784>but <00:20:58.892>on <00:20:59.000>the

00:20:59.430 --> 00:20:59.440 align:start position:0%
<00:20:59.430>the <00:20:59.431>table <00:20:59.433>formats <00:20:59.434>itself, <00:20:59.436>but <00:20:59.437>on <00:20:59.439>the

00:20:59.440 --> 00:21:01.310 align:start position:0%
<00:20:59.440>the <00:20:59.556>table <00:20:59.673>formats <00:20:59.790>itself, <00:20:59.906>but <00:21:00.023>on <00:21:00.140>the <00:21:00.256>data <00:21:00.373>layer. <00:21:00.490>Well, <00:21:00.606>there <00:21:00.723>might <00:21:00.840>actually

00:21:01.310 --> 00:21:01.320 align:start position:0%
<00:21:01.310>data <00:21:01.311>layer. <00:21:01.313>Well, <00:21:01.315>there <00:21:01.317>might <00:21:01.319>actually

00:21:01.320 --> 00:21:03.270 align:start position:0%
<00:21:01.320>data <00:21:01.436>layer. <00:21:01.553>Well, <00:21:01.669>there <00:21:01.786>might <00:21:01.903>actually <00:21:02.020>be <00:21:02.136>at <00:21:02.253>some <00:21:02.370>point <00:21:02.486>a <00:21:02.603>replacement <00:21:02.720>for

00:21:03.270 --> 00:21:03.280 align:start position:0%
<00:21:03.270>be <00:21:03.271>at <00:21:03.273>some <00:21:03.274>point <00:21:03.276>a <00:21:03.277>replacement <00:21:03.279>for

00:21:03.280 --> 00:21:06.030 align:start position:0%
<00:21:03.280>be <00:21:03.379>at <00:21:03.480>some <00:21:03.580>point <00:21:03.680>a <00:21:03.780>replacement <00:21:03.879>for <00:21:03.980>Parquet. <00:21:04.080>So, <00:21:04.180>that <00:21:04.280>is <00:21:04.379>the <00:21:04.480>Ice- <00:21:04.580>there <00:21:04.680>is

00:21:06.030 --> 00:21:06.040 align:start position:0%
<00:21:06.030>Parquet. <00:21:06.031>So, <00:21:06.032>that <00:21:06.033>is <00:21:06.035>the <00:21:06.036>Ice- <00:21:06.037>there <00:21:06.039>is

00:21:06.040 --> 00:21:07.750 align:start position:0%
<00:21:06.040>Parquet. <00:21:06.133>So, <00:21:06.226>that <00:21:06.320>is <00:21:06.413>the <00:21:06.506>Ice- <00:21:06.600>there <00:21:06.693>is <00:21:06.786>the <00:21:06.879>metadata <00:21:06.973>layer, <00:21:07.066>but <00:21:07.159>as <00:21:07.253>a <00:21:07.346>storage <00:21:07.440>we

00:21:07.750 --> 00:21:07.760 align:start position:0%
<00:21:07.750>the <00:21:07.751>metadata <00:21:07.752>layer, <00:21:07.753>but <00:21:07.755>as <00:21:07.756>a <00:21:07.757>storage <00:21:07.759>we

00:21:07.760 --> 00:21:09.710 align:start position:0%
<00:21:07.760>the <00:21:07.860>metadata <00:21:07.960>layer, <00:21:08.060>but <00:21:08.160>as <00:21:08.260>a <00:21:08.360>storage <00:21:08.460>we <00:21:08.560>don't <00:21:08.660>have <00:21:08.760>parquet <00:21:08.860>anymore <00:21:08.960>but <00:21:09.060>it <00:21:09.160>might

00:21:09.710 --> 00:21:09.720 align:start position:0%
<00:21:09.710>don't <00:21:09.711>have <00:21:09.713>parquet <00:21:09.714>anymore <00:21:09.716>but <00:21:09.717>it <00:21:09.719>might

00:21:09.720 --> 00:21:12.790 align:start position:0%
<00:21:09.720>don't <00:21:09.820>have <00:21:09.920>parquet <00:21:10.020>anymore <00:21:10.120>but <00:21:10.220>it <00:21:10.320>might <00:21:10.420>come <00:21:10.520>to <00:21:10.620>a <00:21:10.720>format <00:21:10.820>that <00:21:10.920>is <00:21:11.020>called <00:21:11.120>vertex

00:21:12.790 --> 00:21:12.800 align:start position:0%
<00:21:12.790>come <00:21:12.791>to <00:21:12.792>a <00:21:12.793>format <00:21:12.795>that <00:21:12.796>is <00:21:12.797>called <00:21:12.799>vertex

00:21:12.800 --> 00:21:14.630 align:start position:0%
<00:21:12.800>come <00:21:12.899>to <00:21:13.000>a <00:21:13.100>format <00:21:13.200>that <00:21:13.300>is <00:21:13.399>called <00:21:13.500>vertex <00:21:13.600>that <00:21:13.700>it <00:21:13.800>has <00:21:13.899>a <00:21:14.000>more <00:21:14.100>flexible <00:21:14.200>compression

00:21:14.630 --> 00:21:14.640 align:start position:0%
<00:21:14.630>that <00:21:14.631>it <00:21:14.633>has <00:21:14.634>a <00:21:14.636>more <00:21:14.637>flexible <00:21:14.639>compression

00:21:14.640 --> 00:21:16.510 align:start position:0%
<00:21:14.640>that <00:21:14.767>it <00:21:14.894>has <00:21:15.021>a <00:21:15.149>more <00:21:15.276>flexible <00:21:15.403>compression <00:21:15.530>more <00:21:15.658>flexible <00:21:15.785>encoding <00:21:15.912>where <00:21:16.040>you

00:21:16.510 --> 00:21:16.520 align:start position:0%
<00:21:16.510>more <00:21:16.512>flexible <00:21:16.514>encoding <00:21:16.516>where <00:21:16.519>you

00:21:16.520 --> 00:21:19.190 align:start position:0%
<00:21:16.520>more <00:21:16.660>flexible <00:21:16.800>encoding <00:21:16.940>where <00:21:17.080>you <00:21:17.220>actually <00:21:17.360>can <00:21:17.500>work <00:21:17.639>on <00:21:17.780>encoded <00:21:17.920>values

00:21:19.190 --> 00:21:19.200 align:start position:0%
<00:21:19.190>actually <00:21:19.191>can <00:21:19.193>work <00:21:19.195>on <00:21:19.197>encoded <00:21:19.199>values

00:21:19.200 --> 00:21:20.710 align:start position:0%
<00:21:19.200>actually <00:21:19.323>can <00:21:19.447>work <00:21:19.570>on <00:21:19.694>encoded <00:21:19.817>values <00:21:19.941>filter <00:21:20.064>on <00:21:20.188>encoded <00:21:20.311>values <00:21:20.435>instead <00:21:20.559>of

00:21:20.710 --> 00:21:20.720 align:start position:0%
<00:21:20.710>filter <00:21:20.711>on <00:21:20.713>encoded <00:21:20.715>values <00:21:20.717>instead <00:21:20.719>of

00:21:20.720 --> 00:21:23.030 align:start position:0%
<00:21:20.720>filter <00:21:20.860>on <00:21:21.000>encoded <00:21:21.140>values <00:21:21.280>instead <00:21:21.420>of <00:21:21.560>decoding <00:21:21.700>encoding <00:21:21.840>all <00:21:21.980>the <00:21:22.120>time

00:21:23.030 --> 00:21:23.040 align:start position:0%
<00:21:23.030>decoding <00:21:23.032>encoding <00:21:23.034>all <00:21:23.036>the <00:21:23.039>time

00:21:23.040 --> 00:21:25.270 align:start position:0%
<00:21:23.040>decoding <00:21:23.156>encoding <00:21:23.273>all <00:21:23.389>the <00:21:23.506>time <00:21:23.623>so <00:21:23.740>this <00:21:23.856>is <00:21:23.973>things <00:21:24.090>where <00:21:24.206>work <00:21:24.323>is <00:21:24.440>put

00:21:25.270 --> 00:21:25.280 align:start position:0%
<00:21:25.270>so <00:21:25.271>this <00:21:25.272>is <00:21:25.273>things <00:21:25.275>where <00:21:25.276>work <00:21:25.277>is <00:21:25.279>put

00:21:25.280 --> 00:21:27.070 align:start position:0%
<00:21:25.280>so <00:21:25.455>this <00:21:25.629>is <00:21:25.805>things <00:21:25.980>where <00:21:26.155>work <00:21:26.330>is <00:21:26.504>put <00:21:26.680>into.

00:21:27.070 --> 00:21:27.080 align:start position:0%
into.

00:21:27.080 --> 00:21:28.950 align:start position:0%
<00:21:27.080>into. <00:21:27.280>So <00:21:27.480>and <00:21:27.679>you <00:21:27.879>might <00:21:28.080>ask <00:21:28.280>yourself <00:21:28.480>hey

00:21:28.950 --> 00:21:28.960 align:start position:0%
<00:21:28.950>So <00:21:28.951>and <00:21:28.953>you <00:21:28.954>might <00:21:28.956>ask <00:21:28.957>yourself <00:21:28.959>hey

00:21:28.960 --> 00:21:31.030 align:start position:0%
<00:21:28.960>So <00:21:29.100>and <00:21:29.240>you <00:21:29.380>might <00:21:29.520>ask <00:21:29.660>yourself <00:21:29.800>hey <00:21:29.940>somebody <00:21:30.080>gave <00:21:30.220>me <00:21:30.360>an

00:21:31.030 --> 00:21:31.040 align:start position:0%
<00:21:31.030>somebody <00:21:31.033>gave <00:21:31.036>me <00:21:31.039>an

00:21:31.040 --> 00:21:32.470 align:start position:0%
<00:21:31.040>somebody <00:21:31.147>gave <00:21:31.254>me <00:21:31.361>an <00:21:31.469>parquet <00:21:31.576>file <00:21:31.683>and <00:21:31.790>now <00:21:31.898>I <00:21:32.005>have <00:21:32.112>to <00:21:32.219>read <00:21:32.327>it

00:21:32.470 --> 00:21:32.480 align:start position:0%
<00:21:32.470>parquet <00:21:32.471>file <00:21:32.472>and <00:21:32.473>now <00:21:32.474>I <00:21:32.475>have <00:21:32.476>to <00:21:32.477>read <00:21:32.479>it

00:21:32.480 --> 00:21:34.750 align:start position:0%
<00:21:32.480>parquet <00:21:32.562>file <00:21:32.644>and <00:21:32.727>now <00:21:32.809>I <00:21:32.891>have <00:21:32.974>to <00:21:33.056>read <00:21:33.138>it <00:21:33.221>and <00:21:33.303>some <00:21:33.385>I <00:21:33.468>don't <00:21:33.550>know <00:21:33.632>what <00:21:33.715>how <00:21:33.797>and <00:21:33.880>if

00:21:34.750 --> 00:21:34.760 align:start position:0%
<00:21:34.750>and <00:21:34.751>some <00:21:34.752>I <00:21:34.753>don't <00:21:34.754>know <00:21:34.755>what <00:21:34.756>how <00:21:34.757>and <00:21:34.759>if

00:21:34.760 --> 00:21:36.470 align:start position:0%
<00:21:34.760>and <00:21:34.842>some <00:21:34.924>I <00:21:35.007>don't <00:21:35.089>know <00:21:35.171>what <00:21:35.254>how <00:21:35.336>and <00:21:35.418>if <00:21:35.501>you <00:21:35.583>ever <00:21:35.665>try <00:21:35.748>to <00:21:35.830>write <00:21:35.912>Java <00:21:35.995>code <00:21:36.077>to <00:21:36.160>read

00:21:36.470 --> 00:21:36.480 align:start position:0%
<00:21:36.470>you <00:21:36.471>ever <00:21:36.472>try <00:21:36.473>to <00:21:36.474>write <00:21:36.475>Java <00:21:36.476>code <00:21:36.477>to <00:21:36.479>read

00:21:36.480 --> 00:21:38.110 align:start position:0%
<00:21:36.480>you <00:21:36.573>ever <00:21:36.666>try <00:21:36.760>to <00:21:36.853>write <00:21:36.946>Java <00:21:37.040>code <00:21:37.133>to <00:21:37.226>read <00:21:37.320>an <00:21:37.413>parquet <00:21:37.506>file <00:21:37.600>you <00:21:37.693>will <00:21:37.786>break <00:21:37.880>your

00:21:38.110 --> 00:21:38.120 align:start position:0%
<00:21:38.110>an <00:21:38.111>parquet <00:21:38.112>file <00:21:38.114>you <00:21:38.116>will <00:21:38.117>break <00:21:38.119>your

00:21:38.120 --> 00:21:39.510 align:start position:0%
<00:21:38.120>an <00:21:38.276>parquet <00:21:38.432>file <00:21:38.589>you <00:21:38.745>will <00:21:38.901>break <00:21:39.058>your <00:21:39.214>fingers <00:21:39.371>actually.

00:21:39.510 --> 00:21:39.520 align:start position:0%
<00:21:39.510>fingers <00:21:39.519>actually.

00:21:39.520 --> 00:21:40.830 align:start position:0%
<00:21:39.520>fingers <00:21:40.109>actually. <00:21:40.698>Um

00:21:40.830 --> 00:21:40.840 align:start position:0%
Um

00:21:40.840 --> 00:21:43.710 align:start position:0%
<00:21:40.840>Um <00:21:40.995>So <00:21:41.151>I <00:21:41.306>suppose <00:21:41.462>best <00:21:41.617>one <00:21:41.773>and <00:21:41.928>the <00:21:42.084>easiest <00:21:42.240>to

00:21:43.710 --> 00:21:43.720 align:start position:0%
<00:21:43.710>So <00:21:43.711>I <00:21:43.712>suppose <00:21:43.713>best <00:21:43.714>one <00:21:43.715>and <00:21:43.716>the <00:21:43.717>easiest <00:21:43.719>to

00:21:43.720 --> 00:21:46.150 align:start position:0%
<00:21:43.720>So <00:21:43.813>I <00:21:43.906>suppose <00:21:44.000>best <00:21:44.093>one <00:21:44.186>and <00:21:44.280>the <00:21:44.373>easiest <00:21:44.466>to <00:21:44.560>use <00:21:44.653>solution <00:21:44.746>for <00:21:44.840>this <00:21:44.933>one <00:21:45.026>is <00:21:45.120>DuckDB

00:21:46.150 --> 00:21:46.160 align:start position:0%
<00:21:46.150>use <00:21:46.151>solution <00:21:46.153>for <00:21:46.154>this <00:21:46.156>one <00:21:46.157>is <00:21:46.159>DuckDB

00:21:46.160 --> 00:21:49.990 align:start position:0%
<00:21:46.160>use <00:21:46.260>solution <00:21:46.360>for <00:21:46.460>this <00:21:46.560>one <00:21:46.660>is <00:21:46.760>DuckDB <00:21:46.860>as <00:21:46.960>I <00:21:47.060>said <00:21:47.160>really <00:21:47.260>small <00:21:47.360>easy <00:21:47.460>to <00:21:47.560>use

00:21:49.990 --> 00:21:50.000 align:start position:0%
<00:21:49.990>as <00:21:49.991>I <00:21:49.992>said <00:21:49.993>really <00:21:49.995>small <00:21:49.996>easy <00:21:49.997>to <00:21:49.999>use

00:21:50.000 --> 00:21:51.710 align:start position:0%
<00:21:50.000>as <00:21:50.100>I <00:21:50.200>said <00:21:50.300>really <00:21:50.400>small <00:21:50.500>easy <00:21:50.600>to <00:21:50.700>use <00:21:50.800>either <00:21:50.900>as <00:21:51.000>an <00:21:51.100>embedded <00:21:51.200>library <00:21:51.300>in <00:21:51.400>your

00:21:51.710 --> 00:21:51.720 align:start position:0%
<00:21:51.710>either <00:21:51.711>as <00:21:51.713>an <00:21:51.714>embedded <00:21:51.716>library <00:21:51.717>in <00:21:51.719>your

00:21:51.720 --> 00:21:54.110 align:start position:0%
<00:21:51.720>either <00:21:51.820>as <00:21:51.920>an <00:21:52.020>embedded <00:21:52.120>library <00:21:52.220>in <00:21:52.320>your <00:21:52.420>application <00:21:52.520>or <00:21:52.620>just <00:21:52.720>as <00:21:52.820>an <00:21:52.920>CLI <00:21:53.020>tool <00:21:53.120>it

00:21:54.110 --> 00:21:54.120 align:start position:0%
<00:21:54.110>application <00:21:54.111>or <00:21:54.112>just <00:21:54.113>as <00:21:54.115>an <00:21:54.116>CLI <00:21:54.117>tool <00:21:54.119>it

00:21:54.120 --> 00:21:55.710 align:start position:0%
<00:21:54.120>application <00:21:54.213>or <00:21:54.306>just <00:21:54.399>as <00:21:54.493>an <00:21:54.586>CLI <00:21:54.679>tool <00:21:54.773>it <00:21:54.866>can <00:21:54.959>read <00:21:55.053>from <00:21:55.146>a <00:21:55.239>lot <00:21:55.333>of <00:21:55.426>sources <00:21:55.520>the

00:21:55.710 --> 00:21:55.720 align:start position:0%
<00:21:55.710>can <00:21:55.711>read <00:21:55.712>from <00:21:55.713>a <00:21:55.715>lot <00:21:55.716>of <00:21:55.717>sources <00:21:55.719>the

00:21:55.720 --> 00:21:58.190 align:start position:0%
<00:21:55.720>can <00:21:55.813>read <00:21:55.906>from <00:21:56.000>a <00:21:56.093>lot <00:21:56.186>of <00:21:56.280>sources <00:21:56.373>the <00:21:56.466>parquet <00:21:56.560>file <00:21:56.653>might <00:21:56.746>still <00:21:56.840>be <00:21:56.933>on <00:21:57.026>a <00:21:57.120>three

00:21:58.190 --> 00:21:58.200 align:start position:0%
<00:21:58.190>parquet <00:21:58.191>file <00:21:58.192>might <00:21:58.193>still <00:21:58.195>be <00:21:58.196>on <00:21:58.197>a <00:21:58.199>three

00:21:58.200 --> 00:22:00.110 align:start position:0%
<00:21:58.200>parquet <00:21:58.287>file <00:21:58.375>might <00:21:58.462>still <00:21:58.550>be <00:21:58.637>on <00:21:58.725>a <00:21:58.812>three <00:21:58.900>or <00:21:58.987>the <00:21:59.075>iceberg <00:21:59.162>file <00:21:59.250>so <00:21:59.337>it <00:21:59.425>can <00:21:59.512>read <00:21:59.600>Delta

00:22:00.110 --> 00:22:00.120 align:start position:0%
<00:22:00.110>or <00:22:00.111>the <00:22:00.112>iceberg <00:22:00.113>file <00:22:00.114>so <00:22:00.115>it <00:22:00.116>can <00:22:00.117>read <00:22:00.119>Delta

00:22:00.120 --> 00:22:02.350 align:start position:0%
<00:22:00.120>or <00:22:00.207>the <00:22:00.294>iceberg <00:22:00.382>file <00:22:00.469>so <00:22:00.557>it <00:22:00.645>can <00:22:00.732>read <00:22:00.820>Delta <00:22:00.907>iceberg <00:22:00.995>parquet <00:22:01.082>can <00:22:01.169>of <00:22:01.257>of <00:22:01.344>course <00:22:01.432>also <00:22:01.520>be

00:22:02.350 --> 00:22:02.360 align:start position:0%
<00:22:02.350>iceberg <00:22:02.351>parquet <00:22:02.352>can <00:22:02.353>of <00:22:02.355>of <00:22:02.356>course <00:22:02.357>also <00:22:02.359>be

00:22:02.360 --> 00:22:06.430 align:start position:0%
<00:22:02.360>iceberg <00:22:02.447>parquet <00:22:02.534>can <00:22:02.622>of <00:22:02.709>of <00:22:02.797>course <00:22:02.885>also <00:22:02.972>be <00:22:03.060>JSON <00:22:03.147>and <00:22:03.235>CSV <00:22:03.322>it <00:22:03.409>can <00:22:03.497>be <00:22:03.584>stored <00:22:03.672>on <00:22:03.760>HTTPS

00:22:06.430 --> 00:22:06.440 align:start position:0%
<00:22:06.430>JSON <00:22:06.431>and <00:22:06.432>CSV <00:22:06.433>it <00:22:06.434>can <00:22:06.435>be <00:22:06.436>stored <00:22:06.437>on <00:22:06.439>HTTPS

00:22:06.440 --> 00:22:08.270 align:start position:0%
<00:22:06.440>JSON <00:22:06.527>and <00:22:06.615>CSV <00:22:06.702>it <00:22:06.790>can <00:22:06.877>be <00:22:06.965>stored <00:22:07.052>on <00:22:07.140>HTTPS <00:22:07.227>server <00:22:07.315>whatever <00:22:07.402>it <00:22:07.490>can <00:22:07.577>be <00:22:07.665>stored <00:22:07.752>on <00:22:07.840>an

00:22:08.270 --> 00:22:08.280 align:start position:0%
<00:22:08.270>server <00:22:08.271>whatever <00:22:08.272>it <00:22:08.273>can <00:22:08.275>be <00:22:08.276>stored <00:22:08.277>on <00:22:08.279>an

00:22:08.280 --> 00:22:10.790 align:start position:0%
<00:22:08.280>server <00:22:08.373>whatever <00:22:08.466>it <00:22:08.560>can <00:22:08.653>be <00:22:08.746>stored <00:22:08.840>on <00:22:08.933>an <00:22:09.026>S3 <00:22:09.120>buckets <00:22:09.213>in <00:22:09.306>a <00:22:09.399>bucket <00:22:09.493>or <00:22:09.586>something <00:22:09.680>this

00:22:10.790 --> 00:22:10.800 align:start position:0%
<00:22:10.790>S3 <00:22:10.791>buckets <00:22:10.792>in <00:22:10.793>a <00:22:10.795>bucket <00:22:10.796>or <00:22:10.797>something <00:22:10.799>this

00:22:10.800 --> 00:22:13.350 align:start position:0%
<00:22:10.800>S3 <00:22:10.893>buckets <00:22:10.986>in <00:22:11.080>a <00:22:11.173>bucket <00:22:11.266>or <00:22:11.360>something <00:22:11.453>this <00:22:11.546>um <00:22:11.639>and <00:22:11.733>you <00:22:11.826>can <00:22:11.919>just <00:22:12.013>read <00:22:12.106>it <00:22:12.200>there's

00:22:13.350 --> 00:22:13.360 align:start position:0%
<00:22:13.350>um <00:22:13.351>and <00:22:13.352>you <00:22:13.353>can <00:22:13.355>just <00:22:13.356>read <00:22:13.357>it <00:22:13.359>there's

00:22:13.360 --> 00:22:15.350 align:start position:0%
<00:22:13.360>um <00:22:13.467>and <00:22:13.575>you <00:22:13.683>can <00:22:13.790>just <00:22:13.898>read <00:22:14.006>it <00:22:14.113>there's <00:22:14.221>libraries <00:22:14.329>for <00:22:14.436>basically <00:22:14.544>all <00:22:14.652>of <00:22:14.760>the

00:22:15.350 --> 00:22:15.360 align:start position:0%
<00:22:15.350>libraries <00:22:15.351>for <00:22:15.353>basically <00:22:15.355>all <00:22:15.357>of <00:22:15.359>the

00:22:15.360 --> 00:22:16.670 align:start position:0%
<00:22:15.360>libraries <00:22:15.556>for <00:22:15.753>basically <00:22:15.949>all <00:22:16.146>of <00:22:16.342>the <00:22:16.539>languages

00:22:16.670 --> 00:22:16.680 align:start position:0%
languages

00:22:16.680 --> 00:22:17.950 align:start position:0%
<00:22:16.680>languages <00:22:16.843>no <00:22:17.006>not <00:22:17.169>all <00:22:17.333>for <00:22:17.496>all <00:22:17.659>the <00:22:17.823>relevant

00:22:17.950 --> 00:22:17.960 align:start position:0%
<00:22:17.950>no <00:22:17.951>not <00:22:17.953>all <00:22:17.954>for <00:22:17.956>all <00:22:17.957>the <00:22:17.959>relevant

00:22:17.960 --> 00:22:20.950 align:start position:0%
<00:22:17.960>no <00:22:18.060>not <00:22:18.160>all <00:22:18.260>for <00:22:18.360>all <00:22:18.460>the <00:22:18.560>relevant <00:22:18.660>languages <00:22:18.760>I <00:22:18.860>would <00:22:18.960>say <00:22:19.060>there's <00:22:19.160>a <00:22:19.260>Python <00:22:19.360>R

00:22:20.950 --> 00:22:20.960 align:start position:0%
<00:22:20.950>languages <00:22:20.951>I <00:22:20.952>would <00:22:20.953>say <00:22:20.955>there's <00:22:20.956>a <00:22:20.957>Python <00:22:20.959>R

00:22:20.960 --> 00:22:22.910 align:start position:0%
<00:22:20.960>languages <00:22:21.087>I <00:22:21.214>would <00:22:21.341>say <00:22:21.469>there's <00:22:21.596>a <00:22:21.723>Python <00:22:21.850>R <00:22:21.978>Rust <00:22:22.105>JavaScript <00:22:22.232>TypeScript <00:22:22.360>Java

00:22:22.910 --> 00:22:22.920 align:start position:0%
<00:22:22.910>Rust <00:22:22.913>JavaScript <00:22:22.916>TypeScript <00:22:22.919>Java

00:22:22.920 --> 00:22:25.110 align:start position:0%
<00:22:22.920>Rust <00:22:23.060>JavaScript <00:22:23.200>TypeScript <00:22:23.340>Java <00:22:23.480>libraries <00:22:23.620>that <00:22:23.760>you <00:22:23.900>can <00:22:24.040>just <00:22:24.180>use <00:22:24.320>just

00:22:25.110 --> 00:22:25.120 align:start position:0%
<00:22:25.110>libraries <00:22:25.111>that <00:22:25.112>you <00:22:25.114>can <00:22:25.116>just <00:22:25.117>use <00:22:25.119>just

00:22:25.120 --> 00:22:28.150 align:start position:0%
<00:22:25.120>libraries <00:22:25.236>that <00:22:25.353>you <00:22:25.469>can <00:22:25.586>just <00:22:25.703>use <00:22:25.820>just <00:22:25.936>pull <00:22:26.053>into <00:22:26.169>your <00:22:26.286>into <00:22:26.403>your <00:22:26.520>application.

00:22:28.150 --> 00:22:28.160 align:start position:0%
<00:22:28.150>pull <00:22:28.151>into <00:22:28.153>your <00:22:28.155>into <00:22:28.157>your <00:22:28.159>application.

00:22:28.160 --> 00:22:29.990 align:start position:0%
<00:22:28.160>pull <00:22:28.335>into <00:22:28.510>your <00:22:28.685>into <00:22:28.860>your <00:22:29.035>application. <00:22:29.210>And <00:22:29.385>you <00:22:29.560>can

00:22:29.990 --> 00:22:30.000 align:start position:0%
<00:22:29.990>And <00:22:29.994>you <00:22:29.999>can

00:22:30.000 --> 00:22:31.910 align:start position:0%
<00:22:30.000>And <00:22:30.127>you <00:22:30.254>can <00:22:30.381>also <00:22:30.509>install <00:22:30.636>it <00:22:30.763>on <00:22:30.890>the <00:22:31.018>CLI <00:22:31.145>if <00:22:31.272>you <00:22:31.400>want

00:22:31.910 --> 00:22:31.920 align:start position:0%
<00:22:31.910>also <00:22:31.911>install <00:22:31.912>it <00:22:31.913>on <00:22:31.914>the <00:22:31.915>CLI <00:22:31.916>if <00:22:31.917>you <00:22:31.919>want

00:22:31.920 --> 00:22:34.110 align:start position:0%
<00:22:31.920>also <00:22:32.020>install <00:22:32.120>it <00:22:32.220>on <00:22:32.320>the <00:22:32.420>CLI <00:22:32.520>if <00:22:32.620>you <00:22:32.720>want <00:22:32.820>for <00:22:32.920>instance <00:22:33.020>with <00:22:33.120>Brew <00:22:33.220>or <00:22:33.320>another

00:22:34.110 --> 00:22:34.120 align:start position:0%
<00:22:34.110>for <00:22:34.111>instance <00:22:34.113>with <00:22:34.115>Brew <00:22:34.117>or <00:22:34.119>another

00:22:34.120 --> 00:22:35.590 align:start position:0%
<00:22:34.120>for <00:22:34.340>instance <00:22:34.561>with <00:22:34.781>Brew <00:22:35.002>or <00:22:35.222>another <00:22:35.443>installer.

00:22:35.590 --> 00:22:35.600 align:start position:0%
installer.

00:22:35.600 --> 00:22:38.590 align:start position:0%
<00:22:35.600>installer. <00:22:35.774>And <00:22:35.949>by <00:22:36.125>putting <00:22:36.300>this <00:22:36.475>into <00:22:36.649>so <00:22:36.824>this <00:22:37.000>would

00:22:38.590 --> 00:22:38.600 align:start position:0%
<00:22:38.590>And <00:22:38.591>by <00:22:38.592>putting <00:22:38.593>this <00:22:38.595>into <00:22:38.596>so <00:22:38.597>this <00:22:38.599>would

00:22:38.600 --> 00:22:40.830 align:start position:0%
<00:22:38.600>And <00:22:38.687>by <00:22:38.774>putting <00:22:38.862>this <00:22:38.949>into <00:22:39.037>so <00:22:39.125>this <00:22:39.212>would <00:22:39.300>this <00:22:39.387>is <00:22:39.475>how <00:22:39.562>it <00:22:39.649>would <00:22:39.737>look <00:22:39.824>like <00:22:39.912>reading <00:22:40.000>a

00:22:40.830 --> 00:22:40.840 align:start position:0%
<00:22:40.830>this <00:22:40.831>is <00:22:40.832>how <00:22:40.833>it <00:22:40.834>would <00:22:40.835>look <00:22:40.836>like <00:22:40.837>reading <00:22:40.839>a

00:22:40.840 --> 00:22:42.830 align:start position:0%
<00:22:40.840>this <00:22:40.939>is <00:22:41.040>how <00:22:41.139>it <00:22:41.240>would <00:22:41.340>look <00:22:41.439>like <00:22:41.540>reading <00:22:41.639>a <00:22:41.740>single <00:22:41.840>table <00:22:41.939>select <00:22:42.040>count <00:22:42.139>iceberg <00:22:42.240>scan

00:22:42.830 --> 00:22:42.840 align:start position:0%
<00:22:42.830>single <00:22:42.831>table <00:22:42.833>select <00:22:42.835>count <00:22:42.837>iceberg <00:22:42.839>scan

00:22:42.840 --> 00:22:44.550 align:start position:0%
<00:22:42.840>single <00:22:42.947>table <00:22:43.055>select <00:22:43.163>count <00:22:43.270>iceberg <00:22:43.378>scan <00:22:43.486>and <00:22:43.593>then <00:22:43.701>just <00:22:43.809>give <00:22:43.916>it <00:22:44.024>the <00:22:44.132>path <00:22:44.240>to

00:22:44.550 --> 00:22:44.560 align:start position:0%
<00:22:44.550>and <00:22:44.551>then <00:22:44.552>just <00:22:44.553>give <00:22:44.555>it <00:22:44.556>the <00:22:44.557>path <00:22:44.559>to

00:22:44.560 --> 00:22:46.710 align:start position:0%
<00:22:44.560>and <00:22:44.700>then <00:22:44.840>just <00:22:44.980>give <00:22:45.120>it <00:22:45.260>the <00:22:45.399>path <00:22:45.540>to <00:22:45.679>where's <00:22:45.820>the <00:22:45.960>iceberg

00:22:46.710 --> 00:22:46.720 align:start position:0%
<00:22:46.710>where's <00:22:46.714>the <00:22:46.719>iceberg

00:22:46.720 --> 00:22:48.790 align:start position:0%
<00:22:46.720>where's <00:22:46.860>the <00:22:47.000>iceberg <00:22:47.140>table <00:22:47.280>stored <00:22:47.420>or <00:22:47.560>if <00:22:47.700>you <00:22:47.840>don't <00:22:47.980>connect <00:22:48.120>to

00:22:48.790 --> 00:22:48.800 align:start position:0%
<00:22:48.790>table <00:22:48.791>stored <00:22:48.792>or <00:22:48.793>if <00:22:48.795>you <00:22:48.796>don't <00:22:48.797>connect <00:22:48.799>to

00:22:48.800 --> 00:22:51.270 align:start position:0%
<00:22:48.800>table <00:22:48.887>stored <00:22:48.975>or <00:22:49.062>if <00:22:49.149>you <00:22:49.237>don't <00:22:49.325>connect <00:22:49.412>to <00:22:49.500>a <00:22:49.587>single <00:22:49.675>table <00:22:49.762>but <00:22:49.850>to <00:22:49.937>a <00:22:50.024>catalog <00:22:50.112>you <00:22:50.200>give

00:22:51.270 --> 00:22:51.280 align:start position:0%
<00:22:51.270>a <00:22:51.271>single <00:22:51.272>table <00:22:51.273>but <00:22:51.274>to <00:22:51.275>a <00:22:51.276>catalog <00:22:51.277>you <00:22:51.279>give

00:22:51.280 --> 00:22:53.590 align:start position:0%
<00:22:51.280>a <00:22:51.367>single <00:22:51.455>table <00:22:51.542>but <00:22:51.629>to <00:22:51.717>a <00:22:51.805>catalog <00:22:51.892>you <00:22:51.980>give <00:22:52.067>him <00:22:52.155>the <00:22:52.242>path <00:22:52.330>to <00:22:52.417>the <00:22:52.504>catalog <00:22:52.592>here <00:22:52.680>down

00:22:53.590 --> 00:22:53.600 align:start position:0%
<00:22:53.590>him <00:22:53.591>the <00:22:53.592>path <00:22:53.593>to <00:22:53.595>the <00:22:53.596>catalog <00:22:53.597>here <00:22:53.599>down

00:22:53.600 --> 00:22:56.070 align:start position:0%
<00:22:53.600>him <00:22:53.707>the <00:22:53.815>path <00:22:53.923>to <00:22:54.030>the <00:22:54.138>catalog <00:22:54.246>here <00:22:54.353>down <00:22:54.461>there <00:22:54.569>some <00:22:54.676>authentication <00:22:54.784>stuff <00:22:54.892>and <00:22:55.000>just

00:22:56.070 --> 00:22:56.080 align:start position:0%
<00:22:56.070>there <00:22:56.071>some <00:22:56.073>authentication <00:22:56.075>stuff <00:22:56.077>and <00:22:56.079>just

00:22:56.080 --> 00:22:58.150 align:start position:0%
<00:22:56.080>there <00:22:56.173>some <00:22:56.266>authentication <00:22:56.360>stuff <00:22:56.453>and <00:22:56.546>just <00:22:56.639>read <00:22:56.733>it <00:22:56.826>and <00:22:56.919>use <00:22:57.013>it <00:22:57.106>as <00:22:57.199>a <00:22:57.293>database <00:22:57.386>and <00:22:57.480>you

00:22:58.150 --> 00:22:58.160 align:start position:0%
<00:22:58.150>read <00:22:58.151>it <00:22:58.152>and <00:22:58.153>use <00:22:58.154>it <00:22:58.155>as <00:22:58.156>a <00:22:58.157>database <00:22:58.158>and <00:22:58.159>you

00:22:58.160 --> 00:23:00.150 align:start position:0%
<00:22:58.160>read <00:22:58.267>it <00:22:58.375>and <00:22:58.483>use <00:22:58.590>it <00:22:58.698>as <00:22:58.806>a <00:22:58.913>database <00:22:59.021>and <00:22:59.129>you <00:22:59.236>can <00:22:59.344>just <00:22:59.452>read <00:22:59.560>iceberg

00:23:00.150 --> 00:23:00.160 align:start position:0%
<00:23:00.150>can <00:23:00.153>just <00:23:00.156>read <00:23:00.159>iceberg

00:23:00.160 --> 00:23:03.790 align:start position:0%
<00:23:00.160>can <00:23:00.287>just <00:23:00.414>read <00:23:00.541>iceberg <00:23:00.669>natively <00:23:00.796>with <00:23:00.923>SQL <00:23:01.050>really <00:23:01.178>easy <00:23:01.305>to <00:23:01.432>use <00:23:01.560>and

00:23:03.790 --> 00:23:03.800 align:start position:0%
<00:23:03.790>natively <00:23:03.791>with <00:23:03.792>SQL <00:23:03.793>really <00:23:03.795>easy <00:23:03.796>to <00:23:03.797>use <00:23:03.799>and

00:23:03.800 --> 00:23:05.110 align:start position:0%
<00:23:03.800>natively <00:23:03.931>with <00:23:04.062>SQL <00:23:04.193>really <00:23:04.323>easy <00:23:04.455>to <00:23:04.586>use <00:23:04.716>and <00:23:04.848>to <00:23:04.978>do.

00:23:05.110 --> 00:23:05.120 align:start position:0%
<00:23:05.110>to <00:23:05.119>do.

00:23:05.120 --> 00:23:07.150 align:start position:0%
<00:23:05.120>to <00:23:05.294>do. <00:23:05.469>And <00:23:05.645>as <00:23:05.820>a <00:23:05.995>software <00:23:06.169>engineer, <00:23:06.344>this <00:23:06.520>opens

00:23:07.150 --> 00:23:07.160 align:start position:0%
<00:23:07.150>And <00:23:07.151>as <00:23:07.153>a <00:23:07.154>software <00:23:07.156>engineer, <00:23:07.157>this <00:23:07.159>opens

00:23:07.160 --> 00:23:08.470 align:start position:0%
<00:23:07.160>And <00:23:07.307>as <00:23:07.454>a <00:23:07.602>software <00:23:07.749>engineer, <00:23:07.896>this <00:23:08.044>opens <00:23:08.191>up <00:23:08.339>some

00:23:08.470 --> 00:23:08.480 align:start position:0%
<00:23:08.470>up <00:23:08.479>some

00:23:08.480 --> 00:23:10.390 align:start position:0%
<00:23:08.480>up <00:23:08.620>some <00:23:08.760>idea <00:23:08.900>and <00:23:09.040>this <00:23:09.180>is <00:23:09.320>what <00:23:09.460>I <00:23:09.600>want <00:23:09.740>to <00:23:09.880>give

00:23:10.390 --> 00:23:10.400 align:start position:0%
<00:23:10.390>idea <00:23:10.391>and <00:23:10.392>this <00:23:10.393>is <00:23:10.394>what <00:23:10.395>I <00:23:10.396>want <00:23:10.397>to <00:23:10.399>give

00:23:10.400 --> 00:23:12.790 align:start position:0%
<00:23:10.400>idea <00:23:10.487>and <00:23:10.575>this <00:23:10.662>is <00:23:10.750>what <00:23:10.837>I <00:23:10.925>want <00:23:11.012>to <00:23:11.100>give <00:23:11.187>you. <00:23:11.275>So, <00:23:11.362>you <00:23:11.450>now <00:23:11.537>might <00:23:11.625>know <00:23:11.712>what <00:23:11.800>Hey,

00:23:12.790 --> 00:23:12.800 align:start position:0%
<00:23:12.790>you. <00:23:12.791>So, <00:23:12.792>you <00:23:12.793>now <00:23:12.795>might <00:23:12.796>know <00:23:12.797>what <00:23:12.799>Hey,

00:23:12.800 --> 00:23:14.510 align:start position:0%
<00:23:12.800>you. <00:23:12.899>So, <00:23:13.000>you <00:23:13.100>now <00:23:13.200>might <00:23:13.300>know <00:23:13.399>what <00:23:13.500>Hey, <00:23:13.600>okay, <00:23:13.700>I <00:23:13.800>understand <00:23:13.899>what <00:23:14.000>Parquet <00:23:14.100>is <00:23:14.200>and

00:23:14.510 --> 00:23:14.520 align:start position:0%
<00:23:14.510>okay, <00:23:14.511>I <00:23:14.513>understand <00:23:14.514>what <00:23:14.516>Parquet <00:23:14.517>is <00:23:14.519>and

00:23:14.520 --> 00:23:16.030 align:start position:0%
<00:23:14.520>okay, <00:23:14.624>I <00:23:14.729>understand <00:23:14.833>what <00:23:14.938>Parquet <00:23:15.042>is <00:23:15.147>and <00:23:15.251>they <00:23:15.356>have <00:23:15.460>all <00:23:15.565>this <00:23:15.669>metadata <00:23:15.774>to <00:23:15.879>make

00:23:16.030 --> 00:23:16.040 align:start position:0%
<00:23:16.030>they <00:23:16.031>have <00:23:16.033>all <00:23:16.034>this <00:23:16.036>metadata <00:23:16.037>to <00:23:16.039>make

00:23:16.040 --> 00:23:17.630 align:start position:0%
<00:23:16.040>they <00:23:16.156>have <00:23:16.273>all <00:23:16.389>this <00:23:16.506>metadata <00:23:16.623>to <00:23:16.740>make <00:23:16.856>reading <00:23:16.973>and <00:23:17.090>writing <00:23:17.206>Parquet <00:23:17.323>faster <00:23:17.440>and

00:23:17.630 --> 00:23:17.640 align:start position:0%
<00:23:17.630>reading <00:23:17.631>and <00:23:17.633>writing <00:23:17.635>Parquet <00:23:17.637>faster <00:23:17.639>and

00:23:17.640 --> 00:23:19.670 align:start position:0%
<00:23:17.640>reading <00:23:17.767>and <00:23:17.894>writing <00:23:18.021>Parquet <00:23:18.149>faster <00:23:18.276>and <00:23:18.403>easier. <00:23:18.530>But <00:23:18.658>the <00:23:18.785>interesting <00:23:18.912>part <00:23:19.040>is

00:23:19.670 --> 00:23:19.680 align:start position:0%
<00:23:19.670>easier. <00:23:19.671>But <00:23:19.673>the <00:23:19.675>interesting <00:23:19.677>part <00:23:19.679>is

00:23:19.680 --> 00:23:22.550 align:start position:0%
<00:23:19.680>easier. <00:23:19.820>But <00:23:19.960>the <00:23:20.100>interesting <00:23:20.240>part <00:23:20.380>is <00:23:20.520>building <00:23:20.660>applications <00:23:20.800>with <00:23:20.940>those <00:23:21.080>stuff.

00:23:22.550 --> 00:23:22.560 align:start position:0%
<00:23:22.550>building <00:23:22.552>applications <00:23:22.554>with <00:23:22.556>those <00:23:22.559>stuff.

00:23:22.560 --> 00:23:24.030 align:start position:0%
<00:23:22.560>building <00:23:22.670>applications <00:23:22.780>with <00:23:22.890>those <00:23:23.001>stuff. <00:23:23.111>You <00:23:23.221>might <00:23:23.331>now <00:23:23.442>think, <00:23:23.552>"Hey, <00:23:23.662>I <00:23:23.772>have <00:23:23.883>to

00:23:24.030 --> 00:23:24.040 align:start position:0%
<00:23:24.030>You <00:23:24.031>might <00:23:24.032>now <00:23:24.033>think, <00:23:24.035>"Hey, <00:23:24.036>I <00:23:24.037>have <00:23:24.039>to

00:23:24.040 --> 00:23:25.510 align:start position:0%
<00:23:24.040>You <00:23:24.150>might <00:23:24.260>now <00:23:24.370>think, <00:23:24.481>"Hey, <00:23:24.591>I <00:23:24.701>have <00:23:24.811>to <00:23:24.922>build <00:23:25.032>an <00:23:25.142>application <00:23:25.252>for <00:23:25.363>analytical

00:23:25.510 --> 00:23:25.520 align:start position:0%
<00:23:25.510>build <00:23:25.512>an <00:23:25.514>application <00:23:25.516>for <00:23:25.519>analytical

00:23:25.520 --> 00:23:28.070 align:start position:0%
<00:23:25.520>build <00:23:25.660>an <00:23:25.800>application <00:23:25.940>for <00:23:26.080>analytical <00:23:26.220>purposes. <00:23:26.360>There's <00:23:26.500>some <00:23:26.639>user <00:23:26.780>wanting <00:23:26.920>to

00:23:28.070 --> 00:23:28.080 align:start position:0%
<00:23:28.070>purposes. <00:23:28.071>There's <00:23:28.073>some <00:23:28.075>user <00:23:28.077>wanting <00:23:28.079>to

00:23:28.080 --> 00:23:29.990 align:start position:0%
<00:23:28.080>purposes. <00:23:28.173>There's <00:23:28.266>some <00:23:28.360>user <00:23:28.453>wanting <00:23:28.546>to <00:23:28.639>do <00:23:28.733>queries <00:23:28.826>and <00:23:28.919>so <00:23:29.013>on <00:23:29.106>and <00:23:29.199>I <00:23:29.293>just <00:23:29.386>have <00:23:29.480>to

00:23:29.990 --> 00:23:30.000 align:start position:0%
<00:23:29.990>do <00:23:29.991>queries <00:23:29.992>and <00:23:29.993>so <00:23:29.994>on <00:23:29.995>and <00:23:29.996>I <00:23:29.997>just <00:23:29.998>have <00:23:29.999>to

00:23:30.000 --> 00:23:31.670 align:start position:0%
<00:23:30.000>do <00:23:30.082>queries <00:23:30.164>and <00:23:30.247>so <00:23:30.329>on <00:23:30.411>and <00:23:30.494>I <00:23:30.576>just <00:23:30.658>have <00:23:30.741>to <00:23:30.823>run <00:23:30.905>a <00:23:30.988>database <00:23:31.070>for <00:23:31.152>this <00:23:31.235>user <00:23:31.317>all <00:23:31.400>the

00:23:31.670 --> 00:23:31.680 align:start position:0%
<00:23:31.670>run <00:23:31.671>a <00:23:31.672>database <00:23:31.673>for <00:23:31.675>this <00:23:31.676>user <00:23:31.677>all <00:23:31.679>the

00:23:31.680 --> 00:23:34.630 align:start position:0%
<00:23:31.680>run <00:23:31.796>a <00:23:31.913>database <00:23:32.030>for <00:23:32.146>this <00:23:32.263>user <00:23:32.380>all <00:23:32.496>the <00:23:32.613>time <00:23:32.730>or <00:23:32.846>this <00:23:32.963>user <00:23:33.080>just

00:23:34.630 --> 00:23:34.640 align:start position:0%
<00:23:34.630>time <00:23:34.632>or <00:23:34.634>this <00:23:34.636>user <00:23:34.639>just

00:23:34.640 --> 00:23:35.990 align:start position:0%
<00:23:34.640>time <00:23:34.761>or <00:23:34.883>this <00:23:35.004>user <00:23:35.126>just <00:23:35.247>the <00:23:35.369>the <00:23:35.490>database <00:23:35.612>is <00:23:35.733>my <00:23:35.855>production

00:23:35.990 --> 00:23:36.000 align:start position:0%
<00:23:35.990>the <00:23:35.991>the <00:23:35.993>database <00:23:35.995>is <00:23:35.997>my <00:23:35.999>production

00:23:36.000 --> 00:23:37.870 align:start position:0%
<00:23:36.000>the <00:23:36.155>the <00:23:36.311>database <00:23:36.466>is <00:23:36.622>my <00:23:36.777>production <00:23:36.933>database <00:23:37.088>and <00:23:37.244>it <00:23:37.400>gets

00:23:37.870 --> 00:23:37.880 align:start position:0%
<00:23:37.870>database <00:23:37.873>and <00:23:37.876>it <00:23:37.879>gets

00:23:37.880 --> 00:23:40.270 align:start position:0%
<00:23:37.880>database <00:23:38.035>and <00:23:38.191>it <00:23:38.346>gets <00:23:38.502>performance <00:23:38.657>hit <00:23:38.813>by <00:23:38.968>analytical <00:23:39.124>queries. <00:23:39.280>I

00:23:40.270 --> 00:23:40.280 align:start position:0%
<00:23:40.270>performance <00:23:40.271>hit <00:23:40.273>by <00:23:40.275>analytical <00:23:40.277>queries. <00:23:40.279>I

00:23:40.280 --> 00:23:42.150 align:start position:0%
<00:23:40.280>performance <00:23:40.396>hit <00:23:40.513>by <00:23:40.629>analytical <00:23:40.746>queries. <00:23:40.863>I <00:23:40.980>would <00:23:41.096>say, <00:23:41.213>"Hey, <00:23:41.330>just <00:23:41.446>store <00:23:41.563>the <00:23:41.680>data.

00:23:42.150 --> 00:23:42.160 align:start position:0%
<00:23:42.150>would <00:23:42.151>say, <00:23:42.153>"Hey, <00:23:42.154>just <00:23:42.156>store <00:23:42.157>the <00:23:42.159>data.

00:23:42.160 --> 00:23:44.350 align:start position:0%
<00:23:42.160>would <00:23:42.260>say, <00:23:42.360>"Hey, <00:23:42.460>just <00:23:42.560>store <00:23:42.660>the <00:23:42.760>data. <00:23:42.860>Most <00:23:42.960>of <00:23:43.060>the <00:23:43.160>time <00:23:43.260>the <00:23:43.360>data <00:23:43.460>is <00:23:43.560>refreshed

00:23:44.350 --> 00:23:44.360 align:start position:0%
<00:23:44.350>Most <00:23:44.351>of <00:23:44.352>the <00:23:44.353>time <00:23:44.355>the <00:23:44.356>data <00:23:44.357>is <00:23:44.359>refreshed

00:23:44.360 --> 00:23:45.790 align:start position:0%
<00:23:44.360>Most <00:23:44.488>of <00:23:44.617>the <00:23:44.746>time <00:23:44.874>the <00:23:45.003>data <00:23:45.132>is <00:23:45.260>refreshed <00:23:45.389>once <00:23:45.518>a <00:23:45.647>day.

00:23:45.790 --> 00:23:45.800 align:start position:0%
<00:23:45.790>once <00:23:45.794>a <00:23:45.799>day.

00:23:45.800 --> 00:23:47.510 align:start position:0%
<00:23:45.800>once <00:23:45.955>a <00:23:46.111>day. <00:23:46.266>Just <00:23:46.422>store <00:23:46.577>this <00:23:46.733>data <00:23:46.888>in <00:23:47.044>a <00:23:47.200>Parquet

00:23:47.510 --> 00:23:47.520 align:start position:0%
<00:23:47.510>Just <00:23:47.511>store <00:23:47.513>this <00:23:47.514>data <00:23:47.516>in <00:23:47.517>a <00:23:47.519>Parquet

00:23:47.520 --> 00:23:49.670 align:start position:0%
<00:23:47.520>Just <00:23:47.636>store <00:23:47.753>this <00:23:47.870>data <00:23:47.986>in <00:23:48.103>a <00:23:48.220>Parquet <00:23:48.336>Iceberg <00:23:48.453>Delta <00:23:48.570>or <00:23:48.686>whatever <00:23:48.803>format. <00:23:48.920>Store

00:23:49.670 --> 00:23:49.680 align:start position:0%
<00:23:49.670>Iceberg <00:23:49.671>Delta <00:23:49.673>or <00:23:49.675>whatever <00:23:49.677>format. <00:23:49.679>Store

00:23:49.680 --> 00:23:51.190 align:start position:0%
<00:23:49.680>Iceberg <00:23:49.793>Delta <00:23:49.906>or <00:23:50.019>whatever <00:23:50.133>format. <00:23:50.246>Store <00:23:50.359>it <00:23:50.472>in <00:23:50.586>a <00:23:50.699>blob <00:23:50.812>storage, <00:23:50.925>write <00:23:51.039>an

00:23:51.190 --> 00:23:51.200 align:start position:0%
<00:23:51.190>it <00:23:51.191>in <00:23:51.193>a <00:23:51.194>blob <00:23:51.196>storage, <00:23:51.197>write <00:23:51.199>an

00:23:51.200 --> 00:23:53.670 align:start position:0%
<00:23:51.200>it <00:23:51.316>in <00:23:51.433>a <00:23:51.550>blob <00:23:51.666>storage, <00:23:51.783>write <00:23:51.900>an <00:23:52.016>application, <00:23:52.133>throw <00:23:52.250>DuckDB <00:23:52.366>in <00:23:52.483>it, <00:23:52.600>and

00:23:53.670 --> 00:23:53.680 align:start position:0%
<00:23:53.670>application, <00:23:53.671>throw <00:23:53.673>DuckDB <00:23:53.675>in <00:23:53.677>it, <00:23:53.679>and

00:23:53.680 --> 00:23:55.750 align:start position:0%
<00:23:53.680>application, <00:23:53.796>throw <00:23:53.913>DuckDB <00:23:54.030>in <00:23:54.146>it, <00:23:54.263>and <00:23:54.380>connect <00:23:54.496>DuckDB <00:23:54.613>to <00:23:54.730>these <00:23:54.846>data. <00:23:54.963>You <00:23:55.080>don't

00:23:55.750 --> 00:23:55.760 align:start position:0%
<00:23:55.750>connect <00:23:55.751>DuckDB <00:23:55.753>to <00:23:55.754>these <00:23:55.756>data. <00:23:55.757>You <00:23:55.759>don't

00:23:55.760 --> 00:23:57.190 align:start position:0%
<00:23:55.760>connect <00:23:55.859>DuckDB <00:23:55.958>to <00:23:56.057>these <00:23:56.156>data. <00:23:56.255>You <00:23:56.354>don't <00:23:56.453>need <00:23:56.552>a <00:23:56.651>database <00:23:56.750>running <00:23:56.849>all <00:23:56.948>the <00:23:57.047>time.

00:23:57.190 --> 00:23:57.200 align:start position:0%
<00:23:57.190>need <00:23:57.191>a <00:23:57.193>database <00:23:57.194>running <00:23:57.196>all <00:23:57.197>the <00:23:57.199>time.

00:23:57.200 --> 00:23:58.830 align:start position:0%
<00:23:57.200>need <00:23:57.307>a <00:23:57.415>database <00:23:57.523>running <00:23:57.630>all <00:23:57.738>the <00:23:57.846>time. <00:23:57.953>You <00:23:58.061>spare <00:23:58.169>the <00:23:58.276>cost. <00:23:58.384>You <00:23:58.492>have <00:23:58.600>cheap

00:23:58.830 --> 00:23:58.840 align:start position:0%
<00:23:58.830>You <00:23:58.831>spare <00:23:58.832>the <00:23:58.834>cost. <00:23:58.836>You <00:23:58.837>have <00:23:58.839>cheap

00:23:58.840 --> 00:24:00.710 align:start position:0%
<00:23:58.840>You <00:23:58.939>spare <00:23:59.040>the <00:23:59.139>cost. <00:23:59.240>You <00:23:59.340>have <00:23:59.439>cheap <00:23:59.540>storage <00:23:59.639>on <00:23:59.740>a <00:23:59.840>blob <00:23:59.939>storage <00:24:00.040>and <00:24:00.139>you <00:24:00.240>have

00:24:00.710 --> 00:24:00.720 align:start position:0%
<00:24:00.710>storage <00:24:00.711>on <00:24:00.712>a <00:24:00.713>blob <00:24:00.715>storage <00:24:00.716>and <00:24:00.717>you <00:24:00.719>have

00:24:00.720 --> 00:24:02.670 align:start position:0%
<00:24:00.720>storage <00:24:00.820>on <00:24:00.920>a <00:24:01.020>blob <00:24:01.120>storage <00:24:01.220>and <00:24:01.320>you <00:24:01.420>have <00:24:01.520>the <00:24:01.620>compute, <00:24:01.720>the <00:24:01.820>really <00:24:01.920>fast <00:24:02.020>and <00:24:02.120>simple

00:24:02.670 --> 00:24:02.680 align:start position:0%
<00:24:02.670>the <00:24:02.671>compute, <00:24:02.673>the <00:24:02.674>really <00:24:02.676>fast <00:24:02.677>and <00:24:02.679>simple

00:24:02.680 --> 00:24:04.870 align:start position:0%
<00:24:02.680>the <00:24:02.807>compute, <00:24:02.934>the <00:24:03.061>really <00:24:03.189>fast <00:24:03.316>and <00:24:03.443>simple <00:24:03.570>compute, <00:24:03.698>directly <00:24:03.825>in <00:24:03.952>your <00:24:04.080>application.

00:24:04.870 --> 00:24:04.880 align:start position:0%
<00:24:04.870>compute, <00:24:04.872>directly <00:24:04.874>in <00:24:04.876>your <00:24:04.879>application.

00:24:04.880 --> 00:24:06.710 align:start position:0%
<00:24:04.880>compute, <00:24:05.020>directly <00:24:05.160>in <00:24:05.300>your <00:24:05.440>application. <00:24:05.580>Just <00:24:05.720>connect <00:24:05.860>it <00:24:06.000>to <00:24:06.140>the <00:24:06.280>data."

00:24:06.710 --> 00:24:06.720 align:start position:0%
<00:24:06.710>Just <00:24:06.711>connect <00:24:06.713>it <00:24:06.715>to <00:24:06.717>the <00:24:06.719>data."

00:24:06.720 --> 00:24:09.190 align:start position:0%
<00:24:06.720>Just <00:24:06.847>connect <00:24:06.974>it <00:24:07.101>to <00:24:07.229>the <00:24:07.356>data." <00:24:07.483>So, <00:24:07.610>therefore, <00:24:07.738>think <00:24:07.865>this <00:24:07.992>is <00:24:08.120>worth

00:24:09.190 --> 00:24:09.200 align:start position:0%
<00:24:09.190>So, <00:24:09.191>therefore, <00:24:09.193>think <00:24:09.195>this <00:24:09.197>is <00:24:09.199>worth

00:24:09.200 --> 00:24:10.870 align:start position:0%
<00:24:09.200>So, <00:24:09.327>therefore, <00:24:09.454>think <00:24:09.581>this <00:24:09.709>is <00:24:09.836>worth <00:24:09.963>knowing <00:24:10.090>as <00:24:10.218>an <00:24:10.345>additional <00:24:10.472>file <00:24:10.600>format.

00:24:10.870 --> 00:24:10.880 align:start position:0%
<00:24:10.870>knowing <00:24:10.871>as <00:24:10.873>an <00:24:10.875>additional <00:24:10.877>file <00:24:10.879>format.

00:24:10.880 --> 00:24:11.830 align:start position:0%
<00:24:10.880>knowing <00:24:11.002>as <00:24:11.124>an <00:24:11.246>additional <00:24:11.368>file <00:24:11.490>format. <00:24:11.612>It's <00:24:11.735>just

00:24:11.830 --> 00:24:11.840 align:start position:0%
<00:24:11.830>It's <00:24:11.839>just

00:24:11.840 --> 00:24:14.110 align:start position:0%
<00:24:11.840>It's <00:24:11.995>just <00:24:12.151>another <00:24:12.306>tool <00:24:12.462>that <00:24:12.617>you <00:24:12.773>might <00:24:12.928>have <00:24:13.084>in <00:24:13.240>a

00:24:14.110 --> 00:24:14.120 align:start position:0%
<00:24:14.110>another <00:24:14.111>tool <00:24:14.112>that <00:24:14.113>you <00:24:14.115>might <00:24:14.116>have <00:24:14.117>in <00:24:14.119>a

00:24:14.120 --> 00:24:17.230 align:start position:0%
<00:24:14.120>another <00:24:14.247>tool <00:24:14.374>that <00:24:14.501>you <00:24:14.629>might <00:24:14.756>have <00:24:14.883>in <00:24:15.010>a <00:24:15.138>engine <00:24:15.265>as <00:24:15.392>an <00:24:15.520>engineer.

00:24:17.230 --> 00:24:17.240 align:start position:0%
<00:24:17.230>engine <00:24:17.233>as <00:24:17.236>an <00:24:17.239>engineer.

00:24:17.240 --> 00:24:18.190 align:start position:0%
<00:24:17.240>engine <00:24:17.453>as <00:24:17.667>an <00:24:17.881>engineer. <00:24:18.095>So,

00:24:18.190 --> 00:24:18.200 align:start position:0%
So,

00:24:18.200 --> 00:24:20.030 align:start position:0%
<00:24:18.200>So, <00:24:19.600>takeaway.

00:24:20.030 --> 00:24:20.040 align:start position:0%
takeaway.

00:24:20.040 --> 00:24:22.350 align:start position:0%
<00:24:20.040>takeaway. <00:24:20.273>It <00:24:20.506>was <00:24:20.740>built <00:24:20.973>to <00:24:21.206>solve <00:24:21.440>analytical

00:24:22.350 --> 00:24:22.360 align:start position:0%
<00:24:22.350>It <00:24:22.351>was <00:24:22.353>built <00:24:22.355>to <00:24:22.357>solve <00:24:22.359>analytical

00:24:22.360 --> 00:24:24.510 align:start position:0%
<00:24:22.360>It <00:24:22.500>was <00:24:22.639>built <00:24:22.780>to <00:24:22.919>solve <00:24:23.060>analytical <00:24:23.199>challenges. <00:24:23.340>It's <00:24:23.479>not <00:24:23.620>a <00:24:23.760>transactional

00:24:24.510 --> 00:24:24.520 align:start position:0%
<00:24:24.510>challenges. <00:24:24.512>It's <00:24:24.514>not <00:24:24.516>a <00:24:24.519>transactional

00:24:24.520 --> 00:24:26.670 align:start position:0%
<00:24:24.520>challenges. <00:24:24.627>It's <00:24:24.735>not <00:24:24.843>a <00:24:24.950>transactional <00:24:25.058>file <00:24:25.166>format. <00:24:25.273>If <00:24:25.381>you <00:24:25.489>do <00:24:25.596>a <00:24:25.704>lot <00:24:25.812>of <00:24:25.920>single

00:24:26.670 --> 00:24:26.680 align:start position:0%
<00:24:26.670>file <00:24:26.671>format. <00:24:26.672>If <00:24:26.673>you <00:24:26.674>do <00:24:26.675>a <00:24:26.676>lot <00:24:26.677>of <00:24:26.679>single

00:24:26.680 --> 00:24:28.830 align:start position:0%
<00:24:26.680>file <00:24:26.773>format. <00:24:26.866>If <00:24:26.960>you <00:24:27.053>do <00:24:27.146>a <00:24:27.240>lot <00:24:27.333>of <00:24:27.426>single <00:24:27.520>rows <00:24:27.613>updates <00:24:27.706>and <00:24:27.800>inserts, <00:24:27.893>stay <00:24:27.986>with <00:24:28.080>the

00:24:28.830 --> 00:24:28.840 align:start position:0%
<00:24:28.830>rows <00:24:28.831>updates <00:24:28.832>and <00:24:28.834>inserts, <00:24:28.836>stay <00:24:28.837>with <00:24:28.839>the

00:24:28.840 --> 00:24:30.430 align:start position:0%
<00:24:28.840>rows <00:24:28.995>updates <00:24:29.151>and <00:24:29.306>inserts, <00:24:29.462>stay <00:24:29.617>with <00:24:29.773>the <00:24:29.928>database. <00:24:30.084>You're <00:24:30.240>fine.

00:24:30.430 --> 00:24:30.440 align:start position:0%
<00:24:30.430>database. <00:24:30.434>You're <00:24:30.439>fine.

00:24:30.440 --> 00:24:31.390 align:start position:0%
<00:24:30.440>database. <00:24:30.725>You're <00:24:31.010>fine. <00:24:31.295>Um

00:24:31.390 --> 00:24:31.400 align:start position:0%
Um

00:24:31.400 --> 00:24:33.190 align:start position:0%
<00:24:31.400>Um <00:24:31.633>it's <00:24:31.866>all <00:24:32.100>based <00:24:32.333>on <00:24:32.566>open <00:24:32.800>standards.

00:24:33.190 --> 00:24:33.200 align:start position:0%
<00:24:33.190>it's <00:24:33.191>all <00:24:33.193>based <00:24:33.195>on <00:24:33.197>open <00:24:33.199>standards.

00:24:33.200 --> 00:24:35.230 align:start position:0%
<00:24:33.200>it's <00:24:33.327>all <00:24:33.454>based <00:24:33.581>on <00:24:33.709>open <00:24:33.836>standards. <00:24:33.963>Parquet <00:24:34.090>is <00:24:34.218>basically <00:24:34.345>an <00:24:34.472>open <00:24:34.600>standard.

00:24:35.230 --> 00:24:35.240 align:start position:0%
<00:24:35.230>Parquet <00:24:35.231>is <00:24:35.233>basically <00:24:35.235>an <00:24:35.237>open <00:24:35.239>standard.

00:24:35.240 --> 00:24:36.950 align:start position:0%
<00:24:35.240>Parquet <00:24:35.356>is <00:24:35.473>basically <00:24:35.590>an <00:24:35.706>open <00:24:35.823>standard. <00:24:35.940>Iceberg <00:24:36.056>is <00:24:36.173>open <00:24:36.290>standard. <00:24:36.406>Duck <00:24:36.523>Lake <00:24:36.640>is

00:24:36.950 --> 00:24:36.960 align:start position:0%
<00:24:36.950>Iceberg <00:24:36.951>is <00:24:36.953>open <00:24:36.954>standard. <00:24:36.956>Duck <00:24:36.957>Lake <00:24:36.959>is

00:24:36.960 --> 00:24:38.070 align:start position:0%
<00:24:36.960>Iceberg <00:24:37.050>is <00:24:37.141>open <00:24:37.232>standard. <00:24:37.323>Duck <00:24:37.414>Lake <00:24:37.504>is <00:24:37.595>an <00:24:37.686>open <00:24:37.777>standard. <00:24:37.868>Everybody <00:24:37.958>can

00:24:38.070 --> 00:24:38.080 align:start position:0%
<00:24:38.070>an <00:24:38.072>open <00:24:38.074>standard. <00:24:38.076>Everybody <00:24:38.079>can

00:24:38.080 --> 00:24:39.790 align:start position:0%
<00:24:38.080>an <00:24:38.207>open <00:24:38.334>standard. <00:24:38.461>Everybody <00:24:38.589>can <00:24:38.716>implement <00:24:38.843>the <00:24:38.970>client <00:24:39.098>and <00:24:39.225>the <00:24:39.352>writer <00:24:39.480>for

00:24:39.790 --> 00:24:39.800 align:start position:0%
<00:24:39.790>implement <00:24:39.791>the <00:24:39.793>client <00:24:39.794>and <00:24:39.796>the <00:24:39.797>writer <00:24:39.799>for

00:24:39.800 --> 00:24:42.150 align:start position:0%
<00:24:39.800>implement <00:24:39.907>the <00:24:40.015>client <00:24:40.123>and <00:24:40.230>the <00:24:40.338>writer <00:24:40.446>for <00:24:40.553>this <00:24:40.661>and <00:24:40.769>reader <00:24:40.876>and <00:24:40.984>writer <00:24:41.092>for <00:24:41.200>this.

00:24:42.150 --> 00:24:42.160 align:start position:0%
<00:24:42.150>this <00:24:42.151>and <00:24:42.153>reader <00:24:42.154>and <00:24:42.156>writer <00:24:42.157>for <00:24:42.159>this.

00:24:42.160 --> 00:24:43.950 align:start position:0%
<00:24:42.160>this <00:24:42.276>and <00:24:42.393>reader <00:24:42.510>and <00:24:42.626>writer <00:24:42.743>for <00:24:42.860>this. <00:24:42.976>It's <00:24:43.093>based <00:24:43.210>on <00:24:43.326>these <00:24:43.443>decoupling <00:24:43.560>from

00:24:43.950 --> 00:24:43.960 align:start position:0%
<00:24:43.950>It's <00:24:43.951>based <00:24:43.953>on <00:24:43.955>these <00:24:43.957>decoupling <00:24:43.959>from

00:24:43.960 --> 00:24:45.750 align:start position:0%
<00:24:43.960>It's <00:24:44.076>based <00:24:44.193>on <00:24:44.310>these <00:24:44.426>decoupling <00:24:44.543>from <00:24:44.660>storage <00:24:44.776>and <00:24:44.893>compute <00:24:45.010>that <00:24:45.126>you <00:24:45.243>can <00:24:45.360>scale

00:24:45.750 --> 00:24:45.760 align:start position:0%
<00:24:45.750>storage <00:24:45.751>and <00:24:45.753>compute <00:24:45.754>that <00:24:45.756>you <00:24:45.757>can <00:24:45.759>scale

00:24:45.760 --> 00:24:48.430 align:start position:0%
<00:24:45.760>storage <00:24:45.876>and <00:24:45.993>compute <00:24:46.110>that <00:24:46.226>you <00:24:46.343>can <00:24:46.460>scale <00:24:46.576>both <00:24:46.693>independently. <00:24:46.810>I <00:24:46.926>have <00:24:47.043>have <00:24:47.160>really

00:24:48.430 --> 00:24:48.440 align:start position:0%
<00:24:48.430>both <00:24:48.431>independently. <00:24:48.433>I <00:24:48.435>have <00:24:48.437>have <00:24:48.439>really

00:24:48.440 --> 00:24:50.070 align:start position:0%
<00:24:48.440>both <00:24:48.567>independently. <00:24:48.694>I <00:24:48.821>have <00:24:48.949>have <00:24:49.076>really <00:24:49.203>high-powered <00:24:49.330>compute <00:24:49.458>if <00:24:49.585>you <00:24:49.712>need <00:24:49.840>it.

00:24:50.070 --> 00:24:50.080 align:start position:0%
<00:24:50.070>high-powered <00:24:50.071>compute <00:24:50.073>if <00:24:50.075>you <00:24:50.077>need <00:24:50.079>it.

00:24:50.080 --> 00:24:51.310 align:start position:0%
<00:24:50.080>high-powered <00:24:50.238>compute <00:24:50.396>if <00:24:50.554>you <00:24:50.712>need <00:24:50.870>it. <00:24:51.028>Have <00:24:51.187>really

00:24:51.310 --> 00:24:51.320 align:start position:0%
<00:24:51.310>Have <00:24:51.319>really

00:24:51.320 --> 00:24:53.670 align:start position:0%
<00:24:51.320>Have <00:24:51.495>really <00:24:51.669>um <00:24:51.845>cheap <00:24:52.020>storage <00:24:52.195>underneath. <00:24:52.370>Um <00:24:52.544>you <00:24:52.720>can

00:24:53.670 --> 00:24:53.680 align:start position:0%
<00:24:53.670>um <00:24:53.671>cheap <00:24:53.673>storage <00:24:53.674>underneath. <00:24:53.676>Um <00:24:53.677>you <00:24:53.679>can

00:24:53.680 --> 00:24:55.430 align:start position:0%
<00:24:53.680>um <00:24:53.787>cheap <00:24:53.895>storage <00:24:54.003>underneath. <00:24:54.110>Um <00:24:54.218>you <00:24:54.326>can <00:24:54.433>have <00:24:54.541>multiple <00:24:54.649>engines <00:24:54.756>on <00:24:54.864>this. <00:24:54.972>You <00:24:55.080>can

00:24:55.430 --> 00:24:55.440 align:start position:0%
<00:24:55.430>have <00:24:55.431>multiple <00:24:55.433>engines <00:24:55.434>on <00:24:55.436>this. <00:24:55.437>You <00:24:55.439>can

00:24:55.440 --> 00:24:57.950 align:start position:0%
<00:24:55.440>have <00:24:55.547>multiple <00:24:55.655>engines <00:24:55.763>on <00:24:55.870>this. <00:24:55.978>You <00:24:56.086>can <00:24:56.193>store <00:24:56.301>the <00:24:56.409>data <00:24:56.516>once <00:24:56.624>in <00:24:56.732>Iceberg. <00:24:56.840>have

00:24:57.950 --> 00:24:57.960 align:start position:0%
<00:24:57.950>store <00:24:57.951>the <00:24:57.953>data <00:24:57.954>once <00:24:57.956>in <00:24:57.957>Iceberg. <00:24:57.959>have

00:24:57.960 --> 00:24:59.950 align:start position:0%
<00:24:57.960>store <00:24:58.060>the <00:24:58.160>data <00:24:58.260>once <00:24:58.360>in <00:24:58.460>Iceberg. <00:24:58.560>have <00:24:58.660>Spark <00:24:58.760>connect <00:24:58.860>to <00:24:58.960>it <00:24:59.060>can <00:24:59.160>Trino <00:24:59.260>connect <00:24:59.360>to

00:24:59.950 --> 00:24:59.960 align:start position:0%
<00:24:59.950>Spark <00:24:59.951>connect <00:24:59.952>to <00:24:59.953>it <00:24:59.955>can <00:24:59.956>Trino <00:24:59.957>connect <00:24:59.959>to

00:24:59.960 --> 00:25:02.430 align:start position:0%
<00:24:59.960>Spark <00:25:00.060>connect <00:25:00.160>to <00:25:00.260>it <00:25:00.360>can <00:25:00.460>Trino <00:25:00.560>connect <00:25:00.660>to <00:25:00.760>it. <00:25:00.860>You <00:25:00.960>can <00:25:01.060>have <00:25:01.160>your <00:25:01.260>Python <00:25:01.360>code

00:25:02.430 --> 00:25:02.440 align:start position:0%
<00:25:02.430>it. <00:25:02.431>You <00:25:02.433>can <00:25:02.434>have <00:25:02.436>your <00:25:02.437>Python <00:25:02.439>code

00:25:02.440 --> 00:25:03.710 align:start position:0%
<00:25:02.440>it. <00:25:02.527>You <00:25:02.615>can <00:25:02.703>have <00:25:02.791>your <00:25:02.879>Python <00:25:02.967>code <00:25:03.055>connect <00:25:03.143>to <00:25:03.231>it. <00:25:03.319>You <00:25:03.407>can <00:25:03.495>have <00:25:03.583>DuckDB

00:25:03.710 --> 00:25:03.720 align:start position:0%
<00:25:03.710>connect <00:25:03.711>to <00:25:03.713>it. <00:25:03.714>You <00:25:03.716>can <00:25:03.717>have <00:25:03.719>DuckDB

00:25:03.720 --> 00:25:06.030 align:start position:0%
<00:25:03.720>connect <00:25:03.827>to <00:25:03.935>it. <00:25:04.043>You <00:25:04.150>can <00:25:04.258>have <00:25:04.366>DuckDB <00:25:04.473>connect <00:25:04.581>to <00:25:04.689>it. <00:25:04.796>Whatever <00:25:04.904>engines <00:25:05.012>is <00:25:05.120>the

00:25:06.030 --> 00:25:06.040 align:start position:0%
<00:25:06.030>connect <00:25:06.031>to <00:25:06.033>it. <00:25:06.034>Whatever <00:25:06.036>engines <00:25:06.037>is <00:25:06.039>the

00:25:06.040 --> 00:25:07.790 align:start position:0%
<00:25:06.040>connect <00:25:06.133>to <00:25:06.226>it. <00:25:06.320>Whatever <00:25:06.413>engines <00:25:06.506>is <00:25:06.600>the <00:25:06.693>one <00:25:06.786>you <00:25:06.879>need. <00:25:06.973>If <00:25:07.066>you <00:25:07.159>need <00:25:07.253>a <00:25:07.346>small <00:25:07.440>easy

00:25:07.790 --> 00:25:07.800 align:start position:0%
<00:25:07.790>one <00:25:07.791>you <00:25:07.792>need. <00:25:07.793>If <00:25:07.794>you <00:25:07.795>need <00:25:07.796>a <00:25:07.797>small <00:25:07.799>easy

00:25:07.800 --> 00:25:10.150 align:start position:0%
<00:25:07.800>one <00:25:07.893>you <00:25:07.986>need. <00:25:08.080>If <00:25:08.173>you <00:25:08.266>need <00:25:08.360>a <00:25:08.453>small <00:25:08.546>easy <00:25:08.639>engine <00:25:08.733>use <00:25:08.826>DuckDB <00:25:08.919>if <00:25:09.013>if <00:25:09.106>really <00:25:09.200>really

00:25:10.150 --> 00:25:10.160 align:start position:0%
<00:25:10.150>engine <00:25:10.151>use <00:25:10.153>DuckDB <00:25:10.154>if <00:25:10.156>if <00:25:10.157>really <00:25:10.159>really

00:25:10.160 --> 00:25:11.790 align:start position:0%
<00:25:10.160>engine <00:25:10.335>use <00:25:10.510>DuckDB <00:25:10.685>if <00:25:10.860>if <00:25:11.035>really <00:25:11.210>really <00:25:11.385>big <00:25:11.560>use

00:25:11.790 --> 00:25:11.800 align:start position:0%
<00:25:11.790>big <00:25:11.799>use

00:25:11.800 --> 00:25:14.230 align:start position:0%
<00:25:11.800>big <00:25:12.000>use <00:25:12.200>Iceberg <00:25:12.399>but <00:25:12.600>use <00:25:12.800>separate <00:25:13.000>storage <00:25:13.200>and

00:25:14.230 --> 00:25:14.240 align:start position:0%
<00:25:14.230>Iceberg <00:25:14.231>but <00:25:14.233>use <00:25:14.235>separate <00:25:14.237>storage <00:25:14.239>and

00:25:14.240 --> 00:25:17.390 align:start position:0%
<00:25:14.240>Iceberg <00:25:14.356>but <00:25:14.473>use <00:25:14.590>separate <00:25:14.706>storage <00:25:14.823>and <00:25:14.940>compute <00:25:15.056>and <00:25:15.173>it's <00:25:15.290>really <00:25:15.406>nice <00:25:15.523>tool <00:25:15.640>to

00:25:17.390 --> 00:25:17.400 align:start position:0%
<00:25:17.390>compute <00:25:17.391>and <00:25:17.393>it's <00:25:17.394>really <00:25:17.396>nice <00:25:17.397>tool <00:25:17.399>to

00:25:17.400 --> 00:25:19.310 align:start position:0%
<00:25:17.400>compute <00:25:17.540>and <00:25:17.680>it's <00:25:17.820>really <00:25:17.960>nice <00:25:18.100>tool <00:25:18.240>to <00:25:18.380>build <00:25:18.520>analytical <00:25:18.660>application <00:25:18.800>customer

00:25:19.310 --> 00:25:19.320 align:start position:0%
<00:25:19.310>build <00:25:19.312>analytical <00:25:19.316>application <00:25:19.319>customer

00:25:19.320 --> 00:25:21.950 align:start position:0%
<00:25:19.320>build <00:25:19.553>analytical <00:25:19.786>application <00:25:20.020>customer <00:25:20.253>facing <00:25:20.486>report <00:25:20.720>applications

00:25:21.950 --> 00:25:21.960 align:start position:0%
<00:25:21.950>facing <00:25:21.954>report <00:25:21.959>applications

00:25:21.960 --> 00:25:24.990 align:start position:0%
<00:25:21.960>facing <00:25:22.115>report <00:25:22.271>applications <00:25:22.426>with <00:25:22.582>this <00:25:22.737>stuff <00:25:22.893>and <00:25:23.048>with <00:25:23.204>the <00:25:23.360>Duck

00:25:24.990 --> 00:25:25.000 align:start position:0%
<00:25:24.990>with <00:25:24.991>this <00:25:24.993>stuff <00:25:24.994>and <00:25:24.996>with <00:25:24.997>the <00:25:24.999>Duck

00:25:25.000 --> 00:25:28.550 align:start position:0%
<00:25:25.000>with <00:25:25.140>this <00:25:25.280>stuff <00:25:25.420>and <00:25:25.560>with <00:25:25.700>the <00:25:25.840>Duck <00:25:25.980>especially <00:25:26.120>combined <00:25:26.260>with <00:25:26.400>DuckDB.

00:25:28.550 --> 00:25:28.560 align:start position:0%
<00:25:28.550>especially <00:25:28.553>combined <00:25:28.556>with <00:25:28.559>DuckDB.

00:25:28.560 --> 00:25:31.230 align:start position:0%
<00:25:28.560>especially <00:25:28.735>combined <00:25:28.909>with <00:25:29.085>DuckDB. <00:25:29.260>That's <00:25:29.435>it. <00:25:29.610>Thank <00:25:29.784>you <00:25:29.960>and

00:25:31.230 --> 00:25:31.240 align:start position:0%
<00:25:31.230>That's <00:25:31.232>it. <00:25:31.234>Thank <00:25:31.236>you <00:25:31.239>and

00:25:31.240 --> 00:25:32.430 align:start position:0%
<00:25:31.240>That's <00:25:31.337>it. <00:25:31.434>Thank <00:25:31.532>you <00:25:31.629>and <00:25:31.726>would <00:25:31.824>be <00:25:31.921>happy <00:25:32.018>about <00:25:32.116>feedback <00:25:32.213>at <00:25:32.311>the

00:25:32.430 --> 00:25:32.440 align:start position:0%
<00:25:32.430>would <00:25:32.431>be <00:25:32.433>happy <00:25:32.434>about <00:25:32.436>feedback <00:25:32.437>at <00:25:32.439>the

00:25:32.440 --> 00:25:34.017 align:start position:0%
<00:25:32.440>would <00:25:32.595>be <00:25:32.751>happy <00:25:32.906>about <00:25:33.062>feedback <00:25:33.217>at <00:25:33.373>the <00:25:33.528>talk <00:25:33.684>as <00:25:33.840>well.

00:25:34.017 --> 00:25:34.027 align:start position:0%
<00:25:34.017>talk <00:25:34.021>as <00:25:34.026>well.

00:25:34.027 --> 00:25:39.350 align:start position:0%
<00:25:34.027>talk <00:25:34.377>as <00:25:34.727>well. <00:25:35.077>&gt;&gt; <00:25:35.427>[applause]

00:25:39.360 --> 00:25:41.550 align:start position:0%
<00:25:39.360>&gt;&gt; <00:25:39.534>Thank <00:25:39.709>you <00:25:39.885>so <00:25:40.060>much <00:25:40.235>Matthias. <00:25:40.409>We <00:25:40.584>have <00:25:40.760>a

00:25:41.550 --> 00:25:41.560 align:start position:0%
<00:25:41.550>&gt;&gt; <00:25:41.551>Thank <00:25:41.552>you <00:25:41.553>so <00:25:41.554>much <00:25:41.555>Matthias. <00:25:41.556>We <00:25:41.557>have <00:25:41.559>a

00:25:41.560 --> 00:25:44.390 align:start position:0%
<00:25:41.560>&gt;&gt; <00:25:41.653>Thank <00:25:41.746>you <00:25:41.840>so <00:25:41.933>much <00:25:42.026>Matthias. <00:25:42.120>We <00:25:42.213>have <00:25:42.306>a <00:25:42.399>bunch <00:25:42.493>of <00:25:42.586>questions. <00:25:42.679>So <00:25:42.773>first <00:25:42.866>one <00:25:42.960>Roberto

00:25:44.390 --> 00:25:44.400 align:start position:0%
<00:25:44.390>bunch <00:25:44.391>of <00:25:44.393>questions. <00:25:44.394>So <00:25:44.396>first <00:25:44.397>one <00:25:44.399>Roberto

00:25:44.400 --> 00:25:47.390 align:start position:0%
<00:25:44.400>bunch <00:25:44.500>of <00:25:44.600>questions. <00:25:44.700>So <00:25:44.800>first <00:25:44.900>one <00:25:45.000>Roberto <00:25:45.100>is <00:25:45.200>asking <00:25:45.300>would <00:25:45.400>you <00:25:45.500>say <00:25:45.600>Avro <00:25:45.700>is <00:25:45.800>dead?

00:25:47.390 --> 00:25:47.400 align:start position:0%
<00:25:47.390>is <00:25:47.391>asking <00:25:47.392>would <00:25:47.393>you <00:25:47.395>say <00:25:47.396>Avro <00:25:47.397>is <00:25:47.399>dead?

00:25:47.400 --> 00:25:49.590 align:start position:0%
<00:25:47.400>is <00:25:47.540>asking <00:25:47.680>would <00:25:47.820>you <00:25:47.960>say <00:25:48.100>Avro <00:25:48.240>is <00:25:48.380>dead? <00:25:48.520>&gt;&gt; <00:25:48.660>Avro <00:25:48.800>is

00:25:49.590 --> 00:25:49.600 align:start position:0%
<00:25:49.590>&gt;&gt; <00:25:49.594>Avro <00:25:49.599>is

00:25:49.600 --> 00:25:51.430 align:start position:0%
<00:25:49.600>&gt;&gt; <00:25:49.740>Avro <00:25:49.879>is <00:25:50.020>No, <00:25:50.159>Avro <00:25:50.300>isn't <00:25:50.439>dead <00:25:50.580>but <00:25:50.719>I <00:25:50.860>wouldn't <00:25:51.000>never

00:25:51.430 --> 00:25:51.440 align:start position:0%
<00:25:51.430>No, <00:25:51.431>Avro <00:25:51.432>isn't <00:25:51.433>dead <00:25:51.435>but <00:25:51.436>I <00:25:51.437>wouldn't <00:25:51.439>never

00:25:51.440 --> 00:25:53.510 align:start position:0%
<00:25:51.440>No, <00:25:51.527>Avro <00:25:51.615>isn't <00:25:51.702>dead <00:25:51.790>but <00:25:51.877>I <00:25:51.965>wouldn't <00:25:52.052>never <00:25:52.140>store <00:25:52.227>my <00:25:52.315>data <00:25:52.402>in <00:25:52.490>Avro <00:25:52.577>but <00:25:52.665>Avro <00:25:52.752>is <00:25:52.840>used

00:25:53.510 --> 00:25:53.520 align:start position:0%
<00:25:53.510>store <00:25:53.511>my <00:25:53.512>data <00:25:53.513>in <00:25:53.514>Avro <00:25:53.515>but <00:25:53.516>Avro <00:25:53.517>is <00:25:53.519>used

00:25:53.520 --> 00:25:56.230 align:start position:0%
<00:25:53.520>store <00:25:53.620>my <00:25:53.720>data <00:25:53.820>in <00:25:53.920>Avro <00:25:54.020>but <00:25:54.120>Avro <00:25:54.220>is <00:25:54.320>used <00:25:54.420>as <00:25:54.520>for <00:25:54.620>instance <00:25:54.720>to <00:25:54.820>store <00:25:54.920>Apache

00:25:56.230 --> 00:25:56.240 align:start position:0%
<00:25:56.230>as <00:25:56.231>for <00:25:56.233>instance <00:25:56.235>to <00:25:56.237>store <00:25:56.239>Apache

00:25:56.240 --> 00:25:57.830 align:start position:0%
<00:25:56.240>as <00:25:56.356>for <00:25:56.473>instance <00:25:56.590>to <00:25:56.706>store <00:25:56.823>Apache <00:25:56.940>the <00:25:57.056>metadata <00:25:57.173>in <00:25:57.290>Apache <00:25:57.406>Iceberg <00:25:57.523>but <00:25:57.640>Avro

00:25:57.830 --> 00:25:57.840 align:start position:0%
<00:25:57.830>the <00:25:57.831>metadata <00:25:57.832>in <00:25:57.834>Apache <00:25:57.836>Iceberg <00:25:57.837>but <00:25:57.839>Avro

00:25:57.840 --> 00:26:00.670 align:start position:0%
<00:25:57.840>the <00:25:57.939>metadata <00:25:58.040>in <00:25:58.139>Apache <00:25:58.240>Iceberg <00:25:58.340>but <00:25:58.439>Avro <00:25:58.540>as <00:25:58.639>a <00:25:58.740>file <00:25:58.840>format <00:25:58.939>itself <00:25:59.040>itself <00:25:59.139>not <00:25:59.240>for

00:26:00.670 --> 00:26:00.680 align:start position:0%
<00:26:00.670>as <00:26:00.671>a <00:26:00.672>file <00:26:00.673>format <00:26:00.675>itself <00:26:00.676>itself <00:26:00.677>not <00:26:00.679>for

00:26:00.680 --> 00:26:02.990 align:start position:0%
<00:26:00.680>as <00:26:00.787>a <00:26:00.895>file <00:26:01.003>format <00:26:01.110>itself <00:26:01.218>itself <00:26:01.326>not <00:26:01.433>for <00:26:01.541>store <00:26:01.649>data <00:26:01.756>just <00:26:01.864>in <00:26:01.972>Kafka <00:26:02.080>messages

00:26:02.990 --> 00:26:03.000 align:start position:0%
<00:26:02.990>store <00:26:02.991>data <00:26:02.993>just <00:26:02.995>in <00:26:02.997>Kafka <00:26:02.999>messages

00:26:03.000 --> 00:26:03.750 align:start position:0%
<00:26:03.000>store <00:26:03.112>data <00:26:03.225>just <00:26:03.337>in <00:26:03.450>Kafka <00:26:03.562>messages <00:26:03.675>basically.

00:26:03.750 --> 00:26:03.760 align:start position:0%
basically.

00:26:03.760 --> 00:26:04.870 align:start position:0%
<00:26:03.760>basically. <00:26:04.259>&gt;&gt; <00:26:04.759>Okay.

00:26:04.870 --> 00:26:04.880 align:start position:0%
<00:26:04.870>&gt;&gt; <00:26:04.879>Okay.

00:26:04.880 --> 00:26:07.150 align:start position:0%
<00:26:04.880>&gt;&gt; <00:26:05.020>Okay. <00:26:05.160>Thank <00:26:05.300>you. <00:26:05.440>Next <00:26:05.580>one <00:26:05.720>from <00:26:05.860>Tim. <00:26:06.000>Is <00:26:06.140>there <00:26:06.280>a

00:26:07.150 --> 00:26:07.160 align:start position:0%
<00:26:07.150>Thank <00:26:07.151>you. <00:26:07.152>Next <00:26:07.153>one <00:26:07.154>from <00:26:07.155>Tim. <00:26:07.156>Is <00:26:07.157>there <00:26:07.159>a

00:26:07.160 --> 00:26:09.150 align:start position:0%
<00:26:07.160>Thank <00:26:07.267>you. <00:26:07.375>Next <00:26:07.483>one <00:26:07.590>from <00:26:07.698>Tim. <00:26:07.806>Is <00:26:07.913>there <00:26:08.021>a <00:26:08.129>simple <00:26:08.236>explanation <00:26:08.344>why <00:26:08.452>Parquet <00:26:08.560>user

00:26:09.150 --> 00:26:09.160 align:start position:0%
<00:26:09.150>simple <00:26:09.152>explanation <00:26:09.154>why <00:26:09.156>Parquet <00:26:09.159>user

00:26:09.160 --> 00:26:11.950 align:start position:0%
<00:26:09.160>simple <00:26:09.300>explanation <00:26:09.440>why <00:26:09.580>Parquet <00:26:09.720>user <00:26:09.860>footers <00:26:10.000>uses <00:26:10.140>footers <00:26:10.280>and <00:26:10.420>not <00:26:10.560>headers?

00:26:11.950 --> 00:26:11.960 align:start position:0%
<00:26:11.950>footers <00:26:11.951>uses <00:26:11.953>footers <00:26:11.955>and <00:26:11.957>not <00:26:11.959>headers?

00:26:11.960 --> 00:26:13.750 align:start position:0%
<00:26:11.960>footers <00:26:12.076>uses <00:26:12.193>footers <00:26:12.310>and <00:26:12.426>not <00:26:12.543>headers? <00:26:12.660>Seems <00:26:12.776>counter <00:26:12.893>intuitive <00:26:13.010>to <00:26:13.126>me <00:26:13.243>as <00:26:13.360>you

00:26:13.750 --> 00:26:13.760 align:start position:0%
<00:26:13.750>Seems <00:26:13.751>counter <00:26:13.753>intuitive <00:26:13.754>to <00:26:13.756>me <00:26:13.757>as <00:26:13.759>you

00:26:13.760 --> 00:26:15.910 align:start position:0%
<00:26:13.760>Seems <00:26:13.853>counter <00:26:13.946>intuitive <00:26:14.040>to <00:26:14.133>me <00:26:14.226>as <00:26:14.320>you <00:26:14.413>first <00:26:14.506>need <00:26:14.600>to <00:26:14.693>find <00:26:14.786>a <00:26:14.879>footer <00:26:14.973>to <00:26:15.066>read <00:26:15.160>out

00:26:15.910 --> 00:26:15.920 align:start position:0%
<00:26:15.910>first <00:26:15.911>need <00:26:15.912>to <00:26:15.913>find <00:26:15.914>a <00:26:15.915>footer <00:26:15.916>to <00:26:15.917>read <00:26:15.919>out

00:26:15.920 --> 00:26:17.470 align:start position:0%
<00:26:15.920>first <00:26:16.046>need <00:26:16.173>to <00:26:16.300>find <00:26:16.427>a <00:26:16.554>footer <00:26:16.680>to <00:26:16.807>read <00:26:16.934>out <00:26:17.061>e.g. <00:26:17.188>the <00:26:17.315>statistics.

00:26:17.470 --> 00:26:17.480 align:start position:0%
<00:26:17.470>e.g. <00:26:17.474>the <00:26:17.479>statistics.

00:26:17.480 --> 00:26:18.510 align:start position:0%
<00:26:17.480>e.g. <00:26:17.711>the <00:26:17.943>statistics. <00:26:18.175>&gt;&gt; <00:26:18.407>Yeah,

00:26:18.510 --> 00:26:18.520 align:start position:0%
<00:26:18.510>&gt;&gt; <00:26:18.519>Yeah,

00:26:18.520 --> 00:26:20.550 align:start position:0%
<00:26:18.520>&gt;&gt; <00:26:18.720>Yeah, <00:26:18.920>interesting <00:26:19.120>question. <00:26:19.320>They <00:26:19.520>the <00:26:19.720>footer <00:26:19.920>is

00:26:20.550 --> 00:26:20.560 align:start position:0%
<00:26:20.550>interesting <00:26:20.551>question. <00:26:20.553>They <00:26:20.555>the <00:26:20.557>footer <00:26:20.559>is

00:26:20.560 --> 00:26:22.790 align:start position:0%
<00:26:20.560>interesting <00:26:20.760>question. <00:26:20.960>They <00:26:21.159>the <00:26:21.360>footer <00:26:21.560>is <00:26:21.760>basically <00:26:21.960>um

00:26:22.790 --> 00:26:22.800 align:start position:0%
<00:26:22.790>basically <00:26:22.799>um

00:26:22.800 --> 00:26:23.750 align:start position:0%
<00:26:22.800>basically <00:26:23.013>um <00:26:23.227>they <00:26:23.441>have <00:26:23.655>a

00:26:23.750 --> 00:26:23.760 align:start position:0%
<00:26:23.750>they <00:26:23.754>have <00:26:23.759>a

00:26:23.760 --> 00:26:25.190 align:start position:0%
<00:26:23.760>they <00:26:23.888>have <00:26:24.017>a <00:26:24.146>fixed <00:26:24.274>length <00:26:24.403>and <00:26:24.532>can <00:26:24.660>just <00:26:24.789>go <00:26:24.918>from <00:26:25.047>the

00:26:25.190 --> 00:26:25.200 align:start position:0%
<00:26:25.190>fixed <00:26:25.191>length <00:26:25.192>and <00:26:25.193>can <00:26:25.195>just <00:26:25.196>go <00:26:25.197>from <00:26:25.199>the

00:26:25.200 --> 00:26:26.230 align:start position:0%
<00:26:25.200>fixed <00:26:25.315>length <00:26:25.431>and <00:26:25.547>can <00:26:25.663>just <00:26:25.779>go <00:26:25.895>from <00:26:26.011>the <00:26:26.127>back

00:26:26.230 --> 00:26:26.240 align:start position:0%
back

00:26:26.240 --> 00:26:28.430 align:start position:0%
<00:26:26.240>back <00:26:26.415>and <00:26:26.590>it's <00:26:26.765>easier <00:26:26.940>to <00:26:27.115>write <00:26:27.290>the <00:26:27.465>footer <00:26:27.640>at

00:26:28.430 --> 00:26:28.440 align:start position:0%
<00:26:28.430>and <00:26:28.431>it's <00:26:28.432>easier <00:26:28.433>to <00:26:28.435>write <00:26:28.436>the <00:26:28.437>footer <00:26:28.439>at

00:26:28.440 --> 00:26:30.030 align:start position:0%
<00:26:28.440>and <00:26:28.533>it's <00:26:28.626>easier <00:26:28.720>to <00:26:28.813>write <00:26:28.906>the <00:26:29.000>footer <00:26:29.093>at <00:26:29.186>the <00:26:29.280>begin <00:26:29.373>at <00:26:29.466>the <00:26:29.560>end <00:26:29.653>because <00:26:29.746>if <00:26:29.840>you

00:26:30.030 --> 00:26:30.040 align:start position:0%
<00:26:30.030>the <00:26:30.031>begin <00:26:30.032>at <00:26:30.033>the <00:26:30.035>end <00:26:30.036>because <00:26:30.037>if <00:26:30.039>you

00:26:30.040 --> 00:26:31.830 align:start position:0%
<00:26:30.040>the <00:26:30.139>begin <00:26:30.240>at <00:26:30.340>the <00:26:30.440>end <00:26:30.540>because <00:26:30.639>if <00:26:30.740>you <00:26:30.840>write <00:26:30.940>this <00:26:31.040>you <00:26:31.139>write <00:26:31.240>write <00:26:31.340>write <00:26:31.440>collect

00:26:31.830 --> 00:26:31.840 align:start position:0%
<00:26:31.830>write <00:26:31.831>this <00:26:31.832>you <00:26:31.834>write <00:26:31.836>write <00:26:31.837>write <00:26:31.839>collect

00:26:31.840 --> 00:26:33.190 align:start position:0%
<00:26:31.840>write <00:26:31.933>this <00:26:32.026>you <00:26:32.120>write <00:26:32.213>write <00:26:32.307>write <00:26:32.400>collect <00:26:32.494>all <00:26:32.587>the <00:26:32.681>statistics <00:26:32.774>then <00:26:32.868>the <00:26:32.961>end <00:26:33.055>just

00:26:33.190 --> 00:26:33.200 align:start position:0%
<00:26:33.190>all <00:26:33.191>the <00:26:33.193>statistics <00:26:33.194>then <00:26:33.196>the <00:26:33.197>end <00:26:33.199>just

00:26:33.200 --> 00:26:34.750 align:start position:0%
<00:26:33.200>all <00:26:33.307>the <00:26:33.414>statistics <00:26:33.521>then <00:26:33.629>the <00:26:33.736>end <00:26:33.843>just <00:26:33.951>write <00:26:34.058>the <00:26:34.165>statistics. <00:26:34.273>If <00:26:34.380>you <00:26:34.487>would <00:26:34.595>have

00:26:34.750 --> 00:26:34.760 align:start position:0%
<00:26:34.750>write <00:26:34.751>the <00:26:34.753>statistics. <00:26:34.754>If <00:26:34.756>you <00:26:34.757>would <00:26:34.759>have

00:26:34.760 --> 00:26:36.510 align:start position:0%
<00:26:34.760>write <00:26:34.860>the <00:26:34.960>statistics. <00:26:35.060>If <00:26:35.160>you <00:26:35.260>would <00:26:35.360>have <00:26:35.460>the <00:26:35.560>header <00:26:35.660>you <00:26:35.760>have <00:26:35.860>to <00:26:35.960>first <00:26:36.060>collect <00:26:36.160>the

00:26:36.510 --> 00:26:36.520 align:start position:0%
<00:26:36.510>the <00:26:36.511>header <00:26:36.512>you <00:26:36.513>have <00:26:36.515>to <00:26:36.516>first <00:26:36.517>collect <00:26:36.519>the

00:26:36.520 --> 00:26:38.390 align:start position:0%
<00:26:36.520>the <00:26:36.627>header <00:26:36.735>you <00:26:36.843>have <00:26:36.950>to <00:26:37.058>first <00:26:37.166>collect <00:26:37.273>the <00:26:37.381>statistic <00:26:37.489>write <00:26:37.596>the <00:26:37.704>statistic <00:26:37.812>and <00:26:37.920>write

00:26:38.390 --> 00:26:38.400 align:start position:0%
<00:26:38.390>statistic <00:26:38.391>write <00:26:38.393>the <00:26:38.395>statistic <00:26:38.397>and <00:26:38.399>write

00:26:38.400 --> 00:26:40.190 align:start position:0%
<00:26:38.400>statistic <00:26:38.507>write <00:26:38.615>the <00:26:38.723>statistic <00:26:38.830>and <00:26:38.938>write <00:26:39.046>the <00:26:39.153>data <00:26:39.261>again. <00:26:39.369>That <00:26:39.476>is <00:26:39.584>the <00:26:39.692>main <00:26:39.800>reason.

00:26:40.190 --> 00:26:40.200 align:start position:0%
<00:26:40.190>the <00:26:40.191>data <00:26:40.192>again. <00:26:40.193>That <00:26:40.195>is <00:26:40.196>the <00:26:40.197>main <00:26:40.199>reason.

00:26:40.200 --> 00:26:41.110 align:start position:0%
<00:26:40.200>the <00:26:40.268>data <00:26:40.336>again. <00:26:40.404>That <00:26:40.473>is <00:26:40.541>the <00:26:40.609>main <00:26:40.677>reason. <00:26:40.745>&gt;&gt; <00:26:40.814>It's <00:26:40.882>a <00:26:40.950>trade-off, <00:26:41.019>right?

00:26:41.110 --> 00:26:41.120 align:start position:0%
<00:26:41.110>&gt;&gt; <00:26:41.112>It's <00:26:41.114>a <00:26:41.116>trade-off, <00:26:41.119>right?

00:26:41.120 --> 00:26:41.430 align:start position:0%
<00:26:41.120>&gt;&gt; <00:26:41.166>It's <00:26:41.213>a <00:26:41.259>trade-off, <00:26:41.306>right? <00:26:41.352>&gt;&gt; <00:26:41.399>Yeah.

00:26:41.430 --> 00:26:41.440 align:start position:0%
<00:26:41.430>&gt;&gt; <00:26:41.439>Yeah.

00:26:41.440 --> 00:26:44.230 align:start position:0%
<00:26:41.440>&gt;&gt; <00:26:41.615>Yeah. <00:26:41.790>&gt;&gt; <00:26:41.965>Yeah. <00:26:42.140>Okay. <00:26:42.315>Thank <00:26:42.490>you <00:26:42.665>very <00:26:42.840>much.

00:26:44.230 --> 00:26:44.240 align:start position:0%
<00:26:44.230>&gt;&gt; <00:26:44.231>Yeah. <00:26:44.233>Okay. <00:26:44.234>Thank <00:26:44.236>you <00:26:44.237>very <00:26:44.239>much.

00:26:44.240 --> 00:26:46.430 align:start position:0%
<00:26:44.240>&gt;&gt; <00:26:44.347>Yeah. <00:26:44.455>Okay. <00:26:44.563>Thank <00:26:44.670>you <00:26:44.778>very <00:26:44.886>much. <00:26:44.993>Lisa <00:26:45.101>asks <00:26:45.209>how <00:26:45.316>do <00:26:45.424>these <00:26:45.532>techniques <00:26:45.640>work

00:26:46.430 --> 00:26:46.440 align:start position:0%
<00:26:46.430>Lisa <00:26:46.431>asks <00:26:46.433>how <00:26:46.434>do <00:26:46.436>these <00:26:46.437>techniques <00:26:46.439>work

00:26:46.440 --> 00:26:48.350 align:start position:0%
<00:26:46.440>Lisa <00:26:46.556>asks <00:26:46.673>how <00:26:46.790>do <00:26:46.906>these <00:26:47.023>techniques <00:26:47.140>work <00:26:47.256>with <00:26:47.373>non-table <00:26:47.490>based <00:26:47.606>data <00:26:47.723>such <00:26:47.840>as

00:26:48.350 --> 00:26:48.360 align:start position:0%
<00:26:48.350>with <00:26:48.351>non-table <00:26:48.353>based <00:26:48.355>data <00:26:48.357>such <00:26:48.359>as

00:26:48.360 --> 00:26:50.150 align:start position:0%
<00:26:48.360>with <00:26:48.476>non-table <00:26:48.593>based <00:26:48.709>data <00:26:48.826>such <00:26:48.943>as <00:26:49.060>images? <00:26:49.176>I <00:26:49.293>have <00:26:49.409>a <00:26:49.526>hunch <00:26:49.643>but <00:26:49.760>I'm

00:26:50.150 --> 00:26:50.160 align:start position:0%
<00:26:50.150>images? <00:26:50.151>I <00:26:50.153>have <00:26:50.154>a <00:26:50.156>hunch <00:26:50.157>but <00:26:50.159>I'm

00:26:50.160 --> 00:26:50.710 align:start position:0%
<00:26:50.160>images? <00:26:50.221>I <00:26:50.283>have <00:26:50.345>a <00:26:50.407>hunch <00:26:50.469>but <00:26:50.531>I'm <00:26:50.593>interested <00:26:50.655>in

00:26:50.710 --> 00:26:50.720 align:start position:0%
<00:26:50.710>interested <00:26:50.719>in

00:26:50.720 --> 00:26:52.710 align:start position:0%
<00:26:50.720>interested <00:26:50.895>in <00:26:51.070>&gt;&gt; <00:26:51.245>Yeah, <00:26:51.420>the <00:26:51.595>hunch <00:26:51.770>is <00:26:51.945>correct <00:26:52.120>likely.

00:26:52.710 --> 00:26:52.720 align:start position:0%
<00:26:52.710>&gt;&gt; <00:26:52.711>Yeah, <00:26:52.713>the <00:26:52.714>hunch <00:26:52.716>is <00:26:52.717>correct <00:26:52.719>likely.

00:26:52.720 --> 00:26:53.950 align:start position:0%
<00:26:52.720>&gt;&gt; <00:26:52.858>Yeah, <00:26:52.996>the <00:26:53.135>hunch <00:26:53.273>is <00:26:53.411>correct <00:26:53.550>likely. <00:26:53.688>They <00:26:53.827>don't.

00:26:53.950 --> 00:26:53.960 align:start position:0%
<00:26:53.950>They <00:26:53.959>don't.

00:26:53.960 --> 00:26:55.110 align:start position:0%
<00:26:53.960>They <00:26:54.305>don't. <00:26:54.649>They <00:26:54.995>don't.

00:26:55.110 --> 00:26:55.120 align:start position:0%
<00:26:55.110>They <00:26:55.119>don't.

00:26:55.120 --> 00:26:56.430 align:start position:0%
<00:26:55.120>They <00:26:55.513>don't. <00:26:55.906>&gt;&gt; <00:26:56.299>Okay.

00:26:56.430 --> 00:26:56.440 align:start position:0%
<00:26:56.430>&gt;&gt; <00:26:56.439>Okay.

00:26:56.440 --> 00:26:57.950 align:start position:0%
<00:26:56.440>&gt;&gt; <00:26:56.591>Okay. <00:26:56.742>Then <00:26:56.893>we <00:26:57.044>have <00:26:57.195>time <00:26:57.346>for <00:26:57.497>some <00:26:57.648>more, <00:26:57.799>I

00:26:57.950 --> 00:26:57.960 align:start position:0%
<00:26:57.950>Then <00:26:57.951>we <00:26:57.952>have <00:26:57.953>time <00:26:57.955>for <00:26:57.956>some <00:26:57.957>more, <00:26:57.959>I

00:26:57.960 --> 00:26:58.950 align:start position:0%
<00:26:57.960>Then <00:26:58.071>we <00:26:58.182>have <00:26:58.294>time <00:26:58.405>for <00:26:58.516>some <00:26:58.628>more, <00:26:58.739>I <00:26:58.851>guess.

00:26:58.950 --> 00:26:58.960 align:start position:0%
guess.

00:26:58.960 --> 00:27:01.030 align:start position:0%
<00:26:58.960>guess. <00:26:59.193>I've <00:26:59.426>noticed <00:26:59.660>that <00:26:59.893>parquet <00:27:00.126>folders <00:27:00.360>are

00:27:01.030 --> 00:27:01.040 align:start position:0%
<00:27:01.030>I've <00:27:01.031>noticed <00:27:01.033>that <00:27:01.035>parquet <00:27:01.037>folders <00:27:01.039>are

00:27:01.040 --> 00:27:03.030 align:start position:0%
<00:27:01.040>I've <00:27:01.167>noticed <00:27:01.294>that <00:27:01.421>parquet <00:27:01.549>folders <00:27:01.676>are <00:27:01.803>generally <00:27:01.930>smaller <00:27:02.058>than <00:27:02.185>CSV <00:27:02.312>files. <00:27:02.440>I'm

00:27:03.030 --> 00:27:03.040 align:start position:0%
<00:27:03.030>generally <00:27:03.031>smaller <00:27:03.033>than <00:27:03.035>CSV <00:27:03.037>files. <00:27:03.039>I'm

00:27:03.040 --> 00:27:04.750 align:start position:0%
<00:27:03.040>generally <00:27:03.167>smaller <00:27:03.294>than <00:27:03.421>CSV <00:27:03.549>files. <00:27:03.676>I'm <00:27:03.803>guessing <00:27:03.930>due <00:27:04.058>to <00:27:04.185>compression. <00:27:04.312>How <00:27:04.440>does

00:27:04.750 --> 00:27:04.760 align:start position:0%
<00:27:04.750>guessing <00:27:04.751>due <00:27:04.753>to <00:27:04.755>compression. <00:27:04.757>How <00:27:04.759>does

00:27:04.760 --> 00:27:06.710 align:start position:0%
<00:27:04.760>guessing <00:27:04.867>due <00:27:04.975>to <00:27:05.083>compression. <00:27:05.190>How <00:27:05.298>does <00:27:05.406>compression <00:27:05.513>stay <00:27:05.621>out <00:27:05.729>of <00:27:05.836>the <00:27:05.944>way <00:27:06.052>of <00:27:06.160>the

00:27:06.710 --> 00:27:06.720 align:start position:0%
<00:27:06.710>compression <00:27:06.711>stay <00:27:06.712>out <00:27:06.713>of <00:27:06.715>the <00:27:06.716>way <00:27:06.717>of <00:27:06.719>the

00:27:06.720 --> 00:27:09.190 align:start position:0%
<00:27:06.720>compression <00:27:06.827>stay <00:27:06.935>out <00:27:07.043>of <00:27:07.150>the <00:27:07.258>way <00:27:07.366>of <00:27:07.473>the <00:27:07.581>smart <00:27:07.689>footnote <00:27:07.796>way <00:27:07.904>of <00:27:08.012>accessing <00:27:08.120>parquet

00:27:09.190 --> 00:27:09.200 align:start position:0%
<00:27:09.190>smart <00:27:09.191>footnote <00:27:09.193>way <00:27:09.195>of <00:27:09.197>accessing <00:27:09.199>parquet

00:27:09.200 --> 00:27:11.110 align:start position:0%
<00:27:09.200>smart <00:27:09.433>footnote <00:27:09.666>way <00:27:09.900>of <00:27:10.133>accessing <00:27:10.366>parquet <00:27:10.600>files?

00:27:11.110 --> 00:27:11.120 align:start position:0%
files?

00:27:11.120 --> 00:27:12.990 align:start position:0%
<00:27:11.120>files? <00:27:11.260>&gt;&gt; <00:27:11.399>Um <00:27:11.540>so <00:27:11.679>yeah, <00:27:11.820>this <00:27:11.959>is <00:27:12.100>one <00:27:12.239>of <00:27:12.379>the <00:27:12.520>things.

00:27:12.990 --> 00:27:13.000 align:start position:0%
<00:27:12.990>&gt;&gt; <00:27:12.991>Um <00:27:12.992>so <00:27:12.993>yeah, <00:27:12.994>this <00:27:12.995>is <00:27:12.996>one <00:27:12.997>of <00:27:12.998>the <00:27:12.999>things.

00:27:13.000 --> 00:27:15.270 align:start position:0%
<00:27:13.000>&gt;&gt; <00:27:13.087>Um <00:27:13.175>so <00:27:13.262>yeah, <00:27:13.350>this <00:27:13.437>is <00:27:13.525>one <00:27:13.612>of <00:27:13.700>the <00:27:13.787>things. <00:27:13.875>So <00:27:13.962>yeah, <00:27:14.050>it's <00:27:14.137>due <00:27:14.225>to <00:27:14.312>compression <00:27:14.400>and

00:27:15.270 --> 00:27:15.280 align:start position:0%
<00:27:15.270>So <00:27:15.271>yeah, <00:27:15.273>it's <00:27:15.274>due <00:27:15.276>to <00:27:15.277>compression <00:27:15.279>and

00:27:15.280 --> 00:27:16.950 align:start position:0%
<00:27:15.280>So <00:27:15.373>yeah, <00:27:15.466>it's <00:27:15.560>due <00:27:15.653>to <00:27:15.746>compression <00:27:15.840>and <00:27:15.933>often <00:27:16.026>the <00:27:16.120>ratio <00:27:16.213>is <00:27:16.306>1 <00:27:16.399>to <00:27:16.493>10. <00:27:16.586>So <00:27:16.680>it's

00:27:16.950 --> 00:27:16.960 align:start position:0%
<00:27:16.950>often <00:27:16.951>the <00:27:16.952>ratio <00:27:16.953>is <00:27:16.954>1 <00:27:16.955>to <00:27:16.956>10. <00:27:16.957>So <00:27:16.959>it's

00:27:16.960 --> 00:27:18.310 align:start position:0%
<00:27:16.960>often <00:27:17.081>the <00:27:17.203>ratio <00:27:17.324>is <00:27:17.446>1 <00:27:17.567>to <00:27:17.689>10. <00:27:17.810>So <00:27:17.932>it's <00:27:18.053>really <00:27:18.175>worth

00:27:18.310 --> 00:27:18.320 align:start position:0%
<00:27:18.310>really <00:27:18.319>worth

00:27:18.320 --> 00:27:19.630 align:start position:0%
<00:27:18.320>really <00:27:18.713>worth <00:27:19.106>doing <00:27:19.499>this.

00:27:19.630 --> 00:27:19.640 align:start position:0%
<00:27:19.630>doing <00:27:19.639>this.

00:27:19.640 --> 00:27:21.310 align:start position:0%
<00:27:19.640>doing <00:27:19.795>this. <00:27:19.951>And <00:27:20.106>this <00:27:20.262>is <00:27:20.417>also <00:27:20.573>one <00:27:20.728>of <00:27:20.884>the <00:27:21.040>main

00:27:21.310 --> 00:27:21.320 align:start position:0%
<00:27:21.310>And <00:27:21.311>this <00:27:21.312>is <00:27:21.313>also <00:27:21.315>one <00:27:21.316>of <00:27:21.317>the <00:27:21.319>main

00:27:21.320 --> 00:27:22.910 align:start position:0%
<00:27:21.320>And <00:27:21.427>this <00:27:21.535>is <00:27:21.643>also <00:27:21.750>one <00:27:21.858>of <00:27:21.966>the <00:27:22.073>main <00:27:22.181>problems <00:27:22.289>that <00:27:22.396>Vertica <00:27:22.504>is <00:27:22.612>trying <00:27:22.720>to

00:27:22.910 --> 00:27:22.920 align:start position:0%
<00:27:22.910>problems <00:27:22.911>that <00:27:22.913>Vertica <00:27:22.915>is <00:27:22.917>trying <00:27:22.919>to

00:27:22.920 --> 00:27:24.870 align:start position:0%
<00:27:22.920>problems <00:27:23.047>that <00:27:23.174>Vertica <00:27:23.301>is <00:27:23.429>trying <00:27:23.556>to <00:27:23.683>address. <00:27:23.810>You <00:27:23.938>always <00:27:24.065>have <00:27:24.192>to <00:27:24.320>decode,

00:27:24.870 --> 00:27:24.880 align:start position:0%
<00:27:24.870>address. <00:27:24.871>You <00:27:24.873>always <00:27:24.875>have <00:27:24.877>to <00:27:24.879>decode,

00:27:24.880 --> 00:27:27.790 align:start position:0%
<00:27:24.880>address. <00:27:25.020>You <00:27:25.160>always <00:27:25.300>have <00:27:25.440>to <00:27:25.580>decode, <00:27:25.720>encode, <00:27:25.860>decompress, <00:27:26.000>compress <00:27:26.140>the <00:27:26.280>things.

00:27:27.790 --> 00:27:27.800 align:start position:0%
<00:27:27.790>encode, <00:27:27.792>decompress, <00:27:27.794>compress <00:27:27.796>the <00:27:27.799>things.

00:27:27.800 --> 00:27:30.150 align:start position:0%
<00:27:27.800>encode, <00:27:27.927>decompress, <00:27:28.054>compress <00:27:28.181>the <00:27:28.309>things. <00:27:28.436>And <00:27:28.563>therefore <00:27:28.690>it's <00:27:28.818>kind <00:27:28.945>of <00:27:29.072>slow <00:27:29.200>for

00:27:30.150 --> 00:27:30.160 align:start position:0%
<00:27:30.150>And <00:27:30.151>therefore <00:27:30.153>it's <00:27:30.154>kind <00:27:30.156>of <00:27:30.157>slow <00:27:30.159>for

00:27:30.160 --> 00:27:32.190 align:start position:0%
<00:27:30.160>And <00:27:30.260>therefore <00:27:30.360>it's <00:27:30.460>kind <00:27:30.560>of <00:27:30.660>slow <00:27:30.760>for <00:27:30.860>point <00:27:30.960>lookups. <00:27:31.060>And <00:27:31.160>this <00:27:31.260>is <00:27:31.360>a <00:27:31.460>thing <00:27:31.560>that

00:27:32.190 --> 00:27:32.200 align:start position:0%
<00:27:32.190>point <00:27:32.191>lookups. <00:27:32.192>And <00:27:32.193>this <00:27:32.195>is <00:27:32.196>a <00:27:32.197>thing <00:27:32.199>that

00:27:32.200 --> 00:27:33.710 align:start position:0%
<00:27:32.200>point <00:27:32.297>lookups. <00:27:32.394>And <00:27:32.491>this <00:27:32.588>is <00:27:32.685>a <00:27:32.782>thing <00:27:32.879>that <00:27:32.976>Vertica <00:27:33.073>is <00:27:33.170>trying <00:27:33.267>to <00:27:33.364>solve <00:27:33.461>because <00:27:33.559>they

00:27:33.710 --> 00:27:33.720 align:start position:0%
<00:27:33.710>Vertica <00:27:33.711>is <00:27:33.713>trying <00:27:33.714>to <00:27:33.716>solve <00:27:33.717>because <00:27:33.719>they

00:27:33.720 --> 00:27:35.670 align:start position:0%
<00:27:33.720>Vertica <00:27:33.836>is <00:27:33.953>trying <00:27:34.070>to <00:27:34.186>solve <00:27:34.303>because <00:27:34.420>they <00:27:34.536>are <00:27:34.653>compression <00:27:34.770>and <00:27:34.886>decode <00:27:35.003>and <00:27:35.120>encoding

00:27:35.670 --> 00:27:35.680 align:start position:0%
<00:27:35.670>are <00:27:35.671>compression <00:27:35.673>and <00:27:35.675>decode <00:27:35.677>and <00:27:35.679>encoding

00:27:35.680 --> 00:27:37.590 align:start position:0%
<00:27:35.680>are <00:27:35.796>compression <00:27:35.913>and <00:27:36.030>decode <00:27:36.146>and <00:27:36.263>encoding <00:27:36.380>algorithms <00:27:36.496>where <00:27:36.613>you <00:27:36.730>can <00:27:36.846>do <00:27:36.963>the <00:27:37.080>filter

00:27:37.590 --> 00:27:37.600 align:start position:0%
<00:27:37.590>algorithms <00:27:37.591>where <00:27:37.592>you <00:27:37.594>can <00:27:37.596>do <00:27:37.597>the <00:27:37.599>filter

00:27:37.600 --> 00:27:39.910 align:start position:0%
<00:27:37.600>algorithms <00:27:37.707>where <00:27:37.815>you <00:27:37.923>can <00:27:38.030>do <00:27:38.138>the <00:27:38.246>filter <00:27:38.353>on <00:27:38.461>the <00:27:38.569>compressed <00:27:38.676>data <00:27:38.784>actually. <00:27:38.892>That <00:27:39.000>is

00:27:39.910 --> 00:27:39.920 align:start position:0%
<00:27:39.910>on <00:27:39.911>the <00:27:39.913>compressed <00:27:39.914>data <00:27:39.916>actually. <00:27:39.917>That <00:27:39.919>is

00:27:39.920 --> 00:27:41.870 align:start position:0%
<00:27:39.920>on <00:27:40.027>the <00:27:40.135>compressed <00:27:40.243>data <00:27:40.350>actually. <00:27:40.458>That <00:27:40.566>is <00:27:40.673>what <00:27:40.781>Vertica <00:27:40.889>is <00:27:40.996>doing, <00:27:41.104>which <00:27:41.212>is <00:27:41.320>parquet

00:27:41.870 --> 00:27:41.880 align:start position:0%
<00:27:41.870>what <00:27:41.871>Vertica <00:27:41.873>is <00:27:41.874>doing, <00:27:41.876>which <00:27:41.877>is <00:27:41.879>parquet

00:27:41.880 --> 00:27:42.990 align:start position:0%
<00:27:41.880>what <00:27:42.022>Vertica <00:27:42.165>is <00:27:42.308>doing, <00:27:42.450>which <00:27:42.593>is <00:27:42.736>parquet <00:27:42.879>not.

00:27:42.990 --> 00:27:43.000 align:start position:0%
not.

00:27:43.000 --> 00:27:46.110 align:start position:0%
<00:27:43.000>not. <00:27:43.200>&gt;&gt; <00:27:43.400>Okay. <00:27:43.600>Hope <00:27:43.800>that <00:27:44.000>answers <00:27:44.200>the <00:27:44.400>question.

00:27:46.110 --> 00:27:46.120 align:start position:0%
<00:27:46.110>&gt;&gt; <00:27:46.111>Okay. <00:27:46.112>Hope <00:27:46.114>that <00:27:46.116>answers <00:27:46.117>the <00:27:46.119>question.

00:27:46.120 --> 00:27:47.910 align:start position:0%
<00:27:46.120>&gt;&gt; <00:27:46.207>Okay. <00:27:46.294>Hope <00:27:46.382>that <00:27:46.469>answers <00:27:46.557>the <00:27:46.645>question. <00:27:46.732>Then <00:27:46.820>we <00:27:46.907>have <00:27:46.995>a <00:27:47.082>last <00:27:47.169>one <00:27:47.257>and <00:27:47.344>then <00:27:47.432>I <00:27:47.520>think

00:27:47.910 --> 00:27:47.920 align:start position:0%
<00:27:47.910>Then <00:27:47.911>we <00:27:47.912>have <00:27:47.913>a <00:27:47.914>last <00:27:47.915>one <00:27:47.916>and <00:27:47.917>then <00:27:47.918>I <00:27:47.919>think

00:27:47.920 --> 00:27:49.430 align:start position:0%
<00:27:47.920>Then <00:27:48.033>we <00:27:48.146>have <00:27:48.259>a <00:27:48.373>last <00:27:48.486>one <00:27:48.599>and <00:27:48.712>then <00:27:48.826>I <00:27:48.939>think <00:27:49.052>we <00:27:49.165>also <00:27:49.279>done.

00:27:49.430 --> 00:27:49.440 align:start position:0%
<00:27:49.430>we <00:27:49.434>also <00:27:49.439>done.

00:27:49.440 --> 00:27:52.110 align:start position:0%
<00:27:49.440>we <00:27:49.595>also <00:27:49.751>done. <00:27:49.906>Um <00:27:50.062>time's <00:27:50.217>up. <00:27:50.373>So <00:27:50.528>Matthias <00:27:50.684>asks, <00:27:50.840>"How

00:27:52.110 --> 00:27:52.120 align:start position:0%
<00:27:52.110>Um <00:27:52.111>time's <00:27:52.112>up. <00:27:52.114>So <00:27:52.116>Matthias <00:27:52.117>asks, <00:27:52.119>"How

00:27:52.120 --> 00:27:53.990 align:start position:0%
<00:27:52.120>Um <00:27:52.236>time's <00:27:52.353>up. <00:27:52.469>So <00:27:52.586>Matthias <00:27:52.703>asks, <00:27:52.820>"How <00:27:52.936>does <00:27:53.053>the <00:27:53.169>described <00:27:53.286>setup <00:27:53.403>compare <00:27:53.520>to

00:27:53.990 --> 00:27:54.000 align:start position:0%
<00:27:53.990>does <00:27:53.991>the <00:27:53.993>described <00:27:53.995>setup <00:27:53.997>compare <00:27:53.999>to

00:27:54.000 --> 00:27:55.870 align:start position:0%
<00:27:54.000>does <00:27:54.127>the <00:27:54.254>described <00:27:54.381>setup <00:27:54.509>compare <00:27:54.636>to <00:27:54.763>dumping <00:27:54.890>all <00:27:55.018>data <00:27:55.145>in <00:27:55.272>Elasticsearch <00:27:55.400>for

00:27:55.870 --> 00:27:55.880 align:start position:0%
<00:27:55.870>dumping <00:27:55.871>all <00:27:55.873>data <00:27:55.875>in <00:27:55.877>Elasticsearch <00:27:55.879>for

00:27:55.880 --> 00:27:58.550 align:start position:0%
<00:27:55.880>dumping <00:27:56.035>all <00:27:56.191>data <00:27:56.346>in <00:27:56.502>Elasticsearch <00:27:56.657>for <00:27:56.813>complex <00:27:56.968>data <00:27:57.124>analysis <00:27:57.280>queries?"

00:27:58.550 --> 00:27:58.560 align:start position:0%
<00:27:58.550>complex <00:27:58.553>data <00:27:58.556>analysis <00:27:58.559>queries?"

00:27:58.560 --> 00:28:01.270 align:start position:0%
<00:27:58.560>complex <00:27:58.687>data <00:27:58.814>analysis <00:27:58.941>queries?" <00:27:59.069>&gt;&gt; <00:27:59.196>Uh <00:27:59.323>in <00:27:59.450>Elasticsearch <00:27:59.578>you <00:27:59.705>would <00:27:59.832>need <00:27:59.960>So

00:28:01.270 --> 00:28:01.280 align:start position:0%
<00:28:01.270>&gt;&gt; <00:28:01.271>Uh <00:28:01.272>in <00:28:01.273>Elasticsearch <00:28:01.275>you <00:28:01.276>would <00:28:01.277>need <00:28:01.279>So

00:28:01.280 --> 00:28:02.510 align:start position:0%
<00:28:01.280>&gt;&gt; <00:28:01.353>Uh <00:28:01.427>in <00:28:01.501>Elasticsearch <00:28:01.575>you <00:28:01.649>would <00:28:01.722>need <00:28:01.796>So <00:28:01.870>first <00:28:01.944>of <00:28:02.018>all, <00:28:02.091>you <00:28:02.165>don't <00:28:02.239>have <00:28:02.313>SQL <00:28:02.387>on

00:28:02.510 --> 00:28:02.520 align:start position:0%
<00:28:02.510>first <00:28:02.511>of <00:28:02.512>all, <00:28:02.513>you <00:28:02.515>don't <00:28:02.516>have <00:28:02.517>SQL <00:28:02.519>on

00:28:02.520 --> 00:28:04.150 align:start position:0%
<00:28:02.520>first <00:28:02.627>of <00:28:02.735>all, <00:28:02.843>you <00:28:02.950>don't <00:28:03.058>have <00:28:03.166>SQL <00:28:03.273>on <00:28:03.381>Elasticsearch. <00:28:03.489>Might <00:28:03.596>be <00:28:03.704>a <00:28:03.812>matter <00:28:03.920>of

00:28:04.150 --> 00:28:04.160 align:start position:0%
<00:28:04.150>Elasticsearch. <00:28:04.151>Might <00:28:04.153>be <00:28:04.155>a <00:28:04.157>matter <00:28:04.159>of

00:28:04.160 --> 00:28:05.630 align:start position:0%
<00:28:04.160>Elasticsearch. <00:28:04.261>Might <00:28:04.363>be <00:28:04.465>a <00:28:04.567>matter <00:28:04.668>of <00:28:04.770>taste, <00:28:04.872>but <00:28:04.974>my <00:28:05.075>matter <00:28:05.177>of <00:28:05.279>taste <00:28:05.381>would <00:28:05.483>be

00:28:05.630 --> 00:28:05.640 align:start position:0%
<00:28:05.630>taste, <00:28:05.631>but <00:28:05.632>my <00:28:05.633>matter <00:28:05.635>of <00:28:05.636>taste <00:28:05.637>would <00:28:05.639>be

00:28:05.640 --> 00:28:07.190 align:start position:0%
<00:28:05.640>taste, <00:28:05.814>but <00:28:05.988>my <00:28:06.163>matter <00:28:06.337>of <00:28:06.511>taste <00:28:06.686>would <00:28:06.860>be <00:28:07.035>clear.

00:28:07.190 --> 00:28:07.200 align:start position:0%
clear.

00:28:07.200 --> 00:28:08.950 align:start position:0%
<00:28:07.200>clear. <00:28:07.433>Otherwise, <00:28:07.666>you <00:28:07.900>would <00:28:08.133>need <00:28:08.366>a <00:28:08.600>server

00:28:08.950 --> 00:28:08.960 align:start position:0%
<00:28:08.950>Otherwise, <00:28:08.951>you <00:28:08.953>would <00:28:08.955>need <00:28:08.957>a <00:28:08.959>server

00:28:08.960 --> 00:28:10.670 align:start position:0%
<00:28:08.960>Otherwise, <00:28:09.076>you <00:28:09.193>would <00:28:09.310>need <00:28:09.426>a <00:28:09.543>server <00:28:09.660>instance <00:28:09.776>that <00:28:09.893>is <00:28:10.010>running <00:28:10.126>all <00:28:10.243>the <00:28:10.360>time.

00:28:10.670 --> 00:28:10.680 align:start position:0%
<00:28:10.670>instance <00:28:10.671>that <00:28:10.673>is <00:28:10.674>running <00:28:10.676>all <00:28:10.677>the <00:28:10.679>time.

00:28:10.680 --> 00:28:12.630 align:start position:0%
<00:28:10.680>instance <00:28:10.780>that <00:28:10.880>is <00:28:10.980>running <00:28:11.080>all <00:28:11.180>the <00:28:11.280>time. <00:28:11.380>That <00:28:11.480>costs <00:28:11.580>you <00:28:11.680>money <00:28:11.780>where <00:28:11.880>you <00:28:11.980>keep <00:28:12.080>the

00:28:12.630 --> 00:28:12.640 align:start position:0%
<00:28:12.630>That <00:28:12.631>costs <00:28:12.632>you <00:28:12.633>money <00:28:12.635>where <00:28:12.636>you <00:28:12.637>keep <00:28:12.639>the

00:28:12.640 --> 00:28:14.630 align:start position:0%
<00:28:12.640>That <00:28:12.740>costs <00:28:12.840>you <00:28:12.940>money <00:28:13.040>where <00:28:13.140>you <00:28:13.240>keep <00:28:13.340>the <00:28:13.440>computer <00:28:13.540>all <00:28:13.640>the <00:28:13.740>time, <00:28:13.840>have <00:28:13.940>the <00:28:14.040>computer

00:28:14.630 --> 00:28:14.640 align:start position:0%
<00:28:14.630>computer <00:28:14.631>all <00:28:14.633>the <00:28:14.634>time, <00:28:14.636>have <00:28:14.637>the <00:28:14.639>computer

00:28:14.640 --> 00:28:16.870 align:start position:0%
<00:28:14.640>computer <00:28:14.740>all <00:28:14.840>the <00:28:14.940>time, <00:28:15.040>have <00:28:15.140>the <00:28:15.240>computer <00:28:15.340>ready, <00:28:15.440>and <00:28:15.540>nobody <00:28:15.640>uses <00:28:15.740>this <00:28:15.840>only <00:28:15.940>they <00:28:16.040>if

00:28:16.870 --> 00:28:16.880 align:start position:0%
<00:28:16.870>ready, <00:28:16.871>and <00:28:16.872>nobody <00:28:16.873>uses <00:28:16.875>this <00:28:16.876>only <00:28:16.877>they <00:28:16.879>if

00:28:16.880 --> 00:28:19.270 align:start position:0%
<00:28:16.880>ready, <00:28:16.973>and <00:28:17.066>nobody <00:28:17.160>uses <00:28:17.253>this <00:28:17.346>only <00:28:17.440>they <00:28:17.533>if <00:28:17.626>they <00:28:17.720>do <00:28:17.813>analytics. <00:28:17.906>If <00:28:18.000>you <00:28:18.093>say, <00:28:18.186>"I <00:28:18.280>just

00:28:19.270 --> 00:28:19.280 align:start position:0%
<00:28:19.270>they <00:28:19.271>do <00:28:19.272>analytics. <00:28:19.273>If <00:28:19.275>you <00:28:19.276>say, <00:28:19.277>"I <00:28:19.279>just

00:28:19.280 --> 00:28:21.310 align:start position:0%
<00:28:19.280>they <00:28:19.373>do <00:28:19.466>analytics. <00:28:19.560>If <00:28:19.653>you <00:28:19.746>say, <00:28:19.840>"I <00:28:19.933>just <00:28:20.026>store <00:28:20.120>the <00:28:20.213>data <00:28:20.306>in <00:28:20.399>a <00:28:20.493>cheap <00:28:20.586>blob <00:28:20.680>storage

00:28:21.310 --> 00:28:21.320 align:start position:0%
<00:28:21.310>store <00:28:21.311>the <00:28:21.312>data <00:28:21.313>in <00:28:21.315>a <00:28:21.316>cheap <00:28:21.317>blob <00:28:21.319>storage

00:28:21.320 --> 00:28:23.790 align:start position:0%
<00:28:21.320>store <00:28:21.407>the <00:28:21.495>data <00:28:21.582>in <00:28:21.669>a <00:28:21.757>cheap <00:28:21.845>blob <00:28:21.932>storage <00:28:22.020>and <00:28:22.107>just <00:28:22.195>spin <00:28:22.282>up <00:28:22.370>the <00:28:22.457>compute <00:28:22.544>when <00:28:22.632>I <00:28:22.720>need

00:28:23.790 --> 00:28:23.800 align:start position:0%
<00:28:23.790>and <00:28:23.791>just <00:28:23.792>spin <00:28:23.793>up <00:28:23.794>the <00:28:23.795>compute <00:28:23.796>when <00:28:23.797>I <00:28:23.799>need

00:28:23.800 --> 00:28:25.870 align:start position:0%
<00:28:23.800>and <00:28:23.893>just <00:28:23.986>spin <00:28:24.080>up <00:28:24.173>the <00:28:24.266>compute <00:28:24.360>when <00:28:24.453>I <00:28:24.546>need <00:28:24.639>this <00:28:24.733>and <00:28:24.826>otherwise <00:28:24.919>the <00:28:25.013>computer <00:28:25.106>is <00:28:25.200>just

00:28:25.870 --> 00:28:25.880 align:start position:0%
<00:28:25.870>this <00:28:25.871>and <00:28:25.873>otherwise <00:28:25.874>the <00:28:25.876>computer <00:28:25.877>is <00:28:25.879>just

00:28:25.880 --> 00:28:27.150 align:start position:0%
<00:28:25.880>this <00:28:26.043>and <00:28:26.206>otherwise <00:28:26.369>the <00:28:26.533>computer <00:28:26.696>is <00:28:26.859>just <00:28:27.023>zero."

00:28:27.150 --> 00:28:27.160 align:start position:0%
zero."

00:28:27.160 --> 00:28:30.350 align:start position:0%
<00:28:27.160>zero." <00:28:27.335>is <00:28:27.510>just <00:28:27.685>the <00:28:27.860>other <00:28:28.035>way. <00:28:28.210>And <00:28:28.385>I <00:28:28.560>think

00:28:30.350 --> 00:28:30.360 align:start position:0%
<00:28:30.350>is <00:28:30.351>just <00:28:30.352>the <00:28:30.353>other <00:28:30.355>way. <00:28:30.356>And <00:28:30.357>I <00:28:30.359>think

00:28:30.360 --> 00:28:32.630 align:start position:0%
<00:28:30.360>is <00:28:30.476>just <00:28:30.593>the <00:28:30.709>other <00:28:30.826>way. <00:28:30.943>And <00:28:31.060>I <00:28:31.176>think <00:28:31.293>depending <00:28:31.409>on <00:28:31.526>the <00:28:31.643>analytics <00:28:31.760>type,

00:28:32.630 --> 00:28:32.640 align:start position:0%
<00:28:32.630>depending <00:28:32.632>on <00:28:32.634>the <00:28:32.636>analytics <00:28:32.639>type,

00:28:32.640 --> 00:28:34.150 align:start position:0%
<00:28:32.640>depending <00:28:32.775>on <00:28:32.911>the <00:28:33.047>analytics <00:28:33.183>type, <00:28:33.319>Elasticsearch <00:28:33.455>might <00:28:33.591>be <00:28:33.727>okay, <00:28:33.863>might <00:28:33.999>not

00:28:34.150 --> 00:28:34.160 align:start position:0%
<00:28:34.150>Elasticsearch <00:28:34.151>might <00:28:34.153>be <00:28:34.155>okay, <00:28:34.157>might <00:28:34.159>not

00:28:34.160 --> 00:28:35.590 align:start position:0%
<00:28:34.160>Elasticsearch <00:28:34.303>might <00:28:34.446>be <00:28:34.589>okay, <00:28:34.732>might <00:28:34.875>not <00:28:35.018>be <00:28:35.161>the <00:28:35.303>best <00:28:35.447>choice.

00:28:35.590 --> 00:28:35.600 align:start position:0%
<00:28:35.590>be <00:28:35.592>the <00:28:35.596>best <00:28:35.599>choice.

00:28:35.600 --> 00:28:36.670 align:start position:0%
<00:28:35.600>be <00:28:35.840>the <00:28:36.081>best <00:28:36.322>choice. <00:28:36.563>Yeah.

00:28:36.670 --> 00:28:36.680 align:start position:0%
Yeah.

00:28:36.680 --> 00:28:37.230 align:start position:0%
<00:28:36.680>Yeah. <00:28:36.927>Thank <00:28:37.175>you.

00:28:37.230 --> 00:28:37.240 align:start position:0%
<00:28:37.230>Thank <00:28:37.239>you.

00:28:37.240 --> 00:28:39.384 align:start position:0%
<00:28:37.240>Thank <00:28:37.440>you. <00:28:37.640>&gt;&gt; <00:28:37.840>Thank <00:28:38.040>you <00:28:38.240>so <00:28:38.440>much, <00:28:38.640>Matthias.

00:28:39.384 --> 00:28:39.394 align:start position:0%
<00:28:39.384>&gt;&gt; <00:28:39.385>Thank <00:28:39.387>you <00:28:39.389>so <00:28:39.391>much, <00:28:39.393>Matthias.

00:28:39.394 --> 00:28:41.414 align:start position:0%
<00:28:39.394>&gt;&gt; <00:28:39.594>Thank <00:28:39.794>you <00:28:39.994>so <00:28:40.194>much, <00:28:40.394>Matthias. <00:28:40.594>&gt;&gt; <00:28:40.794>[applause]