Is the `weird_rides.db` file python or some sort of duckdb script?
I'm quite intrigued about DuckDBs ability to read parquet files off of buckets. How good is at at simply ignoring files (e.g, filtering based on info in datafiles paths)?
I'm quite intrigued about DuckDBs ability to read parquet files off of buckets. How good is at at simply ignoring files (e.g, filtering based on info in datafiles paths)?
It will even use range requests in S3 to avoid fetching the entire blob.
See here for the details https://duckdb.org/2021/06/25/querying-parquet.html#automati...