The data is still stored on object storage. It’s just a more performant format.
The root of the problem is using object storage improperly.
The root of the problem is using object storage improperly.
The initial concept was created by Databricks in the CIDR Paper (https://www.cidrdb.org/cidr2021/papers/cidr2021_paper17.pdf) in 2021.
>The root of the problem is using object storage improperly.
I don't see anything improper for any Parquet-with-metadata format.