Re:Comparing SQLite, DuckDB and Arrow with UN trade data
by wodenokoto on Wednesday October 27, 2021 @03:34AM
(#29010525)
I came to a completely different conclusion.
RDS is slow to load, because it has to unzip and read everything into memory. All others are fast to load because they have somesort of index into data on disk (at the cost of being much larger at rest)
Everything else is fast to load compared to RDS, with arrow being the fastest because its index happened to be optimized for the test query.
RDS is slow to load, because it has to unzip and read everything into memory. All others are fast to load because they have somesort of index into data on disk (at the cost of being much larger at rest)
Everything else is fast to load compared to RDS, with arrow being the fastest because its index happened to be optimized for the test query.