Re:DuckDB: SQLite for Analytics
by mytherin on Sunday May 24, 2020 @06:11AM
(#23290497)
The primary difference for analytic workloads is the processing model. MonetDB uses a column-at-a-time processing model which causes large intermediates to be materialized in memory. This significantly increases memory usage, and causes poor performance when data exceeds memory. DuckDB uses a vectorized execution engine, which materializes only small subsets of the columns. This increases cache-locality, decreases memory usage and also improves parallel execution capabilities (although parallel execution is still WIP currently).
[ Parent
| on HN ]
There are no comments on this comment yet.