Re:DuckDB 1.5.2 – SQL database that runs on laptop, server, ...
by gigatexal on Wednesday April 22, 2026 @01:59PM
(#47867020)
i must be doing something wrong but if i try a huge join on a table bigger than my ram no matter the flags or the spill-to-disk modes enabled i get crashes. im sure im doing something wrong.
Re:DuckDB 1.5.2 – SQL database that runs on laptop, server, ...
by goerch on Wednesday April 22, 2026 @02:22PM
(#47867313)
Hm, only anecdotal evidence, but page rank computation for Wikipedia works on my laptop (https://github.com/idesis-gmbh/WikiExperiments) where `NetworkX` fails. And it uses some joins like here: https://github.com/idesis-gmbh/WikiExperiments/blob/0b108f3f...
Re:DuckDB 1.5.2 – SQL database that runs on laptop, server, ...
by infinet on Thursday April 23, 2026 @10:55AM
(#47876483)
From my very limited experience with duckdb, being a column based database, simple query also need loads entire columns and that uses a lots of RAM if a table has millions of rows. Perhaps there is a way to make it more memory friendly but I don't know how.
Interested here: for me it works for out of core work. Where is the limit? On a related note: do you need to handle concurrency restrictions?