DuckDB 1.5.2 – SQL database that runs on laptop, server, in the browser

Re:DuckDB 1.5.2 – SQL database that runs on laptop, server, ... by gigatexal on Wednesday April 22, 2026 @01:39PM (#47866751)

Data engineer here: I use this all the time. It's amazing. For most of the data the sizes we often deal with it's perfect.

[ Parent | on HN ]

Re:DuckDB 1.5.2 – SQL database that runs on laptop, server, ... by goerch on Wednesday April 22, 2026 @01:45PM (#47866845)

> For most of the data the sizes we often deal with it's perfect.

Interested here: for me it works for out of core work. Where is the limit? On a related note: do you need to handle concurrency restrictions?

[ Parent | on HN ]

Re:DuckDB 1.5.2 – SQL database that runs on laptop, server, ... by gigatexal on Wednesday April 22, 2026 @01:59PM (#47867020)

i must be doing something wrong but if i try a huge join on a table bigger than my ram no matter the flags or the spill-to-disk modes enabled i get crashes. im sure im doing something wrong.

[ Parent | on HN ]

Re:DuckDB 1.5.2 – SQL database that runs on laptop, server, ... by goerch on Wednesday April 22, 2026 @02:22PM (#47867313)

Hm, only anecdotal evidence, but page rank computation for Wikipedia works on my laptop (https://github.com/idesis-gmbh/WikiExperiments) where `NetworkX` fails. And it uses some joins like here: https://github.com/idesis-gmbh/WikiExperiments/blob/0b108f3f...

[ Parent | on HN ]

Re:DuckDB 1.5.2 – SQL database that runs on laptop, server, ... by infinet on Thursday April 23, 2026 @10:55AM (#47876483)

From my very limited experience with duckdb, being a column based database, simple query also need loads entire columns and that uses a lots of RAM if a table has millions of rows. Perhaps there is a way to make it more memory friendly but I don't know how.

[ Parent | on HN ]