News for hackers. Stuff that matters.
Re:Using DuckDB WASM and Cloudflare R2 to host and query big... by pranavmalvawala on Monday June 30, 2025 @03:50AM (#44420581)
I didn’t think it was possible to host such amount of data for free. I have not tried duck db but this gives me the reason
Re:Using DuckDB WASM and Cloudflare R2 to host and query big... by jrouviere on Monday June 30, 2025 @05:56AM (#44421372)
Does that approach really work for a 72GB dataset? I assume that means DuckDB will need to load all that data in the browser?
Re:Using DuckDB WASM and Cloudflare R2 to host and query big... by apwheele on Monday June 30, 2025 @07:18AM (#44421874)
Client side it is aggregations of the data, (so yes you could run out of memory). DuckDB does not load all of the data client side.
Re:Using DuckDB WASM and Cloudflare R2 to host and query big... by cedws on Monday June 30, 2025 @10:44AM (#44423986)
It would be nice if R2 supported Requester Pays like S3. In the past there's various data/files I've wanted to make public but not at my own expense.