News for hackers. Stuff that matters.
Re:DuckDB 1.0.0 by nomilk on Monday June 03, 2024 @10:34AM (#40563026)
> Why not store it on the EC2 instance directly?

Since the data in S3 receives updates every few hours, querying it directly ensures queries are on up-to-date data, whereas creating a copy of the dataset on the EC2 would necessitate periodically checking for updates and moving the deltas across to the EC2 (not insurmountable; but complexity worth avoiding if possible).

Re:DuckDB 1.0.0 by gizzlon on Monday June 03, 2024 @12:35PM (#40564380)
ah, I see. I though you decided t put it there (also, what the sibling said makes it a better idea)