Optimizing Large-Scale OpenStreetMap Data with SQLite

Re:Optimizing Large-Scale OpenStreetMap Data with SQLite by arp242 on Sunday July 07, 2024 @01:11AM (#40895404)

So for a one-off query DuckDB is tons faster, and easier.

[ Parent | on HN ]

Re:Optimizing Large-Scale OpenStreetMap Data with SQLite by winrid on Sunday July 07, 2024 @02:41PM (#40899539)

yeah, but it's not high performance, which was my original point.

I spend a lot of time optimizing stuff developers thought was "high performance" and they're scanning a 100gb+ dataset on every page load.

[ Parent | on HN ]

Re:Optimizing Large-Scale OpenStreetMap Data with SQLite by arp242 on Monday July 08, 2024 @07:02AM (#40904298)

If the alternative takes hours, then ~30 seconds seems high performance to me.

[ Parent | on HN ]

Re:Optimizing Large-Scale OpenStreetMap Data with SQLite by winrid on Monday July 08, 2024 @01:19PM (#40907291)

DuckDB is indeed great for one off stuff.

But calling 30s high performance for quantifying 60k unique values like in this case is misleading at best. I try not to mislead people. :)

[ Parent | on HN ]