Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by mistrial9 on Tuesday September 24, 2024 @10:17AM
(#41636710)
ok except "full planet datasets" make little sense for terrestrial features. Splitting .. aka sharding the files into basic continents would make SO much sense. Asia is big, but no requests for Africa mixed in.. Australia would be manageable?
[ Parent
| on HN ]
Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by hyperknot on Tuesday September 24, 2024 @10:24AM
(#41636782)
PMTiles could come up with a version in the future where instead of one 90 GB file, they have 9 thousand 10 MB files. That would work well I believe.
Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by bdon on Tuesday September 24, 2024 @12:13PM
(#41638118)
The latency for small files and ranges of large files is pretty similar on most storage platforms, but there are some exceptions like Cloudflare R2.
The main reason PMTiles is one file and not two or more files is that it enables atomic updates in-place (which every mature storage platform supports) as well as ETag content change detection in downstream caches. All of the server and serverless implementations at http://github.com/protomaps support this now for AWS, S3-compatible storage, Google Cloud, and Azure.
Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by wcedmisten on Tuesday September 24, 2024 @02:35PM
(#41639574)
Now I'm curious, what causes the latency for range requests with R2?
Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by bdon on Tuesday September 24, 2024 @10:20PM
(#41643056)
I don't have any insight into this other than observing how their storage system works, but here's some scripts I made last year to test:
Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by mannyv on Wednesday September 25, 2024 @08:22AM
(#41646553)
Range requests means work and logic. Getting a file requires no logic.
Also, I'm pretty sure range requests are going to be difficult to cache. That implies going to origin every request which is bad.