Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by apitman on Tuesday September 24, 2024 @09:11PM
(#41642645)
That's an interesting claim. I make range requests to 100GB+ files (genomics) all the time for work and it works great. I've never considered total file size as directly related to latency in this respect, assuming you have some sort of an index of course.
[ Parent
| on HN ]
Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by bdon on Tuesday September 24, 2024 @10:16PM
(#41643039)
You can test this claim directly against a AWS S3 bucket.
First 100KB of a 100GB+ file:
curl -H "Range: bytes=0-100000" https://overturemaps-tiles-us-west-2-beta.s3.amazonaws.com/2... --output tmp -w "%{time_total}"
First 100KB at the 100GB mark:
curl -H "Range: bytes=100000000000-100000100000" https://overturemaps-tiles-us-west-2-beta.s3.amazonaws.com/2... --output tmp -w "%{time_total}"
Re:Show HN: OpenFreeMap – Open-Source Map Hosting
by hyperknot on Wednesday September 25, 2024 @04:53AM
(#41645275)
Here the requests are really really small, on average 405 bytes each. I guess in your genomics work you are making larger requests, so probably it's not so much of an issue.
BTW, we are discussing latency with bdon in this issue, it seems to be specific to Cloudflare: https://github.com/hyperknot/openfreemap/issues/16