Re:Show HN: mbtiles-s3-server – serve vector map tiles direc...
by londons_explore on Sunday July 10, 2022 @06:22AM
(#32043397)
I wouldn't recommend using any sqlite database direct on s3... You'll end up with a pretty high bill from all the operations.
[ Parent
| on HN ]
Re:Show HN: mbtiles-s3-server – serve vector map tiles direc...
by toomuchtodo on Sunday July 10, 2022 @09:38AM
(#32044642)
Do range requests against s3 work if you’re fronting with Cloudflare and aggressively caching? Could be more economical.
Re:Show HN: mbtiles-s3-server – serve vector map tiles direc...
by elithrar on Sunday July 10, 2022 @10:36AM
(#32045154)
It should work directly against R2 - our S3 compatible object storage) w/ no egress fees: https://developers.cloudflare.com/r2/
Makes experimenting with things like this much cheaper.
(I work for CF)
Re:Show HN: mbtiles-s3-server – serve vector map tiles direc...
by piperswe on Sunday July 10, 2022 @10:57AM
(#32045347)
Though if you have enough users pinging the server you'll probably end up with a bunch of operations happening, which do have fees. It may be better cost-wise to just put this SQLite database on D1 (especially if it gets read-only replication at some point) and set up a Worker to return tile data in one HTTP request. That way the infrastructure is still serverless, but doesn't require N requests per tile, just 1.
(I also work for CF)
Re:Show HN: mbtiles-s3-server – serve vector map tiles direc...
by simonw on Sunday July 10, 2022 @11:04AM
(#32045405)
Can D1 handle a 92GB SQLite database file?
Re:Show HN: mbtiles-s3-server – serve vector map tiles direc...
by piperswe on Sunday July 10, 2022 @12:49PM
(#32046357)
I'm not sure! I would imagine it's planned though, scaling to that size seems important for a database product. I'm not on the D1 or R2 teams so I'm not intimately familiar with their products.
Re:Show HN: mbtiles-s3-server – serve vector map tiles direc...
by toomuchtodo on Sunday July 10, 2022 @01:32PM
(#32046802)
Thank you Cloudflare folks for contributing, extremely helpful.
Re:Show HN: mbtiles-s3-server – serve vector map tiles direc...
by zylepe on Sunday July 10, 2022 @11:15AM
(#32045508)
We’ve been experimenting with R2 for serving tiles from an 80gb pmtiles archive, unfortunately the latency on up to 3 byte range requests from a worker is 5-10 seconds so it’s not practical for real usage yet. Can we expect that to improve as R2 gets closer to general availability?