Re:Canon's cloud platform has lost users' files and can't re...
by ignoramous on Tuesday August 18, 2020 @10:56AM
(#24199375)
> Do any cloud providers create backups on top of replication though?
Any serious database does offer backups in addition to replication, and that kind of validates OP's point. As for object stores there are a variety of techniques [0].
> But an entire cloud storage for photo and video for millions, we're talking maybe exabytes. The notion of making "separate" backups seems cost-prohibitive.
Cold-stores like the one Facebook built would be apt [1].
> I know there must be redundancy in case a disk fails, but do they keep 2 instances of your data or more? And are the instances spread out geographically, some or all?
See [0]. Backblaze do share quite a bit too about the space, too [2][3]. With minio, one could run their S3-like system on-premise [4].
Any serious database does offer backups in addition to replication, and that kind of validates OP's point. As for object stores there are a variety of techniques [0].
> But an entire cloud storage for photo and video for millions, we're talking maybe exabytes. The notion of making "separate" backups seems cost-prohibitive.
Cold-stores like the one Facebook built would be apt [1].
> I know there must be redundancy in case a disk fails, but do they keep 2 instances of your data or more? And are the instances spread out geographically, some or all?
See [0]. Backblaze do share quite a bit too about the space, too [2][3]. With minio, one could run their S3-like system on-premise [4].
[0] https://maisonbisson.com/post/object-storage-prior-art-and-l...
[1] https://engineering.fb.com/core-data/under-the-hood-facebook...
[2] https://news.ycombinator.com/item?id=10540361
[3] https://news.ycombinator.com/item?id=17550837
[4] https://news.ycombinator.com/item?id=12392081