News for hackers. Stuff that matters.
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by dsacco on Tuesday March 20, 2018 @08:15AM (#16627825)
This is great, but I’m disappointed Backblaze B2 isn’t included. That seems like an oversight unless someone can point out how B2 doesn’t hold its own with these options in a glaring way. There are tradeoffs, but B2 seems to be very competitive overall.

B2 is cheaper than every option here for both storage ($0.005/GB) and egress ($0.01/GB).[1] Their transaction pricing is also cheaper.[2] Despite being cheaper, it’s still hot storage, so you can immediately download buckets, in whole or in part. I’ve personally used it to backup (and restore) terabytes of data for over a year. I doubt it has an SLA like GCP or AWS, but DigitalOcean doesn’t either, yet it’s listed here. I find the B2 API documentation to be very readable as well.[3]

I’ve used AWS S3, Glacier and GCP Nearline, Coldline. I can’t think of a specific thing that has disappointed me about B2, and the reliability has been excellent. The nature of my work is that I have very large datasets, and B2 becomes extremely competitive when you’re backing up tens of terabytes or more.

_________________________________

1. https://www.backblaze.com/b2/cloud-storage-pricing.html

2. https://www.backblaze.com/b2/b2-transactions-price.html

3. https://www.backblaze.com/b2/docs/

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by truetraveller on Tuesday March 20, 2018 @08:32AM (#16627931)
I really wanted to like B2. I love the docs and super-clean interface. But B2 was just too "weird" when it came to uploading an object. You can't replace an object key, so you always get a new object key when uploading. This is unlike any normal object store, where you can just upload to an existing key.

Also, if you upload an object with the same name (e.g. myphoto.png) it creates a new version, and there's no way to stop this. I don't want or need a new version!

I have a feeling this restriction is in place because of the underlying "vault" implementation.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by beepbeepbeep1 on Tuesday March 20, 2018 @08:42AM (#16627999)
B2 is great as a backup store. I use it for backup.

I wouldn't use it for non backup object storage, as it's in a single data center. S3 and Google Cloud are completely different, I'm not sure on the Google specifics but S3 has data replicated across three AZs.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by yjftsjthsd-h on Tuesday March 20, 2018 @09:17AM (#16628257)
Isn't backing up the last place where you want zero redundancy?
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by linsomniac on Tuesday March 20, 2018 @11:42AM (#16629521)
I don't know about that. In my case I'm backing up a backup, so I have to lose both backups. B2 is just for the offsite copy of the backup. Like taking a tape home sometimes...
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by zwily on Tuesday March 20, 2018 @09:57AM (#16628559)
A backup has redundancy already - your local copy + the backup.

(edit: I’m talking about geographic redundancy. B2 does use redundancy inside the datacenter to protect from drive failure, etc)

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by corobo on Tuesday March 20, 2018 @11:26AM (#16629357)
In fairness backing up is the last place I want to hand over redundancy responsibility. Better I consider B2 as one part of the 3-2-1 backups than the be-all end-all
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by jnsaff2 on Tuesday March 20, 2018 @10:11AM (#16628671)
I guess what OP meant was that for backups durability is important and periods of downtime are not as crucial as for say catpicturegram.
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by puzzle on Tuesday March 20, 2018 @09:53AM (#16628531)
GCS has multi-AZ replication, but also multi-region (at a premium).
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by mayank on Tuesday March 20, 2018 @11:30AM (#16629395)
S3 also does eventually consistent multi-region replication (at a premium).
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by arghwhat on Tuesday March 20, 2018 @10:32AM (#16628882)
If you upload an object with the same 'name' to S3, you also get a new version.

When you say 'key', do you mean the opaque object ID granted to objects in B2 which object stores like S3 doesn't have at all? I don't understand the rant here. S3 only operate by 'name' (key).

I have had no problem integrating B2 side-by-side with S3 and GCP in the products I have written. Their high-level models are largely compatible.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by mayank on Tuesday March 20, 2018 @11:28AM (#16629377)
S3 versioning is optional and off by default. Writes (including rewrites) to S3 are also atomic, so you’ll never see partial writes.
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by arghwhat on Tuesday March 20, 2018 @01:34PM (#16630700)
Ah, fair enough. I have oddly enough never in my life written to the same key twice, so I hadn't noticed it was off by default for S3.

Just to clarify you statement about atomicity: All writes to S3 and B2 are 'atomic' (and B2 can also verify the hash and reject on failure for an extra layer of security). The difference you mention is just that you can superficially "disable" versioning for S3, so that each key only stores one object version at a given time.

The only difference to the upload when S3 versioning is disabled is what happens during the metadata update: With versioning, a version is appended. Without, the version is replaced.

For B2, simulating disabled versioning is two operations: Upload a new object, and delete the old one. As long as the object is only referenced by name, this will also be atomic.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by zedpm on Tuesday March 20, 2018 @11:04AM (#16629151)
S3 allows you to turn versioning on and off for a bucket; my understanding is that B2 does not.
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by arghwhat on Tuesday March 20, 2018 @01:36PM (#16630717)
Yeah, that's correct. You have to delete old versions manually after upload if you want to simulate an "overwrite".

It would be quite simple for backblaze to implement, though, so I guess it might come as a future option.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by manigandham on Tuesday March 20, 2018 @12:38PM (#16630168)
Why would you need a separate ID other than the actual filepath key? (and a metadata version number if you have versioning available)
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by arghwhat on Tuesday March 20, 2018 @01:17PM (#16630545)
B2 doesn't have metadata version numbers, but instead use the globally unique file identifier to refer to specific versions. When you list file versions, you're presented with file ids rather than version numbers.

It's only slightly different from the name+version approach, but I personally like the concept of unique identifiers better. It feels nicer.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by 3pt14159 on Tuesday March 20, 2018 @10:20AM (#16628757)
I'm on DigitalOcean, and I love it, but I use B2 for backup because it just naturally seems safer to have the backups with a different company. It is great for that. I found the object upload a bit weird / different, but I appreciated how it stops you from shooting yourself in the foot by default, rather than the other way around.
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by moondev on Tuesday March 20, 2018 @09:38AM (#16628401)
Backblaze is in only a single datacenter, so perhaps not quite fair to compare pricing between true multi-region competitors?
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by toomuchtodo on Tuesday March 20, 2018 @10:23AM (#16628785)
None of the other multi-region competitors provide multi-region durability "out of the box" (although S3 does offer cross region replication as an option), so you might consider distributing your data between two object stores if you need multi-region (AWS us-east-1 and Backblaze, for example). This ensure not only geographic redundancy, but also vendor redundancy (not to mention B2 is cheaper than S3).

Disclaimer: I am in risk management.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by lobster_johnson on Tuesday March 20, 2018 @01:14PM (#16630516)
Not sure what you mean by "out of the box". Both Google Cloud Storage and Amazon S3 have cross-region replication built in. Something not "in the box" would imply you have to build it yourself, or buy a vendor product, to get it.

Google Cloud Storage's multi-regional support (asynchronously replicated to two or more geographic locations) is even easier than AWS: You simply specify, on bucket creation, whether the bucket should be regional or multi-regional.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by toomuchtodo on Tuesday March 20, 2018 @01:58PM (#16630928)
Thanks for correcting me on Google Cloud! I wasn't aware, as I work exclusively in AWS.

I stand by my statement about the benefit of multi vendor object replication.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by beedrillzzzzz on Tuesday March 20, 2018 @11:56AM (#16629698)
A little unfinished, but https://storagestatistics.com includes backblaze and others
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by codemac on Tuesday March 20, 2018 @12:19PM (#16629941)
The "geographic resiliency" chart is pretty inaccurate for the major providers, especially folks like Google cloud that have multi regional offerings with 99.95% availability & a lot more than "1" for redundancy.

I'd also add - unless you are going to include a median/mean latency number many options will look absurdly good even though we know they're a horrible idea, e.g. https://en.wikipedia.org/wiki/GmailFS. I also think "unknown" availability looks a lot like a durability issue..

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by therealmarv on Tuesday March 20, 2018 @10:46AM (#16629005)
there are also many other missing.... OVH object storage, online.net C14, Rackspace, Delimiter ObjSpace etc.etc.etc.

The world is not only Google, Amazon, Azure and DigitalOcean!

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by jopsen on Tuesday March 20, 2018 @11:47AM (#16629585)
blob storage without associated compute resources is boring.

transfer costs and latency makes it unusable for anything interesting.