News for hackers. Stuff that matters.
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by arghwhat on Tuesday March 20, 2018 @10:32AM (#16628882)
If you upload an object with the same 'name' to S3, you also get a new version.

When you say 'key', do you mean the opaque object ID granted to objects in B2 which object stores like S3 doesn't have at all? I don't understand the rant here. S3 only operate by 'name' (key).

I have had no problem integrating B2 side-by-side with S3 and GCP in the products I have written. Their high-level models are largely compatible.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by mayank on Tuesday March 20, 2018 @11:28AM (#16629377)
S3 versioning is optional and off by default. Writes (including rewrites) to S3 are also atomic, so you’ll never see partial writes.
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by arghwhat on Tuesday March 20, 2018 @01:34PM (#16630700)
Ah, fair enough. I have oddly enough never in my life written to the same key twice, so I hadn't noticed it was off by default for S3.

Just to clarify you statement about atomicity: All writes to S3 and B2 are 'atomic' (and B2 can also verify the hash and reject on failure for an extra layer of security). The difference you mention is just that you can superficially "disable" versioning for S3, so that each key only stores one object version at a given time.

The only difference to the upload when S3 versioning is disabled is what happens during the metadata update: With versioning, a version is appended. Without, the version is replaced.

For B2, simulating disabled versioning is two operations: Upload a new object, and delete the old one. As long as the object is only referenced by name, this will also be atomic.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by zedpm on Tuesday March 20, 2018 @11:04AM (#16629151)
S3 allows you to turn versioning on and off for a bucket; my understanding is that B2 does not.
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by arghwhat on Tuesday March 20, 2018 @01:36PM (#16630717)
Yeah, that's correct. You have to delete old versions manually after upload if you want to simulate an "overwrite".

It would be quite simple for backblaze to implement, though, so I guess it might come as a future option.

Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by manigandham on Tuesday March 20, 2018 @12:38PM (#16630168)
Why would you need a separate ID other than the actual filepath key? (and a metadata version number if you have versioning available)
Re:Object Storage: AWS vs Google Cloud Storage vs Azure Stor... by arghwhat on Tuesday March 20, 2018 @01:17PM (#16630545)
B2 doesn't have metadata version numbers, but instead use the globally unique file identifier to refer to specific versions. When you list file versions, you're presented with file ids rather than version numbers.

It's only slightly different from the name+version approach, but I personally like the concept of unique identifiers better. It feels nicer.