News for hackers. Stuff that matters.
Re:HopsFS: 100x Times Faster Than AWS S3 by fxtentacle on Sunday November 22, 2020 @10:22AM (#25178092)
Depending on your write throughput, versioning can be quite expensive.

Also, we were already at a throughput where the s3 metadata nodes would sometimes go offline, so I'm not sure putting more work on them would have improved our overall situation.

Re:HopsFS: 100x Times Faster Than AWS S3 by Galanwe on Sunday November 22, 2020 @11:25AM (#25178678)
Interesting, do you have more information on how you did monitors these S3 metadata nodes? Never heard of that.

Why would an unversioned put be less costly than a versioned put? To me it should be pretty much the same. I would almost suspect unversioned puts are hacked around versioned ones.

Out of curiosity what kind of workload did you perform? I have been moving terabytes of files (some very small 1kB files, some huge 150GB files) and never noticed a single blip of change in behavior from S3 (and certainly not anything going "off")

Re:HopsFS: 100x Times Faster Than AWS S3 by fxtentacle on Monday November 23, 2020 @07:39AM (#25186111)
> Interesting, do you have more information on how you did monitors these S3 metadata nodes? Never heard of that.

Pretty simple, we started a bulk import, and then HTTPS requests to amazonaws.com started timing out... Later, support told us to spread out our requests to alleviate the load spike.

What we did was process roughly 50mio 1MB JPEG images from the full-res S3 bucket into an derived-data S3 bucket.