News for hackers. Stuff that matters.
Re:Hetzner Object Storage by phil21 on Monday October 07, 2024 @09:07AM (#41765619)
Having implemented object storage at a service provider - it's extremely rare for any customer to have 1gbit/sec sustained throughput on an account, much less a bucket.

Those that do likely will already have an actual sales rep and the means to get these restrictions lifted, with a direct line to engineering.

Hetzner certainly markets to a different crowd, which I suspect is why these limits are being put in place ahead of time. It's very difficult to design around noisy neighbor, and will take some battle tested time in production to get right for the "average Joe" style customer who won't engage engineering resources to work with a provider to avoid hot spots and impacting other customers.

Re:Hetzner Object Storage by fabian2k on Monday October 07, 2024 @09:12AM (#41765655)
I'm more concerned about bursts, not sustained throughput. When handling large files a single client can load at 1 Gbit/s if the other side supports that.

My suspicion was also that they're intentionally targeting a different crowd than S3 and focusing on their niche here.

Re:Hetzner Object Storage by phil21 on Monday October 07, 2024 @10:13AM (#41766208)
Definitely agreed. I would be pretty surprised if this was burst capacity though. I have no insight as to how Hetzner implemented their object storage, but in general terms it's pretty difficult to ratelimit burst without adverse effects. Sustained is a lot easier to implement since you are typically having to have multiple load balancers coordinate to achieve such results. Attempting to do this at sub-minute time intervals is pretty tricky at scale.