News for hackers. Stuff that matters.
Re:Debunking Cloudflare’s recent performance tests by dcow on Monday December 06, 2021 @08:16PM (#29468048)
>> So, I would encourage everyone to run your own test and don't just go on other people's numbers.

> But I agree everyone should run their own benchmarks.

But they literally can't because the ToS forbids it.

Re:Debunking Cloudflare’s recent performance tests by onion2k on Tuesday December 07, 2021 @01:58AM (#29469738)
They don't forbid it. They request you get permission first. No one seems to have bothered asking to find out if CF say no.

Benchmarking accurately is hard, so CF trying to make sure they're not going to be subject to a "report" by someone whose tests are garbage, or by a competitor who's benchmarking poorly to make their own offering look better isn't totally unreasonable. Ideally, as far as CF are concerned, they'd be so far ahead of the competition it wouldn't matter, but presumably that wasn't the case when the ToS were written. The fact the CEO posted to say the clause is being removed means we can all freely test in future.

This is how things are supposed to work. Someone does something, someone else reacts, and the first person updates their position. Expecting everyone to get things perfectly correct on the first try is nonsense.

Re:Debunking Cloudflare’s recent performance tests by lambdadmitry on Tuesday December 07, 2021 @07:47AM (#29471843)
It would be nice for the first person to actually own it and not just say "I have no idea who put it into our TOS". Besides, it's either disingenuous or something is seriously broken in Cloudflare if their CEO is more attentive to HN comments than their own SMM people, as Fastly called that clause out on Twitter weeks ago.
Re:Debunking Cloudflare’s recent performance tests by ewalk153 on Monday December 06, 2021 @08:35PM (#29468182)
Anti benchmark clauses usually prohibit publication. This wouldn’t exclude running two systems with your workload and documenting the results for internal use.
Re:Debunking Cloudflare’s recent performance tests by hn_throwaway_99 on Monday December 06, 2021 @08:49PM (#29468276)
Except the CloudFlare ToS (posted as an image from the tweet thread above) says "perform or publish benchmark tests or analyses..."