News for hackers. Stuff that matters.
Re:A Bunch of Money on AWS and Some Benchmark Results by peterwwillis on Tuesday May 14, 2019 @06:39PM (#19914503)
> Other folks don't do that, and while not 1:1, they are able to correlate the performance of a benchmark with the performance of their own use case.

You can correlate lots of things. Poor countries increase penis size. Ice cream leads to murder. Cheese kills people by tangling them in their bedsheets. These things are strongly correlated. But they have no causative relationship.

To put it another way, a single benchmark test used find a solution is scientifically equivalent to finding one "average" man, making him run a series of athletic tests, and making his performance the benchmark for men's athletics.

Re:A Bunch of Money on AWS and Some Benchmark Results by diminoten on Tuesday May 14, 2019 @06:51PM (#19914597)
Sure, if you do it wrong. But if you do it right, you can get a lot of informative, valuable data out of a benchmark result that can accurately help decide between two (or more) technologies.

Like I've been saying, benchmark results are plenty useful if you know how to use them.