News for hackers. Stuff that matters.
Re:Intel publishes misleading benchmarks against AMD by exabrial on Wednesday November 06, 2019 @11:06AM (#21463871)
Pro tip: generic benchmarks, in general, are misleading.
Re:Intel publishes misleading benchmarks against AMD by stephencanon on Wednesday November 06, 2019 @11:18AM (#21463996)
All benchmarks are misleading.
Re:Intel publishes misleading benchmarks against AMD by sin7 on Wednesday November 06, 2019 @11:30AM (#21464138)
The map is not the territory.

All models are wrong, some are useful.

Blah, blah, blah.

Re:Intel publishes misleading benchmarks against AMD by bigmattystyles on Wednesday November 06, 2019 @11:53AM (#21464354)
Re:Intel publishes misleading benchmarks against AMD by VC999 on Wednesday November 06, 2019 @11:29AM (#21464126)
Could you expand on that please
Re:Intel publishes misleading benchmarks against AMD by me_me_me on Wednesday November 06, 2019 @11:42AM (#21464241)
The fastest animal on earth is the fastest not because it has huge muscles, but because it falls. Is it fair compare top speed of falcon to cheetah? Yeah but... x y z.

Every benchmark can be set up in a way that will give edge to one part or another. Especially if there is a vested interest.

Re:Intel publishes misleading benchmarks against AMD by deaddodo on Wednesday November 06, 2019 @01:05PM (#21465133)
And even in your example, the Cheetah can hit 65mph for a whopping 330 feet before risking total exhaustion. Meanwhile Pronghorns, Impala and Antelope can reach 55mph-60mph and maintain it for about half a mile, and vary their speed to increase distance.

So which would you consider faster? The one that can give you a few seconds of effort really quickly; or the one that gives you 90% of that effort but for hours?

Re:Intel publishes misleading benchmarks against AMD by jstewartmobile on Wednesday November 06, 2019 @11:40AM (#21464216)
The search space has many, many dimensions--CPU, MMU, OS implementation details, how well the compiler translated source to machine code for that particular CPU, how well did the benchmark implementation cater to the target architecture, etc, etc.

Immense opportunities to fool others, and even yourself.

Re:Intel publishes misleading benchmarks against AMD by stephencanon on Wednesday November 06, 2019 @01:53PM (#21465714)
All benchmarks are chosen to show precisely what the person presenting the benchmark wants them to, no more, no less. If the benchmark didn't tell a story that they want to show you, they wouldn't be showing it to you (or they'd be showing you a different benchmark).

This doesn't make them wrong, but benchmarks are never the full story.

Re:Intel publishes misleading benchmarks against AMD by Tepix on Wednesday November 06, 2019 @11:53AM (#21464346)
Not if you designed a benchmark for your special requirements.
Re:Intel publishes misleading benchmarks against AMD by emmelaich on Wednesday November 06, 2019 @12:42PM (#21464901)
It still is misleading, because your special requirements will not perfectly match your benchmark.
Re:Intel publishes misleading benchmarks against AMD by zerkten on Wednesday November 06, 2019 @01:17PM (#21465267)
That's true, but like many human endeavors we can reach a point that is good enough, or the process of implementing the benchmark leads to useful discoveries. It is not going to be perfect for all situations, but that doesn't mean it's not a valuable tool to use in some situations.
Re:Intel publishes misleading benchmarks against AMD by stephencanon on Wednesday November 06, 2019 @01:51PM (#21465685)
Or your requirements will change in ways that you didn't expect, invalidating your benchmark, or ...
Re:Intel publishes misleading benchmarks against AMD by gameswithgo on Wednesday November 06, 2019 @01:18PM (#21465282)
they might, if your benchmark IS your special requirements.
Re:Intel publishes misleading benchmarks against AMD by Fnoord on Wednesday November 06, 2019 @11:52AM (#21464343)
..but some are more [obviously] misleading than other.