[Seriously, Phoronix benchmarks are often very badly designed/executed. I'm not sure whether it's because they really are completely clueless about benchmarking, or because they just don't care.]
Those tendency combined with the sometimes enormous amount of graphs makes a lot of page views for them.
The criticism of the benchmarks, though, is out of line. All benchmarks suck. Why? Because benchmaking is hard. It takes a ton of patience, a ton of diligence, and a ton of hardware. It's easy to sit back typing on the one laptop you use, running one OS, and whine about someone's inability to be an expert across dozens of environment.
Yet we all want benchmarks, as evidenced by this post. If you guys really think Phoronix benchmarks can be improved (and obviously they can), I'd appreciate it if you'd get off your MBP's and post some.
It would be far better if they'd simply do nothing at all, because as it is, their benchmarks produce misinformation.
Other than that, on x86, they seem to compare a PAE-enabled linux kernel to a FreeBSD kernel without PAE. And different versions of Xorg, for some reason. And, yeah, Unity vs KDE.
While most of it shouldn't matter (my money is on "Unity vs KDE makes all other differences negligible"), it's like they didn't even try to give the illusion they were doing things seriously.
Also, why did they use different motherboards? For that matter, what the hell is the purpose of providing the page two table of system details if you're going to crop half of it away???