In my opinion, it is entirely misguided to blame local maxima problem on A/B testing. The methodology doesn't dictate what is that you want to test. It is all about having a hypothesis and then collecting data to prove/disprove it. The post looks like it is blames poor results on instruments while wrong experimental design is the true culprit.
See http://visualwebsiteoptimizer.com/split-testing-blog/using-a... as an example of subtle change.
In my opinion, it is entirely misguided to blame local maxima problem on A/B testing. The methodology doesn't dictate what is that you want to test. It is all about having a hypothesis and then collecting data to prove/disprove it. The post looks like it is blames poor results on instruments while wrong experimental design is the true culprit.