No, the Shermer example is right on. Shermer knows he dishonestly argued against cryonics; he knows that his little frozen-strawberry example is factually incorrect (see his admission in http://web.archive.org/web/20100306205336/http://leitl.org/d...) but still published it.
However, I also find the whole idea of a "skeptic test" a bit disquieting. Paraphrasing what you quoted above: "Don't give someone credit for being a smart, rational skeptic until they have defended some non-mainstream belief, until they have stuck their neck out to say something a little less usual." That's a bit aggressive for my taste.