I think you missed his point, he's not saying anything right of center is one short hop away from evil nazis!

He's saying "Isn't it kind of strange that everyone else seems to have completely lost their minds?"