>Isn't the whole point of democracy "a large enough volume of ignorance will average out to something sensible"? :P

I hope not. A much stronger argument is that government should be by consent of its citizens. Otherwise, you get democracy-is-bad-because-people-vote-wrongly arguments (e.g. women vote too left-wing or white people vote too right-wing).