That's ridiculous. Just look at Switzerland. Dozens of referendums a year, pretty much the opposite of anarcho-libertarianism. The richest and most successful countries also the ones that tend to use referendums a lot, have lots of checks and balances and don't simply "choose rulers" to the extent practically possible.