They don't rule themselves either. They're ruled by the decisions of the majority.

Direct democracy has its place, but that place isn't the UK, which is a parliamentary democracy. It's an arrogation of parliament's responsibility to make decisions based on referenda.