My argument against is this: professional politicians and bureaucrats often have a hard time governing a nation, what makes anyone believe the aggregate decisions of the crowd would do any better. Admittedly it'd often be hard to do any worse, but make no mistake we are as, and probably more so, fallible and as easily influenced as any politian.
At least with representative democracy we, the crowd, have someone to blame / prosecute / shame / hang. And we probably secretively want that.
I guess I just don't believe that salvation from our own follies can be found in one political system or another. Politics is a shitty abstraction built on top of shitty people like me, what with my unconscious biases, prejudices, and personal preferences. I don't know what's best for other people, he'll I don't even know what's best for me. I mean, I have trouble deciding what to have for dinner let alone what is good economic or environmental policy for the next x period of time.
Also, the direct democracy in, e.g. Athens actually encompassed a very limited number of people (adult males owners of land) so it's not 100% comparable with a modern version.
I do agree we should try more things though.
In fact, the Greek example that is often pointed to as an example of how not to do it. Even by the Greeks, who watched the dynamics up close. See, for example, Plato's fondness for tyranny of him and his buddies over democracy.
Plato's a great example of how much better antidemocratic views seem to have survived subsequent transmission. Whenever we read historical judgments instead of facts we need to keep in mind we're seeing what managed to keep getting copied over almost two millennia until the printing press, almost all of the time under ideologies where the prince's word was law.
Is that true? It certainly has its critics, but in classical Greece it more than held its own in a highly competitive ecosystem for ~180 years. I'm sure at least that we need more experiments with different institutions.