OP was proposing replacing the current system with direct democracy whereas the swiss simply hold referenda on specific issues while they still have representatives to govern them.
Meanwhile, on the issues that they do vote on through referenda, it can result in popular support for discriminatory laws like the ban on ....Muslim temples with pointy roofs:
https://en.m.wikipedia.org/wiki/2009_Swiss_minaret_referendu...
> The Swiss government recommended that the proposed amendment be rejected as inconsistent with the basic principles of the constitution.[3] However, after the results were tabulated, the government immediately announced that the ban was in effect.[4]
The problem is that people tend to believe that the outcome of an election or a referendum should be allowed to overrule basic human rights and national constitutions.
The jump from there to direct democracy was already an straw-man. The jump from that to "no representatives on the middle" is completely baseless.
I fail to see how that is substantially different from direct democracy.
What good would representative democracy be if each representative was just an empty vessel carrying out the collective wishes of a mass of Internet commenters?