No, voting is not dumb. Direct voting (referendum), representation and sortition (random selection) are 3 basic democratic mechanisms (they distribute power equally among people).

But each mechanism has different tradeoffs. How much you get involved, how much expertise you need, and how well your interests are represented. A good political system uses all 3 to public's advantage, to reinforce each other.