An idea i've heard and liked is to allow direct democracy like you've described, but also allow anyone to select any representative that they want (they're brother, someone with a good history, etc). Allow them to override their representitive wherever they want, and change their representitive whenever they want. This gets you direct democracy without as much tedium.