The problem is the direct voter communication bandwidth is at best a few bits per election. People need to condense thousands of very important choices into one overall choice per election. Which often boils down to are you doing a terrible job or not.

Granted elected officials often listen to side channels, but they care about what will influence the election not what most people actually want aka 'the will of the people'.