I suppose even if there were different groups (say, one free trade group, another protectionist group), the people individually could have coherent opinions. It would then go wrong when the elected representatives try to pander to both groups simultaneously.