That does not mean that miners dictate which fork to use. The opposite situation, that miners wanted bigger blocks but exchanges and users refused, would be similarly impossible. It's a bit like mutually assured destruction, nobody wants to see a big drop in value.