Missing from your equation is the important fact that people usually pay for the bandwidth they use, and that that's how bandwidth is split amongst people. Once they paid for it, I'm sure you'll agree it's really their business how they use it.

Net neutrality prevents the ISPs from selling bundles where some sites are discounted, and from throttling or blocking some sites.