Certainly there are legitimate reasons for sites to get larger. But too often it's because of poorly compressed media and poor library/framework choices.

For businesses, it does come down to time and resources. If the users don't complain about the browsing experience then it's good enough.