I personally browse with JS on (with a lot of filters), but I know a lot of people who have it off and whitelist sites that are broken without it. Sometimes on a per-script basis.

Main reasons are for extra privacy (scripts aren't there making arbitrary requests), better responsiveness, and better battery life etc. Of course there is a cost.