Speak for yourself. In my opinion, the ability to count how many people click on which search results, and rank results higher if they get a lot of clicks (excluding cases where the user then pressed back and picked another result), seems like a good way to boost result quality without having much impact on privacy.

Full disclosure – I also allow Google to track my search history for personalization, but I think there are many good reasons to dislike that, I understand why people turn it off, and while I don't, I'd prefer a personalization method that doesn't require such granular data.