I agree with you to a point. The problem is that if most people turn it off, then developing the telemetry system was a huge waste of time and resources for not much gain. Valuable data that could have been used to improve the program without any extra work from others may be lost.

Similar to Windows forcing users to update because most of them keep putting it off forever, hurting their own security.