>> It implies that hitting the gym or studying or putting on make-up will make harm you in equal measures as it helps you.

No, it doesn't, not for anyone who played D&D which is where it is derived from.

Also, your statement is at least partially true, given that you have finite time and resources to pursue skill development in any given area.