If someone cares about his karma points, it may discourage him for commenting again in the future.

Maybe the best solution is to eliminate the "leaders" page and each user's karma score from public view.