The problem with "by top score" is it would itself influence the scoring, even if only some people used it. The oldest comments would stay at the top of such a list, because they get seen more and thus have more opportunities for upvotes, creating a self-sustaining cycle. You always need a time counterweight.