The score is probably a measure of mutual information (or some other kind of log prob). That's what usually produces scores distributed like this.