This may have been considered already, but maybe things could be arranged so that downvoting submissions is allowed, but does not reduce the submitter's karma.