One way to label is by expectation. If the outcome is what you expected, then it gets one label. If it didn't it gets another label. Deepmind has had some success with this approach.