News for hackers. Stuff that matters.
Re:Differential Transformer by ithkuil on Tuesday October 08, 2024 @09:42AM (#41777284)
This may work when the next token is a key concept but when it's a filler word or a part of one of many sequences of words that can convey the same meaning but in different ways (synonyms but not only at the word also at the sentence levels) then it's harder to know whether the probability is low because the word is absolutely unlikely or because it's likelihood is spread/shared among other truthful statements

There are no comments on this comment yet.