Re:Differential Transformer
by singularity2001 on Tuesday October 08, 2024 @10:52AM
(#41777992)
in another paper which popped up recently they approximated uncertainty with Entropy and inserted "wait!" tokens whenever Entropy was high, simulating chain of thought within the system.
[ Parent
| on HN ]
There are no comments on this comment yet.