Re:Ask HN: Is anyone doing anything cool with tiny language ...
by dotancohen on Tuesday January 21, 2025 @05:50PM
(#42786158)
Sounds to me like you might want to reduce the Top P - that will prevent the really unlikely next tokens from ever being selected, while still providing nice randomness in the remaining next tokens so you continue to get diverse stories.
[ Parent
| on HN ]
There are no comments on this comment yet.