News for hackers. Stuff that matters.
Re:Ask HN: Is anyone doing anything cool with tiny language ... by dotancohen on Tuesday January 21, 2025 @05:50PM (#42786158)
Sounds to me like you might want to reduce the Top P - that will prevent the really unlikely next tokens from ever being selected, while still providing nice randomness in the remaining next tokens so you continue to get diverse stories.

There are no comments on this comment yet.