News for hackers. Stuff that matters.
Re:Mistral 7B, the most powerful language model for its size... by amilios on Friday September 29, 2023 @04:49PM (#37709929)
Oh yeah that's true! Just block the stop token. But yes, my thought is that there are scenarios where it can get "stuck" as you said. I'll look at the PR, thanks!

There are no comments on this comment yet.