News for hackers. Stuff that matters.

A comment on Mistral 7B, the most powerful language model for its size to date, Apache 2.0. Parent comment

Re:Mistral 7B, the most powerful language model for its size... by uoaei on Wednesday September 27, 2023 @10:48PM (#37684583)
At every generation step you mask the tokens so that only syntactically valid outputs are possible. This includes the <end> token.
[ Parent | on HN ]

There are no comments on this comment yet.