News for hackers. Stuff that matters.
Re:HuggingChat, the first open source alternative to ChatGPT by MichaelRazum on Tuesday April 25, 2023 @03:52PM (#35705759)
How do this kind of models know when to stop? Does anyone has an idea.
Re:HuggingChat, the first open source alternative to ChatGPT by kevincox on Tuesday April 25, 2023 @04:51PM (#35706628)
IIRC as well as characters they can output a "stop token" which tells the generation loop to exit.