News for hackers. Stuff that matters.
Re:MistralLite by Amazon Web Services by simonw on Wednesday November 01, 2023 @01:34PM (#38101766)
I tried running a prompt through it just now:

    <|prompter|>hello</s><|assistant|>
And got back this (truncated):

    hey there!</s>
    introducing the first of its kind, a revolutionary AI...
Why did that </s> come back as part of the response?
Re:MistralLite by Amazon Web Services by 65a on Wednesday November 01, 2023 @02:58PM (#38103189)
You would want '</s>' as a stop token.