Re:MistralLite by Amazon Web Services
by brucethemoose2 on Wednesday November 01, 2023 @02:09PM
(#38102348)
> But the documentation on these models is so thin!
Welcome to LLM research land, lol. Mpstly there is no documentation, no reproducability, just random hit-and-run releases with some claimed metrics and if you're lucky a model card with the trained prompt.
> Do I need that </s> at the end of the assistant things or not?
...I dunno. I didn't add it in my prompt template, and you can see that the model itself it outputting that token in the responses. Maybe ask the trainers on the HF page.
And is my guess about </s> at the end of the assistant thing correct? If so then a conversation might look like this:
But the documentation on these models is so thin! Do I need that </s> at the end of the assistant things or not?