News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by ineedasername on Tuesday July 18, 2023 @03:23PM (#36777900)
>Hosted chat API here

Very strange: When I turn the temperature to 1.25 to 1.5 I get much more interesting responses, but they are very ungrammatical with missing punctuation, misspelled words, dropped linking/transition words, etc.

When I try out finer gradations converging on 1 from > 1 and < 1 temperatures, responses < 1 tend to be more orderly and structured including bullet points, while > 1 are much more free form, and increasingly outright chaotic and incomprehensible at > 1.5.

Re:Llama 2 – Meta AI by londons_explore on Tuesday July 18, 2023 @07:03PM (#36780202)
Isn't that pretty much expected?
Re:Llama 2 – Meta AI by ineedasername on Tuesday July 18, 2023 @08:23PM (#36780756)
In other models I definitely get wider responses with higher temperature, hallucinations too, but not a breakdown in structure with endless sentences, few line breaks, poor spellings and grammar, etc. Though I've not tested for such things systematically-- this is the first time I've notices this sort of behavior in a model.