Re:Gemma, Ollama and LangChainGo
by mchinen on Sunday February 25, 2024 @02:32PM
(#39503964)
Interesting, I have had a different experience with Gemma 7B in being able to be generally useful for basic questions after a couple prompts.
It frequently gets stuck and starts outputting grammatically incorrect sentences and answers unrelated to the prompt.
I also found it answering everything with "Sure, " and wasn't able to stop even if prompted. Another thing was that every response was a list of items.
Feels like a temperature issue, but not sure. With mistral or llama I get a better session in every case so far (Only about 5 conversations with Gemma).
It frequently gets stuck and starts outputting grammatically incorrect sentences and answers unrelated to the prompt.
I also found it answering everything with "Sure, " and wasn't able to stop even if prompted. Another thing was that every response was a list of items.
Feels like a temperature issue, but not sure. With mistral or llama I get a better session in every case so far (Only about 5 conversations with Gemma).