News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by ilaksh on Monday April 01, 2024 @09:26AM (#39893952)
You should specify the model size and temperature.

For fact retrieval you need to use temperature 0.

If you don't get the right facts then try 34b, 70b, Mixtral, Falcon 180b, or another highly ranked one that has come out recently like DBRX.

There are no comments on this comment yet.