News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by anukin on Monday April 01, 2024 @05:26PM (#39899563)
Which uncensored model is willing to play hot or not? I just knew about llava. Are there other such models now?
Re:LLaMA Now Goes Faster on CPUs by Eisenstein on Monday April 01, 2024 @10:58PM (#39901949)
Llava just integrates Clip with a llama model. Koboldcpp can now do this with many models out of the box:

* https://github.com/LostRuins/koboldcpp/releases/tag/v1.61.2