Re:LLaMA Now Goes Faster on CPUs
by anukin on Monday April 01, 2024 @05:26PM
(#39899563)
Which uncensored model is willing to play hot or not? I just knew about llava. Are there other such models now?
[ Parent
| on HN ]
Re:LLaMA Now Goes Faster on CPUs
by Eisenstein on Monday April 01, 2024 @10:58PM
(#39901949)
Llava just integrates Clip with a llama model. Koboldcpp can now do this with many models out of the box:
* https://github.com/LostRuins/koboldcpp/releases/tag/v1.61.2