Re:Forget ChatGPT: why researchers now run small AIs on thei...
by threecheese on Saturday September 21, 2024 @04:37PM
(#41612524)
I should have qualified the meaning of “works perfectly” :) No 70b for me, but I am able to experiment with many quantized models (and I am using a Llama successfully, latency isn’t terrible)
[ Parent
| on HN ]
There are no comments on this comment yet.