Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Show HN: AI companions stack – create and host your own AI companions. Parent comment
13b will work on 16GB RAM, and 33b on 32GB RAM, with pretty much any dGPU for a little acceleration and RAM offloading.
Doubly so if you host it as an AI Horde node (so you have priority access to many models through the web browser).
There are no comments on this comment yet.
13b will work on 16GB RAM, and 33b on 32GB RAM, with pretty much any dGPU for a little acceleration and RAM offloading.
Doubly so if you host it as an AI Horde node (so you have priority access to many models through the web browser).