Re:Show HN: I made an app to use local AI as daily driver
by quickthrower2 on Wednesday February 28, 2024 @05:33AM
(#39536261)
Thanks for the list. Tried Jan just now as it is both easy and open source. It is a bit buggy I think but the concept is ace. The quick install, tells you which models work on your machine, one click download and then a chatgpt style interface. Mistral 7B running on my low spec laptop at 6 token/s making some damn sense is amazing. The bugs are at the inference time. Could be hardware issues though, not sure. YMMV
[ Parent
| on HN ]
There are no comments on this comment yet.