News for hackers. Stuff that matters.
Re:Show HN: I made an app to use local AI as daily driver by quickthrower2 on Wednesday February 28, 2024 @05:33AM (#39536261)
Thanks for the list. Tried Jan just now as it is both easy and open source. It is a bit buggy I think but the concept is ace. The quick install, tells you which models work on your machine, one click download and then a chatgpt style interface. Mistral 7B running on my low spec laptop at 6 token/s making some damn sense is amazing. The bugs are at the inference time. Could be hardware issues though, not sure. YMMV

There are no comments on this comment yet.