News for hackers. Stuff that matters.

A comment on Show HN: Reor – An AI note-taking app that runs models locally.

Re:Show HN: Reor – An AI note-taking app that runs models lo... by outside1234 on Wednesday February 14, 2024 @07:29PM (#39377557)
Which local model works best for folks? Sort of intimidated by the large number of models on Hugging Face and it is hard to conceptualize which of the variants work the best.

I downloaded:

mistral-7b-v0.1.Q4_K_M.gguf Q4_K_M 4bits 4.37 GB 6.87 GB medium, balanced quality - recommended

Was that a good choice?

[ Parent | on HN ]
Re:Show HN: Reor – An AI note-taking app that runs models lo... by stuartriffle on Thursday February 15, 2024 @05:49PM (#39390351)
Yes (imho) just be sure to get the instruct or chat model of any LLM you try. There is an awesome snapshot of what models people are using here:

https://openrouter.ai/rankings

[ Parent | on HN ]