News for hackers. Stuff that matters.
Re:Building a personal, private AI computer on a budget by diggan on Tuesday February 11, 2025 @09:16AM (#43012932)
Not to mention even simpler things, like wanting to tag all of your local notes based on the content, basically a bash loop you can run indefinitely and speed doesn't matter much, as long as it eventually finishes
Re:Building a personal, private AI computer on a budget by vunderba on Tuesday February 11, 2025 @06:57PM (#43019937)
Additionally if all you're doing is simple tagging and classification, you can probably get away with a significantly smaller model (sub 14b parameter model) like Mistral 7b or Qwen 14b.