News for hackers. Stuff that matters.

A comment on Building a personal, private AI computer on a budget. Parent comment

Re:Building a personal, private AI computer on a budget by walterbell on Tuesday February 11, 2025 @09:11AM (#43012888)
Some LLM use cases are async, e.g. agents, "deep research" clones.
[ Parent | on HN ]
Re:Building a personal, private AI computer on a budget by diggan on Tuesday February 11, 2025 @09:16AM (#43012932)
Not to mention even simpler things, like wanting to tag all of your local notes based on the content, basically a bash loop you can run indefinitely and speed doesn't matter much, as long as it eventually finishes
[ Parent | on HN ]
Re:Building a personal, private AI computer on a budget by vunderba on Tuesday February 11, 2025 @06:57PM (#43019937)
Additionally if all you're doing is simple tagging and classification, you can probably get away with a significantly smaller model (sub 14b parameter model) like Mistral 7b or Qwen 14b.
[ Parent | on HN ]