Re:I want everything local – Building my offline AI workspace
by OneDeuxTriSeiGo on Friday August 08, 2025 @11:17PM
(#44843772)
You can already do A LOT with an SLM running on commodity consumer hardware. Also it's important to consider that the bigger an embedding is, the more bandwidth you need to use it at any reasonable speed. And while storage may be "cheap", memory bandwidth absolutely is not.
[ Parent
| on HN ]
There are no comments on this comment yet.