Re:Ask HN: Has anyone replaced Claude/GPT with a local model...
by kristopolous on Tuesday June 16, 2026 @02:30AM
(#48551350)
that's super contextually dependent. I use them just as essentially a decompress of what I already know that I'm doing. I legitimately use 4B models just fine. I've got a large number of tools that make this entirely feasible and a daily driver for me (like https://github.com/day50-dev/llm-manpage-tool) ...
It's not really a bitter lesson here, I can scale those 4B models easier than someone can scale their 1000B models.
It's not really a bitter lesson here, I can scale those 4B models easier than someone can scale their 1000B models.