News for hackers. Stuff that matters.

thandv

I generally used them for token saving purposes, just using them for repetitive tasks, gated and supervised by claude. So its planned and verified by better models, but implementation falls on local ones. It has been pretty effective for me, as long as I spend a bit more initially on splitting complex tasks further down
This might be a stupid question, but can a extra added local llm help with the caching problem?