News for hackers. Stuff that matters.

A comment on Goodbye Claude, Hello Pi. Parent comment

Re:Goodbye Claude, Hello Pi by ohmahjong on Sunday November 08, 2026 @12:33AM (#50410686)
Man, my M1 Pro unfortunately only has 16GB of RAM; it has been such a limiter to using local models. I'll give kapitsa a try, I see I should be able to squeeze some smaller models on
[ Parent | on HN ]
Re:Goodbye Claude, Hello Pi by yieldcrv on Sunday November 08, 2026 @01:26AM (#50410907)
kapitsa is customized to just a small selection of models that are in vogue right now

compared to llama.cpp that tries to cater to all but does so only averagely

check the catalogue and see if one of the quantizations fit

[ Parent | on HN ]