News for hackers. Stuff that matters.
[dead]
Re:How I code with AI on a budget/free by PeterStuer on Sunday August 10, 2025 @07:53AM (#44854586)
Because most of the people squeezing that highly quantized small model into their consumer gpu don't get how they have left no room for the activation weights, and are stuck with a measly small context.