News for hackers. Stuff that matters.
Re:Handbook.md shows that long policy documents do not relia... by DiabloD3 on Wednesday July 29, 2026 @01:08PM (#49100175)
Every single analysis I've seen done by anyone has basically come to the same conclusion: assuming sane BF16 or Q8 model quant, and BF16 or Q8 KV context quant (ie, not intentionally screwing over the model), you get about 250k before it pukes.

There are no comments on this comment yet.