News for hackers. Stuff that matters.
Re:DeepSeek-R1: Incentivizing Reasoning Capability in LLMs v... by brandall10 on Saturday January 25, 2025 @04:13PM (#42824901)
4 bit only requires about 18gb, plus a little more for context. So 5 bit should be easy.

There are no comments on this comment yet.