News for hackers. Stuff that matters.
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by eru on Wednesday February 28, 2024 @09:11PM (#39545833)
If you are are using two bits anyway, you might as well represent (-2, -1, 0, 1) instead of ternary?
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by int_19h on Wednesday February 28, 2024 @10:31PM (#39546144)
Sure, but then you lose the symmetry that makes trits so convenient for many things.