News for hackers. Stuff that matters.

A comment on The Era of 1-bit LLMs: ternary parameters for cost-effective computing. Parent comment

Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by int_19h on Wednesday February 28, 2024 @03:02PM (#39542784)
People haven't built reliable ternary electronics, though. Soviets tried with Setun, but they eventually had to resort to emulating each trit with two hardware bits (and wasting one state out of the possible four).
[ Parent | on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by eru on Wednesday February 28, 2024 @09:11PM (#39545833)
If you are are using two bits anyway, you might as well represent (-2, -1, 0, 1) instead of ternary?
[ Parent | on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by int_19h on Wednesday February 28, 2024 @10:31PM (#39546144)
Sure, but then you lose the symmetry that makes trits so convenient for many things.
[ Parent | on HN ]