Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by eru on Wednesday February 28, 2024 @08:41PM
(#39545698)
You can probably apply the same techniques 'Deep neural networks are robust to weight binarization and other non-linear distortions' used to get to 0.68 bits / weight to get your ternary weights below one bit; so you can claim they are still one-bit networks.
[ Parent
| on HN ]
There are no comments on this comment yet.