News for hackers. Stuff that matters.

A comment on The Era of 1-bit LLMs: ternary parameters for cost-effective computing.

Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by oxxoxoxooo on Wednesday February 28, 2024 @02:23PM (#39542445)
Prior art:

Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1

https://arxiv.org/abs/1602.02830

Ternary Neural Networks for Resource-Efficient AI Applications

https://arxiv.org/abs/1609.00222

[ Parent | on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect... by kandu on Wednesday February 28, 2024 @04:22PM (#39543596)
Also: training neural networks by turning connections on and off, or by just flipping the sign of the weights: https://arxiv.org/abs/2006.16627
[ Parent | on HN ]