Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by the8472 on Wednesday February 28, 2024 @09:56AM
(#39538729)
Bits are copyable without data loss. Analog properties of individual transistors are less so.
[ Parent
| on HN ]
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by eru on Wednesday February 28, 2024 @09:14PM
(#39545846)
Yes, but the whole point of the link submitted to HN here is that in some applications, like machine learning, precision doesn't matter too much.
(However, analog computing is still a bad fit for machine learning, because it requires a lot more power.)
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by the8472 on Thursday February 29, 2024 @08:45AM
(#39549197)
Exact copies aren't just about precision but also about reproducibility.
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by eru on Friday March 01, 2024 @06:28AM
(#39560783)
You can keep your weights in a discrete format for storage, but do inference and training in analog.
Re:The Era of 1-bit LLMs: ternary parameters for cost-effect...
by the8472 on Saturday March 02, 2024 @06:08AM
(#39571730)
That only prevents analog copy degradation. It doesn't give you reproducibility.
Reproducibility means running the same process twice with the same inputs and getting the same outputs.
E.g. to later prove that something came from an LLM and not a human you could store the random seed and the input and then reproduce the output. But that only works if the network is digital.