Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on You can now train a 70B language model at home. Parent comment
You are probably referring to XNOR net, and the novel piece there was also using binary activations (which bitnet is not).
So as far as I can tell, bitnet is basically BinaryConnect applied to LLMs.
https://arxiv.org/abs/1511.00363
You are probably referring to XNOR net, and the novel piece there was also using binary activations (which bitnet is not).
So as far as I can tell, bitnet is basically BinaryConnect applied to LLMs.
https://arxiv.org/abs/1511.00363