Re:BitNet b1.58 2B4T Technical Report
by logicchains on Thursday April 17, 2025 @06:11AM
(#43714864)
2B models by themselves aren't so useful, but it's very interesting as a proof of concept, because the same technique used to train a 200B model could produce one that's much more efficient (cheaper and more environmentally friendly) than existing 200B models, especially with specialised hardware support.
[ Parent
| on HN ]
There are no comments on this comment yet.