Re:You can now train a 70B language model at home
by mmoskal on Saturday March 09, 2024 @12:36AM
(#39649648)
The bitnet paper was showing worse results than fp16 transformer with the same parameter count. The shocking result in the 1.58b paper (same group) is no quality loss compared to fp16.
[ Parent
| on HN ]
There are no comments on this comment yet.