News for hackers. Stuff that matters.
Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based... by zone411 on Thursday January 19, 2023 @06:25PM (#34447089)
The large model weights are 14B, so at 16 bits per weight, it won't quite fit on one 3090 or 4090.
Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based... by coolspot on Thursday January 19, 2023 @07:41PM (#34447713)
AFAIK You will also need 14B x 16bit for activations.