News for hackers. Stuff that matters.
Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based... by visarga on Friday January 20, 2023 @04:03AM (#34450605)
> I assume once a model is loaded, many queries can be serviced by that model quickly.

Depends. If you have room to load the whole model, yes. If you need to swap in and out parts of the model, then it matters if you have enough RAM.

There are no comments on this comment yet.