News for hackers. Stuff that matters.

A comment on ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based, open) language model. Parent comment

Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based... by dahdum on Thursday January 19, 2023 @09:20PM (#34448422)
> 2-3 high end GPUs implies it's likely not very far off from mainstream

Looks like FLOP/s per $ are doubling every ~3 years for high end cards, and 10x in ~10 years. So probably not that far off for desktop users.

https://www.lesswrong.com/posts/c6KFvQcZggQKZzxr9/trends-in-...

[ Parent | on HN ]
Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based... by visarga on Friday January 20, 2023 @03:50AM (#34450534)
FLOPs remain unused when the bottleneck is bandwidth.
[ Parent | on HN ]