News for hackers. Stuff that matters.

A comment on ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based, open) language model. Parent comment

Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based... by tempay on Friday January 20, 2023 @01:02AM (#34449736)
Yes, the connection between system memory and the GPU isn’t fast enough to keep the compute units fed with data to process. Generally PCIe latency isn’t as much of a problem as bandwidth.
[ Parent | on HN ]

There are no comments on this comment yet.