Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based...
by uni_rule on Friday January 20, 2023 @03:49AM
(#34450528)
You'd basically need a rack mount server full of Nvidia H100 cards (80 Vram, they cost $40 thousand us dollars each). So... good luck with that?
On the relatively cheap end Nvidia tesla cards are kinda cheap used, 24 gig ones going for ~$200 with architectures from a few years ago. That's still nearly $3000 worth of cards not counting the rest of the whole computer. This isn't really something you can run out home without having a whole "operation" going on.
[ Parent
| on HN ]
Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based...
by logicallee on Friday January 20, 2023 @04:57AM
(#34450909)
got it, thanks.