News for hackers. Stuff that matters.
Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based... by uni_rule on Friday January 20, 2023 @03:49AM (#34450528)
You'd basically need a rack mount server full of Nvidia H100 cards (80 Vram, they cost $40 thousand us dollars each). So... good luck with that? On the relatively cheap end Nvidia tesla cards are kinda cheap used, 24 gig ones going for ~$200 with architectures from a few years ago. That's still nearly $3000 worth of cards not counting the rest of the whole computer. This isn't really something you can run out home without having a whole "operation" going on.
Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based... by logicallee on Friday January 20, 2023 @04:57AM (#34450909)
got it, thanks.