Re:Running large language models like ChatGPT on a single GPU
by zargon on Monday February 20, 2023 @04:02PM
(#34872868)
256gb of ddr4 rdimms only costs about $400 right now. $200 for ddr3. Not uncommon in homelabs.
I don't think 200gb ram is actually required, that's just what that cloud vm was spec'd with. Though the 175b model should see benefit with ram even beyond 200gb.
I don't think 200gb ram is actually required, that's just what that cloud vm was spec'd with. Though the 175b model should see benefit with ram even beyond 200gb.