News for hackers. Stuff that matters.
Re:Running large language models like ChatGPT on a single GPU by zargon on Monday February 20, 2023 @04:02PM (#34872868)
256gb of ddr4 rdimms only costs about $400 right now. $200 for ddr3. Not uncommon in homelabs.

I don't think 200gb ram is actually required, that's just what that cloud vm was spec'd with. Though the 175b model should see benefit with ram even beyond 200gb.

There are no comments on this comment yet.