News for hackers. Stuff that matters.

A comment on The genie escapes: Stanford copies the ChatGPT AI for less than $600. Parent comment

Re:The genie escapes: Stanford copies the ChatGPT AI for les... by leodriesch on Monday March 20, 2023 @07:04PM (#35240102)
Not an expert on the matter so take this with a grain of salt, but I’d say the compression is also about VRAM/RAM, which seems to be the more limiting factor over inference speed.
[ Parent | on HN ]

There are no comments on this comment yet.