News for hackers. Stuff that matters.
Re:Run LLMs at home, BitTorrent‑style by zacmps on Sunday September 17, 2023 @06:33PM (#37549967)
I think you'd need 2 80GB A100's for unquantised.

There are no comments on this comment yet.