News for hackers. Stuff that matters.
Re:Tinygrad: Hacked 4090 driver to enable P2P by swalsh on Sunday April 14, 2024 @03:38PM (#40033755)
Gamers have a TON of really good really affordable options. But you kind of need 24gb min unless you're using heavy quantization. So 3090 and 4090's are what local llm people are building with (mostly 3090's as you can get then for about $700, and they're dang good)

There are no comments on this comment yet.