News for hackers. Stuff that matters.
Re:Tinygrad: Hacked 4090 driver to enable P2P by redox99 on Friday April 12, 2024 @05:01PM (#40017595)
If you mean train llama from scratch, you aren't going to train it on any single box.

But even with a single 3090 you can do quite a lot with LLMs (through QLoRA and similar).

There are no comments on this comment yet.