News for hackers. Stuff that matters.
Re:Tinygrad: Hacked 4090 driver to enable P2P by Tepix on Saturday April 13, 2024 @08:13PM (#40027480)
I know there's some overhead, it's not my calculation.

https://www.tweaktown.com/news/97110/tinycorps-new-tinybox-a...

Quote: "Runs 70B FP16 LLaMA-2 out of the box using tinygrad"

Related: https://github.com/tinygrad/tinygrad/issues/3791

There are no comments on this comment yet.