News for hackers. Stuff that matters.
Re:Using mmap to make LLaMA load faster by dekhn on Wednesday April 05, 2023 @06:39PM (#35461434)
Many of us would like to get rid of the host CPU and have ML trainers that are just GPUs and drives and NICs all attached to a northbridge. The GPU has everything required to make disk requests over the bus, and ideally the drive can receive network messages that get plumbed straight to the drive (I'm only partially joking).

There are no comments on this comment yet.