News for hackers. Stuff that matters.
Re:Simplifying GPU Application Development with HMM by liuliu on Tuesday August 29, 2023 @12:02PM (#37309886)
mmap weights directly from a file seems to be new (I think). Need to check notes to remember whether you can already do that with some cuda* API.
Re:Simplifying GPU Application Development with HMM by aseipp on Tuesday August 29, 2023 @12:11PM (#37310029)
Yeah, I think a good simple litmus test for this is "can I directly call mmap(2) on a file, and then launch a kernel on that mmap'd memory, with no extra steps, and it works as I expect it to". With these newer features in CUDA, the answer to that is "yes you can."