Re:Simplifying GPU Application Development with HMM
by liuliu on Tuesday August 29, 2023 @12:02PM
(#37309886)
mmap weights directly from a file seems to be new (I think). Need to check notes to remember whether you can already do that with some cuda* API.
[ Parent
| on HN ]
Re:Simplifying GPU Application Development with HMM
by aseipp on Tuesday August 29, 2023 @12:11PM
(#37310029)
Yeah, I think a good simple litmus test for this is "can I directly call mmap(2) on a file, and then launch a kernel on that mmap'd memory, with no extra steps, and it works as I expect it to". With these newer features in CUDA, the answer to that is "yes you can."