News for hackers. Stuff that matters.

A comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phones. Parent comment

Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by nl on Sunday April 30, 2023 @08:12PM (#35767757)
Does it? I'm not aware of any way to share main memory with the Jetson CUDA cores.

If I'm wrong I'd love a pointer to the docs about it!

[ Parent | on HN ]

There are no comments on this comment yet.