News for hackers. Stuff that matters.

A comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phones. Parent comment

Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by amelius on Sunday April 30, 2023 @03:44PM (#35765957)
NVidia Jetson is a line of products with tight integration between CPU and GPU. As just one example.
[ Parent | on HN ]
Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by nl on Sunday April 30, 2023 @08:12PM (#35767757)
Does it? I'm not aware of any way to share main memory with the Jetson CUDA cores.

If I'm wrong I'd love a pointer to the docs about it!

[ Parent | on HN ]