News for hackers. Stuff that matters.

A comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phones. Parent comment

Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by dhruvdh on Sunday April 30, 2023 @05:46PM (#35766895)
How do you imagine consoles work? And what about Apple's tight integration has actually made itself useful? The developer experience is terrible.
[ Parent | on HN ]
Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by valine on Sunday April 30, 2023 @06:07PM (#35767028)
It’s useful because you can buy a Macbook with 64GB of RAM, and then use that RAM as VRAM to run your LLM.
[ Parent | on HN ]