News for hackers. Stuff that matters.

A comment on MLC-LLM: GPT/Llama on consumer-class GPUs and phones. Parent comment

Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by hawski on Sunday April 30, 2023 @04:26PM (#35766303)
So possibly some basic iGPU (maybe even Intel) with lots of VRAM assigned could be enough?
[ Parent | on HN ]

There are no comments on this comment yet.