News for hackers. Stuff that matters.
Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by trifurcate on Sunday April 30, 2023 @01:45PM (#35764838)
The slowdown here is going to be more about the increased context length than throttling.
Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones by david-gpu on Sunday April 30, 2023 @02:12PM (#35765104)
Good point! Didn't think of that.