Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones
by trifurcate on Sunday April 30, 2023 @01:45PM
(#35764838)
The slowdown here is going to be more about the increased context length than throttling.
[ Parent
| on HN ]