Re:MLC-LLM: GPT/Llama on consumer-class GPUs and phones
by david-gpu on Sunday April 30, 2023 @02:12PM
(#35765093)
"The cloud" simply means remote servers. Those servers may or may not contain application-specific hardware acceleration.
Nowadays many cell phone application processors also have dedicated hardware to accelerate neural nets, but they will always be limited by thermal constraints.
Nowadays many cell phone application processors also have dedicated hardware to accelerate neural nets, but they will always be limited by thermal constraints.