Re:Web LLM – WebGPU Powered Inference of Large Language Models
by verdverm on Saturday April 15, 2023 @04:09PM
(#35584091)
Check out LLAMA-CPP
[ Parent
| on HN ]
Re:Web LLM – WebGPU Powered Inference of Large Language Models
by cahoot_bird on Saturday April 15, 2023 @06:01PM
(#35585024)
Looks like this was hacked together pretty quickly. This in CPU is exactly what needs optimized to run on more devices, if that's even possible..
I guess it will take hardware and software a while to catch up to compete with ChatGPT..