News for hackers. Stuff that matters.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by cahoot_bird on Saturday April 15, 2023 @06:01PM (#35585024)
Looks like this was hacked together pretty quickly. This in CPU is exactly what needs optimized to run on more devices, if that's even possible..

I guess it will take hardware and software a while to catch up to compete with ChatGPT..

Re:Web LLM – WebGPU Powered Inference of Large Language Models by verdverm on Saturday April 15, 2023 @06:59PM (#35585507)
If you look at the news, yes it came together quickly, but it has also gotten a lot of performance upgrades which have made significant improvements.