Re:WebGPU enables local LLM in the browser. Demo site with A...
by asim on Saturday August 02, 2025 @11:44AM
(#44768551)
What's the performance of a model like vs an OpenAI API? What's the comparable here? Edit: I see it's same models locally that you'd run using Ollama or something else. So basically just constrained by the size of the model, GPU and perf of the machine.
[ Parent
| on HN ]
Re:WebGPU enables local LLM in the browser. Demo site with A...
by andreinwald on Saturday August 02, 2025 @12:51PM
(#44769135)
Yes, its very similar to Ollama app, and Llama-3.2-1B model used