News for hackers. Stuff that matters.
Re:WebGPU enables local LLM in the browser. Demo site with A... by asim on Saturday August 02, 2025 @11:44AM (#44768551)
What's the performance of a model like vs an OpenAI API? What's the comparable here? Edit: I see it's same models locally that you'd run using Ollama or something else. So basically just constrained by the size of the model, GPU and perf of the machine.
Re:WebGPU enables local LLM in the browser. Demo site with A... by andreinwald on Saturday August 02, 2025 @12:51PM (#44769135)
Yes, its very similar to Ollama app, and Llama-3.2-1B model used