News for hackers. Stuff that matters.

A comment on WebGPU enables local LLM in the browser. Demo site with AI chat. Parent comment

Re:WebGPU enables local LLM in the browser. Demo site with A... by lukan on Saturday August 02, 2025 @11:48AM (#44768586)
Well, I am on a mobile right now, can someone maybe share anything about the performance?
[ Parent | on HN ]
Re:WebGPU enables local LLM in the browser. Demo site with A... by pjmlp on Saturday August 02, 2025 @12:25PM (#44768895)
Not everyone enjoys unlimited data plans, and 500 MB is schon a lot.
[ Parent | on HN ]
Re:WebGPU enables local LLM in the browser. Demo site with A... by andreinwald on Saturday August 02, 2025 @12:54PM (#44769167)
On my Android device works pretty fast.

But keep in mind that it's small Llama-3.2-1B model, specially for less powerfull GPU.

[ Parent | on HN ]