Re:A Guide to In-Browser LLMs
by fancyfredbot on Thursday March 13, 2025 @02:22PM
(#43355961)
No thanks. Even if you are running the LLM locally it's a terrible experience for me since inference will be slow and I'll need a lot of bandwidth to fetch weights. I'll probably not trust that my data remains on my device, and I definitely don't trust anything the LLM does.
It's cool JavaScript can use the NPU though.