News for hackers. Stuff that matters.
Re:A Guide to In-Browser LLMs by fancyfredbot on Thursday March 13, 2025 @02:22PM (#43355961)
No thanks. Even if you are running the LLM locally it's a terrible experience for me since inference will be slow and I'll need a lot of bandwidth to fetch weights. I'll probably not trust that my data remains on my device, and I definitely don't trust anything the LLM does.

It's cool JavaScript can use the NPU though.