Re:MicroLLM Lab – Try 7 tiny LLM's in the browser
by logicallee on Monday September 28, 2026 @04:55PM
(#49884195)
I read your proposal, I think it's great! Where will the navigator get the model if the user agrees to download it? For this demonstration I just serve the models on my own server, but for larger models it may be an issue as they may not have direct download links even if they are open weights.
[ Parent
| on HN ]
Re:MicroLLM Lab – Try 7 tiny LLM's in the browser
by kenzic on Monday September 28, 2026 @05:00PM
(#49884272)
Great question. Right now there isn’t a definitive answer, but it’s something that needs to be worked out. There would likely be a registry. The question is how to keep model IDs consistent: does each browser manage its own registry, or is there one shared across browsers?
Re:MicroLLM Lab – Try 7 tiny LLM's in the browser
by logicallee on Monday September 28, 2026 @05:41PM
(#49884800)
Since you're asking for some kinds of permissions anyway, you could ask if the user is willing to also seed the model, p2p. (However, seeding files is not as popular as it used to be, many residential Internet connections don't have good upload.) If you have the capacity for it, your site webmodels.dev could act as a tracker and initial seed for any models. Then it could be the one central registry. It might get to be too much for you though, a lot of the open weights models are huge.