News for hackers. Stuff that matters.
Re:MicroLLM Lab – Try 7 tiny LLM's in the browser by logicallee on Tuesday September 29, 2026 @03:11AM (#49889329)
Thanks for sharing. I tried the online demo, which downloaded the model but, unfortunately, couldn't start it. (It says " Invalid magic number Make sure your local server is running and CORS is enabled.")
Re:MicroLLM Lab – Try 7 tiny LLM's in the browser by moooff on Tuesday September 29, 2026 @07:47AM (#49891595)
Thank you for testing. i just checked it works with Chrome.

FireFox seems broken in the current Version i.e. i can reproduce the bug. Working on it.

Which browser do you use?

Re:MicroLLM Lab – Try 7 tiny LLM's in the browser by logicallee on Tuesday September 29, 2026 @09:01AM (#49892497)
I think you've fixed it! I just tested it, now it works. (In both Chrome on Windows with NVidia 1060 gpu w/ 6 GB vram, which is what it wasn't working on yesterday, and on Safari on 2026 Mac Mini M4 with 24 GB of RAM. The former is pretty slow, around 1 tok/sec, the latter is fast at 18 tok/sec.)
Re:MicroLLM Lab – Try 7 tiny LLM's in the browser by moooff on Tuesday September 29, 2026 @09:23AM (#49892830)
Yeah, I found a bug during model load occurring with Firefox and low VRAM machines. It is fixed now, thanks!

The 1060 is unusually slow. The Mac mini sounds about right. Have fun playing around and sharing. With the more VRAM of the mini you can also run Qwen 3.8 27b :)

I really like to showcase this to non-tech people to show what their home machines already can do WITHOUT INSTALLATION in an air-gapped scenario! And given all the recent fuss, we should not trust the big providers at all with important data.

Re:MicroLLM Lab – Try 7 tiny LLM's in the browser by logicallee on Tuesday September 29, 2026 @01:37PM (#49897195)
Great, thank you for making it and also the fixes!