News for hackers. Stuff that matters.
Re:MicroLLM Lab – Try 7 tiny LLM's in the browser by moooff on Tuesday September 29, 2026 @09:23AM (#49892830)
Yeah, I found a bug during model load occurring with Firefox and low VRAM machines. It is fixed now, thanks!

The 1060 is unusually slow. The Mac mini sounds about right. Have fun playing around and sharing. With the more VRAM of the mini you can also run Qwen 3.8 27b :)

I really like to showcase this to non-tech people to show what their home machines already can do WITHOUT INSTALLATION in an air-gapped scenario! And given all the recent fuss, we should not trust the big providers at all with important data.

Re:MicroLLM Lab – Try 7 tiny LLM's in the browser by logicallee on Tuesday September 29, 2026 @01:37PM (#49897195)
Great, thank you for making it and also the fixes!