News for hackers. Stuff that matters.
Re:Flash-Moe: Running a 397B Parameter Model on a Mac with 4... by Wowfunhappy on Sunday March 22, 2026 @09:07AM (#47477117)
Eh. I mean, 4 tokens a second works fine if you're patient. Go do something else while you wait.

I feel like whenever I'm trying to find information on which local models will work on my hardware, I have to overestimate because people don't know how to wait for things.

Also, reading data doesn't cause SSD wear.

There are no comments on this comment yet.