Re:Flash-Moe: Running a 397B Parameter Model on a Mac with 4...
by Wowfunhappy on Sunday March 22, 2026 @09:07AM
(#47477117)
Eh. I mean, 4 tokens a second works fine if you're patient. Go do something else while you wait.
I feel like whenever I'm trying to find information on which local models will work on my hardware, I have to overestimate because people don't know how to wait for things.
I feel like whenever I'm trying to find information on which local models will work on my hardware, I have to overestimate because people don't know how to wait for things.
Also, reading data doesn't cause SSD wear.