News for hackers. Stuff that matters.
Re:Apple introduces M6 and M5 Ultra for a big leap in perfor... by AbsurdCensor on Tuesday August 25, 2026 @11:47AM (#49436108)
I have had a difficult time with running 120b models on my 128gb setup, especially with any larger context size. The 6bit of Qwen 3.5 is already just over 100gb, and when you go down to 4bit it seems a bit lobotomized.

There are no comments on this comment yet.