News for hackers. Stuff that matters.
Re:Mixtral 8x22B by coder543 on Wednesday April 17, 2024 @11:16AM (#40065887)
At what quantization? 4-bit is 80GB. Less than 4-bit is rarely good enough at this point.

There are no comments on this comment yet.