News for hackers. Stuff that matters.
Re:Mixtral 8x7B: A sparse Mixture of Experts language model by Redster on Tuesday January 09, 2024 @12:01PM (#38928520)
At this small a scale, what would the benefits be of something like a 8x2B as opposed to moving to a 7B?

There are no comments on this comment yet.