Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by Redster on Tuesday January 09, 2024 @12:01PM
(#38928520)
At this small a scale, what would the benefits be of something like a 8x2B as opposed to moving to a 7B?
[ Parent
| on HN ]
There are no comments on this comment yet.