Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by LoganDark on Tuesday January 09, 2024 @06:28PM
(#38933847)
Not to mention that's 128GB for a single GPU. No need to shard or split.
[ Parent
| on HN ]
There are no comments on this comment yet.