News for hackers. Stuff that matters.
Re:Mixtral 8x7B: A sparse Mixture of Experts language model by zarzavat on Tuesday January 09, 2024 @08:25AM (#38925887)
Considering how inaccessible and expensive 128GB of pro-level cards is, that is believe it or not, a good price.
Re:Mixtral 8x7B: A sparse Mixture of Experts language model by LoganDark on Tuesday January 09, 2024 @06:28PM (#38933847)
Not to mention that's 128GB for a single GPU. No need to shard or split.