News for hackers. Stuff that matters.
Re:Mixtral 8x7B: A sparse Mixture of Experts language model by mkesper on Tuesday January 09, 2024 @02:32AM (#38923414)
But that's not a Macbook. And a Macbook M3Max with 128GB of RAM is almost 8000€.
Re:Mixtral 8x7B: A sparse Mixture of Experts language model by zarzavat on Tuesday January 09, 2024 @08:25AM (#38925887)
Considering how inaccessible and expensive 128GB of pro-level cards is, that is believe it or not, a good price.
Re:Mixtral 8x7B: A sparse Mixture of Experts language model by LoganDark on Tuesday January 09, 2024 @06:28PM (#38933847)
Not to mention that's 128GB for a single GPU. No need to shard or split.