Re:Mixtral 8x7B: A sparse Mixture of Experts language model
by Tepix on Tuesday January 09, 2024 @01:56PM
(#38930308)
I tried it, with NVlink. The speedup during inference is negligible. You'll probably benefit more during training.
[ Parent
| on HN ]
There are no comments on this comment yet.