Re:Mistral AI Launches New 8x22B MOE Model
by MPSimmons on Thursday April 11, 2024 @01:18PM
(#40004541)
I think 4b for this is support to be over 70GB, so definitely still heavy hardware.
[ Parent
| on HN ]
Re:Mistral AI Launches New 8x22B MOE Model
by bevekspldnw on Thursday April 11, 2024 @02:40PM
(#40005366)
Fucking hell, my A6000 is shy of that and I can’t reasonably justify picking up a second.