Re:Mistral AI Launches New 8x22B MOE Model
by fbdab103 on Tuesday April 09, 2024 @11:20PM
(#39986648)
Ooof. I really need to pick up another HD, these model sizes are killer.
Lacking a godly GPU, I will probably hold off for a quanitized version which has the potential to run okish on CPU or my modest GPU, but really appreciate the info.
Lacking a godly GPU, I will probably hold off for a quanitized version which has the potential to run okish on CPU or my modest GPU, but really appreciate the info.