Re:Stability AI: Emad Mostaque resigned from his role as CEO
by renewiltord on Saturday March 23, 2024 @03:45AM
(#39798212)
Mixtral 8x7b is better than both of those and runs on a top spec M3 Max wonderfully.
[ Parent
| on HN ]
Re:Stability AI: Emad Mostaque resigned from his role as CEO
by woadwarrior01 on Saturday March 23, 2024 @06:46AM
(#39798900)
Indeed! Also, Mixtral 8x7b runs just as well on older M1 Max and M2 Max Macs, since LLM inference is memory bandwidth bound and memory bandwidth hasn't significantly changed between M1 and M3.