News for hackers. Stuff that matters.
Re:Stability AI: Emad Mostaque resigned from his role as CEO by woadwarrior01 on Saturday March 23, 2024 @06:46AM (#39798900)
Indeed! Also, Mixtral 8x7b runs just as well on older M1 Max and M2 Max Macs, since LLM inference is memory bandwidth bound and memory bandwidth hasn't significantly changed between M1 and M3.
Re:Stability AI: Emad Mostaque resigned from his role as CEO by karolist on Saturday March 23, 2024 @12:36PM (#39801150)
It didn't change at all, rather was reduced in certain configurations.