News for hackers. Stuff that matters.
Re:Ferret: A Multimodal Large Language Model by Apple by lern_too_spel on Saturday December 23, 2023 @07:37PM (#38749827)
This plot is about general GPU performance, not pure inference. https://www.apple.com/newsroom/2022/03/apple-unveils-m1-ultr...

Training the model requires inference for forward propagation, so even then, for your comment to be relevant, you'd need to find a plot that Apple uses to compare inference on quantized models versus Nvidia, which doesn't exist.

There are no comments on this comment yet.