Re:Ferret: A Multimodal Large Language Model by Apple
by lern_too_spel on Saturday December 23, 2023 @01:54PM
(#38746920)
Apple doesn't make silly charts saying they make better refrigerators.
[ Parent
| on HN ]
Re:Ferret: A Multimodal Large Language Model by Apple
by airstrike on Saturday December 23, 2023 @04:08PM
(#38748254)
Because they don't sell refrigerators
Re:Ferret: A Multimodal Large Language Model by Apple
by lern_too_spel on Saturday December 23, 2023 @04:11PM
(#38748276)
The point of this thread is that even though Apple makes silly charts saying how good their hardware is at ML, they use products that their silly charts say aren't as good.
There is no such hypocrisy if they use Samsung refrigerators.
Re:Ferret: A Multimodal Large Language Model by Apple
by astrange on Saturday December 23, 2023 @04:36PM
(#38748465)
ML inference and training are not the same task.
Re:Ferret: A Multimodal Large Language Model by Apple
by lern_too_spel on Saturday December 23, 2023 @07:37PM
(#38749827)
This plot is about general GPU performance, not pure inference. https://www.apple.com/newsroom/2022/03/apple-unveils-m1-ultr...
Training the model requires inference for forward propagation, so even then, for your comment to be relevant, you'd need to find a plot that Apple uses to compare inference on quantized models versus Nvidia, which doesn't exist.
Re:Ferret: A Multimodal Large Language Model by Apple
by smoldesu on Saturday December 23, 2023 @04:45PM
(#38748542)
...and doing either of those things with CUDA is impossible on Mac. Why? Because Apple burned their bridge with Nvidia and threw a temper tantrum, that's why. Now Nvidia can't support MacOS, even if they wanted.
That's kinda the point of my original comment. Apple claims to know what's best, but contradict themselves through their own actions. We wouldn't be in awkward situations like this if Apple didn't staunchly box-out competitors and force customers to follow them or abandon the ecosystem. It's almost vindicating for people like me, who left MacOS because of these pointless decisions.