News for hackers. Stuff that matters.
Re:Ferret: A Multimodal Large Language Model by Apple by ayewo on Saturday December 23, 2023 @01:12PM (#38746489)
They are implying that even though Apple is a wealthy consumer hardware company that has major spats with nVidia and Samsung, it doesn't always make economic sense to make tools they might need in-house when they can simply buy them from a rival.

So rather than invest engineering resources to re-imagine the fridge, they can simply buy them from established manufacturers that make household appliances like Samsung, Sony etc.

Re:Ferret: A Multimodal Large Language Model by Apple by MBCook on Saturday December 23, 2023 @03:13PM (#38747730)
Not only that, don’t they buy display panels and maybe even storage or RAM chips from Samsung?

Once two giant companies are dealing with each other it can get really complicated to cut everything off.

Re:Ferret: A Multimodal Large Language Model by Apple by lern_too_spel on Saturday December 23, 2023 @01:54PM (#38746920)
Apple doesn't make silly charts saying they make better refrigerators.
Re:Ferret: A Multimodal Large Language Model by Apple by airstrike on Saturday December 23, 2023 @04:08PM (#38748254)
Because they don't sell refrigerators
Re:Ferret: A Multimodal Large Language Model by Apple by lern_too_spel on Saturday December 23, 2023 @04:11PM (#38748276)
The point of this thread is that even though Apple makes silly charts saying how good their hardware is at ML, they use products that their silly charts say aren't as good.

There is no such hypocrisy if they use Samsung refrigerators.

Re:Ferret: A Multimodal Large Language Model by Apple by astrange on Saturday December 23, 2023 @04:36PM (#38748465)
ML inference and training are not the same task.
Re:Ferret: A Multimodal Large Language Model by Apple by lern_too_spel on Saturday December 23, 2023 @07:37PM (#38749827)
This plot is about general GPU performance, not pure inference. https://www.apple.com/newsroom/2022/03/apple-unveils-m1-ultr...

Training the model requires inference for forward propagation, so even then, for your comment to be relevant, you'd need to find a plot that Apple uses to compare inference on quantized models versus Nvidia, which doesn't exist.

Re:Ferret: A Multimodal Large Language Model by Apple by smoldesu on Saturday December 23, 2023 @04:45PM (#38748542)
...and doing either of those things with CUDA is impossible on Mac. Why? Because Apple burned their bridge with Nvidia and threw a temper tantrum, that's why. Now Nvidia can't support MacOS, even if they wanted.

That's kinda the point of my original comment. Apple claims to know what's best, but contradict themselves through their own actions. We wouldn't be in awkward situations like this if Apple didn't staunchly box-out competitors and force customers to follow them or abandon the ecosystem. It's almost vindicating for people like me, who left MacOS because of these pointless decisions.