Re:2023 was the year that GPUs stood still
by J_Shelby_J on Friday December 29, 2023 @12:35PM
(#38807716)
I bring this up all the time and get downvoted by apple defenders (usually I’m one). Apples policy of locking out 3rd party gpus might be the cause of a serious decline in Mac OS over the next decade.
That or devs will start building Linux hosts for their gpus at home.
Re:2023 was the year that GPUs stood still
by tracerbulletx on Friday December 29, 2023 @01:00PM
(#38808048)
That doesn't really make sense, if anything the importance of having third party cards is diminishing. Apple Silicon is already massively competitive at running things like Blender and Video Compositors. And the trends are towards apple investing in improving gaming and ML workloads (which they've made large strides towards this year), and the relative attractiveness of other GPUs is going down. Almost all of the signs are pointing at apple making their hardware the place to run on device ml.
Still, trying to do significantly fun or interesting things in any major AI ecosystem, such as the Stable Diffusion one through Automatic1111 or with the LLMs in Oobabooga (which supports nearly all LLM backends i.e. llama.cpp), will be mostly crippled and stuff will break in ways that simply don't happen to Nvidia hardware. I'll take the 2 4090s all day, because I know that quantization techniques which shouldn't even be possible (who knows maybethe fabled 1 bit quantization seems inevitable at this point) will make it possible for me to stuff even the most bloated LLM into my measly 48 GBs will be available on Nvidia first and Apple (maybe) second.