News for hackers. Stuff that matters.
Re:How Meta trains large language models at scale by candiddevmike on Wednesday June 12, 2024 @09:54PM (#40665163)
I thought NVIDIA's moat was mostly software/CUDA?
Re:How Meta trains large language models at scale by rapsey on Wednesday June 12, 2024 @11:28PM (#40665643)
They have by far the fastest chip, the best software with CUDA and feverishly working on next gen chips. They also bought out multiple years worth of global high bandwidth memory manufacturing capacity.

No one will beat them at their game. However if there are any major breakthroughs that might render those processing capacities unneeded, or the major players hitting a wall regarding AI spending, then they will take a massive hit. It will come eventually because the chip business is always in boom/bust cycles.