News for hackers. Stuff that matters.
Re:AI's $600B Question by kristjansson on Wednesday July 03, 2024 @10:42PM (#40871917)
per Zuckerberg[0], ~half of their H100s were for Reels content recommendation:

> I think it was because we were working on Reels. We always want to have enough capacity to build something that we can't quite see on the horizon yet. ... So let's order enough GPUs to do what we need to do on Reels and ranking content and feed. But let's also double that.

So there's an immense capacity inside Meta, but the _whole_ fleet isn't available for LLM training.

[0]: https://www.dwarkeshpatel.com/p/mark-zuckerberg?open=false#§...

Re:AI's $600B Question by matthewdgreen on Thursday July 04, 2024 @08:06AM (#40874220)
Surely they’re using some of that hardware to overcome Apple’s attempts to deprive them of targeted advertising data.