News for hackers. Stuff that matters.
Re:How Meta trains large language models at scale by vineyardmike on Thursday June 13, 2024 @11:24AM (#40670808)
Because people generally don’t use TPUs outside of Google. The tooling is different, the access is metered through GCP, etc.

Nvidia is in a vaguely unique position in that their products have great tooling support and few companies sell silicon at their scale.

Re:How Meta trains large language models at scale by refulgentis on Thursday June 13, 2024 @01:07PM (#40672092)
Correct, I'm pointing out politely that's in conflict with the person I'm replying to.