News for hackers. Stuff that matters.

A comment on How Meta trains large language models at scale. Parent comment

Re:How Meta trains large language models at scale by mike_d on Thursday June 13, 2024 @01:30AM (#40666260)
> This is like saying $popularApp will fail because they buy expensive hosting at AWS.

For any given mobile app startup, AWS is effectively infinite. The more money you throw at it the more doodads you get back. Nvidia's supply chain is not infinite and is the bottle neck for all the non-Google players to fight over.

[ Parent | on HN ]
Re:How Meta trains large language models at scale by KaiserPro on Thursday June 13, 2024 @05:38AM (#40667631)
IF you are training on AWS, its not infinite. worse still you are bidding against other people.
[ Parent | on HN ]