News for hackers. Stuff that matters.

A comment on How Meta trains large language models at scale. Parent comment

Re:How Meta trains large language models at scale by mike_d on Wednesday June 12, 2024 @09:55PM (#40665171)
Yes. Google was building custom HPC hardware 5-8 years before Nvidia decided to expand outside the consumer and "workstation" markets.
[ Parent | on HN ]
Re:How Meta trains large language models at scale by threeseed on Wednesday June 12, 2024 @10:42PM (#40665400)
Nvidia acquired Mellanox who know far more about custom HPC hardware than Google.
[ Parent | on HN ]
Re:How Meta trains large language models at scale by mike_d on Thursday June 13, 2024 @04:21AM (#40667214)
Mellanox and friends not being able to build fast enough switching gear at a reasonable price point was what got Google into the hardware game in the first place ;)
[ Parent | on HN ]