How Meta trains large language models at scale

Re:How Meta trains large language models at scale by jauer on Wednesday June 12, 2024 @10:03PM (#40665222)

and so is Meta: https://ai.meta.com/blog/next-generation-meta-training-infer...

[ Parent | on HN ]

Re:How Meta trains large language models at scale by boringg on Wednesday June 12, 2024 @10:19PM (#40665301)

Ever since Apple did it everyone has leaped on board. Let's see how things pan out for everyone...

[ Parent | on HN ]

Re:How Meta trains large language models at scale by 1024core on Wednesday June 12, 2024 @11:04PM (#40665509)

Google introduced their first TPU in 2015...? Long before Apple taped out their first silicon.

[ Parent | on HN ]

Re:How Meta trains large language models at scale by fragmede on Wednesday June 12, 2024 @11:13PM (#40665563)

if we're talking custom silicon, Google acquired Motorola in 2011, and Apple acquired PA semi in 2008.

The idea is obvious to everybody in the industry, it's a question of money and motivation.

[ Parent | on HN ]

Re:How Meta trains large language models at scale by mamp on Thursday June 13, 2024 @12:28AM (#40665946)

Apple’s first in-house designed chip was the A4 in 2010.

[ Parent | on HN ]

Re:How Meta trains large language models at scale by jacurtis on Wednesday June 12, 2024 @10:30PM (#40665354)

And that's why $ARM is a good buy. Selling swords and steel to all these armies as they go to war.

[ Parent | on HN ]

Re:How Meta trains large language models at scale by silisili on Thursday June 13, 2024 @12:21AM (#40665899)

ARM is just collecting royalties in this space. Their reference designs aren't exactly competitive.

I'm not saying it's a bad buy, either, but if and when they turn the screws, there will be a mass exodus. Solid long term play perhaps, but not going to see Nvidia like price action.

[ Parent | on HN ]