Re:How Meta trains large language models at scale
by yellow_postit on Wednesday June 12, 2024 @11:39PM
(#40665705)
And they missed multiple waves of effectively building on their own in house research.
[ Parent
| on HN ]
Re:How Meta trains large language models at scale
by tadala on Thursday June 13, 2024 @12:15AM
(#40665869)
I think this is a little bit of a stretch. They have been using transformers for search since the paper came out—which is partially why they dominated the space, and also at this point they're caught up with OpenAI. Google simply had to be more careful about releasing something like ChatGPT because they're a public company.
They're the only company that is fully end-to-end (not Apple anymore, sorry Steve): energy, silicon, data, cloud, also serving to both consumer and enterprise. Frankly their only problem is the sentiment towards them, and their juvenile, cheap branding (though the tech-illiterate philistine managers they keep importing are of no help).
I had an idea that they should rebrand to E-corp and go all black.