Re:Unexpected ways generative AI will change how you work fo...
by jbcranshaw on Wednesday January 18, 2023 @04:45PM
(#34433563)
Good point on the terminology. What do you think the right terminology should be? LLMs is too much of a mouthful and is not as informative for the general public, imo. People are also using Foundation Models, which I rather like.
Re:Unexpected ways generative AI will change how you work fo...
by zone411 on Wednesday January 18, 2023 @05:42PM
(#34434173)
I don't like "Foundation Models" because it's a term invented by Stanford and they're pushing it hard while not really doing all that much in the field.
Re:Unexpected ways generative AI will change how you work fo...
by d_burfoot on Wednesday January 18, 2023 @06:00PM
(#34434350)
+1 to Foundation Models. I don't share your concerns about LLMs, though, and often refer to the future involving LXMs where X could be images, audio, bioinformatics data, etc
Re:Unexpected ways generative AI will change how you work fo...
by jbcranshaw on Thursday January 19, 2023 @12:32AM
(#34437041)
Ooh, I like LXMs. Hadn't heard that before.
They key to the power of GPT3 is that it has billions of parameters, AND those parameters are well-justified because it was trained on billions of documents. So the term should be something like "gigaparam AI" or something like that. Maybe GIGAI as a parallel to GOFAI. If you could somehow build a gigaparam discrimative model, you would get better performance on the task it was trained on than GPT3.