Re:OpenAI chief goes before US Congress to propose licenses ...
by jazzyjackson on Tuesday May 16, 2023 @10:55AM
(#35962731)
your comment reads to me as totally disconnected to the OP, whose concern relates to using the appearance of intelligence as a scare tactic to build a regulatory moat.
[ Parent
| on HN ]
Re:OpenAI chief goes before US Congress to propose licenses ...
by adamsmith143 on Tuesday May 16, 2023 @11:11AM
(#35962923)
Actually OP is clearly, ironically, parroting the stochastic parrot idea that LLMs are incapable of anything other than basic token prediction and dismissing any of their other emergent abilities.
Re:OpenAI chief goes before US Congress to propose licenses ...
by woeirua on Tuesday May 16, 2023 @11:46AM
(#35963472)
Spoiler alert: they're actually both LLMs arguing with one another.
Re:OpenAI chief goes before US Congress to propose licenses ...
by jazzyjackson on Tuesday May 16, 2023 @01:22PM
(#35964961)
yea but that's a boring critique and not the point they were making - whether or not LLMs reason or parrot has no relevance to whether Mr Altman should be the one building the moat.
Re:OpenAI chief goes before US Congress to propose licenses ...
by srslack on Tuesday May 16, 2023 @09:00PM
(#35970014)
It can't generalize and adapt outside of its corpus, not in a way that's correct anyhow, and there's nothing "emergent." They are incapable of anything other than token prediction on its corpus and context. it just produces really good predictions. Funny how everyone keeps citing that Microsoft paper, when Microsoft is who is lobbying for this regulatory capture, and it's already been shown that such emergence on the tasks they chose when you scale up was a "mirage."
Re:OpenAI chief goes before US Congress to propose licenses ...
by comp_throw7 on Tuesday May 16, 2023 @11:36PM
(#35970978)
Yes, and neither could GPT-3, which is why we don't observe any differences between GPT-3 and GPT-4. Right?
Tell me: how does this claim _constrain my expectations_ about what this (or future) models can do? Is there a specific thing that you predicted in advance that GPT-4 would be unable to do, which ended up being a correct prediction? Is there a specific thing you want to predict in advance of the next generation, that it will be unable to do?
Re:OpenAI chief goes before US Congress to propose licenses ...
by adamsmith143 on Wednesday May 17, 2023 @10:25AM
(#35975627)
This is demonstrably wrong. It can clearly generate unique text not from it's training corpus and can successfully answer logic based questions that were also not in it's training corpus.
Another paper not from Msft showing emergent task capabilities across a variety of LLMs as scale increases.
https://arxiv.org/pdf/2206.07682.pdf
You can hem and haw all you want but the reality is these models have internal representations of the world that can be probed via prompts. They are not stochastic parrots no matter how much you shout in the wind that they are.