Re:Sora: Creating video from text
by 8n4vidtmkvmk on Friday February 16, 2024 @01:20AM
(#39393828)
It absolutely struggles with math. It's not solving anything. It sometimes gets the answer right only because it's seen the question before. It's rote memorization at best.
No it doesn't. I know because I've actually used the thing and you clearly haven't.
And if Terence Tao finds some use for GPT-4 as well as Khan Academy employing it as a Math tutor then I don't think I have some wild opinion either.
Now Math isn't just Arithmetic but do you know easy it is to go out of training for say Arithmetic ?
Yesterday, it failed to give me the correct answer to 4 + 2 / 2.
It said 3...
Re:Sora: Creating video from text
by isaacfrond on Friday February 16, 2024 @07:50AM
(#39396270)
Just tried in chatGpt-4. It gives the correct output (5), along with a short explanations of the order of operations (which you probably need to know, if you're asking the question).
Re:Sora: Creating video from text
by xanderlewis on Friday February 16, 2024 @08:02AM
(#39396390)
We shouldn't necessarily regard 5 as the correct output. Sure, almost all of us choose to make division higher precedence than addition, but there's no reason that has to be the case. I think a truly intelligent system would reply with 5 (which follows the usual convention, and would therefore mimic the standard human response), but immediately ask if perhaps you had intended a different order of operations (or even other meanings for the symbols), and suggest other possibilities and mention the fact that your question could be considered not well-defined...which is basically what it did.
Re:Sora: Creating video from text
by pizzafeelsright on Friday February 16, 2024 @08:44AM
(#39396878)
Correct based upon whom? If someone of authority asks the question and receives a detailed response back that is plausible but not necessarily correct, and that version of authority says the answer is actually three, how would you disagree?
In order to combat Authority you need to both appeal to a higher authority, and that has been lost. One follows AI. Another follows Old Men from long ago who's words populated the AI.
The TV show American Gods becoming reality...
Re:Sora: Creating video from text
by xanderlewis on Friday February 16, 2024 @07:55AM
(#39396323)
I guess you might think 'math' means arithmetic. It definitely does struggle with mathematical reasoning, and I can tell you that because I and many others have tried it.
Mind you, it's not brilliant at arithmetic either...
Sora is not autoregressive anyway but there's nothing "just" and next frame/token prediction.