Re:Just How Smart are You, ChatGPT? I quiz ChatGPT about math
by dxbydt on Friday December 16, 2022 @04:29PM
(#34020696)
If I post that same question on Wikipedia and confidently assert the answer is 1, some good Samaritan will edit it within a day & say no dumbass its 6, and then link me to the Talk page & we'll duke it out over there. On ChatGPT, you have no recourse other than the thumb down button. When you give it the right answer it simply refuses to accept! It's sure amusing as an adult, but be aware that several schools (atleast here in the midwest) are discussing this in the classroom - my kid said his teacher was talking about ChatGPT and that's why I proceeded to show what it does. So kids might be quite confused by this behavior. Better to just go with the standard disclaimer "I don't know. As a large language model trained by ClosedAI blah blah blah insert boilerplate here, I can't figure out the answers to basic equations mankind has known for a few centuries now unless more VC money forthcoming. Ask Powell to pause his ratehikes and market shoots back up, we staff up the org with few mathematicians and they'll tell you its 6. Right now its 1, suck it dummy"
[ Parent
| on HN ]
Re:Just How Smart are You, ChatGPT? I quiz ChatGPT about math
by HDThoreaun on Friday December 16, 2022 @04:38PM
(#34020803)
Well my point is there aren't pages for specific math problems on wikipedia, because that's not the goal of wikipedia. ChatGPT can tell you the rules of algebra, but it can't apply them.
Re:Just How Smart are You, ChatGPT? I quiz ChatGPT about math
by gernb on Friday December 16, 2022 @07:50PM
(#34022850)
The problem is when it's not objectively wrong but it has an opinion of what is right and refuses to consider alternatives. Just had an experience with it when I asked for advice on xyz it effectively said "xyz is bad, um-kay" when "xyz" was not objectively bad and there are debates about it all over. I tried 5 ~ 6 different ways to get it to acknowledge there were different points of view but it just kept parroting the same paragraph that effectively said "xyz is bad, um-kay"
It made me really scared for the day there is the one "true think" and that's the only answer you get from Siri, Google, etc...
Re:Just How Smart are You, ChatGPT? I quiz ChatGPT about math
by satvikpendem on Friday December 16, 2022 @04:52PM
(#34021002)
You're misunderstanding the parent. They mean that in school, teachers tell you to use Wikipedia as simply a starting point rather than an authoritative source (indeed, look at the article's actual sources and references at the bottom and read those), not to literally use Wikipedia to perform mathematical operations.
In the same vein, use ChatGPT but verify its answers.