Re:GPT-4 prediction: it won’t be useful
by joegibbs on Saturday January 07, 2023 @10:19PM
(#34295676)
Morse code, mathematics, playing chess, string reversal - these are all things that a computer can already do, but GPT isn't good at. So why not combine GPT and something else, so it can make some kind of external call to a service and have that do some computation for it?
[ Parent
| on HN ]
Re:GPT-4 prediction: it won’t be useful
by professoretc on Saturday January 07, 2023 @11:54PM
(#34296155)
Because GPT doesn't "know" what you're asking it to do. If you want it to be able to call out to a chess engine when you ask it "Solve this chess problem" then we're back in the old world of grammars and trying to parse sentence structure.
It's anecdotal, but in my usage GPT "knows" way better how to formalize a problem than the actual factual answer. If I ask for a list of animal names that end with the string "ar", the answer is nonsense, but if I ask for a python script that check if a string end with the substring "ar", the answer is correct. Same with simple math problems and many other questions. I was wondering the same thing, if it would be possible to use some kind of deterministic confirmation as a part of GPT training.