Re:ChatGPT vs. a Cryptic Crossword
by yowzadave on Monday December 05, 2022 @09:54PM
(#33875311)
That was how it appeared to me. A Google search for "cryptic crossword" and the clue itself would in all likelihood turn up the correct answer as the top result, so getting the answer correct is a less impressive feat (assuming ChatGPT has access to the internet). Most humans would think doing the puzzle that way was cheating.
[ Parent
| on HN ]
ChatGPT does not have access to the internet. It was trained on a corpus of data drawn from online, but it is not querying the internet live.
Re:ChatGPT vs. a Cryptic Crossword
by thefreeman on Monday December 05, 2022 @10:47PM
(#33875662)
what do you think google is doing when you query it?
Isn't Google index much *much* larger though? There's a large amount of compression going on here (of course, not to say it hasn't probably memorized certain texts obviously [both important/factual snippets and less important bits as well]).
That does seem to be the huge difference here which yields the wonderful features of this system.
Somewhat fair.
Though I think there's a difference between having 'the internet' stored in a preindexed form against which you can perform direct exhaustive lookups, and having instead a set of weights that were produced by having once been exposed to a large amount of the data on the internet.
But you're right to point out that the difference between them is not actually that great, and both of them are really a form of 'recall'.