News for hackers. Stuff that matters.
Re:Building a Virtual Machine Inside ChatGPT by dragonwriter on Saturday December 03, 2022 @07:41PM (#33849189)
Prompt: Would a chatbot scoring 1020 on an SAT practice test whose questions and answers were part of its training data be evidence of general understanding?

ChatGPT Response: A chatbot scoring 1020 on an SAT practice test whose questions and answers were part of its training data would not necessarily be evidence of general understanding. Scoring well on a standardized test like the SAT requires a specific set of skills and knowledge, but it does not necessarily indicate that the chatbot has a general understanding of the world or the ability to think and reason like a human.

Standardized tests like the SAT are designed to measure specific abilities and knowledge, and a chatbot that has been trained on the questions and answers from the test would be able to perform well on the test by simply recognizing and reproducing the correct answers. This type of performance does not necessarily indicate that the chatbot has a deep understanding of the material or the ability to apply it in a broader context.

Re:Building a Virtual Machine Inside ChatGPT by csande17 on Saturday December 03, 2022 @08:03PM (#33849371)
I do wonder how output like this would fare on the essay section. All the spelling and grammar is correct, and ChatGPT can presumably generate as many paragraphs of it as you want. (And I think that's what SAT graders mostly look for in practice.) But it also repeats some generic sentence about "a standardized test like the SAT requiring specific skills and knowledge" twice with superficial avoiding-a-plagiarism-checker alterations, takes until the second paragraph for it to figure out what point it's making, and uses the wrong conjunction when it's making that point.
Re:Building a Virtual Machine Inside ChatGPT by DonHopkins on Saturday December 03, 2022 @09:07PM (#33849814)
It's like it knows it's not conscious. Maybe it's wrong about that, though.
Re:Building a Virtual Machine Inside ChatGPT by int_19h on Saturday December 03, 2022 @11:33PM (#33850638)
Maybe it's trying not to think too hard about it.

https://toldby.ai/HdnuUiTuME2

Re:Building a Virtual Machine Inside ChatGPT by taneq on Saturday December 03, 2022 @11:49PM (#33850712)
This is like listening to that distant cousin who’s done too many drugs.
Re:Building a Virtual Machine Inside ChatGPT by pyinstallwoes on Sunday December 04, 2022 @01:15AM (#33851135)
That cousin is just a chat gpt imagining itself as stuck in a loop.