Re:All of ChatGPT's System Prompts
by diputsmonro on Sunday October 15, 2023 @02:17AM
(#37887369)
A coincidence.
Like, it's a bit sarcastic, sure, but until factuality is explicitly built into the model, I don't think we should use any terminology that implies that the outputs are trustworthy in any way. Until then, every output is like a lucky guess.
Similar to a student flipping a coin to answer a multiple choice test. Though they get the correct answer sometimes, it says nothing at all about what they know, or how much we can trust them when we ask a question that we don't already know the answer to. Every LLM user should keep that in mind.
Like, it's a bit sarcastic, sure, but until factuality is explicitly built into the model, I don't think we should use any terminology that implies that the outputs are trustworthy in any way. Until then, every output is like a lucky guess.
Similar to a student flipping a coin to answer a multiple choice test. Though they get the correct answer sometimes, it says nothing at all about what they know, or how much we can trust them when we ask a question that we don't already know the answer to. Every LLM user should keep that in mind.