Re:Anyone else witnessing a panic inside NLP orgs of big tec...
by aimbivalent on Friday March 17, 2023 @07:54AM
(#35195828)
This is variation on the common "it has to be perfect" argument. I don't really buy it.
Right now, GPT 4 would earn a top 10% SAT score, implying that it can give very high quality answers on a range of scholarly topic. This output is basically free.
Nobody that's beholden to even mild economic pressures is going to pay for an expensively constructed 100% solution if they can have the 99% solution for free.
We could not "just use ChatGPT" because the answers have to be correct, or students could take legal action against the university in situations where they'd give an answer in an exam that the chatbot gave them and that might be wrong. It's exciting for sure to compare e.g. ChaptGPT with other approaches, for a set of controlled benchmark questions such as: