Re:Harvard’s new computer science teacher is a chatbot
by sharma-arjun on Sunday June 25, 2023 @01:35PM
(#36470721)
One useful trick to avoid some of the pitfalls of ChatGPT for non-creative tasks is to respond to its output with something like:
_"Point out incorrect assumptions or statements in the above answer."_
I got the idea from Khan Academy's [implementation](https://youtu.be/A7REVn9gzgs?t=1208) of GPT-4, where they allow it to 'think' by generating an internal response first, before generating a final response. This apparently improved the veracity of its output by a significant margin.
If ChatGPT doesn't double down on its original answer, then I know definitely not to trust it.
This doesn't solve the underlying problem, because it doesn't ultimately correct the error in a reliable way, but it does help me avoid some of the more obviously garbage output.
_"Point out incorrect assumptions or statements in the above answer."_
I got the idea from Khan Academy's [implementation](https://youtu.be/A7REVn9gzgs?t=1208) of GPT-4, where they allow it to 'think' by generating an internal response first, before generating a final response. This apparently improved the veracity of its output by a significant margin.
If ChatGPT doesn't double down on its original answer, then I know definitely not to trust it.
This doesn't solve the underlying problem, because it doesn't ultimately correct the error in a reliable way, but it does help me avoid some of the more obviously garbage output.