News for hackers. Stuff that matters.
Re:The A.I. Bubble is Bursting with Ed Zitron [video] by wongarsu on Saturday July 06, 2024 @01:53PM (#40891972)
Pause tokens [1] are directly dependent on the model recognizing whether the answer it arrived at is one it should "commit" to or whether it should abandon it and output a pause token instead.

Similarly if you ask ChatGPT about the current president of Numbitistan it will tell you that it doesn't know about a county with that name, rather than just hallucinating an answer. So it can at least in this circumstance tell the difference between knowing something and not knowing something.

1: https://arxiv.org/abs/2310.02226

There are no comments on this comment yet.