News for hackers. Stuff that matters.
Re:Large language models lack deep insights or a theory of mind by two_in_one on Thursday November 30, 2023 @02:43PM (#38478131)
Just note that loop doesn't have to be visible from outside. It can be internal, with another driving thread asking right questions. Inner monologue. Then the summary is given back to user. This will give the model space for 'thinking' with internally generated text much large than the visible prompt + output. This way multi-step logic can be implemented.
Re:Large language models lack deep insights or a theory of mind by chii on Thursday November 30, 2023 @07:46PM (#38481444)
> with another driving thread asking right questions. Inner monologue.

spoilers warning:

Is that basically the plot to westworld?

Re:Large language models lack deep insights or a theory of mind by two_in_one on Thursday November 30, 2023 @09:06PM (#38482116)
Inner monologue idea was around for a while. That's interesting that it actually materializes. It was thought that AGI will be operating with some abstracts, logic rules, probability calculations, etc. Not thinking in plain English.