Re:GPT-4
by DubiousPusher on Tuesday March 14, 2023 @07:59PM
(#35161470)
Right, so the decision to or not to inject an outside query into a particular repsonse and then iterate on the result, will be something learned by the model and therefore meta-cognitive as you say. Getting the model to a good balance of when to do so is an interesting problem. However, we at least could see whether the model tried a query and display the iterative steps it took. Then at least the cases where it did use a calculator would be verifiable.
It would seem as simple as assigning probably 1 to certain recognizable queries. Maybe the difficulty is that the very problem of choosing to use a calculator entails a meta-cognitive rational decision, and it's not clear how to organize that in neural networks, which are what Turing himself called an unorganized model of computation.