You mean like our dumb ass brains? Theirs a reason "saying the first thing out of your mind" is a bad fucking idea, thats what AI's currently do, they don't take a moment think about the answer and then formulate a response, they spit out their first "thought" thats why multi-shot works so much better, just like our own dumb brains.

My brain can navigate a computer interface without using word tokens, since I have tokens for navigating OS and browsers and tabs etc. That way I don't have to read a million tokens of text to figure out where buttons are or how to navigate to places, since my brain is smart enough to not use words for it.

ChatGPT doesn't have that sort of thing currently, and until it does it will always be really bad at that sort of thing.

You are using a hand to hammer a nail, that will never go well, the solution isn't to use more hands the solution is to wield a hammer.

WTF are you even talking about, we're talking about understanding and communication not taking actions, navigating an OS and browser, tabs etc are actions, not thoughts or communication. This model isn't taking actions there is no nail to hammer lol, and if their was you'd be smashing a brain into a nail for some reason.

The topic is agents, the AI acting on your behalf, that needs more than text. What are you talking about?

Your brain is doing this without you realising, just because you aren't verbalising it doesn't mean it's not iterating through its own output and selecting the best answer. Some of our thinking is purely illusion. Models can also do this, some models like Gemini allow you to see this in action where you get to select the best answer, there's also behind the scene methods such as q-learning.

When your muscle memory is instinctively clicking that start button, it's more akin to a very strong weighting after many sessions of reinforcement learning. Our brains may still be dumb but we can quickly say things like 1+1=...2 because we used reinforcement learning to strengthen the weighting back in primary school. We're not sitting visualising an abacus moving in our minds.

It's good in any prompt to give the AI a chance to think without impact (without executing anything, maybe without making anything specifically appropriate for the user to read). That works somewhat similarly to "taking a moment to think."

At that point they'll still have a tendency to use a stereotyped response and stick with it, instead of a thoughtful response, but you can try to address that in prompting too by asking for multiple proposals before choosing one.

Disagree. Even going by your example, AlphaGo uses many iterations of a "dumb" model in order to achieve incredible performance. If it had to single shot the solution with a model 100x bigger, it would perform worse. All that matters is the frontier of intelligence vs cost, and larger foundation models aren't necessarily going to push that frontier forward. AlphaCode hints at that.