News for hackers. Stuff that matters.
Re:Gemini "duck" demo was not done in realtime or with voice by modeless on Thursday December 07, 2023 @04:50PM (#38562292)
You're right, the models do think non-verbally. However, crucially, they can only do so for a fixed amount of time for each output token. What's needed is a way for them to think non-verbally continuously, and decide for themselves when they've done enough thinking to output the next token.
Re:Gemini "duck" demo was not done in realtime or with voice by Davidzheng on Thursday December 07, 2023 @05:19PM (#38562619)
Is it clear that humans can think nonverbally (including internal monologue) continuously? As in, for difficult reasoning tasks, do humans benefit a lot from extra time if they are not allowed internal monologue. Genuine question