Re:Mapping the Mind of a Large Language Model
by fassssst on Tuesday May 21, 2024 @11:12AM
(#40429486)
Why does the timing of the “thinking” matter?
[ Parent
| on HN ]
Re:Mapping the Mind of a Large Language Model
by verdverm on Tuesday May 21, 2024 @11:26AM
(#40429660)
thinking is generally considered an internal process, without input/output (of tokens), though some people decide to output some of that thinking into a more permanent form
I see thinking as less about "timing" and more about a "process"
What this post seems to be describing is more about where attention is paid and what neurons fire for various stimuli
Re:Mapping the Mind of a Large Language Model
by sabrina_ramonov on Tuesday May 21, 2024 @11:29AM
(#40429695)
we know so little about thinking and consciousness, these claims seem premature
Re:Mapping the Mind of a Large Language Model
by verdverm on Tuesday May 21, 2024 @11:37AM
(#40429816)
That one can fix the RNG and get consistent output indicates a lack of dynamics
They certainly do not self update the weights in an online process as needed information is experienced
Re:Mapping the Mind of a Large Language Model
by whimsicalism on Tuesday May 21, 2024 @11:43AM
(#40429919)
If we could perfectly simulate the brain and there were quantum hidden variables, we too could “fix RNG and get deterministic output”