News for hackers. Stuff that matters.
Re:Mapping the Mind of a Large Language Model by verdverm on Tuesday May 21, 2024 @11:26AM (#40429660)
thinking is generally considered an internal process, without input/output (of tokens), though some people decide to output some of that thinking into a more permanent form

I see thinking as less about "timing" and more about a "process"

What this post seems to be describing is more about where attention is paid and what neurons fire for various stimuli

Re:Mapping the Mind of a Large Language Model by sabrina_ramonov on Tuesday May 21, 2024 @11:29AM (#40429695)
we know so little about thinking and consciousness, these claims seem premature
Re:Mapping the Mind of a Large Language Model by verdverm on Tuesday May 21, 2024 @11:37AM (#40429816)
That one can fix the RNG and get consistent output indicates a lack of dynamics

They certainly do not self update the weights in an online process as needed information is experienced

Re:Mapping the Mind of a Large Language Model by whimsicalism on Tuesday May 21, 2024 @11:43AM (#40429919)
If we could perfectly simulate the brain and there were quantum hidden variables, we too could “fix RNG and get deterministic output”