News for hackers. Stuff that matters.
Re:Bootstrapping Self Awareness in GPT-4: Towards Recursive ... by raidicy on Sunday November 19, 2023 @05:56PM (#38339422)
Interesting so do you mean that like we can measure 300 MS slices of brain activity? In my code and experiments I was using hertz to measure frequency per second. I wanted to see the output much slower than real time.
Re:Bootstrapping Self Awareness in GPT-4: Towards Recursive ... by robwwilliams on Sunday November 19, 2023 @06:42PM (#38339906)
Check out work by Stanislas Dehaene (Consciousness and the Brain, chapters 4 and 5). And Ernst Pöppel’s Mindworks—Time and Conscious Experience.

One odd feature of all work in neuroscience is the unwarranted assumption that the brain has a timebase in the same way that a digital computer has an oscillator clock. That is obviously not true. The hundreds/thosands of brain subsystems have to learn and make their own quirky/noisy timebases and they have to mesh functionally to each other snd to world time via adaptive well-timed behavior. Arguable job number one if consciousness is creating an internal representation of nowness. Even trickier than managing distributed computing across a continent of infrastructure and latencies.

Re:Bootstrapping Self Awareness in GPT-4: Towards Recursive ... by daveguy on Sunday November 19, 2023 @09:30PM (#38341464)
There is very obviously an oscillator in the human brain. In fact, multiple of them.

https://en.m.wikipedia.org/wiki/Neural_oscillation

Re:Bootstrapping Self Awareness in GPT-4: Towards Recursive ... by robwwilliams on Monday November 20, 2023 @08:27AM (#38347664)
There are certainly oscillation but they are not a timebase for CNS compute—two orders of magnitude too slow. Despite Buzsaki best tries to explain in part with gamma oscillations. Some auditory binaural computes are at the microsecond level—-the owl catching the mouse mid-flight at night. Or you speaking or thinking rapid fire. That it in the millisecond domain.
Re:Bootstrapping Self Awareness in GPT-4: Towards Recursive ... by daveguy on Monday November 20, 2023 @01:24PM (#38352065)
Just because they aren't any faster than 80 hz doesn't mean they don't provide timing for compute. Like the GPS pulse per second doesn't provide the clock frequency, but it does provide the synchronization. Of course it's not digital precision, but how could it not contribute as an integral part of brain function?
Re:Bootstrapping Self Awareness in GPT-4: Towards Recursive ... by robwwilliams on Monday November 20, 2023 @07:30PM (#38357090)
Contribute, yes sure, but not as a timebase for compute and generating motor output. Upper motor neurons need amazingly tight coactivation to achieve fine temporal control of spinal motor neurons when throwing a fast ball—-well under a millisecond (William Calvin, The Throwing Madonna). I do not see any EEG patterns as causal in this context. Nor between retina and visual cortex.

Arguing in your favor, rhythms may be important in getting closer to an adaptive coordination of activation and inhibition. Retinal waves during development are thought to contribute (controversially) to retinotopic maps. The big question again is How does the CNS-body achieve adaptive temporal integration and functional harmony? No one knows.