Yes, but in order to measure its bitrate accurately you need to tell us whether that compression is gzip, zlib, zip or 7zip. They don't all produce the same results.
If we are going to be utterly ridiculous about this conversation, let's at least be complete.
This is a frustrating article.
How? The argument remains exactly the same and we're just discussed counterexamples to the statements of people who obviously don't get it.
And that's while also moving my hands in extremely complex ways to perform the task, looking around my office, listening for threats / wife, observing the breeze from my fan, twiddling my toes on the balance board I don't use...
It's clickbait/ragebait. Well done to the title writer.
Since it costs $35.95 to read the article, probably not. Seriously, paywalling of scientific research is obviously wrong.
Agreed!
Here you go: https://arxiv.org/abs/2408.10234
Ok, but how to count bits for your example with piano? It has 80 keys or so, isn't it? Should we take log2(80)=6.32...? Of if you are working with only part of the keyboard, maybe we should take log2(7)? How many bits per seconds of processing it takes to keep my hand on a keyboard in a right way that was shown by a tutor? How to measure it? Does my experience with a guitar makes it easier? How many bits easier?
Look at a backhoe. It has a few levers and a couple pedals. EXTREMELY simple interface. Each lever and pedal is basically 1 bit for engage/disengage, but the operator has to process orders of magnitude more sensory info to operate it properly. You could use an arduino to control a backhoe, but you'd need quite a powerful computer to know what to tell the arduino to do. This shouldn't surprise anyone. Knowing how to use the tool well is always far more complicated than simply knowing how the tool operates.
It's 1 bit (discriminate red vs. green) but I doubt many here can manage 100 ms, which is what it would take to implement 10 of those decisions per second.
If that sounds ridiculous to you, you are beginning to get it. Every single brain cell works on electric potential (a continous value). Not a single one of them can be said to be in the "zero" or "one" state (a discrete value).
If you send an analog signal over a wire and the receiver on the other end can distinguish between 1024 different voltages reliably, then you sent 10 bits of information. Even though you sent neither a 0 nor a 1, but an analog voltage.
It's about the "information" as an abstract concept, not about how that information is encoded as data sent over some medium. I can send you the same thing thousands of times. I would have sent you lots of data, but 1000 copies of the same thing still only contains as much information as a single copy does.
I come in around 250 ms on the latency, which means that to get up to 10 bps I'd need to actually be able to discriminate between 6 choices each time.
To get up to 100 bps?
And is 100ms (I struggled to get below 180ms, myself) only the time needed to process, or does that include IO latency?
If it includes IO latency, then is there a buffer?
I guess someone with two boxes handy could set them up next to each other and run two copies of this test to see if their reaction time holds up or if it lengthens?
EDIT: mine suffers greatly on dual wield: 225 -> 320 ms
I meant walking, chewing gum, dribbling a basketball, and avoiding traffic.
Driving stick is a good example, as shifting gears requires conscious thought at first and becomes mostly automated with experience.
Now take someone navigating a social situation with three simultaneous participants, actively listening, coordinating body language, interjecting, responding to questions... and you have a human being operating at a "bitrate" of information that is so many orders of magnitude removed from this bullshit psychometry task as to prompt the question: "what the actual are they talking about".
It's used in theories to explain why you can hear your name in a short sentence in a crowded room and then know what the sentence is. Including one or two words before your name. While if your name wasn't said, no attention is diverted to that sound and the "buffer" contents get dropped without retrieving the information.
EDIT: see appendix A.3 Perception
Then consider something more complex like drawing, you draw way way way more than 10 bits a second.
EDIT: not the expanded bit rate, the optimally compressed bit rate, if that makes sense?
EDIT2: typing at 90 wpm is 1,5 wps, or <10 bps according to Shannon (~1 bit per letter, 5 letters per word)
That’s kind of a cop out - at what point do very quick conscious decisions become “automatic.”
People can type way faster than 90 WPM, we talk about bitrate of the hardware here its the same even if you haven't practiced typing. And typing is still not what our consciousness is made to do, we have way higher bitrate than that when doing more native tasks such as running in the woods. You can't run in the woods without consciously thinking about each step and deciding where to put your foot next to not hurt your ankle and not collide with trees, that has a massive bitrate.
Before you say it does not require decisions - you can have friendly fire on.
IO is the problem not processing power.
> Why does the brain need billions of neurons to process 10 bits/s?
Maybe the article is being intentionally disingenuous here? The brain is definitely not processing 10 bits/s, maybe a small part of it is.
I'd also say that you can make very complicated problems with only 10 bits of input (e.g. calculating busy-beaver of N), so "processing X bits" where X is a small value is no guarantee that this should be doable with a low amount of processing anyway.
Nobody would say that the database can only process 10 bits per second. The query just happened to ask for a very simplified answer.
Still, I get the feeling that the apparent bit rate of the conscious output is not the right metric to be measuring. There are so many ways in which the bit rate you're measuring could have been bottle-necked by factors outside of the mind, such as the speed at which you can move your tongue to articulate language, or a cultural expectation that prefers compact answers over chain-of-thought babbles. The mind also leaks a lot of information, both consciously and unconsciously, through side channels such as facial expression, gestures, and even variations in the rate of output itself.
My theory is that consciousness is super complicated and brain has barely enough juice to crank out any of it.
Conscious field of vision is about 2% of total field of vision and we observe the world by constantly swiping it with this 2%. This way we reuse both neural circuitry of our brains and also training data that would otherwise necessarily be spread across larger size of neural network if our conscious field of vision was larger.
So it short, conscious output is so small because we are dumb and short lived.
I also wouldn't say that there's a lot of information in the side channels. Properly compressed it's probably less than engaged conscious output.
Calling actions/thoughts that follow a concrete list of logical rules/algorithms "animal mode" is deeply anti-human.
deeply anti-human
What's wrong with that, just look at us going, globally. Any pro-human thoughts, really? Never understood this clinging to the horribly limited nature of humanity only because it has some relatively nice pockets (which usually correlate with deep thought and negatively with the lack thereof).
Reductionism is setting everything but one thing aside and trying to figure out that one thing. Bringing in the second thing in only after you fail and trying again.
I know the kind you mean though, reducing external factors(like air), so you can isolate gravity as a force unrelated to density by finding out in a vacuum a feather and a metal ball fall with the same speed.
(As for the paper I have not yet made up my mind.)
If we use your example, which is that of identifying an object, we may simply ask the entropy of what the distribution of possible objects-to-be-identified is at t=0, prior to any analysis. Saying we can resolve 10 bits of this entropy per second is equivalent to saying that we can identify one object from a uniform distribution of 1024 per second. Let's suppose this is a low estimate by several orders of magnitude, and that it's really one from a billion objects instead that you can identify per second. Then this would still only be about 30 bits/sec.
None of this changes the main thesis of the paper, which is that this is much lower than the 10⁹ bits/sec our sensory systems transmit.
Sure, some parts of the brain don't receive all that detail, but that's necessary for abstraction. If you pumped all the sensory data everywhere, the brain would get overwhelmed for no reason.
Take color: suppose the average person has 16 baseline colors memorized, and then a few variations of each: each one can be bright or dark, saturated or pastel. That would be about 6 bits for color. If you have an eye for color or you're an artist you may have some additional degrees of freedom. Hell, a computer using RGB can only represent 24 bits worth of color, maximum. I am going to suggest this stuff gets cognized less than 10 bits worth for the average person; let's just say 10.
Now, of course, people can memorize more than one color. If colors are independently distributed uniformly at random, then processing N colors requires 10N bits. But of course they aren't, so the entropy is less. But again, let's just say they were. So how many color combinations can you process per second? I would say it's a bit of a challenge to memorize a set of 10 arbitrary drawn colors shown for a second. Most people couldn't continuously do that at a rate of 10 colors per second. That would be 100 bits/sec of info.
The point is that you really don't perceive all that much. You show the average person a Rubik's cube, there is no way they're going to remember the exact pattern of colors that they saw, unless the cube were solved or something. They will perceive it as "multicolored" and that's about it.
Adding behavior, texture, etc doesn't change this picture. None of this stuff is even close to 10^9 bits of entropy, which would be 2^1,000,000,000 different equally likely possibilities.
How many bits of actual decision is going on here, as compared to the period of time that decision applies to?
For example, if a person decided once per second whether or not to go for a walk, that could be 1 bit per second. But if that person is constantly transitioning back and forth between walking and not-walking, we could consider their behavior pathological. Instead, for most people, the information density of these decisions is quite low, i.e. the per-second decision bits are very compressible.
Personally, I only decide whether to go for a walk (or not) _at most_ once every few minutes. Even if we add in bits for "where" and "precisely when" and "how long", I think we're still at just a small fraction of 1 bit per second.
When I'm reading, that's roughly 2000 bits/second, but I am engaging it with model-making systems that can completely enrapture me.
I/O is not the same as computation; conscious computation is not the same as all computation.
A bit dumb, but maybe relevant comparison might be asking why can an Apple Watch stay on for a single day only on a charge, while Garmin can do 2 weeks/a month? Because one is a general purpose computer, while the other is an embedded software that can only ever do that few things it is preprogrammed to do.
Is about having a ton of mini specific "computers" vs. the very generic conscience.
For example all the balancing, background hearing, hungry, thirsty , and so on are very specific zones in the brain. While our conscient mind is doing...well, whatever we like in a very generic way, basically keeping the joy of living on.
Consciously. Subconsciously much more is going on.
Personally, I only decide whether to go for a walk (or not) _at most_ once every few minutes.
Just because usually the decision is 'keep the current course' that doesn't mean no decision has been made.And yet, if I walked into your office and shouted your name, you would have less than a second of reaction time, indicating that you are processing all sound around you and deciding whether to get up and talk to someone pretty much continuously.
Also not so conscious context like „I am writing a reply on HN not on Reddit - making obvious silly pun about cats is not going to make upvotes - making quasi intellectual comment about subconscious processing should earn me some”.
But stuff I am good at? I don’t see it at all. A terminal? I never have any truly tangible conscious recollection of serious coding.
It might be the same for people good at Rubik’s Cube.
Look, I like the sentence. I like it so much I might steal it. But, that said I think analogising what the brain does to "general purpose computer" is a bit awry because we can invent algorithms, and given a process we can implement algorithms but I still tend to think there is something ineffable about thought/cognition which is NOT general purpose computation. It's a heuristic. I dunno what I think.
Deeper in our brain is reasoning about causality. But even that is more of an input to our reactions and emotions than it is as a consciously accessible function, and it too is often wrong.
As you said, it's a heuristic. We certainly can't solve the halting problem with brain magic.
That said, with enough willpower why couldn't you implement a universal Turing machine in your brain? I think you would need external memory (a tape) but that's not a problem.
Meaning that while you are solving the rubik‘s cube, your brain has the capacity of switching into one of 2^10=1024 possible next states, which might fire nerve impulses for the body and also come with a new set of 1024 next states?
When focusing on the cube about 20 or 30 of the next states could be related to the cube, while the rest is concerned with bodily sensations, other thoughts etc.
What if learning something well meant that less states need to be reserved for the task/cube at hand because the decision tree going forward has become more efficiently packed, so more states are open for something else.
That might be correct but as far as I know the brain has circuits that fire periodically with a certain frequency (what brain waves are about). If such frequencies steer some kind of gate than you do have a kind of digital logic with 1 being where the brain waves cross the zero line.
What makes you think that this is the case? If someone touches you from behind do you immediately fall over dead from sensory overload? Do you react as if you where punched in the gut? Do you look over your shoulder to check who it is? Or do you fail to notice it until they break a bone? There is a significant amount of inputs where the reactions are not just zero or one but happen on a scale, your digital 1 or zero is more likely to be a 1.0 or 0.0 of a numeric type with unknown bit depth, lets go with 80bit since x87 is just the worst and completely blows the 10bit claim.
My point was not that reactions/feelings etc are switched by a signal being 1 or 0, just that sort-of-digital signals (line "on" or "off") are possible within the brain.
My idea about the instruction-set I was talking about earlier was not that it immediately switches behaviours on or off, but that it selects the next, slightly different or deeper "brain circuits / loops" to get activated and shift the whole apparatus towards finally acting out a certain behaviour.
But, as you point out, that is all unfounded speculation.
When you look at a Rubik's cube, you don't just pick out specific positions of colored squares relative to each other. You also pick up the fact that it's a Rubik's cube and not a bird or a series of binary digits or English text. If an orange cat lunged at your Rubik's cube while you were studying it, you wouldn't process it as "face 3 has 4 red squares on the first row, then an orange diagonal with sharp claws", you'd process it as "fast moving sharp clawed orange cat attacking cube". Which implies that every time you loom at the cube you also notice that it's still a cube and not any of the millions of other objects you can recognize, adding many more bits of information.
Similarly, when you're typing English text, you're not just encoding information from your brain into English text, you're also deciding that this is the most relevant activity to keep doing at the moment, instead of doing math or going out for a walk. Not to mention the precise mechanical control of your muscles to achieve the requisite movements, which we're having significant trouble programming into a robot.