News for hackers. Stuff that matters.
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @11:21AM (#42451847)
Has anyone here even read more than the title? The article literally explains that you perceive at a rate of 10^9 bits per second. But after filtering and preprocessing in the outer brain you are only left with about 10 bits per second for conscious processing for things like motor functions. Yes, you can see a Rubic's cube and perceive all sorts of facts about it and the environment at the same time. But try solving it with your hands while someone shows you a bunch of objects and asks you visual comprehension questions at the same time. You might still perceive those other objects, but consciously classifying them verbally is gonna be really difficult. It's no surprise that the feature space that your deeper brain can actively work on is quite limited.
Re:The unbearable slowness of being: Why do we live at 10 bi... by xattt on Wednesday December 18, 2024 @12:16PM (#42452480)
[delayed]
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @12:39PM (#42452780)
Consider normal text compression and you're left with a few bits at best for most of those "fast talkers/listeners." And the human brain is very good at compression.
Re:The unbearable slowness of being: Why do we live at 10 bi... by ghurtado on Wednesday December 18, 2024 @03:41PM (#42454903)
> And the human brain is very good at compression

Yes, but in order to measure its bitrate accurately you need to tell us whether that compression is gzip, zlib, zip or 7zip. They don't all produce the same results.

If we are going to be utterly ridiculous about this conversation, let's at least be complete.

Re:The unbearable slowness of being: Why do we live at 10 bi... by nottorp on Wednesday December 18, 2024 @03:59PM (#42455116)
And were those measurements made with vsync on by any chance?
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Thursday December 19, 2024 @03:10AM (#42459457)
How would that be relevant? The only relevant aspect for this discussion is that language is tightly compressible, which noone here has challenged yet. But I've seen noone come up with a true example where you'd be actively processing high entropy data at a rate that disagrees fundamentally with the paper.
Re:The unbearable slowness of being: Why do we live at 10 bi... by xattt on Wednesday December 18, 2024 @12:59PM (#42453030)
I feel like this is splitting hairs and moving goalposts. The pro side will always have some sort of explanation why it’s 10 bps or less without a way of actually proving it.

This is a frustrating article.

Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @03:27PM (#42454716)
>I feel like this is splitting hairs and moving goalposts.

How? The argument remains exactly the same and we're just discussed counterexamples to the statements of people who obviously don't get it.

Re:The unbearable slowness of being: Why do we live at 10 bi... by grumple on Wednesday December 18, 2024 @01:23PM (#42453265)
I can type at a rate faster than 10 bits/ second (about 2 characters / 16 bits! what a slow rate! I'm well above that, at least 24 bits/second!) and you aren't compressing that to less.

And that's while also moving my hands in extremely complex ways to perform the task, looking around my office, listening for threats / wife, observing the breeze from my fan, twiddling my toes on the balance board I don't use...

It's clickbait/ragebait. Well done to the title writer.

Re:The unbearable slowness of being: Why do we live at 10 bi... by 01HNNWZ0MV43FF on Wednesday December 18, 2024 @12:58PM (#42453018)
(Shannon estimates 11.82 bits per word, so 300 WPM is 59.1 bits per second)
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @03:30PM (#42454767)
The Hutter prize submissions can get compression factors >9 on english wiki text. And if you're listening to podcasts the entropy is probably even lower. The human brain is obviously a much better language model than anything we have today, so you can assume that the latent layer in your brain deals with much less than 60 bits per second.
Re:The unbearable slowness of being: Why do we live at 10 bi... by axus on Wednesday December 18, 2024 @05:01PM (#42455922)
Each second of listening we're perceiving the speaker's identity, what accent they are using, how fast they are talking, and what emotions they are showing. Those should count for the bit rate dealt with by the conscious brain.
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Thursday December 19, 2024 @03:06AM (#42459438)
Again: perception is not what we're talking about and the paper acknowledges that perceptive input is orders of magnitude larger. I challenge you to listen comprehensively to someone talking about a topic you don't know while identifying someone in a police lineup.
Re:The unbearable slowness of being: Why do we live at 10 bi... by gtirloni on Wednesday December 18, 2024 @12:15PM (#42452465)
You're missing my point. I'm saying that `try solving it with your hands while someone shows you a bunch of objects and asks you visual comprehension questions at the same time` is more than 10 bit/s of data being processed. I'm saying made up "tasks and outcomes" in this study are not a measure of the brain's throughput IN THE INNER LAYERS.
Re:The unbearable slowness of being: Why do we live at 10 bi... by wbl on Wednesday December 18, 2024 @11:59AM (#42452296)
What conscious motor processing? My motor functions largely take care of themselves while I daydream when walking or consider where I want to steer while driving.
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @12:36PM (#42452735)
That's just motor reflexes that don't even enter higher cognitive processing. But daydreaming probably does process at the same rate as normal language, as was explained in the other comment. Try doing algebra in your head while running an obstacle course you've never seen and you'll be much slower at everything.
Re:The unbearable slowness of being: Why do we live at 10 bi... by kens on Wednesday December 18, 2024 @11:56AM (#42452270)
> Has anyone here even read more than the title?

Since it costs $35.95 to read the article, probably not. Seriously, paywalling of scientific research is obviously wrong.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ziddoap on Wednesday December 18, 2024 @12:23PM (#42452580)
>Seriously, paywalling of scientific research is obviously wrong.

Agreed!

Here you go: https://arxiv.org/abs/2408.10234

Re:The unbearable slowness of being: Why do we live at 10 bi... by mystified5016 on Wednesday December 18, 2024 @11:26AM (#42451902)
10 bits per second is effectively nothing. Not even a single cell could operate at 10 bits per second. Every organic system would collapse immediately.
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @11:36AM (#42452034)
Remember, this is an intermediate encoding of a hidden feature space between perception and planning. What you see at the start and the end of the neural network might be very different. Consider this: Typing at 60 words/minute, 5 characters/word and 8 bits/character gives a gross bit rate of 40 bits/second. With today's compression algorithms, you can easily get 4:1 reduction in data. That leaves you at approximately 10bits/second that are consciously processed in your brain. Probably even less since your brain might be much better at encoding language than even our best models. Even if some of those numbers are off by a certain factor, the number in the paper is certainly in the right ballpark when you consider orders of magnitude.
Re:The unbearable slowness of being: Why do we live at 10 bi... by cycomanic on Wednesday December 18, 2024 @02:22PM (#42453866)
So the argument is that compression is not processing? That's a very weird definition of processing. Also when we do this we can always argue that we get down to 10bit/s, just change the compression ratio.
Re:The unbearable slowness of being: Why do we live at 10 bi... by hathawsh on Wednesday December 18, 2024 @12:41PM (#42452811)
Another way to put it: try to perform a skill you have never practiced. For example, if you've never played the piano or tried to read sheet music, see how long it takes you to play a few notes correctly. It's complex enough that you'll very likely find yourself limited to around 10 bits per second. You shouldn't count the bits handled by visual processing, basic motor control, and other things you have practiced all your life. If you practice the skill, the skill moves out of your conscious processing and no longer counts toward the 10 bits per second.
Re:The unbearable slowness of being: Why do we live at 10 bi... by ordu on Wednesday December 18, 2024 @02:36PM (#42454079)
> You shouldn't count the bits handled by visual processing, basic motor control, and other things you have practiced all your life.

Ok, but how to count bits for your example with piano? It has 80 keys or so, isn't it? Should we take log2(80)=6.32...? Of if you are working with only part of the keyboard, maybe we should take log2(7)? How many bits per seconds of processing it takes to keep my hand on a keyboard in a right way that was shown by a tutor? How to measure it? Does my experience with a guitar makes it easier? How many bits easier?

Re:The unbearable slowness of being: Why do we live at 10 bi... by seanhunter on Thursday December 19, 2024 @04:26AM (#42459846)
Your argument boils down to “exclude anything faster than 10 bits per second, so then you’re limited to things which are 10 bits per second or less”. It’s extremely unconvincing.
Re:The unbearable slowness of being: Why do we live at 10 bi... by hathawsh on Thursday December 19, 2024 @03:11PM (#42465237)
That is a remarkably good argument. Well done, I'm convinced that this paper has little substance after all.
Re:The unbearable slowness of being: Why do we live at 10 bi... by burnte on Wednesday December 18, 2024 @12:59PM (#42453019)
I did read the summary and see what you saw, but that still leads me to believe the headline of the article is clickbait and that the authors don't understand that action signalling doesn't require the same bandwidth as information processing, but even then it's way more than 10b/s.

Look at a backhoe. It has a few levers and a couple pedals. EXTREMELY simple interface. Each lever and pedal is basically 1 bit for engage/disengage, but the operator has to process orders of magnitude more sensory info to operate it properly. You could use an arduino to control a backhoe, but you'd need quite a powerful computer to know what to tell the arduino to do. This shouldn't surprise anyone. Knowing how to use the tool well is always far more complicated than simply knowing how the tool operates.

Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @01:30PM (#42453349)
Here's a simple reaction test: https://humanbenchmark.com/tests/reactiontime

It's 1 bit (discriminate red vs. green) but I doubt many here can manage 100 ms, which is what it would take to implement 10 of those decisions per second.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ghurtado on Wednesday December 18, 2024 @03:37PM (#42454859)
Can you point me to the book that says that "Booleans" are encoded in the human brain just like in a binary computer and they take exactly 1 bit to store? I mean, why not assume error correction, while we are at it, or some kind of compression algorithm that reduces the size further?

If that sounds ridiculous to you, you are beginning to get it. Every single brain cell works on electric potential (a continous value). Not a single one of them can be said to be in the "zero" or "one" state (a discrete value).

Re:The unbearable slowness of being: Why do we live at 10 bi... by vrighter on Thursday December 19, 2024 @08:04AM (#42461048)
"bits of information" doesn't mean 1's and 0's. "bits" is a measure of entropy.

If you send an analog signal over a wire and the receiver on the other end can distinguish between 1024 different voltages reliably, then you sent 10 bits of information. Even though you sent neither a 0 nor a 1, but an analog voltage.

It's about the "information" as an abstract concept, not about how that information is encoded as data sent over some medium. I can send you the same thing thousands of times. I would have sent you lots of data, but 1000 copies of the same thing still only contains as much information as a single copy does.

Re:The unbearable slowness of being: Why do we live at 10 bi... by burnte on Wednesday December 18, 2024 @03:18PM (#42454617)
If you extend your arm straight out to point for example, that's significantly more than ten commands sent at once to your arm muscles. It's just non-conscious. That test measures a bunch of things all together too. Visual processing, color recognition, and conscious decision to act. I got just under 240, and considering everything I had to do, that's pretty neat.
Re:The unbearable slowness of being: Why do we live at 10 bi... by whatever0124 on Wednesday December 18, 2024 @02:22PM (#42453874)
This measures latency not processing power. You can have 10 b/s or 1 Gb/s of processing power with the same latency.
Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:32PM (#42454022)
yes, but the greater the latency, the greater the number of bits per period required to get the same throughput.

I come in around 250 ms on the latency, which means that to get up to 10 bps I'd need to actually be able to discriminate between 6 choices each time.

To get up to 100 bps?

Re:The unbearable slowness of being: Why do we live at 10 bi... by ssl-3 on Wednesday December 18, 2024 @01:44PM (#42453486)
Can the combination of mind and body only process reactive tasks serially, or can it process them with some amount of parallelism?

And is 100ms (I struggled to get below 180ms, myself) only the time needed to process, or does that include IO latency?

If it includes IO latency, then is there a buffer?

Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @01:51PM (#42453548)
> or can it process them with some amount of parallelism

I guess someone with two boxes handy could set them up next to each other and run two copies of this test to see if their reaction time holds up or if it lengthens?

EDIT: mine suffers greatly on dual wield: 225 -> 320 ms

see also https://news.ycombinator.com/item?id=42453704

Re:The unbearable slowness of being: Why do we live at 10 bi... by ssl-3 on Wednesday December 18, 2024 @02:01PM (#42453636)
I'll have a good think about whether we can process things in parallel or only in series the next time I decide to walk and chew gum while bouncing a ball, not tripping over things, and staying out of traffic.
Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:08PM (#42453718)
none of those activities need involve conscious decisions, however
Re:The unbearable slowness of being: Why do we live at 10 bi... by ssl-3 on Wednesday December 18, 2024 @02:26PM (#42453922)
Having a think is not a conscious activity?
Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:28PM (#42453962)
that, yes, sorry.

I meant walking, chewing gum, dribbling a basketball, and avoiding traffic.

Re:The unbearable slowness of being: Why do we live at 10 bi... by BehindBlueEyes on Thursday December 19, 2024 @11:28AM (#42463037)
Depends on expertise. Consider a toddler learning to walk, while eating a snack, carrying a toy and avoiding the cat.

Driving stick is a good example, as shifting gears requires conscious thought at first and becomes mostly automated with experience.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ziggyzecat on Thursday December 19, 2024 @01:10PM (#42464165)
Mh, balance that ball on your finger while keeping it in spin or dribble it between your legs while spinning your body around and see how many conscious decisions you make while not stepping into canine feces.
Re:The unbearable slowness of being: Why do we live at 10 bi... by jknoepfler on Wednesday December 18, 2024 @02:16PM (#42453792)
This might be the worst possible way to measure the net throughput of conscious decision making I've ever seen. A wildly ecologically invalid, serialized discrimination task.

Now take someone navigating a social situation with three simultaneous participants, actively listening, coordinating body language, interjecting, responding to questions... and you have a human being operating at a "bitrate" of information that is so many orders of magnitude removed from this bullshit psychometry task as to prompt the question: "what the actual are they talking about".

Re:The unbearable slowness of being: Why do we live at 10 bi... by neuralRiot on Wednesday December 18, 2024 @05:34PM (#42456217)
Using a computer analogy to try to understand the brain functions is ok as long as we remember that the brain is not actually one of them. There have been different technological analogies throughout history including hydraulic systems, telegraphic and telephonic lines, all of them might seem comical today but they were the best explanation at the time, same will be in the future with ours, comparing something like the brain (or rather the whole living being) to a mathematical processing device is more than short sighted. We try to explain everything from the engineering point of view by isolating things but that’s not how life or the universe works.
Re:The unbearable slowness of being: Why do we live at 10 bi... by t0mas88 on Wednesday December 18, 2024 @06:09PM (#42456528)
According to psychology research on human perception there is indeed something that you could call buffered IO in the human brain.

It's used in theories to explain why you can hear your name in a short sentence in a crowded room and then know what the sentence is. Including one or two words before your name. While if your name wasn't said, no attention is diverted to that sound and the "buffer" contents get dropped without retrieving the information.

Re:The unbearable slowness of being: Why do we live at 10 bi... by BehindBlueEyes on Thursday December 19, 2024 @11:36AM (#42463113)
Yes, and there's different buffers with different capacity for different types of perception according to these theories. Look up Baddeley & Hitch for details. I would guess there are similar buffers for other senses that didn't make it in the lectures in college.
Re:The unbearable slowness of being: Why do we live at 10 bi... by jknoepfler on Wednesday December 18, 2024 @02:11PM (#42453742)
But on the other hand, a "fast" debator from a high school debate team can process 260 words per second while compressing that down to notes, while simultaneously queuing up meaningful responses, while evaluating which/what to go with for a particular audience/judge, while listening for mistakes from their opponent. If you distill bitrate down to serialized responses to a canned psychometric task, sure, but why do we think that's the total throughput? It isn't, trivially, if we inspect what people do every day.
Re:The unbearable slowness of being: Why do we live at 10 bi... by burnte on Wednesday December 18, 2024 @03:21PM (#42454645)
260 words per SECOND? Are you sure about that? I can only assume you mean for skim/speed reading.
Re:The unbearable slowness of being: Why do we live at 10 bi... by jknoepfler on Wednesday December 18, 2024 @05:43PM (#42456314)
that's a funny typo, I apologize.
Re:The unbearable slowness of being: Why do we live at 10 bi... by burnte on Thursday December 19, 2024 @11:36AM (#42463117)
No need to apologize! We're all human!
Re:The unbearable slowness of being: Why do we live at 10 bi... by bsder on Wednesday December 18, 2024 @02:00PM (#42453619)
There is a difference between latency and throughput.
Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:07PM (#42453704)
True, maybe you can find a test which asks, instead of a single button click, to click one of 4 possibilities for a reaction?

EDIT: see appendix A.3 Perception

Re:The unbearable slowness of being: Why do we live at 10 bi... by Jensson on Wednesday December 18, 2024 @02:27PM (#42453947)
You mean like typing? Typing we click buttons accurately in sequence, people can type way faster than 10 bits per second.

Then consider something more complex like drawing, you draw way way way more than 10 bits a second.

Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:35PM (#42454070)
not like typing, which is largely automatic; conscious decisions per second.

EDIT: not the expanded bit rate, the optimally compressed bit rate, if that makes sense?

EDIT2: typing at 90 wpm is 1,5 wps, or <10 bps according to Shannon (~1 bit per letter, 5 letters per word)

Re:The unbearable slowness of being: Why do we live at 10 bi... by LPisGood on Wednesday December 18, 2024 @04:19PM (#42455365)
> not like typing, which is largely automatic; conscious decisions per second.

That’s kind of a cop out - at what point do very quick conscious decisions become “automatic.”

Re:The unbearable slowness of being: Why do we live at 10 bi... by Jensson on Wednesday December 18, 2024 @04:57PM (#42455860)
> EDIT2: typing at 90 wpm is 1,5 wps, or <10 bps according to Shannon (~1 bit per letter, 5 letters per word)

People can type way faster than 90 WPM, we talk about bitrate of the hardware here its the same even if you haven't practiced typing. And typing is still not what our consciousness is made to do, we have way higher bitrate than that when doing more native tasks such as running in the woods. You can't run in the woods without consciously thinking about each step and deciding where to put your foot next to not hurt your ankle and not collide with trees, that has a massive bitrate.

Re:The unbearable slowness of being: Why do we live at 10 bi... by 73kl4453dz on Wednesday December 18, 2024 @09:48PM (#42457905)
Running in the woods supports TFA: 180 steps per minute * 16 possible locations per step = 12 bits per second; maybe there are fewer or more possible footfall spots but no matter what it's more than 1 bit per second and less than 100. (and way less than 1e9)
Re:The unbearable slowness of being: Why do we live at 10 bi... by whatever0124 on Friday December 20, 2024 @08:56AM (#42471083)
Any FPS is this but with about a million possibilities (depends on the screen resolution). People can become crazy good at it.

Before you say it does not require decisions - you can have friendly fire on.

IO is the problem not processing power.

Re:The unbearable slowness of being: Why do we live at 10 bi... by FartyMcFarter on Wednesday December 18, 2024 @01:13PM (#42453168)
That still doesn't explain strange sentences in the article such as"

> Why does the brain need billions of neurons to process 10 bits/s?

Maybe the article is being intentionally disingenuous here? The brain is definitely not processing 10 bits/s, maybe a small part of it is.

I'd also say that you can make very complicated problems with only 10 bits of input (e.g. calculating busy-beaver of N), so "processing X bits" where X is a small value is no guarantee that this should be doable with a low amount of processing anyway.

Re:The unbearable slowness of being: Why do we live at 10 bi... by anticensor on Thursday December 19, 2024 @12:05AM (#42458571)
There is something wrong with that calculation: our speech output alone is 40 bits per second.