News for hackers. Stuff that matters.
Re:The unbearable slowness of being: Why do we live at 10 bi... by tsimionescu on Wednesday December 18, 2024 @10:24AM (#42451177)
It seems very odd that the article seems to be measuring the information content of specific tasks that the brain is doing or specific objects that it is perceiving. But the brain is a general-purpose computer, not a speed-card computer, or English text computer, or binary digit computer, or Rubik's cube computer.

When you look at a Rubik's cube, you don't just pick out specific positions of colored squares relative to each other. You also pick up the fact that it's a Rubik's cube and not a bird or a series of binary digits or English text. If an orange cat lunged at your Rubik's cube while you were studying it, you wouldn't process it as "face 3 has 4 red squares on the first row, then an orange diagonal with sharp claws", you'd process it as "fast moving sharp clawed orange cat attacking cube". Which implies that every time you loom at the cube you also notice that it's still a cube and not any of the millions of other objects you can recognize, adding many more bits of information.

Similarly, when you're typing English text, you're not just encoding information from your brain into English text, you're also deciding that this is the most relevant activity to keep doing at the moment, instead of doing math or going out for a walk. Not to mention the precise mechanical control of your muscles to achieve the requisite movements, which we're having significant trouble programming into a robot.

Re:The unbearable slowness of being: Why do we live at 10 bi... by gtirloni on Wednesday December 18, 2024 @10:48AM (#42451422)
My thoughts exactly. It makes no sense to me that what I'm thinking and perceiving in real-time is the equivalent of 10 bit/s of data.
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @11:21AM (#42451847)
Has anyone here even read more than the title? The article literally explains that you perceive at a rate of 10^9 bits per second. But after filtering and preprocessing in the outer brain you are only left with about 10 bits per second for conscious processing for things like motor functions. Yes, you can see a Rubic's cube and perceive all sorts of facts about it and the environment at the same time. But try solving it with your hands while someone shows you a bunch of objects and asks you visual comprehension questions at the same time. You might still perceive those other objects, but consciously classifying them verbally is gonna be really difficult. It's no surprise that the feature space that your deeper brain can actively work on is quite limited.
Re:The unbearable slowness of being: Why do we live at 10 bi... by xattt on Wednesday December 18, 2024 @12:16PM (#42452480)
[delayed]
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @12:39PM (#42452780)
Consider normal text compression and you're left with a few bits at best for most of those "fast talkers/listeners." And the human brain is very good at compression.
Re:The unbearable slowness of being: Why do we live at 10 bi... by ghurtado on Wednesday December 18, 2024 @03:41PM (#42454903)
> And the human brain is very good at compression

Yes, but in order to measure its bitrate accurately you need to tell us whether that compression is gzip, zlib, zip or 7zip. They don't all produce the same results.

If we are going to be utterly ridiculous about this conversation, let's at least be complete.

Re:The unbearable slowness of being: Why do we live at 10 bi... by nottorp on Wednesday December 18, 2024 @03:59PM (#42455116)
And were those measurements made with vsync on by any chance?
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Thursday December 19, 2024 @03:10AM (#42459457)
How would that be relevant? The only relevant aspect for this discussion is that language is tightly compressible, which noone here has challenged yet. But I've seen noone come up with a true example where you'd be actively processing high entropy data at a rate that disagrees fundamentally with the paper.
Re:The unbearable slowness of being: Why do we live at 10 bi... by xattt on Wednesday December 18, 2024 @12:59PM (#42453030)
I feel like this is splitting hairs and moving goalposts. The pro side will always have some sort of explanation why it’s 10 bps or less without a way of actually proving it.

This is a frustrating article.

Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @03:27PM (#42454716)
>I feel like this is splitting hairs and moving goalposts.

How? The argument remains exactly the same and we're just discussed counterexamples to the statements of people who obviously don't get it.

Re:The unbearable slowness of being: Why do we live at 10 bi... by grumple on Wednesday December 18, 2024 @01:23PM (#42453265)
I can type at a rate faster than 10 bits/ second (about 2 characters / 16 bits! what a slow rate! I'm well above that, at least 24 bits/second!) and you aren't compressing that to less.

And that's while also moving my hands in extremely complex ways to perform the task, looking around my office, listening for threats / wife, observing the breeze from my fan, twiddling my toes on the balance board I don't use...

It's clickbait/ragebait. Well done to the title writer.

Re:The unbearable slowness of being: Why do we live at 10 bi... by 01HNNWZ0MV43FF on Wednesday December 18, 2024 @12:58PM (#42453018)
(Shannon estimates 11.82 bits per word, so 300 WPM is 59.1 bits per second)
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @03:30PM (#42454767)
The Hutter prize submissions can get compression factors >9 on english wiki text. And if you're listening to podcasts the entropy is probably even lower. The human brain is obviously a much better language model than anything we have today, so you can assume that the latent layer in your brain deals with much less than 60 bits per second.
Re:The unbearable slowness of being: Why do we live at 10 bi... by axus on Wednesday December 18, 2024 @05:01PM (#42455922)
Each second of listening we're perceiving the speaker's identity, what accent they are using, how fast they are talking, and what emotions they are showing. Those should count for the bit rate dealt with by the conscious brain.
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Thursday December 19, 2024 @03:06AM (#42459438)
Again: perception is not what we're talking about and the paper acknowledges that perceptive input is orders of magnitude larger. I challenge you to listen comprehensively to someone talking about a topic you don't know while identifying someone in a police lineup.
Re:The unbearable slowness of being: Why do we live at 10 bi... by gtirloni on Wednesday December 18, 2024 @12:15PM (#42452465)
You're missing my point. I'm saying that `try solving it with your hands while someone shows you a bunch of objects and asks you visual comprehension questions at the same time` is more than 10 bit/s of data being processed. I'm saying made up "tasks and outcomes" in this study are not a measure of the brain's throughput IN THE INNER LAYERS.
Re:The unbearable slowness of being: Why do we live at 10 bi... by wbl on Wednesday December 18, 2024 @11:59AM (#42452296)
What conscious motor processing? My motor functions largely take care of themselves while I daydream when walking or consider where I want to steer while driving.
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @12:36PM (#42452735)
That's just motor reflexes that don't even enter higher cognitive processing. But daydreaming probably does process at the same rate as normal language, as was explained in the other comment. Try doing algebra in your head while running an obstacle course you've never seen and you'll be much slower at everything.
Re:The unbearable slowness of being: Why do we live at 10 bi... by kens on Wednesday December 18, 2024 @11:56AM (#42452270)
> Has anyone here even read more than the title?

Since it costs $35.95 to read the article, probably not. Seriously, paywalling of scientific research is obviously wrong.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ziddoap on Wednesday December 18, 2024 @12:23PM (#42452580)
>Seriously, paywalling of scientific research is obviously wrong.

Agreed!

Here you go: https://arxiv.org/abs/2408.10234

Re:The unbearable slowness of being: Why do we live at 10 bi... by mystified5016 on Wednesday December 18, 2024 @11:26AM (#42451902)
10 bits per second is effectively nothing. Not even a single cell could operate at 10 bits per second. Every organic system would collapse immediately.
Re:The unbearable slowness of being: Why do we live at 10 bi... by sigmoid10 on Wednesday December 18, 2024 @11:36AM (#42452034)
Remember, this is an intermediate encoding of a hidden feature space between perception and planning. What you see at the start and the end of the neural network might be very different. Consider this: Typing at 60 words/minute, 5 characters/word and 8 bits/character gives a gross bit rate of 40 bits/second. With today's compression algorithms, you can easily get 4:1 reduction in data. That leaves you at approximately 10bits/second that are consciously processed in your brain. Probably even less since your brain might be much better at encoding language than even our best models. Even if some of those numbers are off by a certain factor, the number in the paper is certainly in the right ballpark when you consider orders of magnitude.
Re:The unbearable slowness of being: Why do we live at 10 bi... by cycomanic on Wednesday December 18, 2024 @02:22PM (#42453866)
So the argument is that compression is not processing? That's a very weird definition of processing. Also when we do this we can always argue that we get down to 10bit/s, just change the compression ratio.
Re:The unbearable slowness of being: Why do we live at 10 bi... by hathawsh on Wednesday December 18, 2024 @12:41PM (#42452811)
Another way to put it: try to perform a skill you have never practiced. For example, if you've never played the piano or tried to read sheet music, see how long it takes you to play a few notes correctly. It's complex enough that you'll very likely find yourself limited to around 10 bits per second. You shouldn't count the bits handled by visual processing, basic motor control, and other things you have practiced all your life. If you practice the skill, the skill moves out of your conscious processing and no longer counts toward the 10 bits per second.
Re:The unbearable slowness of being: Why do we live at 10 bi... by ordu on Wednesday December 18, 2024 @02:36PM (#42454079)
> You shouldn't count the bits handled by visual processing, basic motor control, and other things you have practiced all your life.

Ok, but how to count bits for your example with piano? It has 80 keys or so, isn't it? Should we take log2(80)=6.32...? Of if you are working with only part of the keyboard, maybe we should take log2(7)? How many bits per seconds of processing it takes to keep my hand on a keyboard in a right way that was shown by a tutor? How to measure it? Does my experience with a guitar makes it easier? How many bits easier?

Re:The unbearable slowness of being: Why do we live at 10 bi... by seanhunter on Thursday December 19, 2024 @04:26AM (#42459846)
Your argument boils down to “exclude anything faster than 10 bits per second, so then you’re limited to things which are 10 bits per second or less”. It’s extremely unconvincing.
Re:The unbearable slowness of being: Why do we live at 10 bi... by hathawsh on Thursday December 19, 2024 @03:11PM (#42465237)
That is a remarkably good argument. Well done, I'm convinced that this paper has little substance after all.
Re:The unbearable slowness of being: Why do we live at 10 bi... by burnte on Wednesday December 18, 2024 @12:59PM (#42453019)
I did read the summary and see what you saw, but that still leads me to believe the headline of the article is clickbait and that the authors don't understand that action signalling doesn't require the same bandwidth as information processing, but even then it's way more than 10b/s.

Look at a backhoe. It has a few levers and a couple pedals. EXTREMELY simple interface. Each lever and pedal is basically 1 bit for engage/disengage, but the operator has to process orders of magnitude more sensory info to operate it properly. You could use an arduino to control a backhoe, but you'd need quite a powerful computer to know what to tell the arduino to do. This shouldn't surprise anyone. Knowing how to use the tool well is always far more complicated than simply knowing how the tool operates.

Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @01:30PM (#42453349)
Here's a simple reaction test: https://humanbenchmark.com/tests/reactiontime

It's 1 bit (discriminate red vs. green) but I doubt many here can manage 100 ms, which is what it would take to implement 10 of those decisions per second.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ghurtado on Wednesday December 18, 2024 @03:37PM (#42454859)
Can you point me to the book that says that "Booleans" are encoded in the human brain just like in a binary computer and they take exactly 1 bit to store? I mean, why not assume error correction, while we are at it, or some kind of compression algorithm that reduces the size further?

If that sounds ridiculous to you, you are beginning to get it. Every single brain cell works on electric potential (a continous value). Not a single one of them can be said to be in the "zero" or "one" state (a discrete value).

Re:The unbearable slowness of being: Why do we live at 10 bi... by vrighter on Thursday December 19, 2024 @08:04AM (#42461048)
"bits of information" doesn't mean 1's and 0's. "bits" is a measure of entropy.

If you send an analog signal over a wire and the receiver on the other end can distinguish between 1024 different voltages reliably, then you sent 10 bits of information. Even though you sent neither a 0 nor a 1, but an analog voltage.

It's about the "information" as an abstract concept, not about how that information is encoded as data sent over some medium. I can send you the same thing thousands of times. I would have sent you lots of data, but 1000 copies of the same thing still only contains as much information as a single copy does.

Re:The unbearable slowness of being: Why do we live at 10 bi... by burnte on Wednesday December 18, 2024 @03:18PM (#42454617)
If you extend your arm straight out to point for example, that's significantly more than ten commands sent at once to your arm muscles. It's just non-conscious. That test measures a bunch of things all together too. Visual processing, color recognition, and conscious decision to act. I got just under 240, and considering everything I had to do, that's pretty neat.
Re:The unbearable slowness of being: Why do we live at 10 bi... by whatever0124 on Wednesday December 18, 2024 @02:22PM (#42453874)
This measures latency not processing power. You can have 10 b/s or 1 Gb/s of processing power with the same latency.
Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:32PM (#42454022)
yes, but the greater the latency, the greater the number of bits per period required to get the same throughput.

I come in around 250 ms on the latency, which means that to get up to 10 bps I'd need to actually be able to discriminate between 6 choices each time.

To get up to 100 bps?

Re:The unbearable slowness of being: Why do we live at 10 bi... by ssl-3 on Wednesday December 18, 2024 @01:44PM (#42453486)
Can the combination of mind and body only process reactive tasks serially, or can it process them with some amount of parallelism?

And is 100ms (I struggled to get below 180ms, myself) only the time needed to process, or does that include IO latency?

If it includes IO latency, then is there a buffer?

Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @01:51PM (#42453548)
> or can it process them with some amount of parallelism

I guess someone with two boxes handy could set them up next to each other and run two copies of this test to see if their reaction time holds up or if it lengthens?

EDIT: mine suffers greatly on dual wield: 225 -> 320 ms

see also https://news.ycombinator.com/item?id=42453704

Re:The unbearable slowness of being: Why do we live at 10 bi... by ssl-3 on Wednesday December 18, 2024 @02:01PM (#42453636)
I'll have a good think about whether we can process things in parallel or only in series the next time I decide to walk and chew gum while bouncing a ball, not tripping over things, and staying out of traffic.
Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:08PM (#42453718)
none of those activities need involve conscious decisions, however
Re:The unbearable slowness of being: Why do we live at 10 bi... by ssl-3 on Wednesday December 18, 2024 @02:26PM (#42453922)
Having a think is not a conscious activity?
Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:28PM (#42453962)
that, yes, sorry.

I meant walking, chewing gum, dribbling a basketball, and avoiding traffic.

Re:The unbearable slowness of being: Why do we live at 10 bi... by BehindBlueEyes on Thursday December 19, 2024 @11:28AM (#42463037)
Depends on expertise. Consider a toddler learning to walk, while eating a snack, carrying a toy and avoiding the cat.

Driving stick is a good example, as shifting gears requires conscious thought at first and becomes mostly automated with experience.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ziggyzecat on Thursday December 19, 2024 @01:10PM (#42464165)
Mh, balance that ball on your finger while keeping it in spin or dribble it between your legs while spinning your body around and see how many conscious decisions you make while not stepping into canine feces.
Re:The unbearable slowness of being: Why do we live at 10 bi... by jknoepfler on Wednesday December 18, 2024 @02:16PM (#42453792)
This might be the worst possible way to measure the net throughput of conscious decision making I've ever seen. A wildly ecologically invalid, serialized discrimination task.

Now take someone navigating a social situation with three simultaneous participants, actively listening, coordinating body language, interjecting, responding to questions... and you have a human being operating at a "bitrate" of information that is so many orders of magnitude removed from this bullshit psychometry task as to prompt the question: "what the actual are they talking about".

Re:The unbearable slowness of being: Why do we live at 10 bi... by neuralRiot on Wednesday December 18, 2024 @05:34PM (#42456217)
Using a computer analogy to try to understand the brain functions is ok as long as we remember that the brain is not actually one of them. There have been different technological analogies throughout history including hydraulic systems, telegraphic and telephonic lines, all of them might seem comical today but they were the best explanation at the time, same will be in the future with ours, comparing something like the brain (or rather the whole living being) to a mathematical processing device is more than short sighted. We try to explain everything from the engineering point of view by isolating things but that’s not how life or the universe works.
Re:The unbearable slowness of being: Why do we live at 10 bi... by t0mas88 on Wednesday December 18, 2024 @06:09PM (#42456528)
According to psychology research on human perception there is indeed something that you could call buffered IO in the human brain.

It's used in theories to explain why you can hear your name in a short sentence in a crowded room and then know what the sentence is. Including one or two words before your name. While if your name wasn't said, no attention is diverted to that sound and the "buffer" contents get dropped without retrieving the information.

Re:The unbearable slowness of being: Why do we live at 10 bi... by BehindBlueEyes on Thursday December 19, 2024 @11:36AM (#42463113)
Yes, and there's different buffers with different capacity for different types of perception according to these theories. Look up Baddeley & Hitch for details. I would guess there are similar buffers for other senses that didn't make it in the lectures in college.
Re:The unbearable slowness of being: Why do we live at 10 bi... by jknoepfler on Wednesday December 18, 2024 @02:11PM (#42453742)
But on the other hand, a "fast" debator from a high school debate team can process 260 words per second while compressing that down to notes, while simultaneously queuing up meaningful responses, while evaluating which/what to go with for a particular audience/judge, while listening for mistakes from their opponent. If you distill bitrate down to serialized responses to a canned psychometric task, sure, but why do we think that's the total throughput? It isn't, trivially, if we inspect what people do every day.
Re:The unbearable slowness of being: Why do we live at 10 bi... by burnte on Wednesday December 18, 2024 @03:21PM (#42454645)
260 words per SECOND? Are you sure about that? I can only assume you mean for skim/speed reading.
Re:The unbearable slowness of being: Why do we live at 10 bi... by jknoepfler on Wednesday December 18, 2024 @05:43PM (#42456314)
that's a funny typo, I apologize.
Re:The unbearable slowness of being: Why do we live at 10 bi... by burnte on Thursday December 19, 2024 @11:36AM (#42463117)
No need to apologize! We're all human!
Re:The unbearable slowness of being: Why do we live at 10 bi... by bsder on Wednesday December 18, 2024 @02:00PM (#42453619)
There is a difference between latency and throughput.
Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:07PM (#42453704)
True, maybe you can find a test which asks, instead of a single button click, to click one of 4 possibilities for a reaction?

EDIT: see appendix A.3 Perception

Re:The unbearable slowness of being: Why do we live at 10 bi... by Jensson on Wednesday December 18, 2024 @02:27PM (#42453947)
You mean like typing? Typing we click buttons accurately in sequence, people can type way faster than 10 bits per second.

Then consider something more complex like drawing, you draw way way way more than 10 bits a second.

Re:The unbearable slowness of being: Why do we live at 10 bi... by 082349872349872 on Wednesday December 18, 2024 @02:35PM (#42454070)
not like typing, which is largely automatic; conscious decisions per second.

EDIT: not the expanded bit rate, the optimally compressed bit rate, if that makes sense?

EDIT2: typing at 90 wpm is 1,5 wps, or <10 bps according to Shannon (~1 bit per letter, 5 letters per word)

Re:The unbearable slowness of being: Why do we live at 10 bi... by LPisGood on Wednesday December 18, 2024 @04:19PM (#42455365)
> not like typing, which is largely automatic; conscious decisions per second.

That’s kind of a cop out - at what point do very quick conscious decisions become “automatic.”

Re:The unbearable slowness of being: Why do we live at 10 bi... by Jensson on Wednesday December 18, 2024 @04:57PM (#42455860)
> EDIT2: typing at 90 wpm is 1,5 wps, or <10 bps according to Shannon (~1 bit per letter, 5 letters per word)

People can type way faster than 90 WPM, we talk about bitrate of the hardware here its the same even if you haven't practiced typing. And typing is still not what our consciousness is made to do, we have way higher bitrate than that when doing more native tasks such as running in the woods. You can't run in the woods without consciously thinking about each step and deciding where to put your foot next to not hurt your ankle and not collide with trees, that has a massive bitrate.

Re:The unbearable slowness of being: Why do we live at 10 bi... by 73kl4453dz on Wednesday December 18, 2024 @09:48PM (#42457905)
Running in the woods supports TFA: 180 steps per minute * 16 possible locations per step = 12 bits per second; maybe there are fewer or more possible footfall spots but no matter what it's more than 1 bit per second and less than 100. (and way less than 1e9)
Re:The unbearable slowness of being: Why do we live at 10 bi... by whatever0124 on Friday December 20, 2024 @08:56AM (#42471083)
Any FPS is this but with about a million possibilities (depends on the screen resolution). People can become crazy good at it.

Before you say it does not require decisions - you can have friendly fire on.

IO is the problem not processing power.

Re:The unbearable slowness of being: Why do we live at 10 bi... by FartyMcFarter on Wednesday December 18, 2024 @01:13PM (#42453168)
That still doesn't explain strange sentences in the article such as"

> Why does the brain need billions of neurons to process 10 bits/s?

Maybe the article is being intentionally disingenuous here? The brain is definitely not processing 10 bits/s, maybe a small part of it is.

I'd also say that you can make very complicated problems with only 10 bits of input (e.g. calculating busy-beaver of N), so "processing X bits" where X is a small value is no guarantee that this should be doable with a low amount of processing anyway.

Re:The unbearable slowness of being: Why do we live at 10 bi... by anticensor on Thursday December 19, 2024 @12:05AM (#42458571)
There is something wrong with that calculation: our speech output alone is 40 bits per second.
Re:The unbearable slowness of being: Why do we live at 10 bi... by kijin on Wednesday December 18, 2024 @12:45PM (#42452862)
Send a query to your favorite database. The database preprocesses hundreds of gigabytes of data, map-reduces it, and finally returns a single 32-bit integer, taking exactly 3.2 seconds to do so.

Nobody would say that the database can only process 10 bits per second. The query just happened to ask for a very simplified answer.

Re:The unbearable slowness of being: Why do we live at 10 bi... by scotty79 on Wednesday December 18, 2024 @12:53PM (#42452947)
Everybody would say it outputs 10 bits per second. And when it comes to consciousness simplified answers at 10 bits per second is the best you can get. This article asks why.
Re:The unbearable slowness of being: Why do we live at 10 bi... by kijin on Wednesday December 18, 2024 @01:16PM (#42453200)
It's an interesting question indeed, why the mind produces so little output compared to input.

Still, I get the feeling that the apparent bit rate of the conscious output is not the right metric to be measuring. There are so many ways in which the bit rate you're measuring could have been bottle-necked by factors outside of the mind, such as the speed at which you can move your tongue to articulate language, or a cultural expectation that prefers compact answers over chain-of-thought babbles. The mind also leaks a lot of information, both consciously and unconsciously, through side channels such as facial expression, gestures, and even variations in the rate of output itself.

Re:The unbearable slowness of being: Why do we live at 10 bi... by scotty79 on Wednesday December 18, 2024 @05:45PM (#42456327)
> It's an interesting question indeed, why the mind produces so little output compared to input.

My theory is that consciousness is super complicated and brain has barely enough juice to crank out any of it.

Conscious field of vision is about 2% of total field of vision and we observe the world by constantly swiping it with this 2%. This way we reuse both neural circuitry of our brains and also training data that would otherwise necessarily be spread across larger size of neural network if our conscious field of vision was larger.

So it short, conscious output is so small because we are dumb and short lived.

I also wouldn't say that there's a lot of information in the side channels. Properly compressed it's probably less than engaged conscious output.

Re:The unbearable slowness of being: Why do we live at 10 bi... by wruza on Wednesday December 18, 2024 @11:55AM (#42452260)
Otoh, I just spent a minute to even comprehend your idea. We are living in the information era, the era of dodging an orange cat has ended. And we suck at this new thing, really. We’re like slow af emulators of logic programs and tend to fallback to animal mode when tired or clueless.
Re:The unbearable slowness of being: Why do we live at 10 bi... by tmiku on Wednesday December 18, 2024 @01:36PM (#42453403)
Do you really think that the fundamental human act of the current era is running logic programs? I don't dispute that digital logic and its uses deeply changed humanity, but this is like calling humans "weak af imitations of steam engines" during the late-1800s railroad boom.

Calling actions/thoughts that follow a concrete list of logical rules/algorithms "animal mode" is deeply anti-human.

Re:The unbearable slowness of being: Why do we live at 10 bi... by wruza on Wednesday December 18, 2024 @05:28PM (#42456170)
I don't see how you could avoid logic and do literally anything useful that is not animalistic by nature. I can only imagine how <human-incomprehensible positive adjective> it would be to be able to remember more than 7 things, use more than one thread and grasp complex ideas by simply looking at their schema for a second, all that on average. Instead we slowly follow triсkles of data, constantly being carried away by nuances and distractions, getting overwhelmed and tired in no time. Our natural "logic" sees god behind a lightning and witch behind an accident, please don't defend it.

deeply anti-human

What's wrong with that, just look at us going, globally. Any pro-human thoughts, really? Never understood this clinging to the horribly limited nature of humanity only because it has some relatively nice pockets (which usually correlate with deep thought and negatively with the lack thereof).

Re:The unbearable slowness of being: Why do we live at 10 bi... by infogulch on Wednesday December 18, 2024 @11:26AM (#42451898)
Such reductionist analyses are reliably blind to the complexity of being embodied in physical reality.
Re:The unbearable slowness of being: Why do we live at 10 bi... by WXLCKNO on Wednesday December 18, 2024 @12:00PM (#42452317)
Should they analyse everything all at once? Your comment seems reductionist to the realities of writing a paper on a specific subject.
Re:The unbearable slowness of being: Why do we live at 10 bi... by akira2501 on Wednesday December 18, 2024 @07:05PM (#42456881)
Your brain does. It's not _one_ computer. It's dozens some interconnected and synchronized to others some with entirely independent control. It's why we have seizures, why optical illusions exist, and why you flinch when something moves at you in your peripheral vision.
Re:The unbearable slowness of being: Why do we live at 10 bi... by freehorse on Wednesday December 18, 2024 @08:14PM (#42457320)
They should just not claim the 10 bits/sec non-sense.
Re:The unbearable slowness of being: Why do we live at 10 bi... by scotty79 on Wednesday December 18, 2024 @12:55PM (#42452975)
Reductionism is the only way humanity ever progressed on anything.
Re:The unbearable slowness of being: Why do we live at 10 bi... by ghurtado on Wednesday December 18, 2024 @03:43PM (#42454938)
Right, just like when we used to believe that "unexplained thing happened" = "god". Can't really get more reductive than that.
Re:The unbearable slowness of being: Why do we live at 10 bi... by scotty79 on Wednesday December 18, 2024 @05:36PM (#42456231)
How's that reductive? It's epitome of holism.

Reductionism is setting everything but one thing aside and trying to figure out that one thing. Bringing in the second thing in only after you fail and trying again.

Re:The unbearable slowness of being: Why do we live at 10 bi... by lukan on Wednesday December 18, 2024 @01:28PM (#42453325)
That's debatable. To me declaring that the world was made in a simple way like this and just listen to the priests was reductionism of the wrong kind.

I know the kind you mean though, reducing external factors(like air), so you can isolate gravity as a force unrelated to density by finding out in a vacuum a feather and a metal ball fall with the same speed.

(As for the paper I have not yet made up my mind.)

Re:The unbearable slowness of being: Why do we live at 10 bi... by scotty79 on Wednesday December 18, 2024 @06:33PM (#42456708)
I'm not sure why reductionism brings simplicity to anyones mind. Yes, you consider one thing at a time, but there are billions of such single things to explain. And isolating one is a challenge in its own right.
Re:The unbearable slowness of being: Why do we live at 10 bi... by freehorse on Wednesday December 18, 2024 @08:16PM (#42457325)
Yes but reductions have implicit or explicit assumptions. When our reductions give non-sensical results (10 bits/sec) we should not take these results seriously/understand them as an artifact of our reductions, rather than taking them seriously and giving them ontological existence.
Re:The unbearable slowness of being: Why do we live at 10 bi... by colordrops on Wednesday December 18, 2024 @11:57AM (#42452278)
The PhD student writing this could be excused for being young an inexperienced but their advisor, tagged second on the paper, should have cut this off at the pass.
Re:The unbearable slowness of being: Why do we live at 10 bi... by ComplexSystems on Wednesday December 18, 2024 @01:06PM (#42453101)
On the other hand, the amount of actual entropic "information" that is processed when you identify a Rubik's cube as such may be nowhere near as much as you think it is, and most importantly, 10 bits may be nowhere near as little as you think it is.

If we use your example, which is that of identifying an object, we may simply ask the entropy of what the distribution of possible objects-to-be-identified is at t=0, prior to any analysis. Saying we can resolve 10 bits of this entropy per second is equivalent to saying that we can identify one object from a uniform distribution of 1024 per second. Let's suppose this is a low estimate by several orders of magnitude, and that it's really one from a billion objects instead that you can identify per second. Then this would still only be about 30 bits/sec.

None of this changes the main thesis of the paper, which is that this is much lower than the 10⁹ bits/sec our sensory systems transmit.

Re:The unbearable slowness of being: Why do we live at 10 bi... by FartyMcFarter on Wednesday December 18, 2024 @01:09PM (#42453127)
But you don't just perceive an object's category (like "cat"). We also perceive a high amount of detail about the object - colour, pattern, behaviour, we make comparisons to past behaviour, predictions of what's likely to happen next and so on.

Sure, some parts of the brain don't receive all that detail, but that's necessary for abstraction. If you pumped all the sensory data everywhere, the brain would get overwhelmed for no reason.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ComplexSystems on Wednesday December 18, 2024 @04:53PM (#42455815)
That 30 bits was not literally intended to represent only the object's noun category, but even if it did, none of the additional pieces of information you would like to add are going to change this picture much, because what one would think of as a "high amount of detail" is not actually all that high in terms of the logarithmic growth of the entropy.

Take color: suppose the average person has 16 baseline colors memorized, and then a few variations of each: each one can be bright or dark, saturated or pastel. That would be about 6 bits for color. If you have an eye for color or you're an artist you may have some additional degrees of freedom. Hell, a computer using RGB can only represent 24 bits worth of color, maximum. I am going to suggest this stuff gets cognized less than 10 bits worth for the average person; let's just say 10.

Now, of course, people can memorize more than one color. If colors are independently distributed uniformly at random, then processing N colors requires 10N bits. But of course they aren't, so the entropy is less. But again, let's just say they were. So how many color combinations can you process per second? I would say it's a bit of a challenge to memorize a set of 10 arbitrary drawn colors shown for a second. Most people couldn't continuously do that at a rate of 10 colors per second. That would be 100 bits/sec of info.

The point is that you really don't perceive all that much. You show the average person a Rubik's cube, there is no way they're going to remember the exact pattern of colors that they saw, unless the cube were solved or something. They will perceive it as "multicolored" and that's about it.

Adding behavior, texture, etc doesn't change this picture. None of this stuff is even close to 10^9 bits of entropy, which would be 2^1,000,000,000 different equally likely possibilities.

Re:The unbearable slowness of being: Why do we live at 10 bi... by dantillberg on Wednesday December 18, 2024 @01:10PM (#42453141)
> deciding that this is the most relevant activity to keep doing at the moment, instead of doing math or going out for a walk.

How many bits of actual decision is going on here, as compared to the period of time that decision applies to?

For example, if a person decided once per second whether or not to go for a walk, that could be 1 bit per second. But if that person is constantly transitioning back and forth between walking and not-walking, we could consider their behavior pathological. Instead, for most people, the information density of these decisions is quite low, i.e. the per-second decision bits are very compressible.

Personally, I only decide whether to go for a walk (or not) _at most_ once every few minutes. Even if we add in bits for "where" and "precisely when" and "how long", I think we're still at just a small fraction of 1 bit per second.

Re:The unbearable slowness of being: Why do we live at 10 bi... by dsr_ on Wednesday December 18, 2024 @01:21PM (#42453243)
Your conscious planner may be making 1 decision/second, but your senses, proprioception, balancing system, etc. are handing you about a gigabit/second of data, most of which never rises to your conscious attention.

When I'm reading, that's roughly 2000 bits/second, but I am engaging it with model-making systems that can completely enrapture me.

I/O is not the same as computation; conscious computation is not the same as all computation.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ChrisClark on Wednesday December 18, 2024 @01:39PM (#42453444)
Yeah, that's what the paper is talking about. A whole lot of input vs. a small amount of conscious focus.
Re:The unbearable slowness of being: Why do we live at 10 bi... by gf000 on Wednesday December 18, 2024 @03:01PM (#42454410)
There is a whole "OS" in the background that is way more complex than all of our programmed systems. I may be hyped focusing on a complex program and really not think about anything else, but my body is still constantly senses, processes, and reacts to signals. E.g. I'm not ragdoll falling to the ground, which requires holding balance and tone, which is far from trivial. I also constantly listening to every possible danger, which would immediately override my current activity. I also react to internal signals like hunger or pain.

A bit dumb, but maybe relevant comparison might be asking why can an Apple Watch stay on for a single day only on a charge, while Garmin can do 2 weeks/a month? Because one is a general purpose computer, while the other is an embedded software that can only ever do that few things it is preprogrammed to do.

Re:The unbearable slowness of being: Why do we live at 10 bi... by wizzwizz4 on Wednesday December 18, 2024 @04:36PM (#42455607)
I don't see your comparison as relevant. I'm a metre away from a nine-year-old Android 6 phone that can easily go a month on a single charge (while tracking its location!). Your Apple Watch is (a) constantly using its radio, (b) running a fairly high-end graphics chip, and (c) actively probing your body at intervals. Nothing to do with software.
Re:The unbearable slowness of being: Why do we live at 10 bi... by ccozan on Wednesday December 18, 2024 @04:47PM (#42455737)
I think you lost the actual comparison. Is not about Android and iOS.

Is about having a ton of mini specific "computers" vs. the very generic conscience.

For example all the balancing, background hearing, hungry, thirsty , and so on are very specific zones in the brain. While our conscient mind is doing...well, whatever we like in a very generic way, basically keeping the joy of living on.

Re:The unbearable slowness of being: Why do we live at 10 bi... by gf000 on Wednesday December 18, 2024 @11:27PM (#42458434)
I mentioned two watches with similarly sized batteries.
Re:The unbearable slowness of being: Why do we live at 10 bi... by wizzwizz4 on Thursday December 19, 2024 @05:52AM (#42460287)
The phone battery is only about twice the volume of a smartwatch battery.
Re:The unbearable slowness of being: Why do we live at 10 bi... by lukan on Wednesday December 18, 2024 @01:18PM (#42453216)
"Personally, I only decide whether to go for a walk (or not) _at most_ once every few minutes. "

Consciously. Subconsciously much more is going on.

Re:The unbearable slowness of being: Why do we live at 10 bi... by rahimnathwani on Wednesday December 18, 2024 @03:09PM (#42454511)

  Personally, I only decide whether to go for a walk (or not) _at most_ once every few minutes.
Just because usually the decision is 'keep the current course' that doesn't mean no decision has been made.
Re:The unbearable slowness of being: Why do we live at 10 bi... by timerol on Wednesday December 18, 2024 @03:31PM (#42454773)
> Personally, I only decide whether to go for a walk (or not) _at most_ once every few minutes.

And yet, if I walked into your office and shouted your name, you would have less than a second of reaction time, indicating that you are processing all sound around you and deciding whether to get up and talk to someone pretty much continuously.

Re:The unbearable slowness of being: Why do we live at 10 bi... by causi on Wednesday December 18, 2024 @01:20PM (#42453234)
The vast majority of the brain's processing power, including conceptual processing, is not conscious. Conscious thought is the framebuffer of the mind, subconscious is the RAM.
Re:The unbearable slowness of being: Why do we live at 10 bi... by ozim on Wednesday December 18, 2024 @04:26PM (#42455462)
Don’t forget typing in English is also outcome of processing all the context.

Also not so conscious context like „I am writing a reply on HN not on Reddit - making obvious silly pun about cats is not going to make upvotes - making quasi intellectual comment about subconscious processing should earn me some”.

Re:The unbearable slowness of being: Why do we live at 10 bi... by benreesman on Wednesday December 18, 2024 @05:10PM (#42456013)
I’m not any good at Rubik’s Cube, and to me it looks like a bunch of colored squares.

But stuff I am good at? I don’t see it at all. A terminal? I never have any truly tangible conscious recollection of serious coding.

It might be the same for people good at Rubik’s Cube.

Re:The unbearable slowness of being: Why do we live at 10 bi... by ggm on Wednesday December 18, 2024 @06:22PM (#42456616)
> But the brain is a general-purpose computer, not a speed-card computer, or English text computer, or binary digit computer, or Rubik's cube computer.

Look, I like the sentence. I like it so much I might steal it. But, that said I think analogising what the brain does to "general purpose computer" is a bit awry because we can invent algorithms, and given a process we can implement algorithms but I still tend to think there is something ineffable about thought/cognition which is NOT general purpose computation. It's a heuristic. I dunno what I think.

Re:The unbearable slowness of being: Why do we live at 10 bi... by PittleyDunkin on Wednesday December 18, 2024 @06:52PM (#42456798)
The computer analogy is definitely off. For one thing, rationality is kind of bolted on to our linguistic ability. It's not deeply seated in our brain; it takes substantial energy to engage in logical reasoning and we're not that great at it; even very skilled mathematicians make trivial mistakes.

Deeper in our brain is reasoning about causality. But even that is more of an input to our reactions and emotions than it is as a consciously accessible function, and it too is often wrong.

As you said, it's a heuristic. We certainly can't solve the halting problem with brain magic.

Re:The unbearable slowness of being: Why do we live at 10 bi... by Vecr on Wednesday December 18, 2024 @07:17PM (#42456977)
Implementing algorithms doesn't need a computer, and it doesn't need something that's not a computer.

That said, with enough willpower why couldn't you implement a universal Turing machine in your brain? I think you would need external memory (a tape) but that's not a problem.

Re:The unbearable slowness of being: Why do we live at 10 bi... by fzeindl on Thursday December 19, 2024 @01:30AM (#42458971)
Could the 10bits be some sort of instruction-set-address-width?

Meaning that while you are solving the rubik‘s cube, your brain has the capacity of switching into one of 2^10=1024 possible next states, which might fire nerve impulses for the body and also come with a new set of 1024 next states?

When focusing on the cube about 20 or 30 of the next states could be related to the cube, while the rest is concerned with bodily sensations, other thoughts etc.

What if learning something well meant that less states need to be reserved for the task/cube at hand because the decision tree going forward has become more efficiently packed, so more states are open for something else.

Re:The unbearable slowness of being: Why do we live at 10 bi... by seanhunter on Thursday December 19, 2024 @04:33AM (#42459889)
THe 10 bits is just very obviously made-up nonsense. The brain doesn’t operate on anything like a binary system, sensory data is not digitally encoded - it is all continuous data. Even the abstract kind of answers its own question. It says sensory data is something like the order of 10^9 bits per second but the “information throughput” is 10 bits per second. It asks “why do we need billions of neurons to process 10 bits per second?” Well we clearly don’t because that’s clearly not what we do. We process 10^9 bits per second, and we do a bunch of things which aren’t just processing sensory data as well. And on top of that we do things which aren’t measured in the 10 bits per second also.
Re:The unbearable slowness of being: Why do we live at 10 bi... by fzeindl on Thursday December 19, 2024 @07:48AM (#42460930)
> sensory data is not digitally encoded - it is all continuous data

That might be correct but as far as I know the brain has circuits that fire periodically with a certain frequency (what brain waves are about). If such frequencies steer some kind of gate than you do have a kind of digital logic with 1 being where the brain waves cross the zero line.

Re:The unbearable slowness of being: Why do we live at 10 bi... by josefx on Thursday December 19, 2024 @12:00PM (#42463382)
> If such frequencies steer some kind of gate than you do have a kind of digital logic with 1 being where the brain waves cross the zero line.

What makes you think that this is the case? If someone touches you from behind do you immediately fall over dead from sensory overload? Do you react as if you where punched in the gut? Do you look over your shoulder to check who it is? Or do you fail to notice it until they break a bone? There is a significant amount of inputs where the reactions are not just zero or one but happen on a scale, your digital 1 or zero is more likely to be a 1.0 or 0.0 of a numeric type with unknown bit depth, lets go with 80bit since x87 is just the worst and completely blows the 10bit claim.

Re:The unbearable slowness of being: Why do we live at 10 bi... by fzeindl on Wednesday December 25, 2024 @01:06AM (#42507178)
> What makes you think that this is the case? If someone touches you from behind do you immediately fall over dead from sensory overload?

My point was not that reactions/feelings etc are switched by a signal being 1 or 0, just that sort-of-digital signals (line "on" or "off") are possible within the brain.

My idea about the instruction-set I was talking about earlier was not that it immediately switches behaviours on or off, but that it selects the next, slightly different or deeper "brain circuits / loops" to get activated and shift the whole apparatus towards finally acting out a certain behaviour.

But, as you point out, that is all unfounded speculation.

Re:The unbearable slowness of being: Why do we live at 10 bi... by atoav on Thursday December 19, 2024 @04:13AM (#42459748)
[delayed]