News for hackers. Stuff that matters.
Re:The End of AI Frontiers by liuliu on Saturday November 07, 2026 @02:54PM (#50407477)
100 trillion parameters doesn't make any sense if your dataset is ~30 trillion tokens. My uneducated guess is 1/10 compression ratio is good and that point to ~300 to ~1000 trillion tokens, which again, doesn't make any practical sense.
Re:The End of AI Frontiers by sbierwagen on Saturday November 07, 2026 @03:07PM (#50407581)
Depending on how you count, the human brain is between 100 trillion and 1 quadrillion parameters, which is one guess as to why we're so much more sample efficient at learning than LLMs are.
Re:The End of AI Frontiers by Frost1x on Saturday November 07, 2026 @03:34PM (#50407803)
Unless quantum effects do infact play a role in consciousness. It’s not clear they do by any means, but if it did that could shift the understanding of our own minds and consciousness drastically. Otherwise we are just a dense complex network we can reproduce with enough money.
Re:The End of AI Frontiers by qlte on Saturday November 07, 2026 @03:49PM (#50407919)
I don't think you even need to go to speculative quantum stuff. A single biological neuron in isolation is a surprisingly complex system that resembles a small artificial neural net more than an artificial neuron in many ways. On top of an entire feedback system from diffusion of neurotransmitters which doesn't cleanly map to ANNs.

Trying to estimate equivalent "parameter size" of the brain when we only superficially understand behavior of individual neurons let alone how intelligence emerges from the connectome seems too speculative to be a particularly useful metric.

Re:The End of AI Frontiers by robotresearcher on Saturday November 07, 2026 @03:39PM (#50407827)
How many tokens does your brain input a day?
Re:The End of AI Frontiers by mschuster91 on Saturday November 07, 2026 @04:09PM (#50408094)
One key difference between humans and (current) LLMs is that we can actually judge the material we learn from at the time we're learning it, contextualize it and discard garbage when we spot it.

LLMs need an awful lot of handholding all the time, meanwhile humans get pretty good at it on their own.

Re:The End of AI Frontiers by jurgenburgen on Saturday November 07, 2026 @05:42PM (#50408733)
Synapses and LLM parameters are not equivalent.
Re:The End of AI Frontiers by cite_please on Saturday November 07, 2026 @06:48PM (#50409150)
In Silicon Valley they are.
Re:The End of AI Frontiers by slashdave on Saturday November 07, 2026 @05:34PM (#50408682)
The extra parameters are useful for optimization. Deep-learning relies on highly singular solutions.