News for hackers. Stuff that matters.

A comment on GPT-3 has no idea what it’s talking about. Parent comment

Re:GPT-3 has no idea what it’s talking about by hackinthebochs on Saturday August 22, 2020 @01:55PM (#24245853)
>Why should we expect a piece of technology with magnitudes less sophistication to be able to mimic higher order lifeforms?

Honeybees apparently have 1 million neurons compared to GPT-3's 175 billion parameters. Granted, there isn't a 1 to 1 correspondence between biological neuron and parameter. And considering much of the honeybees neuron's would be directed towards biological function and control mechanisms, whereas all of GPT-3's parameters are directed towards text prediction, the relevant expressive power of GPT-3 is plausibly much larger.

[ Parent | on HN ]
Re:GPT-3 has no idea what it’s talking about by newman8r on Saturday August 22, 2020 @02:20PM (#24246062)
I believe honeybees have closer to a million neurons, not 100 billion - according to this wikipedia list [1] - but perhaps it makes more sense to count the total number of neurons in the entire colony.

[1] https://en.wikipedia.org/wiki/List_of_animals_by_number_of_n...

[ Parent | on HN ]
Re:GPT-3 has no idea what it’s talking about by hackinthebochs on Saturday August 22, 2020 @02:35PM (#24246170)
Ha you're right. I was quickly scanning a google result and misread it to read 100 billion. Edited. That number should have struck me as unreasonable :)
[ Parent | on HN ]