News for hackers. Stuff that matters.
Re:The Computer Scientist Peering Inside AI’s Black Boxes by sdwr on Monday May 01, 2023 @09:53PM (#35782238)
Same thing as the brain pretty much, except we have root control over the NN in a way we don't with the brain.

To my knowledge, some angles have been explored. Finding which inputs maximally stimulate indiv neurons, and tracing that up the chain (there was a fantastic article that did this on ImageNet). Then ablations, as you mentioned. And finally, rerunning the same training data on differently sized + shaped architectures.

AI systems are missing at least one level of complexity. All neurons in a NN layer fire simultaneously, unlike brain neurons, which trigger each other async.

Re:The Computer Scientist Peering Inside AI’s Black Boxes by janalsncm on Monday May 01, 2023 @11:31PM (#35783000)
The brain is heterogenous in ways that a neural network needn’t be. Certain brain regions definitely perform certain functions, certain regions are hardwired to other regions. You can chop out a chunk of a person’s brain and they’ll be completely unable to do certain things.

Afaik the properties you’re referring to on AlexNet (the network trained to perform on Image Net) have to do with the nature of repeated convolution operations which, while interesting, is not as deeply insightful as I believe the article is aiming for.