News for hackers. Stuff that matters.
Re:Understanding the role of individual units in a deep neur... by lamename on Monday December 07, 2020 @08:22AM (#25331882)
Perturbing units and observing change is so much like the early days of neurology and neuroscience. Lesion studies in post-surgery patients or those with stroke or brain damage told us a lot, removing part of the circuit and observing what changed.
Re:Understanding the role of individual units in a deep neur... by signa11 on Monday December 07, 2020 @08:30AM (#25331943)
yup. i remember reading about something called ‘optimal brain damage’ which aims at pruning non-essential weights from the network for faster training etc.