Forget the biological connection, I'm sitting here waiting for someone to write a paper about how gradient descent and backprop are basically equivalent to the platonic notion of the dialectic within epistemology.

I wouldn't throw out biological plausibility, especially with the spiking neural network variant of them...