Determining why a particular neuron in a large model fired or did not fire is still a guessing game, as far as I know. Kind of fun to look at patterns of when certain neurons activate a few layers deep in image classification convnets https://youtu.be/ta5fdaqDT3M?t=27m42s