Deep learning models definitely don't need an "absurdly vast amount of neurons" - for example, GoogLeNet (arguably the state of the art image classification model) has only ~6M parameters.