What else is it then? Basically all statistical models are weighted averages. I'm not sure why deep learning would be any different.