Ilya gives numerous talks and interviews, and he's well worth listening to about technical matters. I listened to many of his talks recently, and the main theme is that scaling up compute works, and will continue to do so. His optimism about the potential of scaling to support deep learning has clearly guided his entire career, starting with his early success on AlexNet.