Matrix math units are a smart use of silicon for many ML applications, true. But Von Neumann compute isn't going away. Neither are fixed function modules for shading, ray tracing and massively parallel GPGPU type applications. Also not video coding.

My point was that if training could emit an efficient video codec as a network of logic gates, rather than as a dense array of neural network weights, it might just produce something practical for video playback on mobile devices and video processing at hyperscale.