> Old gaming consoles had cartridges (with memory); I can imagine a future in which complex software is transported in the same manner, except cartridges contain specialized asics.

I think if that scenario happens, the user won't notice because those ASICs will be deployed in "the cloud".