I didn't mean to imply that vacuum tubes stopped having uses or stopped improving. My main point is that they stopped being the primary source of electronics and digital processing innovation and progress.

Even if by chance neural/deep-nets stop being the primary source of AI innovation, I'm sure people will find and make improvements in them regardless.