> we'll need quite a few breakthroughs before usable Agent AIs are a thing. Insights on the order of importance as, say, backpropagation and using GPUs.

I think a 10x-100x increase in efficiency is going to come soon, based on more research into efficient hardware and efficient models. New algorithms, new hardware and especially a lot of money and talent invested in research are going to power the next step.