I wonder if AI trained on other AI content inevitably leads to a garbage in garbage out scenario that gets worse over time or whether it actually improves, maybe even at a non linear rate?

I believe the former is true, because of financial and political incentives, but the latter isn’t unthinkable.