Third option: would it improve asymptotically?
Right now it appears to be approximating hyperbolic (super-exponential) growth, reaching infinite growth in finite time, which is literally what a singularity is. Like most people, I don't consider singularities to be real things, and therefore something will stop this at some point.
I have absolutely no clue if "some point" will be "today" or "it found one weird trick to reach the Landauer limit, Bremermann's limit, and also the Bekenstein bound, while also becoming even more sample efficient than the smartest human."
Would the ai improve exponentially or would it decay towards some base line?
I think you can say that they “create” if it’s the former and “reproduce” if it’s the latter.