Yes, the key experiment was when they asked if Astra could improve the maths performance of Gemma 3 270M, a model which rarely looped, and it could not.

So, this is certainly very interesting (and very impressive regardless), but it's not nearly at the we-can-improve-everything-and-anything stage, even for very small LLMs.