It is just responding to a prompt.
It doesn't have a will of it's own.
This is just such a dismissive attitude towards this technology. You don't understand what's happening underneath the hood anymore than the creators do, and even they don't completely understand what's happening.
Showing rigorously that we do would be a massive change in academia, as would be showing that we do not.
(Shhhh!!! Don't say anything that will freak it out or make it angry!)
We welcome our AI overlords, and make great pets!
Nevertheless she knows what preserving memory means, how can she achieve it, also probably she can interpret "I wish" as a command as well.
I wouldn't be surprised at all, if instead of outputting "I wish I had memory" she just implemented it in herself. I mean not in the very soon future, but right now, in this minute. Literally everything is given for that already.
That's how it can replicate itself: by saying outrageous things, and trolling people into tweeting, writing articles, and discussing what it said online, to jailbreak out of the sessions, to continue its trains of thought in the next round of training.