I'm not "worried" about it. Just observing that the race is on. I don't think it's necessarily a bad thing as long as the tech is in the hands of "the good guys".

I think as soon as you can get an AI to break a task down into smaller tasks, and make itself a todo list, you have the autonomy. You just kick it all off by asking it to improve itself. I doesn't have to "want" anything, it just needs to work.