I like your take on this but isnt it overly optimistic? I have the feeling that this tech will hit the a wall pretty quickly like driverless car technology.

It looks great on the surface but it isn't anything like the kind of sci-fi ai I think we're aiming for. Not in anything but a superficial way at least.

It doesnt know when its wrong and just straight up lies constantly inventing all sorts of fantastical stuff.

I asked it for history of a small local area in Ireland and it created a bunch of castles and tribes that never existed.