There is no logical thinking involved. Output can appear to be real communication, but it's basically just a very advanced trick, that has some serious drawbacks.
So the model in production is probably frozen, but before that it went through multiple rounds of interaction with the world.
I am simply thinking of interaction here as similar to learning a language in a classroom. First the teacher provides sample questions/answers, then the teacher asks the students to come up with answers themselves, and tell them which one is better. The end result here is I think ChatGPT is quite good at answering questions and can pass as a human, especially if it's augmented with a fact database, so obviously wrong answers can be pruned.
We don't interact with the world directly, either. All we have are signals mediated through our nervous system.
I wonder why people keep saying this. Is it some type of psychological defense to future AI displacement?