Willfully misunderstanding your interlocutor seems ungracious, you apparently know stochastic is an adjective, so why did you try to use it as a noun?

GPT-3 is conditioned on the entire input sequence as well as its own output, which is strictly NON-MARKOVIAN. In fact, the point in saying something is Markovian is exactly that: the state transition probability only depends on the current state.