Willfully misunderstanding your interlocutor seems ungracious, you apparently know stochastic is an adjective, so why did you try to use it as a noun?

GPT-3 is conditioned on the entire input sequence as well as its own output, which is strictly NON-MARKOVIAN. In fact, the point in saying something is Markovian is exactly that: the state transition probability only depends on the current state.

But the current state could include all of the last N output tokens.

ANNs aren't Markov chains

Well, yes. And apples aren't oranges, but they share a lot of similar traits.

"Given a prompt, provide a completion" is what a Markov chain does. GPT-3 is exactly the same, in the sense that apples and oranges both satisfy your hunger.

Is calculator.exe the equivalent to TI-84?

I would say that a TI-84 is a glorified calculator.exe. The TI-84 is usually more effective, but they’re both calculators.