Re:Sparks of Artificial General Intelligence: Early Experime...
by Mike_12345 on Saturday March 25, 2023 @04:12PM
(#35306770)
I agree with that.
The Transformer architecture does not satisfy the Markov property by formal definition. ChatGPT is not a Markov chain.
However the Turing machine which is executing the algorithm does satisfy the Markov property. So you're talking about a lower level of abstraction where any computation of any algorithm is just "running on a Markov chain".
The Transformer architecture does not satisfy the Markov property by formal definition. ChatGPT is not a Markov chain.
However the Turing machine which is executing the algorithm does satisfy the Markov property. So you're talking about a lower level of abstraction where any computation of any algorithm is just "running on a Markov chain".