Re:Hot take: GPT 4.5 is a nothing burger
by seanhunter on Sunday March 02, 2025 @10:53AM
(#43231653)
They have the Markov property that the next state depends only on the current state (context window plus the weights of the model) do they not? Any stochastic process which possesses that property is a Markov process/chain I believe.
[ Parent
| on HN ]
The universe has that property too.
But no, most LLMs have a tweakae 'temperature' parameter that introduces some randomness and sometimes have very interesting results.
Re:Hot take: GPT 4.5 is a nothing burger
by seanhunter on Sunday March 02, 2025 @11:36PM
(#43238346)
Temperature just changes how an llm samples from the token distribution so I wouldn’t think that constitutes “memory” that would contradict the Markov property