News for hackers. Stuff that matters.
Re:Sutskever: OpenAI board doing its mission to build AGI th... by hardwaresofton on Saturday November 18, 2023 @02:16AM (#38316463)
> But in one sentence, try asking ChatGPT to reverse a string of 20+ digits, like 473936482738338373926. It can't do it. It's a super trivial task, but it can't do it. Because it doesn't really understand anything. It's just an incredibly advanced Markov chain.

I agree with this statement, but why don't I see it described this way more?

It really feels like transformers are (large) parameterized markov chains but I never seen anyone describe it this way, is it just not a good approximation/hiding too much of the technical workings to be true?

There are no comments on this comment yet.