Re:Where Is GPT in the Chomsky Hierarchy?
by suddenlybananas on Friday December 19, 2025 @03:34PM
(#46330574)
LLMs have absolutely nothing to do with truth. If anything the analogy is closer to syntax as LLMs are pure form, just language in absence of any context or reference.
Re:Where Is GPT in the Chomsky Hierarchy?
by enriquepablo on Friday December 19, 2025 @03:48PM
(#46330720)
LLMs tell you one thing and not its negation, this choice is semantic. "just language in absence of any context or reference" is a set that includes every valid text. The usefulness of LLMs is their ability to mostly respect whatever semantics you establish in the prompt in their choice of output.
Re:Where Is GPT in the Chomsky Hierarchy?
by suddenlybananas on Friday December 19, 2025 @06:22PM
(#46332142)
LLMs will definitely tell you a thing and its negation if you prompt them differently.
GPT is purely about semantics, about truth. To the extent that I think it can be said to be fundamentally informal in its dedication to truth, since it can easily be prompted to produce syntactically incorrect output - wrt the syntax of whatever language whose semantics determine the truth GPT is asked to reflect.
So I think this is a categorically incorrect question.
I mean, what is the fundamental syntax of the output of an LLM? It would have to be that any sequence of utf8 chars is valid.