Re:OpenAI chief goes before US Congress to propose licenses ...
by chpatrick on Tuesday May 16, 2023 @10:23AM
(#35962309)
Neither is text generation as you continue generating text.
[ Parent
| on HN ]
Re:OpenAI chief goes before US Congress to propose licenses ...
by shanebellone on Tuesday May 16, 2023 @10:39AM
(#35962516)
LLM is stateless.
Re:OpenAI chief goes before US Congress to propose licenses ...
by chpatrick on Tuesday May 16, 2023 @10:48AM
(#35962638)
On a very fundamental level the LLM is a function from context to the next token but when you generate text there is a state as the context gets updated with what has been generated so far.
Re:OpenAI chief goes before US Congress to propose licenses ...
by shanebellone on Tuesday May 16, 2023 @10:56AM
(#35962744)
"On a very fundamental level the LLM is a function from context to the next token but when you generate text there is a state as the context gets updated with what has been generated so far."
Its output is predicated upon its training data, not user defined prompts.
Re:OpenAI chief goes before US Congress to propose licenses ...
by chpatrick on Tuesday May 16, 2023 @11:03AM
(#35962826)
If you have some data and continuously update it with a function, we usually call that data state. That's what happens when you keep adding tokens to the output. The "story so far" is the state of an LLM-based AI.
Re:OpenAI chief goes before US Congress to propose licenses ...
by shanebellone on Tuesday May 16, 2023 @11:12AM
(#35962948)
'If you have some data and continuously update it with a function, we usually call that data state. That's what happens when you keep adding tokens to the output. The "story so far" is the state of an LLM-based AI.'
You're conflating UX and LLM.
Re:OpenAI chief goes before US Congress to propose licenses ...
by chpatrick on Tuesday May 16, 2023 @11:25AM
(#35963136)
I never said LLMs are stateful.
Re:OpenAI chief goes before US Congress to propose licenses ...
by shanebellone on Tuesday May 16, 2023 @11:55AM
(#35963596)
"I never said LLMs are stateful."
You said it multiple times.
On that note, goodbye.
Re:OpenAI chief goes before US Congress to propose licenses ...
by dang on Tuesday May 16, 2023 @02:00PM
(#35965442)
Please don't do flamewar on HN. It's not what this site is for, and destroys what it is for.
Re:OpenAI chief goes before US Congress to propose licenses ...
by shanebellone on Tuesday May 16, 2023 @02:08PM
(#35965534)
Really?
Delete my account.
Re:OpenAI chief goes before US Congress to propose licenses ...
by danenania on Tuesday May 16, 2023 @12:58PM
(#35964615)
You're being pedantic. While the core token generation function is stateless, that function is not, by a long shot, the only component of an LLM AI. Every LLM system being widely used today is stateful. And it's not only 'UX'. State is fundamental to how these models produce coherent output.
Re:OpenAI chief goes before US Congress to propose licenses ...
by shanebellone on Tuesday May 16, 2023 @02:02PM
(#35965456)
"State is fundamental to how these models produce coherent output."
Incorrect.
Re:OpenAI chief goes before US Congress to propose licenses ...
by alpaca128 on Tuesday May 16, 2023 @11:25AM
(#35963122)
> Its output is predicated upon its training data, not user defined prompts.
Prompts very obviously have influence on the output.
Re:OpenAI chief goes before US Congress to propose licenses ...
by shanebellone on Tuesday May 16, 2023 @11:52AM
(#35963561)
"Prompts very obviously have influence on the output."
The LLM is also discrete.
Re:OpenAI chief goes before US Congress to propose licenses ...
by jazzyjackson on Tuesday May 16, 2023 @11:06AM
(#35962858)
the model is not effected by its inputs over time
its essentially a function that is called recursively on its result, no need to represent state
Re:OpenAI chief goes before US Congress to propose licenses ...
by chpatrick on Tuesday May 16, 2023 @11:27AM
(#35963153)
Being called recursively on a result is state.
Re:OpenAI chief goes before US Congress to propose licenses ...
by jazzyjackson on Tuesday May 16, 2023 @01:21PM
(#35964944)
if you say so, but the model itself is not updated by user input, it is the same function every time, hence, stateless.