News for hackers. Stuff that matters.

A comment on After 118 days, GPT Unicorn has produced a unicorn. Parent comment

Re:After 118 days, GPT Unicorn has produced a unicorn by rcme on Thursday August 10, 2023 @10:54AM (#37076925)
Relying on token probabilities seems like the exact opposite of random
[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by esafak on Thursday August 10, 2023 @01:13PM (#37078853)
"Random" is a loose term. We're discussing a technical subject. Talk about the distribution the random numbers are sampled from.
[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by sigmoid10 on Saturday August 12, 2023 @01:22PM (#37102318)
The neural network just generates a set of probabilities for all tokens. The actual next token is then sampled from this set, which is always random for T>0 (and in the case of GPT4 even for T=0, because of the way the model itself works).
[ Parent | on HN ]