News for hackers. Stuff that matters.

A comment on 3Blue1Brown: But what is a GPT? [video]. Parent comment

Re:3Blue1Brown: But what is a GPT? [video] by davekeck on Monday April 01, 2024 @06:46PM (#39900296)
> then some lower probability tokens may be chosen

Can you explain how it chooses one of the lower-probability tokens? Is it just random?

[ Parent | on HN ]
Re:3Blue1Brown: But what is a GPT? [video] by acchow on Monday April 01, 2024 @07:04PM (#39900428)
Reducing temperature reduces the impact of differences between raw output values giving a higher probability to pick other tokens.
[ Parent | on HN ]
Re:3Blue1Brown: But what is a GPT? [video] by acchow on Monday April 01, 2024 @09:23PM (#39901373)
Oops backwards. Increasing temperature...
[ Parent | on HN ]