News for hackers. Stuff that matters.

A comment on What Is Temperature in NLP?.

Re:What Is Temperature in NLP? by lxe on Monday March 13, 2023 @05:05AM (#35133019)
From what I understand top_k is the number of words it generates to pick from, and the top_p is the percentage of the top words it will use as the next word, correct?
[ Parent | on HN ]
Re:What Is Temperature in NLP? by albystein on Monday March 13, 2023 @01:00PM (#35138630)
I think it depends on the sampling/decoding method. Also, perhaps you could elaborate more on what you mean by top_p
[ Parent | on HN ]