News for hackers. Stuff that matters.
Re:ChatGPT terms disallow its use in providing legal and med... by joquarky on Wednesday November 05, 2025 @09:55PM (#45830863)
I thought that temperature can never actually be zero or it creates a division problem or something similar.

I'm no ML or math expert, just repeating what I've heard.

Re:ChatGPT terms disallow its use in providing legal and med... by ChadNauseam on Wednesday November 05, 2025 @10:35PM (#45831085)
That's an implementation detail I believe. But what I meant was just greedy decoding (picking the token with the highest logit in the LLM output), which can be implemented very easily