News for hackers. Stuff that matters.
Re:LLMs are still surprisingly bad at some simple tasks by never_inline on Monday September 22, 2025 @10:45AM (#45334180)
> Something I think would be interesting for model APIs and consumer apps to exposed would be the probability of each individual token generated.

Isn't that what logprobs is?

There are no comments on this comment yet.