Re:Show HN: Calculate confidence score for OpenAI JSON output
by QueensGambit on Thursday April 10, 2025 @11:27AM
(#43644872)
Not yet. @promptrepo/score relies on token-level logprobs, which OpenAI exposes for their models. But, Anthropic’s Claude currently doesn’t expose token-level confidence (like logprobs) in their API. So, we can’t support Claude until they do. We’d love to add support if/when Claude exposes this capability.
[ Parent
| on HN ]
There are no comments on this comment yet.