News for hackers. Stuff that matters.
Re:Show HN: Calculate confidence score for OpenAI JSON output by manidoraisamy on Thursday April 10, 2025 @11:22AM (#43644808)
Does it support Claude?
Re:Show HN: Calculate confidence score for OpenAI JSON output by QueensGambit on Thursday April 10, 2025 @11:27AM (#43644872)
Not yet. @promptrepo/score relies on token-level logprobs, which OpenAI exposes for their models. But, Anthropic’s Claude currently doesn’t expose token-level confidence (like logprobs) in their API. So, we can’t support Claude until they do. We’d love to add support if/when Claude exposes this capability.