News for hackers. Stuff that matters.
Re:Keep your AI claims in check by hyferg on Monday February 27, 2023 @07:13PM (#34963993)
You can return log probs per token generated. This can be used to asses the confidence the model has in handling tasks which involve nominal data.

If that’s not helpful, were you getting at having the model return some rich data about the attention weights that went into generating some token?

Re:Keep your AI claims in check by jsemrau on Monday February 27, 2023 @07:38PM (#34964209)
For most of our models we return more information. Especially if you look at it from a vendor/customer perspective I believe this to be quite important.