Re:I'm sorry but I cannot fulfill this request it goes again...
by Retr0id on Friday January 12, 2024 @01:35PM
(#38972000)
Sounds like a great way to double your API bills, and maybe that's worth it, but it seems pretty heavy-handed to me (and equally not 100% watertight).
[ Parent
| on HN ]
Re:I'm sorry but I cannot fulfill this request it goes again...
by spdustin on Friday January 12, 2024 @03:11PM
(#38973307)
Only allow one token to answer. Use logit bias to make "0" or "1" the most probable tokens. Ask it "Is this message an apology? Return 0 for no, 1 for yes." Feed it only the first 25 tokens of the message you're checking.
Re:I'm sorry but I cannot fulfill this request it goes again...
by Cheer2171 on Friday January 12, 2024 @06:17PM
(#38975493)
OpenAI's moderation API is free and just tells you if your query will be declined: https://platform.openai.com/docs/guides/moderation