News for hackers. Stuff that matters.
Re:I'm sorry but I cannot fulfill this request it goes again... by Retr0id on Friday January 12, 2024 @01:35PM (#38972000)
Sounds like a great way to double your API bills, and maybe that's worth it, but it seems pretty heavy-handed to me (and equally not 100% watertight).
Re:I'm sorry but I cannot fulfill this request it goes again... by spdustin on Friday January 12, 2024 @03:11PM (#38973307)
Only allow one token to answer. Use logit bias to make "0" or "1" the most probable tokens. Ask it "Is this message an apology? Return 0 for no, 1 for yes." Feed it only the first 25 tokens of the message you're checking.
Re:I'm sorry but I cannot fulfill this request it goes again... by Cheer2171 on Friday January 12, 2024 @06:17PM (#38975493)
OpenAI's moderation API is free and just tells you if your query will be declined: https://platform.openai.com/docs/guides/moderation