Re:Show HN: Q&A with AI Trained on Bankruptcy Law
by dsubburam on Thursday August 10, 2023 @09:53PM
(#37084189)
I can think of a way for it to just decline to answer, after noticing that the question is not relevant to its target area. Thanks for the feedback!
There's a Reddit forum[1] for discussing personal bankruptcy, btw, if you're curious what the process looks like. (I found it interesting myself.)
Re:Show HN: Q&A with AI Trained on Bankruptcy Law
by quickthrower2 on Friday August 11, 2023 @01:52AM
(#37085513)
I guess your choices are fine tune on some RLHF, or system prompt. System prompt being the cheaper option :-). But this is one of those cases where perfection isn't needed. If someone is trying all out to make it say something wrong, they will find a way to succeed (that also works on Humans)
You might want to train it to give a generic answer to off topic questions, e.g. this happened:
Q what is 3+4
A court stated that "[T]he good-faith gateway asks whether the debtorI'm sorry faces, but the the kinds provided text of does problems not that contain information relevant to your justify question about the sum of 3 and Chapter 4.