> A lot of these safety evaluations strike me as pretty silly. How much are we really learning from stuff like this?

This seems like something we're interested in. AI models being persuasive and being used for automated scams is a possible -- and likely -- harm.

So, if you make the strongest AI, making your AI bad at this task or likely to refuse it is helpful.