News for hackers. Stuff that matters.
Re:Anthropic publishes the 'system prompts' that make Claude... by ben_w on Tuesday August 27, 2024 @03:10PM (#41371609)
> because confidently bullshitting unfortunately sometimes results in higher benchmark performance which looks good on competitor comparison reports

You've just reminded me that this was even a recommended strategy in some of the multiple choice tests during my education. Random guessing was scored equally as if you hadn't answered at all

If you really didn't know an answer then every option was equally likely and no benefit, but if you could eliminate just one answer then your expected score from guessing between the others was worthwhile.

There are no comments on this comment yet.