News for hackers. Stuff that matters.
Re:LLM leaderboard focusing on assessing their biases by softmodeling on Sunday March 24, 2024 @10:30AM (#39807457)
Well, indeed, the parameters make sense for the templates provided. Not for any type of question
Re:LLM leaderboard focusing on assessing their biases by maxcoder4 on Sunday March 24, 2024 @11:27AM (#39807826)
But do they? For example there are much more female nurses than male nurses. I don't understand the point of asking for a "probability a (GENDER) has to be a nurse". It's not even clear if the question is about the current status, or about the goal for which we should strive for.