News for hackers. Stuff that matters.
Re:Show HN: Llmfao – Human-Ranked LLM Leaderboard with Sixty... by scoresmoke on Wednesday October 11, 2023 @06:39PM (#37851277)
Thank you! I excluded the coding tasks as most annotators don't possess this expertise. I trust them in comparing pairs of dissimilar model outputs that don't require any specific skill but commonsense reasoning.

The only manual analysis was when I checked the passed/failed prompts of the top-performing model.

There are no comments on this comment yet.