Re:Comparing 60 LLMs with a set of 20 prompts
by adrian_b on Saturday September 09, 2023 @10:52AM
(#37446089)
I have not looked at all responses, but I have found interesting that at the question about the sisters of Sally, initially all LLMs have provided wrong answers.
Nevertheless, when the initial prompt has been augmented with "Let's think step by step.", that helped 2 LLMs to give the right answer: GPT 4 and ReMM SLERP L2 13B.
So at least for this kind of problem, there were 2 clear winners. The fact that one of them is GPT 4, is not a surprise.
Nevertheless, when the initial prompt has been augmented with "Let's think step by step.", that helped 2 LLMs to give the right answer: GPT 4 and ReMM SLERP L2 13B.
So at least for this kind of problem, there were 2 clear winners. The fact that one of them is GPT 4, is not a surprise.