News for hackers. Stuff that matters.
Re:Claude 3 model family by kenjackson on Monday March 04, 2024 @05:10PM (#39596830)
I got an answer with GPT-4 that is mostly wrong:

"Sally has 2 sisters. Since each of her brothers has 2 sisters, that includes Sally and one additional sister."

I think said, "wait, how many sisters does Sally have?" And then it answered it fully correctly.

Re:Claude 3 model family by sigmoid10 on Monday March 04, 2024 @05:15PM (#39596875)
The only way I can get it to consistently generate wrong answers (i.e. two sisters) is by switching to GPT3.5. That one just doesn't seem capable of answering correctly on the first try (and sometimes not even with careful nudging).
Re:Claude 3 model family by m_fayer on Monday March 04, 2024 @05:39PM (#39597104)
A/B testing?