Re:LLMs are better than you think at playing you
by SAI_Peregrinus on Sunday June 11, 2023 @08:15AM
(#36280654)
Multiple choice questions imply that other choices are excluded (unless an answer such as "all of the above" is a choice. So the implied question is:
a) Linda is a bank teller (and NOT active in the feminist movement)
b) Linda is a bank teller and is active in the feminist movement
What you want it to be asking here is:
a) Linda is a bank teller, and may or may not be active in the feminist movement
b) Linda is a bank teller, and is active in the feminist movement
Most college students have taken quite a few multiple-choice tests (particularly in the US, high-schools train for standardized multiple-choice tests). The question isn't asking what the mathematicians seem to think it's asking, because it's format conveys extra restrictions.
a) Linda is a bank teller (and NOT active in the feminist movement) b) Linda is a bank teller and is active in the feminist movement
What you want it to be asking here is:
a) Linda is a bank teller, and may or may not be active in the feminist movement b) Linda is a bank teller, and is active in the feminist movement
Most college students have taken quite a few multiple-choice tests (particularly in the US, high-schools train for standardized multiple-choice tests). The question isn't asking what the mathematicians seem to think it's asking, because it's format conveys extra restrictions.