That is, if I saw the two cups in my example naturally I'd say the obvious one holds more water, but often there'd be no point in putting it as a survey question if the obvious answer was the case. Therefore I'm almost sure the correct answer is the seemingly wrong one.
So I put that as the answer and get it right. But for whoever's running the survey, I'm probably messing up their results by meta-analysing the questions.
One or ours was deliberately set up so that prospect hires applying for a leadership position would end up with very, very, little in their empathy score if they chose answers that sound like the “right” ones for a leadership position. It was done to catch people off guard in their next interview, and see how they handled getting shown a result they’d very likely not agree with.
HR departments know these things are bullshit. They know people game the systems, exactly like people practice for the coding interview. The test and the results are often extremely irrelevant to anyone getting hired, it’s how people handle their results that’s important.
The entire branch of team-building/personality matching/management consulting/management training/management network facilitating is a fat unnecessary cow that enterprise organisations will never get rid of because they are very good at being “people skills” and positioning themselves with top management.
After a year of lockdowns, where they’ve been completely unable to execute their regular function, their absence have left no mark on our organisation though.
Whether or not their HR department is ran by a licensed phrenologist is a distant second concern.