Unexpected impasse. Multiple steps. Requires navigation across multiple pages and applications.
Just taking the test is a Level 3 task.
One of the hardest computer tests I've ever taken.
Only 2 out of 6 questions had anything to do with UI/UX - the rest were either reading comprehension and/or basic math.
From the 2 that dealt with UI/UX, both were extremely hard, in one of them I had to send an email, get a token and navigate the site to send another email.
If this is what the results are based on, I wouldn't base any UI/UX decisions for web products on the results of this test.
For example... at the start of the test, there's a "Please press 'ENTER' to continue"...
A) My keyboard has a return key, but no enter key.
B) It's a button. Has the test started yet, because I'm not sure if you're talking about the button, or the non-existent key on my keyboard.
C) You're making me think, and the test may or may not have started yet.
Maybe my reading comprehension skills are lower than I'd like to admit. Or maybe your UI makes smart people stupid.
Am I missing something?
/am probably more computer illiterate than I realized
It's very concerning to me that they didn't include screenshots of this simulation site in their report. The pages and pages of data are meaningless without knowing what they were actually measuring.
Incidentally, while I got every question right, I could easily imagine myself getting one or two of them wrong. Not out of stupidity, just bad luck. The question asking about the impact of educational attainment had at least 2 sentences that plausibly answered it, yet the correct answer was to highlight just 1 of those sentences.
I did the demo test tasks. I think their test UI is pretty bad. But I feel like anybody who's used email could probably figure most of it out.
http://www.oecd.org/skills/ESonline-assessment/
I have to admit I found it somewhat difficult, it's not surprising that most people performed poorly on it.