It becomes clear once you progress through a few of the examples what this means.
You don't need tutorials and tool-tips, you just need to be able to learn by doing.*
*and users who don't shy away on the first hint of confusion.
Yes.
The problems absolutely illustrate the concept if you have a reliable overconfidence confidence bias. You do not need a background in psychology to understand "Hey, I feel 90% confidence, but am being surprised nearly 1 in 3 times. There's some kind of miscalibration going on there."
"Drag down the circle so that your belief covers all answers that you think are reasonable. This diagram is your belief graph."
I have no idea what a "belief graph" is, or how to use one. I though I had answered the question by entering a number into the field, but then I'm presented with this strange graph.
Perhaps I'm in the minority around here when it comes to my knowledge of this domain, but if this is a game intended for laypeople, you need to be really clear and assume I know nothing at all about your methods and practices. Explain to me what a belief graph is and how to use it. Either have a pre-game tutorial, or use tool tips.
That's my 2 cents.