> As such, we, as humans, generally have zero idea what is going on in someone else's brain when they do something unexpected (it is unexpected after all).

The thing is, we don't do unexpected things in front of each other all that often. Which is why neurotypical people generally do have a sense for each other's state of mind.

Aspies have trouble with this even in normal situations.