Yes, it's irrational, but usually if you ask someone to really unpack why they fear X, they can explain an exact scenario. Often just the process of explaining it oneself helps you get over the fear.

Children certainly fear negative judgement. Think how many times they hear the word "no" and get a nasty look from their parents.