I think that's exactly it. Age eleven is when I first saw my percentile written down, and before then I had some idea that I was smart; but I also knew about the phenomenon of failed prodigies, like Sidis, and I was terrified of failing to live up to my potential. And yes, the idea of a responsibility to live up to it was also there, very strongly.