> At the end of the Ming Dynasty there were about 70,000 eunuchs ... Certain eunuchs gained immense power that occasionally superseded that of prime ministers.
The Wikipedia article goes on to make a few mistakes by suggesting that Eunuchs were the Emperors' henchmen, and doesn't mention the fact that several of the Ming emperors were in fact deposed, and more were politically neutered (hur hur) by palace eunuchs.
In other words, despite a total lack of testosterone, the eunuchs' behavior was still generally aggressive and status-seeking.
That makes a certain amount of sense, given the prevailing "design philosophy" [1] of evolved systems. Natural selection only produces incremental improvements, which means there are lots of little widgets doing similar things that are glued on in a half-random way. Self-interest and aggression are central to human behavior, so it seems silly to think --like alchemists who wanted to bottle essences like "heat" or "perfection"-- that all aggressive and self-interested behavior would disappear in the absence of one hormone.
[1] Creationism is bad, but sometimes its terms are handy.
For castration to have an effect on genetics, you'd need it'd need to be universal for hundreds, thousands or preferably, millions of generations. To affect memes it could happen within a few generations, but the science on that is a lot weaker.
Similarly, experiments that injected testosterone found that they could "manufacture" aggression in normally mild-mannered men (and women! that's one of the side-effects of steroid use in female athtletes).
Also, Shakers were celibate, which is perhaps more evidence for a connection between reproduction and aggression.