Why do you even assume that cowarding behind a castle with armed guards to keep neighbors at Bay are "reasonable defensive measures"?

Sounds to me you're exhibiting "elite panick" while being completely oblivious to it.