That happened indeed and I don't think it was pretty. Although you get some exceptions, like maybe a few of the Antonines. (That didn't end well with Commodus.)