I would leave early if the benefits were not great and I found something better (normally something you do upfront when possible), if the culture was toxic, if you were overworked constantly, if you weren't building new skills, if the networking wasn't good...etc.