It’s different. I would say for most people the infant age is the toughest just because it’s physically tough which is not something most people in the modern world are used to. The rest is mainly just dealing with a moody person who is learning about the world and themselves and can be completely infuriating about half of the time.