> Most phones didn't have a way to charge a battery separate from the phone for some annoying reason.

Yes, this is the main issue. But phone manufacturers didn't care that's how batteries are supposed to be used, most likely because it would have sold less phones.