All batteries go bad. Science
I always go over the 2 years and for $20 I can buy a Duracell Battery that gets me back to the original life. Lithium Batteries Apple or not ALL Lithium batteries last about 300 to 500 charges.
"Rechargeable Lithium-Ion batteries have a limited life and will gradually lose their capacity to hold a charge. This loss of capacity (aging) is irreversible. As the battery loses capacity, the length of time it will power the product (run time) decreases." http://www.newark.com/pdfs/techarticles/tektronix/LIBMG.pdf
Sometimes it's not about going bad, it's about quick recharge. You can have a backup battery charged and ready for a quick swap. There are portable batteries that charge your main one now though, so the need for this is somewhat mitigated.
Also, another important aspect of a removable battery is that some people like it for privacy. If you can't remove your battery, you can't really assume your phone is truly "off". Even if you can, if you really care about that, you would wait a while to make sure any small internal batteries/transistors have used what power they could hold. Other than that, I'm not sure of a way to ensure the baseband processor isn't on[1].
1: http://www.osnews.com/story/27416/The_second_operating_syste...
The batteries came with a charger and were around 10 Euro each.
I always have to chuckle when that comes up.
If the phone is a widely used model, it's often not difficult to find new-old stock for a while.
I gave this list of "not cares" a several year window of context. It's pretty obvious OP doesn't want a bag-phone, but might be perfectly happy with the form factor of an iphone 4/5. Not a novel complaint.
Can you tell me what is a practical use of a replaceable battery, I've had iPhones for many years and battery does not go bad. Also if in 2+ years you decide to change a battery I doubt you can find an original batter, and will end up with a cheap knockoff which might not work at all.
> "weight"
Heavier phones directly impact usability and even handling in your pocket, holding it while reading will tire your arm sooner, handling it in a pocket will make it look ridiculous by pulling your pants down