Battery acid isn't safe to handle, so it's shipped in a container. Same for a battery, if it were unsafe external to the device then there could just be a shipping caddy - remove the battery from caddy, place old battery in caddy and take for recycling. That would probably be safer than the current situation.