The SIM card is even less secure than a username and password because someone just calls the carrier, reads out some sob story and gets your sim credentials transferred over to them.

The sim is nothing more than an auth token which can easily be duplicated.