The cached access token could also be considered a factor, although it depends on the token expiry policy. If the token doesn't require a refresh using a refresh token (which must prompt a password) often enough its security is compromised.
I don't know what kind of expiry Google's OAuth token has, but last time I tested this, it was a very long time. I believe Twitter's live forever. Facebook's offline access scope (which you will need for a normal app) lives forever until the user changes his/her password (see http://developers.facebook.com/blog/post/2011/05/13/how-to--...).
Lastly, they will give you a list of ten one-time-use codes which you can write down or print out and put in your wallet/safe.
If all the above fail, I believe there's an account recovery procedure, which takes a couple of days and involves sending proof of ID.
So you're not relying on a single device, and certainly not on a single phone number, to be able to retain your account.