Well, Dug Song of Duo Security points out that you can't use Google Authenticator and public key authentication in conjunction with each other over SSH at the bottom of this howto: http://www.mnxsolutions.com/security/two-factor-ssh-with-goo...