Yep, but it's still better than not using a second factor at all. It all heavily depends on your threat model. I don't think Yubikeys scale to the general population, carrying around something on your keyring is a hard sell for many. (But if you've got your PGP private keys on it, too, etc, it's a fantastic tool/toy for nerds!)