No house is really secure, and I'm not going to spend my time trying to secure it against non-existent threats.
That's not to say I don't want security. The threat of someone finding a loophole and being able to enumerate and unlock all smart doors is very real. But I'm not going to care if someone can come up with a scheme where they megaphone their voice to unlock the door, then somehow prevent the notification going to my phone letting me know someone is home, avoiding or destroying the few security cameras we have, and avoiding being caught by someone else during all this ruckus. Especially when they could just break a window...
"Alexa unlock the door."
"Ok, what is the passcode."
<Looks at smart watch>
"123456"
"Thanks, unlocking door."
Now that I think of it, as someone that has 3 different 2f tokens.. smart watch integration would actually be useful in general... If I had a smart watch.
The problem is that I don't want to use my voice for commanding that much. It has privacy implications. First, obviously there is data being transmitted to a US corporation such as Google or Amazon. Second, there is analog audio data being transmitted. For example, that TOTP token generally stays valid for 30 seconds. In this window, an attacker could open the door right after you entered. I live in an apartment, and anything I say in the hallway can be heard by other people living on the same level as me while they are within their house (yep, terrible design).
I do admit that in the privacy of your home such analog audio data works better than say in public via your smartphone. But then again, smartphone is a can of worms with more privacy implications such as screen easily being seen by bystanders and cameras (a smartwatch has the very same issue; Google Glass wouldn't!). For the phone, Google Home is an interface, and certainly not (yet) the primary interface. For Amazon Echo, Alexa is the interface.
Bottomline, we need to think of these disadvantages (share our thoughts about them), and understand when they're too big to be a valid use case.
I think this is the most overlooked use case that needs to be addressed. Even in a secure residence, if you leave a 2nd story window open it might be possible to get the audio to Alexa. Though I suppose these skills could add a 2-factor to the unlocking mechanism.
"Alexa unlock the door."
"Ok, what is the passcode."
<get's out phone, retrieves token>
"123456"
"Thanks, unlocking door."
The problem I see is I don't want 2-factor on everything.