I already wrote a system that can take new facial inputs, classify you as "new user", and put your data in a database. All you need do is go up to the door. I can easily view the timecode and enter your details (name, phone#, email) at a later date.
source: https://github.com/jwcrawley/uWho
news article about it: http://hackaday.com/2015/03/04/face-recognition-for-your-nex...
"Print picture" to
"Compute Sfm 3d object from thousands of photos, and have access to a 3d printer that large that can print human-sized heads, and paint it appropriately in the correct color-space as to trigger the right facial recognition"
It's then trivial to add a feature of 'Blink' and 'Smile'. We have public, free haar and lbp cascades for those. It would be a few lines to add in a check that requests those 2 actions.
"Then you have to print an articulated skull and musculature that activate the appropriate smile/blink responses, with the correct coloring across the face."
And then hope that the video feed of the disjoined head trying to pass as human isn't just sent to the butler or a family member for "quality control"....
Also, even in US suburbia, smashing the window is likely going to trigger a burglar alarm and get the police called to the location, whereas bypassing the face recognition system will not.
[1] For a non billionaire house: thinner concrete walls ending in broken glass or decorative-yet-functional metal barbs, outer wall shared by a 10-20 homes neighborhood.
Now, do facial recognition with the depth component. "Oh look, paper. How quaint... NOPE!"
You could also log all people coming by with a known-unknown axis. You could train the system so that all they need do is look at the door, and they have the appropriate access they need. And it could also, instead, default in a "pass through to app for user to decide".
Don't think of this as a huge monolithic system... But instead of dozens of component parts that can work together. Then, the problem is certainly tractable. And then adding things like Google-Now, Alexa, Siri, and similar is no longer damn near impossible.
I particularly like Node-Red for this very project. It is javasript, however the big positive side effect is easy implementation with all sorts of nodejs APIs.