People don't like to feel like they're being taken advantage of, which would be a pretty common reaction to finding out someone had done all of this profiling on you to get you to go out with them.
It's not outright nefarious, because, what is he really doing that's different from a dating site filtering results by your criteria; except that these aren't people who have joined a dating site.
This sounds like the kind of thing Tim Ferris would recommend doing; asymmetrical information warfare in the battle of the sexes.
Between Glass and other projects, individuals will quickly realize how exposed they are and will either care (and these companies/groups will be forced to refocus on privacy like Facebook a year and a half a go) or everyone will just be 'OK' with it (like I am, I'm an open book, go for it).
I think sociology hasn't quite caught up with technology, and it'll be interesting to see where we go from here.