How can you not understand that? If you talk to something wearing google glass you are in the camera's viewport. A smartphone however is mostly kept in you bag, or you have it placed on a table and you are probably NOT in the cameras viewport.

So it's not about the form factor, but the fact that in case of google glass, the camera is pointing on your head!