Then again, if you're not fairly careful, anyone with access to your google password can locate your phone, read your web history (Chrome), access backups of your photos, see a map of where you've been....

I support Google's decision here, but let's be honest, without being a hyper-vigilant user, the whole Google software ecosystem is an extraordinary piece of spyware itself.