Data collection like that is harmless until it isn't, and then there's no turning back. So, no, it's not harmless.

I'm assuming by your use of the word "we're" that you work for Google?