The problem isn't even intentional spying, it's what data about you becomes available via the metadata saved from every day filtering.