A purely p2p ping would help with non-centralized discovery, but it isn't easy. I'd be receptive to a proposal.

Web Crawling is a reliable federated system that doesn't impede user freedoms. The crawlers are so fungible that anything centralized about them doesn't really concern me.