A global hash-based index is literally an undergraduate project to do well. You could even ride atop bittorrent if you really had to.