I don't know how blockchain.info actually works. If you give them your decryption key at any point, even if they claim not to keep it, then you're heavily relying on trusting them and that's not much better than the other web wallet alternatives, I agree.